netdevice.h: Fix unintentional disable of ALL_FOR_ALL features on upper device
Subsystems (2)
PATCH 1/1 netdevice.h: Fix unintentional disable of ALL_FOR_ALL features on upper device
Calling netdev_increment_features() on upper/master device from netdev_add_tso_features() implies unintentional clearance of ALL_FOR_ALL features supported by all slaves. Fix it by passing ALL_FOR_ALL in addition to ALL_TSO.
--- include/linux/netdevice.h | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
Hi,
I know that netdev_increment_features() does not set any feature that's unmasked in the mask argument.
I wonder why it can clear them though, was it meant to be like this? If not, then the proper fix should be in netdev_increment_features(), not in netdev_add_tso_features().
include/linux/netdevice.h +1 -1
@@ -4748,7 +4748,7 @@ netdev_features_t netdev_increment_features(netdev_features_t all,static inline netdev_features_t netdev_add_tso_features (netdev_features_t features,netdev_features_t mask) { -return netdev_increment_features (features,NETIF_F_ALL_TSO , mask); +return netdev_increment_features (features,NETIF_F_ALL_TSO |NETIF_F_ALL_FOR_ALL , mask); }int __netdev_update_features (struct net_device *dev);
Signature · 1 line
2.21.0
Quoted 7 lines · Tariq Toukan
Calling
netdev_increment_features()on upper/master device fromnetdev_add_tso_features()implies unintentional clearance ofALL_FOR_ALLfeatures supported by all slaves. Fix it by passingALL_FOR_ALLin addition toALL_TSO.Fixes b0ce3508b25e ("bonding: allow TSO being set on bonding master")
I think you should give more details to your bug report, because netdev_add_tso_features() is used from different places.
Thanks.
Quoted 7 lines · Eric Dumazet
Quoted 6 lines · Tariq Toukan
Calling
netdev_increment_features()on upper/master device fromnetdev_add_tso_features()implies unintentional clearance ofALL_FOR_ALLfeatures supported by all slaves. Fix it by passingALL_FOR_ALLin addition toALL_TSO.
Quoted 8 lines
Quoted 1 line
Fixes b0ce3508b25e ("bonding: allow TSO being set on bonding master")I think you should give more details to your bug report, because
netdev_add_tso_features()is used from different places.Thanks.
Right. I'll include these in the re-spin:
I wonder though if netdev_increment_features() is expected to clear features that are not part of the mask.
Thanks.
Quoted 17 lines · Tariq Toukan
Quoted 13 lines · Eric Dumazet
Quoted 7 lines · Tariq Toukan
Calling
netdev_increment_features()on upper/master device fromnetdev_add_tso_features()implies unintentional clearance ofALL_FOR_ALLfeatures supported by all slaves. Fix it by passingALL_FOR_ALLin addition toALL_TSO.Fixes b0ce3508b25e ("bonding: allow TSO being set on bonding master")I think you should give more details to your bug report, because
netdev_add_tso_features()is used from different places.
Quoted 6 lines
Quoted 2 lines
Thanks.
Right. I'll include these in the re-spin:
Fixes 247f6d0f8667 ("team: allow TSO being set on master")Fixes f902e8812ef6 ("bridge: Add ability to enable TSO")
I was more thinking about what exact issue you had, and how we can reproduce it, and test the fix.
Quoted 3 lines
I wonder though if
netdev_increment_features()is expected to clear features that are not part of the mask.
Well, the 'increment' part was suggesting the function was adding flags, not removing them.
We might ask Herbert Xu if we :
1) Need to comment the function, or change its name to be more descriptive.
2) Change the behavior (as you suggested)
3) Other choice.
Quoted 21 lines · Eric Dumazet
Quoted 20 lines · Tariq Toukan
Quoted 15 lines · Eric Dumazet
Quoted 7 lines · Tariq Toukan
Calling
netdev_increment_features()on upper/master device fromnetdev_add_tso_features()implies unintentional clearance ofALL_FOR_ALLfeatures supported by all slaves. Fix it by passingALL_FOR_ALLin addition toALL_TSO.Fixes b0ce3508b25e ("bonding: allow TSO being set on bonding master")I think you should give more details to your bug report, because
netdev_add_tso_features()is used from different places.Thanks.
Quoted 7 lines
Quoted 3 lines
Right. I'll include these in the re-spin:
Fixes 247f6d0f8667 ("team: allow TSO being set on master")Fixes f902e8812ef6 ("bridge: Add ability to enable TSO")I was more thinking about what exact issue you had, and how we can reproduce it, and test the fix.
Issue reproduction is very simple:
Pick any of the features under ALL_FOR_ALL, like tx-nocache-copy. Turn it on for all slaves.
Turn it on for the bond.
You'll still not be able to use it:
tx-nocache-copy: off [requested on]
Reason is that the call to netdev_add_tso_features() being considered as a "dummy" slave that has this feature bit cleared, breaking ALL_FOR_ALL logic.
Quoted 7 lines
Quoted 3 lines
I wonder though if
netdev_increment_features()is expected to clear features that are not part of the mask.Well, the 'increment' part was suggesting the function was adding flags, not removing them.
Yes, that's confusing... Although ALL_FOR_ALL logic is just about removing, unlike ONE_FOR_ALL.
Quoted 6 lines
We might ask Herbert Xu if we :
1) Need to comment the function, or change its name to be more descriptive.
2) Change the behavior (as you suggested)
3) Other choice.
Quoted 3 lines · Eric Dumazet
Well, the 'increment' part was suggesting the function was adding flags, not removing them.
The idea of the increment part is that we're adding a constituent device, not that we're adding features. There have always been features which were conjunctions, i.e., they must be supported by all underlying devices for them to be enabled on the virtual device.
Your use of the increment function is unusual, as you're not adding features that belong to one underlying device, but rather you're trying to enable a feature on the virtual device unconditionally.
Quoted 5 lines
We might ask Herbert Xu if we :
1) Need to comment the function, or change its name to be more descriptive.
2) Change the behavior (as you suggested)
3) Other choice.
I think Tariq's patch is fine, although a comment should be added to netdev_add_tso_features as this use of the increment function is nonstandard.
Thanks,
Signature · 3 lines
Email: Herbert Xu <[email protected]> Home Page: http://gondor.apana.org.au/~herbert/ PGP Key: http://gondor.apana.org.au/~herbert/pubkey.txt
Quoted 16 lines · Herbert Xu
Quoted 3 lines · Eric Dumazet
Well, the 'increment' part was suggesting the function was adding flags, not removing them.
The idea of the increment part is that we're adding a constituent device, not that we're adding features. There have always been features which were conjunctions, i.e., they must be supported by all underlying devices for them to be enabled on the virtual device.
Your use of the increment function is unusual, as you're not adding features that belong to one underlying device, but rather you're trying to enable a feature on the virtual device unconditionally.
Quoted 2 lines
We might ask Herbert Xu if we :
Quoted 8 lines
Quoted 3 lines
1) Need to comment the function, or change its name to be more descriptive.
2) Change the behavior (as you suggested)
3) Other choice.I think Tariq's patch is fine, although a comment should be added to
netdev_add_tso_featuresas this use of the increment function is nonstandard.
Thanks Herbert, I'll add a comment and re-spin.
Quoted 2 lines
Thanks,
Quoted 9 lines · Tariq Toukan
Quoted 5 lines · Herbert Xu
Quoted 3 lines · Eric Dumazet
Well, the 'increment' part was suggesting the function was adding flags, not removing them.
Quoted 8 lines
Quoted 8 lines
The idea of the increment part is that we're adding a constituent device, not that we're adding features. There have always been features which were conjunctions, i.e., they must be supported by all underlying devices for them to be enabled on the virtual device.
Your use of the increment function is unusual, as you're not adding features that belong to one underlying device, but rather you're trying to enable a feature on the virtual device unconditionally.
This was not the intent.
We can still disable TSO on the bonding device if desired.
pk51:~# for i in bond0 eth1 eth2; do ethtool -k $i|grep tcp-segmentation-offload; done tcp-segmentation-offload: on tcp-segmentation-offload: on tcp-segmentation-offload: on lpk51:~# ethtool -K bond0 tso off Actual changes: tcp-segmentation-offload: off tx-tcp-segmentation: off tx-tcp-ecn-segmentation: off tx-tcp-mangleid-segmentation: off tx-tcp6-segmentation: off large-receive-offload: off [requested on] lpk51:~# for i in bond0 eth1 eth2; do ethtool -k $i|grep tcp-segmentation-offload; done tcp-segmentation-offload: off tcp-segmentation-offload: on tcp-segmentation-offload: on
The intent was that we could have :
lpk51:~# ethtool -K bond0 tso on Actual changes: tcp-segmentation-offload: on tx-tcp-segmentation: on tx-tcp-ecn-segmentation: on tx-tcp-mangleid-segmentation: on tx-tcp6-segmentation: on lpk51:~# ethtool -K eth1 tso off lpk51:~# ethtool -K eth2 tso off lpk51:~# for i in bond0 eth1 eth2; do ethtool -k $i|grep tcp-segmentation-offload; done tcp-segmentation-offload: on tcp-segmentation-offload: off tcp-segmentation-offload: off lpk51:~#
Quoted 7 lines
Quoted 7 lines
Quoted 6 lines
We might ask Herbert Xu if we :
1) Need to comment the function, or change its name to be more descriptive.
2) Change the behavior (as you suggested)
3) Other choice.
Quoted 6 lines
Quoted 4 lines
I think Tariq's patch is fine, although a comment should be added to
netdev_add_tso_featuresas this use of the increment function is nonstandard.Thanks Herbert, I'll add a comment and re-spin.
I think we should remove the use of netdev_increment_features() and replace it with something else,
because there is too much confusion.
Quoted 44 lines · Eric Dumazet
Quoted 9 lines · Tariq Toukan
Quoted 5 lines · Herbert Xu
Quoted 3 lines · Eric Dumazet
Well, the 'increment' part was suggesting the function was adding flags, not removing them.
Quoted 8 lines
Quoted 8 lines
The idea of the increment part is that we're adding a constituent device, not that we're adding features. There have always been features which were conjunctions, i.e., they must be supported by all underlying devices for them to be enabled on the virtual device.
Your use of the increment function is unusual, as you're not adding features that belong to one underlying device, but rather you're trying to enable a feature on the virtual device unconditionally.
This was not the intent.
We can still disable TSO on the bonding device if desired.
pk51:~# for i in bond0 eth1 eth2; do ethtool -k $i|grep tcp-segmentation-offload; done tcp-segmentation-offload: on tcp-segmentation-offload: on tcp-segmentation-offload: on lpk51:~# ethtool -K bond0 tso off Actual changes: tcp-segmentation-offload: off tx-tcp-segmentation: off tx-tcp-ecn-segmentation: off tx-tcp-mangleid-segmentation: off tx-tcp6-segmentation: off large-receive-offload: off [requested on] lpk51:~# for i in bond0 eth1 eth2; do ethtool -k $i|grep tcp-segmentation-offload; done tcp-segmentation-offload: off tcp-segmentation-offload: on tcp-segmentation-offload: onThe intent was that we could have :
Quoted 17 lines
lpk51:~# ethtool -K bond0 tso on Actual changes: tcp-segmentation-offload: on tx-tcp-segmentation: on tx-tcp-ecn-segmentation: on tx-tcp-mangleid-segmentation: on tx-tcp6-segmentation: on lpk51:~# ethtool -K eth1 tso off lpk51:~# ethtool -K eth2 tso off lpk51:~# for i in bond0 eth1 eth2; do ethtool -k $i|grep tcp-segmentation-offload; done tcp-segmentation-offload: on tcp-segmentation-offload: off tcp-segmentation-offload: off lpk51:~#
IIUC, we want to let the bond TSO feature bit be totally independent, not affected by slaves. If so, I think that:
First we should take NETIF_F_GSO_SOFTWARE (or just NETIF_F_ALL_TSO) out of NETIF_F_ONE_FOR_ALL. Then, make sure it is set in bond_setup (it is already done, as part of BOND_VLAN_FEATURES).
I think this new logic is good for all other upper devices, which will be affected by the change in NETIF_F_ONE_FOR_ALL.
Quoted 12 lines
Quoted 12 lines
Quoted 11 lines
Quoted 6 lines
We might ask Herbert Xu if we :
1) Need to comment the function, or change its name to be more descriptive.
2) Change the behavior (as you suggested)
3) Other choice.I think Tariq's patch is fine, although a comment should be added to
netdev_add_tso_featuresas this use of the increment function is nonstandard.
Quoted 6 lines
Quoted 1 line
Thanks Herbert, I'll add a comment and re-spin.
I think we should remove the use of
netdev_increment_features()and replace it with something else,
because there is too much confusion.
I think it would be best.
I can prepare the patch I described above if you agree with it.