net: sched: keep __gnet_stats_copy_xxx() same semantics for percpu stats
Subsystems (3)
PATCH 1/1 net: sched: keep __gnet_stats_copy_xxx() same semantics for percpu stats
__gnet_stats_copy_basic/queue() support both percpu stat and non-percpu stat, but they are handle in a different manner:
1. For percpu stat, percpu stats are added to the return value;
2. For non-percpu stat, non-percpu stats will overwrite the return value;
We should keep the same semantics for both type.
This patch makes percpu stats follow non-percpu's manner by reset the return bstats before add the percpu bstats to it. Also changes the caller in sch_mq.c/sch_mqprio.c to make sure they dump the right statistics for percpu qdisc.
One more thing, the sch->q.qlen is not set with nonlock child qdisc in mq_dump()/mqprio_dump(), add that.
--- net/core/gen_stats.c | 2 ++ net/sched/sch_mq.c | 34 ++++++++++++++++------------------ net/sched/sch_mqprio.c | 35 +++++++++++++++++------------------ 3 files changed, 35 insertions(+), 36 deletions(-)
net/core/gen_stats.c +2 -0
@@ -120,6 +120,7 @@ __gnet_stats_copy_basic_cpu(struct gnet_stats_basic_packed *bstats, {int i; +memset (bstats,0 ,sizeof (*bstats));for_each_possible_cpu (i) {struct gnet_stats_basic_cpu *bcpu =per_cpu_ptr (cpu, i);unsigned int start;
@@ -288,6 +289,7 @@ __gnet_stats_copy_queue_cpu(struct gnet_stats_queue *qstats, {int i; +memset (qstats,0 ,sizeof (*qstats));for_each_possible_cpu (i) {const struct gnet_stats_queue *qcpu =per_cpu_ptr (q, i);
net/sched/sch_mq.c +16 -18
@@ -131,6 +131,8 @@ static int mq_dump(struct Qdisc *sch, struct sk_buff *skb)struct Qdisc *qdisc;unsigned int ntx;__u32 qlen =0 ; +struct gnet_stats_queue qstats = {0 }; +struct gnet_stats_basic_packed bstats = {0 }; sch->q.qlen =0 ;memset (&sch->bstats,0 ,sizeof (sch->bstats));
@@ -145,24 +147,20 @@ static int mq_dump(struct Qdisc *sch, struct sk_buff *skb) qdisc =netdev_get_tx_queue (dev, ntx)->qdisc_sleeping;spin_lock_bh (qdisc_lock (qdisc)); -if (qdisc_is_percpu_stats (qdisc)) { - qlen =qdisc_qlen_sum (qdisc); -__gnet_stats_copy_basic (NULL , &sch->bstats, - qdisc->cpu_bstats, - &qdisc->bstats); -__gnet_stats_copy_queue (&sch->qstats, - qdisc->cpu_qstats, - &qdisc->qstats, qlen); - }else { - sch->q.qlen += qdisc->q.qlen; - sch->bstats.bytes += qdisc->bstats.bytes; - sch->bstats.packets += qdisc->bstats.packets; - sch->qstats.qlen += qdisc->qstats.qlen; - sch->qstats.backlog += qdisc->qstats.backlog; - sch->qstats.drops += qdisc->qstats.drops; - sch->qstats.requeues += qdisc->qstats.requeues; - sch->qstats.overlimits += qdisc->qstats.overlimits; - } + qlen =qdisc_qlen_sum (qdisc); +__gnet_stats_copy_basic (NULL , &bstats, qdisc->cpu_bstats, + &qdisc->bstats); +__gnet_stats_copy_queue (&qstats, qdisc->cpu_qstats, + &qdisc->qstats, qlen); + + sch->q.qlen += qdisc->q.qlen; + sch->bstats.bytes += bstats.bytes; + sch->bstats.packets += bstats.packets; + sch->qstats.qlen += qstats.qlen; + sch->qstats.backlog += qstats.backlog; + sch->qstats.drops += qstats.drops; + sch->qstats.requeues += qstats.requeues; + sch->qstats.overlimits += qstats.overlimits;spin_unlock_bh (qdisc_lock (qdisc)); }
net/sched/sch_mqprio.c +17 -18
@@ -388,6 +388,9 @@ static int mqprio_dump(struct Qdisc *sch, struct sk_buff *skb)struct tc_mqprio_qopt opt = {0 };struct Qdisc *qdisc;unsigned int ntx, tc; +__u32 qlen =0 ; +struct gnet_stats_queue qstats = {0 }; +struct gnet_stats_basic_packed bstats = {0 }; sch->q.qlen =0 ;memset (&sch->bstats,0 ,sizeof (sch->bstats));
@@ -402,24 +405,20 @@ static int mqprio_dump(struct Qdisc *sch, struct sk_buff *skb) qdisc =netdev_get_tx_queue (dev, ntx)->qdisc_sleeping;spin_lock_bh (qdisc_lock (qdisc)); -if (qdisc_is_percpu_stats (qdisc)) { -__u32 qlen =qdisc_qlen_sum (qdisc); - -__gnet_stats_copy_basic (NULL , &sch->bstats, - qdisc->cpu_bstats, - &qdisc->bstats); -__gnet_stats_copy_queue (&sch->qstats, - qdisc->cpu_qstats, - &qdisc->qstats, qlen); - }else { - sch->q.qlen += qdisc->q.qlen; - sch->bstats.bytes += qdisc->bstats.bytes; - sch->bstats.packets += qdisc->bstats.packets; - sch->qstats.backlog += qdisc->qstats.backlog; - sch->qstats.drops += qdisc->qstats.drops; - sch->qstats.requeues += qdisc->qstats.requeues; - sch->qstats.overlimits += qdisc->qstats.overlimits; - } + qlen =qdisc_qlen_sum (qdisc); +__gnet_stats_copy_basic (NULL , &bstats, qdisc->cpu_bstats, + &qdisc->bstats); +__gnet_stats_copy_queue (&qstats, qdisc->cpu_qstats, + &qdisc->qstats, qlen); + + sch->q.qlen += qdisc->q.qlen; + sch->bstats.bytes += bstats.bytes; + sch->bstats.packets += bstats.packets; + sch->qstats.qlen += qstats.qlen; + sch->qstats.backlog += qstats.backlog; + sch->qstats.drops += qstats.drops; + sch->qstats.requeues += qstats.requeues; + sch->qstats.overlimits += qstats.overlimits;spin_unlock_bh (qdisc_lock (qdisc)); }
Signature · 1 line
2.19.1.3.ge56e4f7
Quoted 38 lines · Dust Li
__gnet_stats_copy_basic/queue() support both percpu stat and non-percpu stat, but they are handle in a different manner:
1. For percpu stat, percpu stats are added to the return value;
2. For non-percpu stat, non-percpu stats will overwrite the return value;
We should keep the same semantics for both type.This patch makes percpu stats follow non-percpu's manner by reset the return bstats before add the percpu bstats to it. Also changes the caller in
sch_mq.c/sch_mqprio.cto make sure they dump the right statistics for percpu qdisc.One more thing, the
sch->q.qlenis not set with nonlock child qdisc in mq_dump()/mqprio_dump(), add that.Fixes 22e0f8b9322c ("net: sched: make bstats per cpu and estimator RCU safe")Signed-off-by Dust Li <[email protected]>Signed-off-by Tony Lu <[email protected]>--- net/core/gen_stats.c | 2 ++ net/sched/sch_mq.c | 34 ++++++++++++++++------------------ net/sched/sch_mqprio.c | 35 +++++++++++++++++------------------ 3 files changed, 35 insertions(+), 36 deletions(-)net/core/gen_stats.c +1
-0@@ -120,6 +120,7 @@ __gnet_stats_copy_basic_cpu(struct gnet_stats_basic_packed *bstats, {int i; +memset (bstats,0 ,sizeof (*bstats));for_each_possible_cpu (i) {struct gnet_stats_basic_cpu *bcpu =per_cpu_ptr (cpu, i);unsigned int start;
net/core/gen_stats.c __gnet_stats_copy_queue_cpu(struct gnet_stats_queue *qstats, · line 292
Quoted 4 lines
net/core/gen_stats.c +1
-0@@ -288,6 +289,7 @@ __gnet_stats_copy_queue_cpu(struct gnet_stats_queue *qstats, {int i; +memset (qstats,0 ,sizeof (*qstats));
I think its caller is responsible to clear the stats, so you don't need to clear them here? It looks like you do memset() twice.
Does this patch fix any bug? It looks more like a clean up to me, if so please mark it for net-next.
Thanks.
Quoted 41 lines · Cong Wang
Quoted 40 lines · Dust Li
__gnet_stats_copy_basic/queue() support both percpu stat and non-percpu stat, but they are handle in a different manner:
1. For percpu stat, percpu stats are added to the return value;
2. For non-percpu stat, non-percpu stats will overwrite thereturn value;We should keep the same semantics for both type.
This patch makes percpu stats follow non-percpu's manner by reset the return bstats before add the percpu bstats to it. Also changes the caller in
sch_mq.c/sch_mqprio.cto make sure they dump the right statistics for percpu qdisc.One more thing, the
sch->q.qlenis not set with nonlock child qdisc in mq_dump()/mqprio_dump(), add that.Fixes 22e0f8b9322c ("net: sched: make bstats per cpu and estimator RCU safe")Signed-off-by Dust Li <[email protected]>Signed-off-by Tony Lu <[email protected]>--- net/core/gen_stats.c | 2 ++ net/sched/sch_mq.c | 34 ++++++++++++++++------------------ net/sched/sch_mqprio.c | 35 +++++++++++++++++------------------ 3 files changed, 35 insertions(+), 36 deletions(-)net/core/gen_stats.c +1
-0@@ -120,6 +120,7 @@ __gnet_stats_copy_basic_cpu(struct gnet_stats_basic_packed *bstats, {int i; +memset (bstats,0 ,sizeof (*bstats));for_each_possible_cpu (i) {struct gnet_stats_basic_cpu *bcpu =per_cpu_ptr (cpu, i);unsigned int start;@@ -288,6 +289,7 @@ __gnet_stats_copy_queue_cpu(struct gnet_stats_queue *qstats, {int i;
Quoted 4 lines
net/core/gen_stats.c __gnet_stats_copy_queue_cpu(struct gnet_stats_queue *qstats, · line 292
Quoted 1 line
net/core/gen_stats.c +1
-0+memset (qstats,0 ,sizeof (*qstats));I think its caller is responsible to clear the stats, so you don't need to clear them here? It looks like you do
memset()twice.
Yes, I should do this in its caller. I will change it, thanks.
The memset() is in two different functions, one for xxx_basic_cpu(), and the
other for xxx_queue_cpu().
Quoted 2 lines
Does this patch fix any bug? It looks more like a clean up to me, if so please mark it for net-next.
It only fixes the 'sch->q.qlen' not set for NOLOCK child qdisc. But as Dave said,
I should split that into an individual patch. So I will change this and mark it
for net-next.
Thanks
Dust Li
David Miller
maintainerFrom: Dust Li <[email protected]>
Date: Thu, 28 Nov 2019 14:30:48 +0800
Quoted 12 lines
__gnet_stats_copy_basic/queue() support both percpu stat and non-percpu stat, but they are handle in a different manner:
1. For percpu stat, percpu stats are added to the return value;
2. For non-percpu stat, non-percpu stats will overwrite the return value;
We should keep the same semantics for both type.This patch makes percpu stats follow non-percpu's manner by reset the return bstats before add the percpu bstats to it. Also changes the caller in
sch_mq.c/sch_mqprio.cto make sure they dump the right statistics for percpu qdisc.
Quoted 6 lines
One more thing, the
sch->q.qlenis not set with nonlock child qdisc in mq_dump()/mqprio_dump(), add that.Fixes 22e0f8b9322c ("net: sched: make bstats per cpu and estimator RCU safe")Signed-off-by Dust Li <[email protected]>Signed-off-by Tony Lu <[email protected]>
You are changing way too many things at one time here.
Fix one bug in one patch, for example just fix the missed initialization of the per-cpu stats.
The qlen fix is another patch.
And so on and so forth.
Thank you.
Quoted 23 lines · David Miller
From: Dust Li <[email protected]>
Date: Thu, 28 Nov 2019 14:30:48 +0800Quoted 12 lines
__gnet_stats_copy_basic/queue() support both percpu stat and non-percpu stat, but they are handle in a different manner:
1. For percpu stat, percpu stats are added to the return value;
2. For non-percpu stat, non-percpu stats will overwrite thereturn value;We should keep the same semantics for both type.
This patch makes percpu stats follow non-percpu's manner by reset the return bstats before add the percpu bstats to it. Also changes the caller in
sch_mq.c/sch_mqprio.cto make sure they dump the right statistics for percpu qdisc.Quoted 6 lines
One more thing, the
sch->q.qlenis not set with nonlock child qdisc in mq_dump()/mqprio_dump(), add that.Fixes 22e0f8b9322c ("net: sched: make bstats per cpu and estimator RCU safe")Signed-off-by Dust Li <[email protected]>Signed-off-by Tony Lu <[email protected]>You are changing way too many things at one time here.
Quoted 8 lines
Fix one bug in one patch, for example just fix the missed initialization of the per-cpu stats.
The qlen fix is another patch.
And so on and so forth.
Thank you.
OK, I will separate them. Thanks for review !
Thanks.
Dust Li