Skip to contentSkip to conversation

sch_htb: Avoid grafting on htb_destroy_class_offload when destroying htb

PATCH Applied Rahul Rameshbabu 4 participants 4 messages Jan 13, 2023 – Jan 14, 2023

Subsystems (3)
lore
Share & tools
lore
#0 lore raw

PATCH v3 1/1 sch_htb: Avoid grafting on htb_destroy_class_offload when destroying htb

Peek at old qdisc and graft only when deleting a leaf class in the htb, rather than when deleting the htb itself. Do not peek at the qdisc of the netdev queue when destroying the htb. The caller may already have grafted a new qdisc that is not part of the htb structure being destroyed.

This fix resolves two use cases.

1. Using tc to destroy the htb.
- Netdev was being prematurely activated before the htb was fully destroyed.
2. Using tc to replace the htb with another qdisc (which also leads to the htb being destroyed).
- Premature netdev activation like previous case. Newly grafted qdisc was also getting accidentally overwritten when destroying the htb.

Fixes d03b195b5aa0 ("sch_htb: Hierarchical QoS hardware offload")
Cc Eric Dumazet <[email protected]>
Cc Maxim Mikityanskiy <[email protected]>

---

Notes:
Changelog

v2->v3:
- Removed NULL assignment to struct Qdisc *old to catch uninitialized usage
- Improved code comments based on previous review feedback
- Removed WARN_ON(err && destroying) to avoid being triggered when the TC_HTB_LEAF_DEL_LAST_FORCE offload operation is used
- Described underlying design errors that caused issues for use cases mentioned in commit message
v1->v2:
- Added use cases that were triggering relevant issues in commit message

 net/sched/sch_htb.c | 27 ++++++++++++++++-----------
 1 file changed, 16 insertions(+), 11 deletions(-)
net/sched/sch_htb.c +16 -11
index 2238edece1a4..f46643850df8 100644
@@ -1549,7 +1549,7 @@ static int htb_destroy_class_offload(struct Qdisc *sch, struct htb_class *cl,
 	struct tc_htb_qopt_offload offload_opt;
 	struct netdev_queue *dev_queue;
 	struct Qdisc *q = cl->leaf.q;
-	struct Qdisc *old = NULL;
+	struct Qdisc *old;
 	int err;
 
 	if (cl->level)
@@ -1557,14 +1557,17 @@ static int htb_destroy_class_offload(struct Qdisc *sch, struct htb_class *cl,
 
 	WARN_ON(!q);
 	dev_queue = htb_offload_get_queue(cl);
-	old = htb_graft_helper(dev_queue, NULL);
-	if (destroying)
-		/* Before HTB is destroyed, the kernel grafts noop_qdisc to
-		 * all queues.
+	/* When destroying, caller qdisc_graft grafts the new qdisc and invokes
+	 * qdisc_put for the qdisc being destroyed. htb_destroy_class_offload
+	 * does not need to graft or qdisc_put the qdisc being destroyed.
+	 */
+	if (!destroying) {
+		old = htb_graft_helper(dev_queue, NULL);
+		/* Last qdisc grafted should be the same as cl->leaf.q when
+		 * calling htb_delete.
 		 */
-		WARN_ON(!(old->flags & TCQ_F_BUILTIN));
-	else
 		WARN_ON(old != q);
+	}
 
 	if (cl->parent) {
 		_bstats_update(&cl->parent->bstats_bias,
@@ -1581,10 +1584,12 @@ static int htb_destroy_class_offload(struct Qdisc *sch, struct htb_class *cl,
 	};
 	err = htb_offload(qdisc_dev(sch), &offload_opt);
 
-	if (!err || destroying)
-		qdisc_put(old);
-	else
-		htb_graft_helper(dev_queue, old);
+	if (!destroying) {
+		if (!err)
+			qdisc_put(old);
+		else
+			htb_graft_helper(dev_queue, old);
+	}
 
 	if (last_child)
 		return err;
Signature · 8 lines
2.36.2

Previous related discussions

[1] https://lore.kernel.org/netdev/[email protected]/
[2] https://lore.kernel.org/netdev/[email protected]/
[3] https://lore.kernel.org/netdev/[email protected]/
[4] https://lore.kernel.org/all/CANn89iJSsFPBp5dYm3y6Jbbpuwbb9P+X3gmqk6zow0VWgx1Q-A@mail.gmail.com/
Reviewed-by on v3 1/1
#1 lore raw
Quoted 15 lines · Rahul Rameshbabu

Peek at old qdisc and graft only when deleting a leaf class in the htb, rather than when deleting the htb itself. Do not peek at the qdisc of the netdev queue when destroying the htb. The caller may already have grafted a new qdisc that is not part of the htb structure being destroyed.

This fix resolves two use cases.

1. Using tc to destroy the htb.
- Netdev was being prematurely activated before the htb was fully destroyed.
2. Using tc to replace the htb with another qdisc (which also leads to the htb being destroyed).
- Premature netdev activation like previous case. Newly grafted qdisc was also getting accidentally overwritten when destroying the htb.

Quoted 6 lines
Fixes d03b195b5aa0 ("sch_htb: Hierarchical QoS hardware offload")
Cc Eric Dumazet <[email protected]>
Cc Maxim Mikityanskiy <[email protected]>

---

Thanks, looks good to me!

maintainer Reviewed-by on v3 1/1
#2 lore raw
In reply to Rahul Rameshbabu
Quoted 15 lines · Fri, Jan 13, 2023 at 01:55:29AM CET, [email protected] wrote:

Peek at old qdisc and graft only when deleting a leaf class in the htb, rather than when deleting the htb itself. Do not peek at the qdisc of the netdev queue when destroying the htb. The caller may already have grafted a new qdisc that is not part of the htb structure being destroyed.

This fix resolves two use cases.

1. Using tc to destroy the htb.
- Netdev was being prematurely activated before the htb was fully destroyed.
2. Using tc to replace the htb with another qdisc (which also leads to the htb being destroyed).
- Premature netdev activation like previous case. Newly grafted qdisc was also getting accidentally overwritten when destroying the htb.

Quoted 5 lines
Fixes d03b195b5aa0 ("sch_htb: Hierarchical QoS hardware offload")
Cc Eric Dumazet <[email protected]>
Cc Maxim Mikityanskiy <[email protected]>
#3 lore raw
In reply to Rahul Rameshbabu
This patch was applied to netdev/net.git (master) by Jakub Kicinski <[email protected]>:

Hello:

This patch was applied to netdev/net.git (master)
by Jakub Kicinski <[email protected]>:

Quoted 8 lines · On Thu, 12 Jan 2023 16:55:29 -0800 you wrote:

Peek at old qdisc and graft only when deleting a leaf class in the htb, rather than when deleting the htb itself. Do not peek at the qdisc of the netdev queue when destroying the htb. The caller may already have grafted a new qdisc that is not part of the htb structure being destroyed.

This fix resolves two use cases.

[...]

Here is the summary with links:
- [net,v3] sch_htb: Avoid grafting on htb_destroy_class_offload when destroying htb

    https://git.kernel.org/netdev/net/c/a22b7388d658

You are awesome, thank you!

Signature · 2 lines
Deet-doot-dot, I am a bot.
https://korg.docs.kernel.org/patchwork/pwbot.html