netvm: check for page == NULL when propogating the skb->pfmemalloc flag
Subsystems (4)
PATCH 1/1 netvm: check for page == NULL when propogating the skb->pfmemalloc flag
Commit [c48a11c7: netvm: propagate page->pfmemalloc to skb] is responsible for the following bug triggered by a xen network driver
[ 1.908592] BUG: unable to handle kernel NULL pointer dereference at 0000000000000010 [ 1.908643] IP: [<ffffffffa0037750>] xennet_poll+0x980/0xec0 [xen_netfront] [ 1.908703] PGD ea1df067 PUD e8ada067 PMD 0 [ 1.908774] Oops: 0000 [#1] SMP [ 1.908797] Modules linked in: fbcon tileblit font radeon bitblit softcursor ttm drm_kms_helper crc32c_intel xen_blkfront xen_netfront xen_fbfront fb_sys_fops sysimgblt sysfillrect syscopyarea +xen_kbdfront xenfs xen_privcmd [ 1.908938] CPU 0 [ 1.908950] Pid: 2165, comm: ip Not tainted 3.5.0upstream-08854-g444fa66 #1 [ 1.908983] RIP: e030:[<ffffffffa0037750>] [<ffffffffa0037750>] xennet_poll+0x980/0xec0 [xen_netfront] [ 1.909029] RSP: e02b:ffff8800ffc03db8 EFLAGS: 00010282 [ 1.909055] RAX: ffff8800ea010140 RBX: ffff8800f00e86c0 RCX: 000000000000009a [ 1.909055] RDX: 0000000000000040 RSI: 000000000000005a RDI: ffff8800fa7dee80 [ 1.909055] RBP: ffff8800ffc03ee8 R08: ffff8800f00e86d8 R09: ffff8800ea010000 [ 1.909055] R10: dead000000200200 R11: dead000000100100 R12: ffff8800fa7dee80 [ 1.909055] R13: 000000000000005a R14: ffff8800fa7dee80 R15: 0000000000000200 [ 1.909055] FS: 00007fbafc188700(0000) GS:ffff8800ffc00000(0000) knlGS:0000000000000000 [ 1.909055] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b [ 1.909055] CR2: 0000000000000010 CR3: 00000000ea108000 CR4: 0000000000002660 [ 1.909055] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1.909055] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [ 1.909055] Process ip (pid: 2165, threadinfo ffff8800ea0f2000, task ffff8800fa783040) [ 1.909055] Stack: [ 1.909055] ffff8800e27e5040 ffff8800ffc03e88 ffff8800ffc03e68 ffff8800ffc03e48 [ 1.909055] 7fffffffffffffff ffff8800ffc03e00 ffff8800e27e5040 ffff8800f00e86d8 [ 1.909055] ffff8800ffc03eb0 00000040ffffffff ffff8800f00e8000 00000000ffc03e30 [ 1.909055] Call Trace: [ 1.909055] <IRQ> [ 1.909055] [<ffffffff81066028>] ? pvclock_clocksource_read+0x58/0xd0 [ 1.909055] [<ffffffff81486352>] net_rx_action+0x112/0x240 [ 1.909055] [<ffffffff8107f319>] __do_softirq+0xb9/0x190 [ 1.909055] [<ffffffff815d8d7c>] call_softirq+0x1c/0x30
The problem is that the xenfront driver is passing a NULL page to __skb_fill_page_desc() which was unexpected. This patch checks that there is a page before dereferencing.
--- include/linux/skbuff.h | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
include/linux/skbuff.h +1 -1
@@ -1256,7 +1256,7 @@ static inline void __skb_fill_page_desc(struct sk_buff *skb, int i,* do not lose pfmemalloc information as the pages would not be * allocated using __GFP_MEMALLOC. */ -if (page->pfmemalloc && !page->mapping) +if (page && page->pfmemalloc && !page->mapping) skb->pfmemalloc = true; frag->page.p = page; frag->page_offset = off;
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>
Quoted 34 lines · Mel Gorman
Commit [
c48a11c7: netvm: propagatepage->pfmemallocto skb] is responsible for the following bug triggered by a xen network driver[ 1.908592] BUG: unable to handle kernel NULL pointer dereference at 0000000000000010 [ 1.908643] IP: [<ffffffffa0037750>] xennet_poll+0x980/0xec0 [xen_netfront] [ 1.908703] PGD ea1df067 PUD e8ada067 PMD 0 [ 1.908774] Oops: 0000 [#1] SMP [ 1.908797] Modules linked in: fbcon tileblit font radeon bitblit softcursor ttm drm_kms_helper crc32c_intel xen_blkfront xen_netfront xen_fbfront fb_sys_fops sysimgblt sysfillrect syscopyarea +xen_kbdfront xenfs xen_privcmd [ 1.908938] CPU 0 [ 1.908950] Pid: 2165, comm: ip Not tainted 3.5.0upstream-08854-g444fa66 #1 [ 1.908983] RIP: e030:[<ffffffffa0037750>] [<ffffffffa0037750>] xennet_poll+0x980/0xec0 [xen_netfront] [ 1.909029] RSP: e02b:ffff8800ffc03db8 EFLAGS: 00010282 [ 1.909055] RAX: ffff8800ea010140 RBX: ffff8800f00e86c0 RCX: 000000000000009a [ 1.909055] RDX: 0000000000000040 RSI: 000000000000005a RDI: ffff8800fa7dee80 [ 1.909055] RBP: ffff8800ffc03ee8 R08: ffff8800f00e86d8 R09: ffff8800ea010000 [ 1.909055] R10: dead000000200200 R11: dead000000100100 R12: ffff8800fa7dee80 [ 1.909055] R13: 000000000000005a R14: ffff8800fa7dee80 R15: 0000000000000200 [ 1.909055] FS: 00007fbafc188700(0000) GS:ffff8800ffc00000(0000) knlGS:0000000000000000 [ 1.909055] CS: e033 DS: 0000 ES: 0000 CR0: 000000008005003b [ 1.909055] CR2: 0000000000000010 CR3: 00000000ea108000 CR4: 0000000000002660 [ 1.909055] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1.909055] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [ 1.909055] Process ip (pid: 2165, threadinfo ffff8800ea0f2000, task ffff8800fa783040) [ 1.909055] Stack: [ 1.909055] ffff8800e27e5040 ffff8800ffc03e88 ffff8800ffc03e68 ffff8800ffc03e48 [ 1.909055] 7fffffffffffffff ffff8800ffc03e00 ffff8800e27e5040 ffff8800f00e86d8 [ 1.909055] ffff8800ffc03eb0 00000040ffffffff ffff8800f00e8000 00000000ffc03e30 [ 1.909055] Call Trace: [ 1.909055] <IRQ> [ 1.909055] [<ffffffff81066028>] ? pvclock_clocksource_read+0x58/0xd0 [ 1.909055] [<ffffffff81486352>] net_rx_action+0x112/0x240 [ 1.909055] [<ffffffff8107f319>] __do_softirq+0xb9/0x190 [ 1.909055] [<ffffffff815d8d7c>] call_softirq+0x1c/0x30
Quoted 6 lines
The problem is that the xenfront driver is passing a NULL page to
__skb_fill_page_desc()which was unexpected. This patch checks that there is a page before dereferencing.Reported-and-Tested-by Konrad Rzeszutek Wilk <[email protected]>Signed-off-by Mel Gorman <[email protected]>
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>
David Miller
maintainerFrom: Mel Gorman <[email protected]>
Date: Tue, 7 Aug 2012 09:55:55 +0100
Quoted 2 lines
Commit [
c48a11c7: netvm: propagatepage->pfmemallocto skb] is responsible for the following bug triggered by a xen network driver
...
Quoted 6 lines
The problem is that the xenfront driver is passing a NULL page to
__skb_fill_page_desc()which was unexpected. This patch checks that there is a page before dereferencing.Reported-and-Tested-by Konrad Rzeszutek Wilk <[email protected]>Signed-off-by Mel Gorman <[email protected]>
That call to __skb_fill_page_desc() in xen-netfront.c looks completely bogus. It's the only driver passing NULL here.
That whole song and dance figuring out what to do with the head fragment page, depending upon whether the length is greater than the RX_COPY_THRESHOLD, is completely unnecessary.
Just use something like a call to __pskb_pull_tail(skb, len) and all that other crap around that area can simply be deleted.
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>
Quoted 16 lines · David Miller
From: Mel Gorman <[email protected]>
Date: Tue, 7 Aug 2012 09:55:55 +0100Quoted 2 lines
Commit [
c48a11c7: netvm: propagatepage->pfmemallocto skb] is responsible for the following bug triggered by a xen network driver...
Quoted 6 lines
The problem is that the xenfront driver is passing a NULL page to
__skb_fill_page_desc()which was unexpected. This patch checks that there is a page before dereferencing.Reported-and-Tested-by Konrad Rzeszutek Wilk <[email protected]>Signed-off-by Mel Gorman <[email protected]>That call to
__skb_fill_page_desc()inxen-netfront.clooks completely bogus. It's the only driver passing NULL here.
Quoted 6 lines
That whole song and dance figuring out what to do with the head fragment page, depending upon whether the length is greater than the
RX_COPY_THRESHOLD, is completely unnecessary.Just use something like a call to
__pskb_pull_tail(skb, len)and all that other crap around that area can simply be deleted.
I looked at this for a while but I did not see how __pskb_pull_tail() could be used sensibly but I'm simily not familiar with writing network device drivers or Xen.
This messing with RX_COPY_THRESHOLD seems to be related to how the frontend and backend communicate (maybe some fixed limitation of the xenbus). The existing code looks like it is trying to take the fragments received and pass them straight to the backend without copying by passing the fragments to the backend without copying. I worry that if I try converting this to __pskb_pull_tail() that it would either hit the limitation of xenbus or introduce copying where it is not wanted.
I'm going to have to punt this to Jeremy and the other Xen folk as I'm not sure what the original intention was and I don't have a Xen setup anywhere to test any patch. Jeremy, xen folk?
Signature · 8 lines
Mel Gorman SUSE Labs -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: <a href=mailto:"[email protected]"> [email protected] </a>
Resending to correct Jeremy's address.
Quoted 16 lines · David Miller
From: Mel Gorman <[email protected]>
Date: Tue, 7 Aug 2012 09:55:55 +0100Quoted 2 lines
Commit [
c48a11c7: netvm: propagatepage->pfmemallocto skb] is responsible for the following bug triggered by a xen network driver...
Quoted 6 lines
The problem is that the xenfront driver is passing a NULL page to
__skb_fill_page_desc()which was unexpected. This patch checks that there is a page before dereferencing.Reported-and-Tested-by Konrad Rzeszutek Wilk <[email protected]>Signed-off-by Mel Gorman <[email protected]>That call to
__skb_fill_page_desc()inxen-netfront.clooks completely bogus. It's the only driver passing NULL here.
Quoted 6 lines
That whole song and dance figuring out what to do with the head fragment page, depending upon whether the length is greater than the
RX_COPY_THRESHOLD, is completely unnecessary.Just use something like a call to
__pskb_pull_tail(skb, len)and all that other crap around that area can simply be deleted.
I looked at this for a while but I did not see how __pskb_pull_tail() could be used sensibly but I'm simily not familiar with writing network device drivers or Xen.
This messing with RX_COPY_THRESHOLD seems to be related to how the frontend and backend communicate (maybe some fixed limitation of the xenbus). The existing code looks like it is trying to take the fragments received and pass them straight to the backend without copying by passing the fragments to the backend without copying. I worry that if I try converting this to __pskb_pull_tail() that it would either hit the limitation of xenbus or introduce copying where it is not wanted.
I'm going to have to punt this to Jeremy and the other Xen folk as I'm not sure what the original intention was and I don't have a Xen setup anywhere to test any patch. Jeremy, xen folk?
Signature · 8 lines
Mel Gorman SUSE Labs -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: <a href=mailto:"[email protected]"> [email protected] </a>
Quoted 36 lines · Mel Gorman
Resending to correct Jeremy's address.
Quoted 15 lines · David Miller
From: Mel Gorman <[email protected]>
Date: Tue, 7 Aug 2012 09:55:55 +0100Quoted 2 lines
Commit [
c48a11c7: netvm: propagatepage->pfmemallocto skb] is responsible for the following bug triggered by a xen network driver...
Quoted 6 lines
The problem is that the xenfront driver is passing a NULL page to
__skb_fill_page_desc()which was unexpected. This patch checks that there is a page before dereferencing.Reported-and-Tested-by Konrad Rzeszutek Wilk <[email protected]>Signed-off-by Mel Gorman <[email protected]>That call to
__skb_fill_page_desc()inxen-netfront.clooks completely bogus. It's the only driver passing NULL here.Quoted 6 lines
That whole song and dance figuring out what to do with the head fragment page, depending upon whether the length is greater than the
RX_COPY_THRESHOLD, is completely unnecessary.Just use something like a call to
__pskb_pull_tail(skb, len)and all that other crap around that area can simply be deleted.I looked at this for a while but I did not see how
__pskb_pull_tail()could be used sensibly but I'm simily not familiar with writing network device drivers or Xen.This messing with
RX_COPY_THRESHOLDseems to be related to how the frontend and backend communicate (maybe some fixed limitation of the xenbus). The existing code looks like it is trying to take the fragments received and pass them straight to the backend without copying by passing the fragments to the backend without copying. I worry that if I try converting this to__pskb_pull_tail()that it would either hit the limitation of xenbus or introduce copying where it is not wanted.
Quoted 3 lines
I'm going to have to punt this to Jeremy and the other Xen folk as I'm not sure what the original intention was and I don't have a Xen setup anywhere to test any patch. Jeremy, xen folk?
It's been a while since I've looked at that stuff, but as I remember, the issue is that since the packet ring memory is shared with another domain which may be untrustworthy, we want to make copies of the headers before making any decisions based on them so that the other domain can't change them after header processing but before they're actually sent. (The packet payload is considered less important, but of course the same issue applies if you're using some kind of content-aware packet filter.)
So that's the rationale for always copying RX_COPY_THRESHOLD, even if the packet is larger than that amount. As far as I know, changing this behaviour wouldn't break the ring protocol, but it does introduce a potential security issue.
J
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>
Quoted 49 lines · Jeremy Fitzhardinge
Quoted 36 lines · Mel Gorman
Resending to correct Jeremy's address.
Quoted 15 lines · David Miller
From: Mel Gorman <[email protected]>
Date: Tue, 7 Aug 2012 09:55:55 +0100Quoted 2 lines
Commit [
c48a11c7: netvm: propagatepage->pfmemallocto skb] is responsible for the following bug triggered by a xen network driver...
Quoted 6 lines
The problem is that the xenfront driver is passing a NULL page to
__skb_fill_page_desc()which was unexpected. This patch checks that there is a page before dereferencing.Reported-and-Tested-by Konrad Rzeszutek Wilk <[email protected]>Signed-off-by Mel Gorman <[email protected]>That call to
__skb_fill_page_desc()inxen-netfront.clooks completely bogus. It's the only driver passing NULL here.Quoted 6 lines
That whole song and dance figuring out what to do with the head fragment page, depending upon whether the length is greater than the
RX_COPY_THRESHOLD, is completely unnecessary.Just use something like a call to
__pskb_pull_tail(skb, len)and all that other crap around that area can simply be deleted.I looked at this for a while but I did not see how
__pskb_pull_tail()could be used sensibly but I'm simily not familiar with writing network device drivers or Xen.This messing with
RX_COPY_THRESHOLDseems to be related to how the frontend and backend communicate (maybe some fixed limitation of the xenbus). The existing code looks like it is trying to take the fragments received and pass them straight to the backend without copying by passing the fragments to the backend without copying. I worry that if I try converting this to__pskb_pull_tail()that it would either hit the limitation of xenbus or introduce copying where it is not wanted.Quoted 3 lines
I'm going to have to punt this to Jeremy and the other Xen folk as I'm not sure what the original intention was and I don't have a Xen setup anywhere to test any patch. Jeremy, xen folk?
It's been a while since I've looked at that stuff, but as I remember, the issue is that since the packet ring memory is shared with another domain which may be untrustworthy, we want to make copies of the headers before making any decisions based on them so that the other domain can't change them after header processing but before they're actually sent. (The packet payload is considered less important, but of course the same issue applies if you're using some kind of content-aware packet filter.)
Quoted 5 lines
So that's the rationale for always copying
RX_COPY_THRESHOLD, even if the packet is larger than that amount. As far as I know, changing this behaviour wouldn't break the ring protocol, but it does introduce a potential security issue.
David,
This leaves us somewhat in a pickle. If I'm reading this right (which I may not be) it means that using __pskb_pull_tail() will work in the ideal case but potentially introduces a subtle issue in the future. This bug could be "fixed" in the driver by partially reverting [01c68026: xen: netfront:
convert to SKB paged frag API.]. That could be viewed as sweeping the problem under the carpet but it does contain the problem to the xen-netfront driver. A new helper could be created like __skb_clear_page_desc but that is overkill for one driver and feels as ugly.
Signature · 8 lines
Mel Gorman SUSE Labs -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: <a href=mailto:"[email protected]"> [email protected] </a>
Quoted 10 lines · David Miller
From: Mel Gorman <[email protected]>
Date: Tue, 7 Aug 2012 09:55:55 +0100Quoted 2 lines
Commit [
c48a11c7: netvm: propagatepage->pfmemallocto skb] is responsible for the following bug triggered by a xen network driver...
Quoted 4 lines
The problem is that the xenfront driver is passing a NULL page to
__skb_fill_page_desc()which was unexpected. This patch checks that there is a page before dereferencing.
Quoted 5 lines
Quoted 2 lines
Reported-and-Tested-by Konrad Rzeszutek Wilk <[email protected]>Signed-off-by Mel Gorman <[email protected]>That call to
__skb_fill_page_desc()inxen-netfront.clooks completely bogus. It's the only driver passing NULL here.
It looks to be passing a valid page pointer (at least by looking at the code) so I am not sure how it got turned in a NULL.
But let me double-check by instrumenting the driver..
Quoted 7 lines
That whole song and dance figuring out what to do with the head fragment page, depending upon whether the length is greater than the
RX_COPY_THRESHOLD, is completely unnecessary.Just use something like a call to
__pskb_pull_tail(skb, len)and all that other crap around that area can simply be deleted.
It looks like an overkill - it does a lot more than just allocate an SKB and a page.
Deleting of extra code would be nice - however I am not going to be able to do that for the next two weeks sadly - as my plate if full of debugging some other stuff.
Lets see if Ian has some time.
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>
Quoted 11 lines · Konrad Rzeszutek Wilk
Quoted 10 lines · David Miller
From: Mel Gorman <[email protected]>
Date: Tue, 7 Aug 2012 09:55:55 +0100Quoted 2 lines
Commit [
c48a11c7: netvm: propagatepage->pfmemallocto skb] is responsible for the following bug triggered by a xen network driver...
Quoted 4 lines
The problem is that the xenfront driver is passing a NULL page to
__skb_fill_page_desc()which was unexpected. This patch checks that there is a page before dereferencing.
Quoted 9 lines
Quoted 5 lines
Quoted 2 lines
Reported-and-Tested-by Konrad Rzeszutek Wilk <[email protected]>Signed-off-by Mel Gorman <[email protected]>That call to
__skb_fill_page_desc()inxen-netfront.clooks completely bogus. It's the only driver passing NULL here.It looks to be passing a valid page pointer (at least by looking at the code) so I am not sure how it got turned in a NULL.
Are we looking at different code bases? I see this and I was assuming it was the source of the bug.
__skb_fill_page_desc(skb, 0, NULL, 0, 0);
Signature · 8 lines
Mel Gorman SUSE Labs -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: <a href=mailto:"[email protected]"> [email protected] </a>
Quoted 18 lines · Mel Gorman
Quoted 17 lines · Konrad Rzeszutek Wilk
Quoted 15 lines · David Miller
From: Mel Gorman <[email protected]>
Date: Tue, 7 Aug 2012 09:55:55 +0100Quoted 2 lines
Commit [
c48a11c7: netvm: propagatepage->pfmemallocto skb] is responsible for the following bug triggered by a xen network driver...
Quoted 6 lines
The problem is that the xenfront driver is passing a NULL page to
__skb_fill_page_desc()which was unexpected. This patch checks that there is a page before dereferencing.Reported-and-Tested-by Konrad Rzeszutek Wilk <[email protected]>Signed-off-by Mel Gorman <[email protected]>That call to
__skb_fill_page_desc()inxen-netfront.clooks completely bogus. It's the only driver passing NULL here.
Quoted 8 lines
Quoted 3 lines
It looks to be passing a valid page pointer (at least by looking at the code) so I am not sure how it got turned in a NULL.
Are we looking at different code bases? I see this and I was assuming it was the source of the bug.
__skb_fill_page_desc(skb, 0, NULL, 0, 0);
Yes! Well, that is embarrassing. I was looking at the first invocation of __skb_fill_page_desc (which is in xennet_alloc_rx_buffers) <sigh>
Quoted 4 lines
Signature · 3 lines
-- Mel Gorman SUSE Labs
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>
Quoted 2 lines · David Miller
Just use something like a call to
__pskb_pull_tail(skb, len)and all that other crap around that area can simply be deleted.
I think you mean something like this, which works for me, although I've only lightly tested it.
Ian.
8<----------------------------------------
Quoted 1 line
From
9e47e3e87a33b45974448649a97859a479183041Mon Sep 17 00:00:00 2001
From: Ian Campbell <[email protected]>
Date: Wed, 22 Aug 2012 10:15:29 +0100
Subject: [PATCH] xen-netfront: use __pskb_pull_tail to ensure linear area is big enough on RX
I'm slightly concerned by the "only in exceptional circumstances" comment on __pskb_pull_tail but the structure of an skb just created by netfront shouldn't hit any of the especially slow cases.
This approach still does slightly more work than the old way, since if we pull up the entire first frag we now have to shuffle everything down where before we just received into the right place in the first place.
--- drivers/net/xen-netfront.c | 39 ++++++++++----------------------------- 1 files changed, 10 insertions(+), 29 deletions(-)
drivers/net/xen-netfront.c +10 -29
@@ -57,8 +57,7 @@static const struct ethtool_ops xennet_ethtool_ops;struct netfront_cb { -struct page *page; -unsigned offset; +int pull_to; };#define NETFRONT_SKB_CB (skb) ((struct netfront_cb *)((skb)->cb))
@@ -867,15 +866,9 @@ static int handle_incoming_queue(struct net_device *dev,struct sk_buff *skb;while ((skb =__skb_dequeue (rxq)) !=NULL ) { -struct page *page =NETFRONT_SKB_CB (skb)->page; -void *vaddr =page_address (page); -unsigned offset =NETFRONT_SKB_CB (skb)->offset; - -memcpy (skb->data, vaddr + offset, -skb_headlen (skb)); +int pull_to =NETFRONT_SKB_CB (skb)->pull_to; -if (page !=skb_frag_page (&skb_shinfo (skb)->frags[0 ])) -__free_page (page); +__pskb_pull_tail (skb, pull_to -skb_headlen (skb));/* Ethernet work: Delayed to here as it peeks the header. */ skb->protocol =eth_type_trans (skb, dev);
@@ -913,7 +906,6 @@ static int xennet_poll(struct napi_struct *napi, int budget)struct sk_buff_head errq;struct sk_buff_head tmpq;unsigned long flags; -unsigned int len;int err;spin_lock (&np->rx_lock);
@@ -955,24 +947,13 @@ err: } } -NETFRONT_SKB_CB (skb)->page = -skb_frag_page (&skb_shinfo (skb)->frags[0 ]); -NETFRONT_SKB_CB (skb)->offset = rx->offset; - - len = rx->status; -if (len >RX_COPY_THRESHOLD ) - len =RX_COPY_THRESHOLD ; -skb_put (skb, len); +NETFRONT_SKB_CB (skb)->pull_to = rx->status; +if (NETFRONT_SKB_CB (skb)->pull_to >RX_COPY_THRESHOLD ) +NETFRONT_SKB_CB (skb)->pull_to =RX_COPY_THRESHOLD ; -if (rx->status > len) { -skb_shinfo (skb)->frags[0 ].page_offset = - rx->offset + len; -skb_frag_size_set (&skb_shinfo (skb)->frags[0 ], rx->status - len); - skb->data_len = rx->status - len; - }else { -__skb_fill_page_desc (skb,0 ,NULL ,0 ,0 ); -skb_shinfo (skb)->nr_frags =0 ; - } +skb_shinfo (skb)->frags[0 ].page_offset = rx->offset; +skb_frag_size_set (&skb_shinfo (skb)->frags[0 ], rx->status); + skb->data_len = rx->status; i =xennet_fill_frags (np, skb, &tmpq);
@@ -999,7 +980,7 @@ err:* receive throughout using the standard receive * buffer size was cut by 25%(!!!). */ - skb->truesize += skb->data_len - (RX_COPY_THRESHOLD - len); + skb->truesize += skb->data_len -RX_COPY_THRESHOLD ; skb->len += skb->data_len;if (rx->flags & XEN_NETRXF_csum_blank)
Signature · 1 line
1.7.2.5
Quoted 7 lines · Ian Campbell
Quoted 2 lines · David Miller
Just use something like a call to
__pskb_pull_tail(skb, len)and all that other crap around that area can simply be deleted.I think you mean something like this, which works for me, although I've only lightly tested it.
I've tested it heavily and works great.
and I took a look at it too and:
Quoted 120 lines
Ian.
8<----------------------------------------
Quoted 1 line
From
9e47e3e87a33b45974448649a97859a479183041Mon Sep 17 00:00:00 2001From: Ian Campbell <[email protected]>
Date: Wed, 22 Aug 2012 10:15:29 +0100
Subject: [PATCH] xen-netfront: use__pskb_pull_tailto ensure linear area is big enough on RXI'm slightly concerned by the "only in exceptional circumstances" comment on
__pskb_pull_tailbut the structure of an skb just created by netfront shouldn't hit any of the especially slow cases.This approach still does slightly more work than the old way, since if we pull up the entire first frag we now have to shuffle everything down where before we just received into the right place in the first place.
Signed-off-by Ian Campbell <[email protected]>Cc Konrad Rzeszutek Wilk <[email protected]>Cc Jeremy Fitzhardinge <[email protected]>Cc Mel Gorman <[email protected]>--- drivers/net/xen-netfront.c | 39 ++++++++++----------------------------- 1 files changed, 10 insertions(+), 29 deletions(-)drivers/net/xen-netfront.c +10
-29@@ -57,8 +57,7 @@static const struct ethtool_ops xennet_ethtool_ops;struct netfront_cb { -struct page *page; -unsigned offset; +int pull_to; };#define NETFRONT_SKB_CB (skb) ((struct netfront_cb *)((skb)->cb))@@ -867,15 +866,9 @@ static int handle_incoming_queue(struct net_device *dev,struct sk_buff *skb;while ((skb =__skb_dequeue (rxq)) !=NULL ) { -struct page *page =NETFRONT_SKB_CB (skb)->page; -void *vaddr =page_address (page); -unsigned offset =NETFRONT_SKB_CB (skb)->offset; - -memcpy (skb->data, vaddr + offset, -skb_headlen (skb)); +int pull_to =NETFRONT_SKB_CB (skb)->pull_to; -if (page !=skb_frag_page (&skb_shinfo (skb)->frags[0 ])) -__free_page (page); +__pskb_pull_tail (skb, pull_to -skb_headlen (skb));/* Ethernet work: Delayed to here as it peeks the header. */ skb->protocol =eth_type_trans (skb, dev);@@ -913,7 +906,6 @@ static int xennet_poll(struct napi_struct *napi, int budget)struct sk_buff_head errq;struct sk_buff_head tmpq;unsigned long flags; -unsigned int len;int err;spin_lock (&np->rx_lock);@@ -955,24 +947,13 @@ err: } } -NETFRONT_SKB_CB (skb)->page = -skb_frag_page (&skb_shinfo (skb)->frags[0 ]); -NETFRONT_SKB_CB (skb)->offset = rx->offset; - - len = rx->status; -if (len >RX_COPY_THRESHOLD ) - len =RX_COPY_THRESHOLD ; -skb_put (skb, len); +NETFRONT_SKB_CB (skb)->pull_to = rx->status; +if (NETFRONT_SKB_CB (skb)->pull_to >RX_COPY_THRESHOLD ) +NETFRONT_SKB_CB (skb)->pull_to =RX_COPY_THRESHOLD ; -if (rx->status > len) { -skb_shinfo (skb)->frags[0 ].page_offset = - rx->offset + len; -skb_frag_size_set (&skb_shinfo (skb)->frags[0 ], rx->status - len); - skb->data_len = rx->status - len; - }else { -__skb_fill_page_desc (skb,0 ,NULL ,0 ,0 ); -skb_shinfo (skb)->nr_frags =0 ; - } +skb_shinfo (skb)->frags[0 ].page_offset = rx->offset; +skb_frag_size_set (&skb_shinfo (skb)->frags[0 ], rx->status); + skb->data_len = rx->status; i =xennet_fill_frags (np, skb, &tmpq);@@ -999,7 +980,7 @@ err:* receive throughout using the standard receive * buffer size was cut by 25%(!!!). */ - skb->truesize += skb->data_len - (RX_COPY_THRESHOLD - len); + skb->truesize += skb->data_len -RX_COPY_THRESHOLD ; skb->len += skb->data_len;if (rx->flags & XEN_NETRXF_csum_blank)Signature · 9 lines
1.7.2.5 -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: <a href=mailto:"[email protected]"> [email protected] </a>
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>
From: Konrad Rzeszutek Wilk <[email protected]>
Date: Thu, 23 Aug 2012 10:17:40 -0400
Quoted 9 lines · Ian Campbell
Quoted 7 lines · David Miller
Quoted 2 lines
Just use something like a call to
__pskb_pull_tail(skb, len)and all that other crap around that area can simply be deleted.I think you mean something like this, which works for me, although I've only lightly tested it.
Quoted 6 lines
I've tested it heavily and works great.
and I took a look at it too and:
Applied, thanks everyone.
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>