Clarification about the series to modernize the tasklet api
Hi Kees,
I'm working to modernize the tasklet api but I don't understand the reply to the patch 12/16 [1] of the patch series of Romain Perier [2].
If this patch is combined with the first one, and the function prototypes are not changed accordingly and these functions don't use the from_tasklet() helper, all the users that use the DECLARE_TASKLET macro don't pass the correct argument to the .data field.
#define DECLARE_TASKLET(name, func, data) \
-struct tasklet_struct name = { NULL, 0, ATOMIC_INIT(0), func, data }
+struct tasklet_struct name = { NULL, 0, ATOMIC_INIT(0), (TASKLET_FUNC_TYPE)func, (TASKLET_DATA_TYPE)&name }
The data argument is lost.
If this patch is splitted in two, the first part will build correctly since there are casts protecting the arguments, but it will not run correctly until we apply the second part.
Is it correct? Or am I wrong?
The only imperative to apply a patch in a series is that it compiles correctly? And I suppose that the next ones fix this situation.
At this moment I'm very confused. A bit of light about this will help me a lot. And sorry if this is a trivial question.
[1] https://lore.kernel.org/kernel-hardening/201909301538.CEA6C827@keescook/
[2] https://lore.kernel.org/kernel-hardening/[email protected]/
Thanks in advance,
Oscar Carter
Oscar,
Quoted 3 lines
I'm working to modernize the tasklet api but I don't understand the reply to the patch 12/16 [1] of the patch series of Romain Perier [2].
Am working on the same too. I did try reaching out to Romain but not luck.
Let's hope we are not duplicating efforts.
Review
Quoted 9 lines
If this patch is combined with the first one, and the function prototypes are not changed accordingly and these functions don't use the
from_tasklet()helper, all the users that use theDECLARE_TASKLETmacro don't pass the correct argument to the .data field.#define
DECLARE_TASKLET(name, func, data)\(quoted diff) +1
-1-struct tasklet_struct name = { NULL, 0, ATOMIC_INIT(0), func, data } +struct tasklet_struct name = { NULL, 0, ATOMIC_INIT(0), (TASKLET_FUNC_TYPE)func, (TASKLET_DATA_TYPE)&name }
Ideally this above bit should have been part of the first patch.
Quoted 6 lines
The data argument is lost.
If this patch is splitted in two, the first part will build correctly since there are casts protecting the arguments, but it will not run correctly until we apply the second part.
I have a few more things to complete, I shall have it done and pushed to github. Will write back
once that's done.
- Allen
Quoted 4 lines
I have a few more things to complete, I shall have it done and pushed to github. Will write back
once that's done.
Here's the link to the list of patches so far. I should hopefully complete the rest in about
a week.
https://github.com/allenpais/tasklets/commits/ref_tasklets
What I have done so far is to keep patches close to the original series, but with changes
from the feedback received to those patches.
Patches 1-10 have been retained as is, except for DECLARE_TASKLET which has been moved to patch 1 from patch 12 in the series.
Patch 11 is broken down to sub-systems(as it was done for Timer changes in the past).
Sub-systems:
arch/*
drivers/atm/*
drivers/block/*
drivers/char/ipmi/*
drivers/crypto/*
drivers/dma/*
drivers/firewire/*
drivers/gpu/drm/*
drivers/hsi/*
drivers/hv/*
drivers/infiniband/*
drivers/input/*
drivers/mailbox/*
drivers/media/*
drivers/memstick/*
drivers/misc/*
drivers/mmc/*
drivers/net/*
drivers/net/ethernet/*
drivers/net/ppp/*
drivers/net/usb/*
drivers/net/wireless/*
drivers/ntb/*
drivers/platform/*
drivers/rapidio/*
drivers/s390/*
drivers/scsi/*
drivers/spi/*
drivers/tty/*
drivers/usb/*
drivers/vme/*
net/dccp/*
net/ipv4/*
net/mac80211/*
net/mac802154/*
net/rds/*
net/sched/*
net/smc/*
net/xfrm/*
sound/core/*
sound/*
and ofcourse staging/*
Patches 12, 13 comments will be addressed and broken down. Patches 14, 15 will remain as is.
Patch 16 will have it's comments addressed.
With this approach, I think it will be a little easier to get the patches into the kernel and also will be easier for maintainers to have them reviewed.
Thanks,
Signature · 1 line
- Allen
Quoted 10 lines · Allen
Quoted 4 lines
I have a few more things to complete, I shall have it done and pushed to github. Will write back
once that's done.Here's the link to the list of patches so far. I should hopefully complete the rest in about
a week.
Thanks for the update! I wonder if there is a way to collaborate better on this, so we're not all waiting on each other? (i.e. Romain got busy, Allen picked up the work, then Allen got busy, then Oscar picked up the work, then Allen returned, etc...)
Perhaps split up testing? I'll like you and Oscar work it out. :)
Quoted 6 lines
What I have done so far is to keep patches close to the original series, but with changes
from the feedback received to those patches.Patches 1-10 have been retained as is, except for
DECLARE_TASKLETwhich has been moved to patch 1 from patch 12 in the series.
I think the "prepare" patches should be collapsed into the "convert" patches (i.e. let's just touch a given driver once with a single patch).
Quoted 46 lines
Patch 11 is broken down to sub-systems(as it was done for Timer changes in the past).
Sub-systems:
arch/*
drivers/atm/*
drivers/block/*
drivers/char/ipmi/*
drivers/crypto/*
drivers/dma/*
drivers/firewire/*
drivers/gpu/drm/*
drivers/hsi/*
drivers/hv/*
drivers/infiniband/*
drivers/input/*
drivers/mailbox/*
drivers/media/*
drivers/memstick/*
drivers/misc/*
drivers/mmc/*
drivers/net/*
drivers/net/ethernet/*
drivers/net/ppp/*
drivers/net/usb/*
drivers/net/wireless/*
drivers/ntb/*
drivers/platform/*
drivers/rapidio/*
drivers/s390/*
drivers/scsi/*
drivers/spi/*
drivers/tty/*
drivers/usb/*
drivers/vme/*
net/dccp/*
net/ipv4/*
net/mac80211/*
net/mac802154/*
net/rds/*
net/sched/*
net/smc/*
net/xfrm/*
sound/core/*
sound/*
and ofcourse staging/*
Quoted 7 lines
Patches 12, 13 comments will be addressed and broken down. Patches 14, 15 will remain as is.
Patch 16 will have it's comments addressed.With this approach, I think it will be a little easier to get the patches into the kernel and also will be easier for maintainers to have them reviewed.
Yup -- it's that first patch that needs to land in a release so the rest can start landing too. (Timing here is the awkward part: the infrastructure change needs to be in -rc1 or -rc2 so the next development cycle can use it (i.e. subsystem maintainers effectively fork after the merge window is over). We can play other tricks (common merged branch) but I don't think that's needed here.
Thanks to all three of you for poking at this!
Signature · 1 line
Kees Cook
Quoted 7 lines
Thanks for the update! I wonder if there is a way to collaborate better on this, so we're not all waiting on each other? (i.e. Romain got busy, Allen picked up the work, then Allen got busy, then Oscar picked up the work, then Allen returned, etc...)
Perhaps split up testing? I'll like you and Oscar work it out. :)
Yes, this has been a bit of a problem. But this time, I will ensure to get
this all upstreamed.
Quoted 9 lines
Quoted 6 lines
What I have done so far is to keep patches close to the original series, but with changes
from the feedback received to those patches.Patches 1-10 have been retained as is, except for
DECLARE_TASKLETwhich has been moved to patch 1 from patch 12 in the series.I think the "prepare" patches should be collapsed into the "convert" patches (i.e. let's just touch a given driver once with a single patch).
Yes, that is WIP.
Quoted 8 lines
Yup -- it's that first patch that needs to land in a release so the rest can start landing too. (Timing here is the awkward part: the infrastructure change needs to be in -rc1 or -rc2 so the next development cycle can use it (i.e. subsystem maintainers effectively fork after the merge window is over). We can play other tricks (common merged branch) but I don't think that's needed here.
My Plan is to get it all ready by the end of 5.8 so that we are ready for 5.9 merge.
Thoughts?
Signature · 1 line
- Allen
Quoted 10 lines · Kees Cook
Quoted 9 lines · Allen
Quoted 4 lines
I have a few more things to complete, I shall have it done and pushed to github. Will write back
once that's done.Here's the link to the list of patches so far. I should hopefully complete the rest in about
a week.
Quoted 8 lines
Thanks for the update! I wonder if there is a way to collaborate better on this, so we're not all waiting on each other? (i.e. Romain got busy, Allen picked up the work, then Allen got busy, then Oscar picked up the work, then Allen returned, etc...)
Perhaps split up testing? I'll like you and Oscar work it out. :)
Sure. If you need help give me some task. It will be a pleasure to help on this. The only inconvenience is that my time to work on this is only a few hours during the weekend. If the task have no timeout I will finish it as soon as possible. Sorry, I would like to have more time to work on the linux kernel.
Quoted 71 lines
Quoted 6 lines
What I have done so far is to keep patches close to the original series, but with changes
from the feedback received to those patches.Patches 1-10 have been retained as is, except for
DECLARE_TASKLETwhich has been moved to patch 1 from patch 12 in the series.I think the "prepare" patches should be collapsed into the "convert" patches (i.e. let's just touch a given driver once with a single patch).
Quoted 46 lines
Patch 11 is broken down to sub-systems(as it was done for Timer changes in the past).
Sub-systems:
arch/*
drivers/atm/*
drivers/block/*
drivers/char/ipmi/*
drivers/crypto/*
drivers/dma/*
drivers/firewire/*
drivers/gpu/drm/*
drivers/hsi/*
drivers/hv/*
drivers/infiniband/*
drivers/input/*
drivers/mailbox/*
drivers/media/*
drivers/memstick/*
drivers/misc/*
drivers/mmc/*
drivers/net/*
drivers/net/ethernet/*
drivers/net/ppp/*
drivers/net/usb/*
drivers/net/wireless/*
drivers/ntb/*
drivers/platform/*
drivers/rapidio/*
drivers/s390/*
drivers/scsi/*
drivers/spi/*
drivers/tty/*
drivers/usb/*
drivers/vme/*
net/dccp/*
net/ipv4/*
net/mac80211/*
net/mac802154/*
net/rds/*
net/sched/*
net/smc/*
net/xfrm/*
sound/core/*
sound/*
and ofcourse staging/*Quoted 7 lines
Patches 12, 13 comments will be addressed and broken down. Patches 14, 15 will remain as is.
Patch 16 will have it's comments addressed.With this approach, I think it will be a little easier to get the patches into the kernel and also will be easier for maintainers to have them reviewed.
Yup -- it's that first patch that needs to land in a release so the rest can start landing too. (Timing here is the awkward part: the infrastructure change needs to be in -rc1 or -rc2 so the next development cycle can use it (i.e. subsystem maintainers effectively fork after the merge window is over). We can play other tricks (common merged branch) but I don't think that's needed here.
Quoted 4 lines
Thanks to all three of you for poking at this!
--
Kees Cook
Thanks,
Oscar Carter
Quoted 1 line · Allen
Okay, I took a look at this series. I'd like to introduce the new API differently than was done for timer_struct because I think it'll be easier and more CFI-friendly. Here's what I've got:
https://git.kernel.org/pub/scm/linux/kernel/git/kees/linux.git/log/?h=kspp/tasklets/new-api/v1
All the rest can apply on top of that (though it looks like many patches need work, I got a lot of errors from "make allmodconfig && make".
How does that look?
Signature · 1 line
Kees Cook
Quoted 6 lines
Okay, I took a look at this series. I'd like to introduce the new API differently than was done for
timer_structbecause I think it'll be easier and more CFI-friendly. Here's what I've got:https://git.kernel.org/pub/scm/linux/kernel/git/kees/linux.git/log/?h=kspp/tasklets/new-api/v1
Okay, I took a quick look and I like it. I shall get this in and work
on the rest of
the patches and hopefully get it all ready by the end of this week.
Quoted 3 lines
All the rest can apply on top of that (though it looks like many patches need work, I got a lot of errors from "make allmodconfig && make".
My bad, I should have told you that github was just a placeholder for WIP patches. I have been testing a set of patches regularly, no issues. I shall push the updated branch.
Thank you.
Signature · 1 line
- Allen
Quoted 5 lines
My bad, I should have told you that github was just a placeholder for WIP patches. I have been testing a set of patches regularly, no issues. I shall push the updated branch.
Made some progress today. I have a few more things to complete
before the series can go out for review. I have pushed out the changes to:
https://github.com/allenpais/tasklets/commits/tasklets_V1
Thanks,
- Allen
Quoted 10 lines · Allen
Quoted 5 lines
My bad, I should have told you that github was just a placeholder for WIP patches. I have been testing a set of patches regularly, no issues. I shall push the updated branch.
Made some progress today. I have a few more things to complete
before the series can go out for review. I have pushed out the changes to:
Nice! One style nit is the Subject lines needs spaces after the ":"s. For example, "crypto:hifn_795x: replace tasklet...." should be "crypto: hifn_795x: replace tasklet...."
I did this to fix it:
rm 0*.patch
git format-patch 7f51b77d527325bfa1dd5da21810765066bd60ff git reset --hard 7f51b77d527325bfa1dd5da21810765066bd60ff
perl -pi.old -e \ 's/Subject: \[PATCH([^\]]+)\] ([^:]+):([^ ])/Subject: [PATCH\1] \2: \3/' 0*patch
git am 0*.patch
Signature · 1 line
Kees Cook
Quoted 10 lines · Kees Cook
I did this to fix it:
rm 0*.patch
git format-patch7f51b77d527325bfa1dd5da21810765066bd60ffgit reset --hard7f51b77d527325bfa1dd5da21810765066bd60ffperl -pi.old -e \ 's/Subject: \[PATCH([^\]]+)\] ([^:]+):([^ ])/Subject: [PATCH\1] \2: \3/' 0*patchgit am 0*.patch
Thanks, I shall have it fixed.
Signature · 1 line
- Allen
Quoted 9 lines
Quoted 7 lines
rm 0*.patch
git format-patch7f51b77d527325bfa1dd5da21810765066bd60ffgit reset --hard7f51b77d527325bfa1dd5da21810765066bd60ffperl -pi.old -e \ 's/Subject: \[PATCH([^\]]+)\] ([^:]+):([^ ])/Subject: [PATCH\1] \2: \3/' 0*patchgit am 0*.patch
Thanks, I shall have it fixed.
Fixed all the patches and cleaned them up.
https://github.com/allenpais/tasklets/commits/tasklets_V2
Build tested with "make allmodconfig" and boot tested on x86, Raspberry Pi3, qemu(arm64 and x86).
I will have the drivers in staging converted in a day or two.
I haven't yet added the patch to completely remove the old API, I think it's best
for the current series to be accepted upstream and only when all of them have been accepted it will be right to send the clean up patch.
Please take a look and let me know if they are good to go out for review.
Signature · 1 line
- Allen
Quoted 18 lines · Allen
Quoted 9 lines
Quoted 7 lines
rm 0*.patch
git format-patch7f51b77d527325bfa1dd5da21810765066bd60ffgit reset --hard7f51b77d527325bfa1dd5da21810765066bd60ffperl -pi.old -e \ 's/Subject: \[PATCH([^\]]+)\] ([^:]+):([^ ])/Subject: [PATCH\1] \2: \3/' 0*patchgit am 0*.patch
Thanks, I shall have it fixed.
Fixed all the patches and cleaned them up.
https://github.com/allenpais/tasklets/commits/tasklets_V2
Build tested with "make allmodconfig" and boot tested on x86, Raspberry Pi3, qemu(arm64 and x86).
Quoted 7 lines
I will have the drivers in staging converted in a day or two.
I haven't yet added the patch to completely remove the old API, I think it's best
for the current series to be accepted upstream and only when all of them have been accepted it will be right to send the clean up patch.Please take a look and let me know if they are good to go out for review.
Looking good! I would send the first three first, and point to the conversion tree in the cover letter "this is what's planned" etc (since the first three need to land before the rest can start going in).
Signature · 1 line
Kees Cook
Quoted 5 lines
Looking good! I would send the first three first, and point to the conversion tree in the cover letter "this is what's planned" etc (since the first three need to land before the rest can start going in).
Sure, will keep an eye out. In case I miss them, please just drop me a ping and I will send out the series.
Thanks.
Signature · 1 line
- Allen
Quoted 8 lines · Allen
Quoted 5 lines
Looking good! I would send the first three first, and point to the conversion tree in the cover letter "this is what's planned" etc (since the first three need to land before the rest can start going in).
Sure, will keep an eye out. In case I miss them, please just drop me a ping and I will send out the series.
Oh, maybe we misunderstood each other? Should I send the first three, or do you want to do it? I'm fine either way.
Signature · 1 line
Kees Cook
Quoted 3 lines
Oh, maybe we misunderstood each other? Should I send the first three, or do you want to do it? I'm fine either way.
I am fine with either, I'll let you decide on it.
Signature · 1 line
- Allen
Quoted 13 lines · Allen
Oscar,
Quoted 3 lines
I'm working to modernize the tasklet api but I don't understand the reply to the patch 12/16 [1] of the patch series of Romain Perier [2].
Am working on the same too. I did try reaching out to Romain but not luck.
Let's hope we are not duplicating efforts.Quoted 5 lines
If this patch is combined with the first one, and the function prototypes are not changed accordingly and these functions don't use the
from_tasklet()helper, all the users that use theDECLARE_TASKLETmacro don't pass the correct argument to the .data field.
Quoted 6 lines
Review
Quoted 4 lines
#define
DECLARE_TASKLET(name, func, data)\(quoted diff) +1
-1-struct tasklet_struct name = { NULL, 0, ATOMIC_INIT(0), func, data } +struct tasklet_struct name = { NULL, 0, ATOMIC_INIT(0), (TASKLET_FUNC_TYPE)func, (TASKLET_DATA_TYPE)&name }Ideally this above bit should have been part of the first patch.
Right, the idea was to have a single patch that contained all the infrastructure changes to support the conversion patches.
Signature · 1 line
Kees Cook
Quoted 8 lines · Kees Cook
Quoted 7 lines · Allen
Oscar,
Quoted 3 lines
I'm working to modernize the tasklet api but I don't understand the reply to the patch 12/16 [1] of the patch series of Romain Perier [2].
Am working on the same too. I did try reaching out to Romain but not luck.
Let's hope we are not duplicating efforts.
Don't worry. The work done by me for the moment has been to read all the Romain patches.
Quoted 12 lines
Quoted 11 lines
Review
Quoted 9 lines
If this patch is combined with the first one, and the function prototypes are not changed accordingly and these functions don't use the
from_tasklet()helper, all the users that use theDECLARE_TASKLETmacro don't pass the correct argument to the .data field.#define
DECLARE_TASKLET(name, func, data)\(quoted diff) +1
-1-struct tasklet_struct name = { NULL, 0, ATOMIC_INIT(0), func, data } +struct tasklet_struct name = { NULL, 0, ATOMIC_INIT(0), (TASKLET_FUNC_TYPE)func, (TASKLET_DATA_TYPE)&name }Ideally this above bit should have been part of the first patch.
Quoted 2 lines
Right, the idea was to have a single patch that contained all the infrastructure changes to support the conversion patches.
Ok, thanks for the explanation.
Quoted 2 lines
--
Kees Cook
Thanks,
Oscar Carter