Skip to contentSkip to conversation

fs: exclude 'wakeup_count' from read_all_sys test.

PATCH New Sandeep Patil 3 participants 6 messages Aug 3, 2018 – Aug 20, 2018

lore
Share & tools
lore
#0 lore raw

PATCH 1/1 fs: exclude 'wakeup_count' from read_all_sys test.

/sys/power/wakeup_count semantics state that the read() for the file will block as long as there is a wakeup_event in progress. On most systems, this will be non deterministic and will result in extremely flaky test. Exclude the file from read_all_sys test for the same.

---
 runtest/fs | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
runtest/fs +1 -1
index a66948a43..aca7e355f 100644
@@ -71,7 +71,7 @@ proc01 proc01 -m 128
 
 read_all_dev read_all -d /dev -p -q -r 10
 read_all_proc read_all -d /proc -q -r 10
-read_all_sys read_all -d /sys -q -r 10
+read_all_sys read_all -d /sys -q -r 10 -e /sys/power/wakeup_count
 
 #Run the File System Race Condition Check tests as well
 fs_racer fs_racer.sh -t 5
Signature · 1 line
2.18.0.597.ga71716f1ad-goog
#1 lore raw

PATCH 1/1 fs: exclude 'wakeup_count' from read_all_sys test.

Hello,

Quoted 15 lines · Sandeep Patil

/sys/power/wakeup_count semantics state that the read() for the file will block as long as there is a wakeup_event in progress. On most systems, this will be non deterministic and will result in extremely flaky test. Exclude the file from read_all_sys test for the same.

---
 runtest/fs | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
runtest/fs +0 -0
index a66948a43..aca7e355f 100644

runtest/fs proc01 proc01 -m 128 · line 75

Quoted 6 lines
runtest/fs +1 -1
@@ -71,7 +71,7 @@ proc01 proc01 -m 128
 
 read_all_dev read_all -d /dev -p -q -r 10
 read_all_proc read_all -d /proc -q -r 10
-read_all_sys read_all -d /sys -q -r 10
+read_all_sys read_all -d /sys -q -r 10 -e /sys/power/wakeup_count
 

This probably won't be the only file with semantics like these. So I am wondering if we can limit the time it spends blocking with timer_create and SIGEV_THREAD_ID or something similar?

Signature · 2 lines
Thank you,
Richard.
#2 lore raw

PATCH 1/1 fs: exclude 'wakeup_count' from read_all_sys test.

Quoted 20 lines · Richard Palethorpe

Hello,

Quoted 16 lines · Sandeep Patil

/sys/power/wakeup_count semantics state that the read() for the file will block as long as there is a wakeup_event in progress. On most systems, this will be non deterministic and will result in extremely flaky test. Exclude the file from read_all_sys test for the same.

---
 runtest/fs | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
runtest/fs +0 -0
index a66948a43..aca7e355f 100644
@@ -71,7 +71,7 @@ proc01 proc01 -m 128
 
Quoted 9 lines

runtest/fs proc01 proc01 -m 128 · line 75

Quoted 5 lines
runtest/fs +1 -1
 read_all_dev read_all -d /dev -p -q -r 10
 read_all_proc read_all -d /proc -q -r 10
-read_all_sys read_all -d /sys -q -r 10
+read_all_sys read_all -d /sys -q -r 10 -e /sys/power/wakeup_count
 

This probably won't be the only file with semantics like these. So I am wondering if we can limit the time it spends blocking with timer_create and SIGEV_THREAD_ID or something similar?

Well, I actually like the fact that this test goes and reads everything and makes sure the kernel operations for those files are "sane". We ended up finding 2 different bugs due to this in the drivers, in 1 case it crashed the kernel and in the other the test halted forever until timeout.

So, unless the upstream ABI says the semantics are different for some files, I don't think we should do this. 'wakeup_count' is the one I found and after I exclude this, the test passes just fine on Pixel phones for example. (Including the debugfs mount point under /sys/kernel/debug).

I say we wait for another case of exclusion show up before considering your approach as I think we will miss real problem if we start timing out. Plus, there is the question of whether we report the test as PASS / FAIL in those cases. The exclusion list is the right approach IMO. We may just have to figure out how to add more than one in the command line as they show up.

Agree?

- ssp

Quoted 9 lines
Signature · 7 lines
-- 
Thank you,
Richard.

-- 
You received this message because you are subscribed to the Google Groups "kernel-team" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [email protected].
#3 lore raw

PATCH 1/1 fs: exclude 'wakeup_count' from read_all_sys test.

Hello Sandeep,

Quoted 31 lines · Sandeep Patil
Quoted 20 lines · Richard Palethorpe

Hello,

Quoted 16 lines · Sandeep Patil

/sys/power/wakeup_count semantics state that the read() for the file will block as long as there is a wakeup_event in progress. On most systems, this will be non deterministic and will result in extremely flaky test. Exclude the file from read_all_sys test for the same.

---
 runtest/fs | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
runtest/fs +0 -0
index a66948a43..aca7e355f 100644
@@ -71,7 +71,7 @@ proc01 proc01 -m 128
 
Quoted 9 lines

runtest/fs proc01 proc01 -m 128 · line 75

Quoted 5 lines
runtest/fs +1 -1
 read_all_dev read_all -d /dev -p -q -r 10
 read_all_proc read_all -d /proc -q -r 10
-read_all_sys read_all -d /sys -q -r 10
+read_all_sys read_all -d /sys -q -r 10 -e /sys/power/wakeup_count
 

This probably won't be the only file with semantics like these. So I am wondering if we can limit the time it spends blocking with timer_create and SIGEV_THREAD_ID or something similar?

Quoted 4 lines

Well, I actually like the fact that this test goes and reads everything and makes sure the kernel operations for those files are "sane". We ended up finding 2 different bugs due to this in the drivers, in 1 case it crashed the kernel and in the other the test halted forever until timeout.

This is good to know.

Quoted 6 lines

So, unless the upstream ABI says the semantics are different for some files, I don't think we should do this. 'wakeup_count' is the one I found and after I exclude this, the test passes just fine on Pixel phones for example. (Including the debugfs mount point under /sys/kernel/debug).

Quoted 8 lines

I say we wait for another case of exclusion show up before considering your approach as I think we will miss real problem if we start timing out. Plus, there is the question of whether we report the test as PASS / FAIL in those cases. The exclusion list is the right approach IMO. We may just have to figure out how to add more than one in the command line as they show up.

Agree?

Yes, but possibly we should add a feature which allows us to annotate some file's. Then we can mark this file as 'can_block', so if we do timeout while reading it then we still know to PASS. Whereas for other files, we can FAIL if it blocks. We discussed doing something like this previously, but decided to wait for feedback before trying anything like this. We already had to drop privileges due to /dev/watchdog, but annotations could allow us to avoid this as well. This could perhaps go into read_all02 and read_all01 just continues to use an exclude list and drop privs.

I would be happy to implement said feature, but it may take a while. In the meantime I'm not against merging this patch and waiting for another file with similar problems to appear.

What do you think Metan? We could probably replace proc01 with read_all02 as well.

Quoted 11 lines

- ssp

Quoted 9 lines

--
Thank you,
Richard.

--
You received this message because you are subscribed to the Google Groups "kernel-team" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [email protected].

--
Thank you,
Richard.

#4 lore raw

PATCH 1/1 fs: exclude 'wakeup_count' from read_all_sys test.

Hi!

Quoted 24 lines
Quoted 5 lines

So, unless the upstream ABI says the semantics are different for some files, I don't think we should do this. 'wakeup_count' is the one I found and after I exclude this, the test passes just fine on Pixel phones for example. (Including the debugfs mount point under /sys/kernel/debug).

Quoted 8 lines

I say we wait for another case of exclusion show up before considering your approach as I think we will miss real problem if we start timing out. Plus, there is the question of whether we report the test as PASS / FAIL in those cases. The exclusion list is the right approach IMO. We may just have to figure out how to add more than one in the command line as they show up.

Agree?

Yes, but possibly we should add a feature which allows us to annotate some file's. Then we can mark this file as 'can_block', so if we do timeout while reading it then we still know to PASS. Whereas for other files, we can FAIL if it blocks. We discussed doing something like this previously, but decided to wait for feedback before trying anything like this. We already had to drop privileges due to /dev/watchdog, but annotations could allow us to avoid this as well. This could perhaps go into read_all02 and read_all01 just continues to use an exclude list and drop privs.

Quoted 3 lines

I would be happy to implement said feature, but it may take a while. In the meantime I'm not against merging this patch and waiting for another file with similar problems to appear.

Sounds good, I will apply this band aid for now, then we can look into better solutions.

Quoted 2 lines

What do you think Metan? We could probably replace proc01 with read_all02 as well.

Sounds good as well.

Signature · 2 lines
Cyril Hrubis
[email protected]
#5 lore raw

PATCH 1/1 fs: exclude 'wakeup_count' from read_all_sys test.

In reply to Richard Palethorpe
Quoted 57 lines · Richard Palethorpe

Hello Sandeep,

Quoted 31 lines · Sandeep Patil
Quoted 20 lines · Richard Palethorpe

Hello,

Quoted 16 lines · Sandeep Patil

/sys/power/wakeup_count semantics state that the read() for the file will block as long as there is a wakeup_event in progress. On most systems, this will be non deterministic and will result in extremely flaky test. Exclude the file from read_all_sys test for the same.

---
 runtest/fs | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
runtest/fs +0 -0
index a66948a43..aca7e355f 100644
@@ -71,7 +71,7 @@ proc01 proc01 -m 128
 
Quoted 9 lines

runtest/fs proc01 proc01 -m 128 · line 75

Quoted 5 lines
runtest/fs +1 -1
 read_all_dev read_all -d /dev -p -q -r 10
 read_all_proc read_all -d /proc -q -r 10
-read_all_sys read_all -d /sys -q -r 10
+read_all_sys read_all -d /sys -q -r 10 -e /sys/power/wakeup_count
 

This probably won't be the only file with semantics like these. So I am wondering if we can limit the time it spends blocking with timer_create and SIGEV_THREAD_ID or something similar?

Quoted 4 lines

Well, I actually like the fact that this test goes and reads everything and makes sure the kernel operations for those files are "sane". We ended up finding 2 different bugs due to this in the drivers, in 1 case it crashed the kernel and in the other the test halted forever until timeout.

This is good to know.

Quoted 6 lines

So, unless the upstream ABI says the semantics are different for some files, I don't think we should do this. 'wakeup_count' is the one I found and after I exclude this, the test passes just fine on Pixel phones for example. (Including the debugfs mount point under /sys/kernel/debug).

Quoted 8 lines

I say we wait for another case of exclusion show up before considering your approach as I think we will miss real problem if we start timing out. Plus, there is the question of whether we report the test as PASS / FAIL in those cases. The exclusion list is the right approach IMO. We may just have to figure out how to add more than one in the command line as they show up.

Agree?

Quoted 9 lines

Yes, but possibly we should add a feature which allows us to annotate some file's. Then we can mark this file as 'can_block', so if we do timeout while reading it then we still know to PASS. Whereas for other files, we can FAIL if it blocks. We discussed doing something like this previously, but decided to wait for feedback before trying anything like this. We already had to drop privileges due to /dev/watchdog, but annotations could allow us to avoid this as well. This could perhaps go into read_all02 and read_all01 just continues to use an exclude list and drop privs.

Oh, I like this idea too. Sounds reasonable to me.

Quoted 2 lines

I would be happy to implement said feature, but it may take a while.

Same here, I'll keep this in my queue though, please CC me if possible if you get around to doing it before I do. I'd be happy to test and give feedback.

Thanks again
- ssp

Quoted 23 lines

In
the meantime I'm not against merging this patch and waiting for another file with similar problems to appear.

What do you think Metan? We could probably replace proc01 with read_all02 as well.

Quoted 11 lines

- ssp

Quoted 9 lines

--
Thank you,
Richard.

--
You received this message because you are subscribed to the Google Groups "kernel-team" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [email protected].

--
Thank you,
Richard.