Skip to content

RFC incorrect unlikely() and likely() cleanups

Steven Rostedt lkml 1 version In review

Get series with b4
b4 am [email protected]

Versions newest first

  1. v1 RFC Latest10 patches 20 repliesIn review

Patches in v1 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/10sched: Change rt_task(prev) in pre_schedule_rt to likelykernel/sched_rt.c+1 -12 replies
2/10mm: Remove likely() from mapping_unevictable()include/linux/pagemap.h+1 -18 replies
3/10workqueue: It is likely that WORKER_NOT_RUNNING is truekernel/workqueue.c+2 -25 replies
4/10sched: Change pick_next_task_rt from unlikely to likelykernel/sched_rt.c+1 -13 replies
5/10mm: Remove likely() from grab_cache_page_write_begin()mm/filemap.c+1 -12 replies
6/10sched: Remove unlikely() from rt_policy() in sched.ckernel/sched.c+1 -10 replies
7/10x86: Remove unlikey()s from sched_switch segment testsarch/x86/kernel/process_64.c+3 -30 replies
8/10fs: Remove unlikely() from fput_light()include/linux/file.h+1 -10 replies
9/10fs: Remove unlikely() from fget_light()fs/file_table.c+1 -10 replies
10/10sched: Remove unlikely() from ttwu_post_activationkernel/sched.c+1 -10 replies

Reviews trailers per patch

2 of 10 patches have a Reviewed-by or Acked-by.

PatchNick PigginRik van RielKOSAKI Motohiro
1/10
2/10A-b A-b R-b
3/10
4/10
5/10A-b
6/10
7/10
8/10
9/10
10/10

Trailers given in replies are filled; those carried in the patches from earlier versions are outlined with dashes. Scroll the table sideways for all 3 reviewers.

Read the v1 thread

Cover letter [RFC][PATCH 00/10] incorrect unlikely() and likely() cleanups

This is my end of year branch annotation cleanups. I compiled my kernel with:

CONFIG_PROFILE_ANNOTATED_BRANCHES

And booted this on my main work station, as well as a couple of test boxes. Letting it run for a while I then looked at the results.

cat /debug/tracing/trace_stat/branch_annotated

Which gives a result looking something like this:

 correct incorrect  %        Function                  File              Line
 ------- ---------  -        --------                  ----              ----
       0 366631256 100 sched_info_switch              sched_stats.h        269
       0 211488512 100 sched_info_queued              sched_stats.h        222
       0 197083456 100 sched_info_dequeued            sched_stats.h        177
       0 130545377 100 syscall_trace_enter            ptrace.c             1375
       0 130545340 100 syscall_trace_leave            ptrace.c             1403
       0   326960 100 pre_schedule_rt                sched_rt.c           1476
       0     5214 100 signal_pending                 sched.h              2313
       0     1305 100 trylock_page                   pagemap.h            316

It sorts the list with those that have the highest percentage of incorrect uses and the largest number of them.

The sched_info_switch() is part of the sched_stats which falls into:

	if (unlikely(1))

And gcc is smart enough to ignore it, but because it uses a static inline function that returns 1, the branch profiler misses that it is indeed a constant.

I also ignored those that only had a few hits, like the signal_pending above.

Anyway, there are 10 areas that I found that really do not need to have an annotated branch, or the annotation is simply the opposite of what it should be.

If people are fine with these, I'm hoping to get acks and then push this out as a real clean up for 2.6.38.

The following patches are in:

git://git.kernel.org/pub/scm/linux/kernel/git/rostedt/linux-2.6-trace.git

branch: unlikely/core

Steven Rostedt (10):
sched: Change rt_task(prev) in pre_schedule_rt to likely
mm: Remove likely() from mapping_unevictable()
workqueue: It is likely that WORKER_NOT_RUNNING is true
sched: Change pick_next_task_rt from unlikely to likely
mm: Remove likely() from grab_cache_page_write_begin()
sched: Remove unlikely() from rt_policy() in sched.c
x86: Remove unlikey()'s from sched_switch segment tests
fs: Remove unlikely() from fput_light()
fs: Remove unlikely() from fget_light()
sched: Remove unlikely() from ttwu_post_activation

----

 arch/x86/kernel/process_64.c |    6 +++---
 fs/file_table.c              |    2 +-
 include/linux/file.h         |    2 +-
 include/linux/pagemap.h      |    2 +-
 kernel/sched.c               |    4 ++--
 kernel/sched_rt.c            |    4 ++--
 kernel/workqueue.c           |    4 ++--
 mm/filemap.c                 |    2 +-
 8 files changed, 13 insertions(+), 13 deletions(-)