Markers : fix markers read barrier for multiple probes
PATCH 1/1 Markers : fix markers read barrier for multiple probes
Paul pointed out two incorrect read barriers in the marker handler code in the path where multiple probes are connected. Those are ordering reads of "ptype" (single or multi probe marker), "multi" array pointer, and "multi" array data access.
It should be ordered like this :
read ptypesmp_rmb()
read multi array pointersmp_read_barrier_depends()
access data referenced by multi array pointer
The code with a single probe connected (optimized case, does not have to allocate an array) has correct memory ordering.
It applies to kernel 2.6.26.x, 2.6.25.x and linux-next.
Signed-off-by Mathieu Desnoyers <[email protected]>
CC "Paul E. McKenney" <[email protected]>
--- kernel/marker.c | 12 ++++++++++-- 1 file changed, 10 insertions(+), 2 deletions(-)
kernel/marker.c +10 -2
@@ -127,6 +127,11 @@struct marker_probe_closure *multi;int i;/* +* Read mdata->ptype before mdata->multi. +*/ +smp_rmb (); + multi = mdata->multi; +/* * multi points to an array, therefore accessing the array * depends on reading multi. However, even in this case, * we must insure that the pointer is read _before_ the array
@@ -134,7 +139,6 @@* in the fast path, so put the explicit barrier here. */ smp_read_barrier_depends (); - multi = mdata->multi;for (i =0 ; multi[i].func; i++) {va_start (args, fmt); multi[i].func(multi[i].probe_private, call_private, fmt,
@@ -177,6 +181,11 @@struct marker_probe_closure *multi;int i;/* +* Read mdata->ptype before mdata->multi. +*/ +smp_rmb (); + multi = mdata->multi; +/* * multi points to an array, therefore accessing the array * depends on reading multi. However, even in this case, * we must insure that the pointer is read _before_ the array
@@ -184,7 +193,6 @@* in the fast path, so put the explicit barrier here. */ smp_read_barrier_depends (); - multi = mdata->multi;for (i =0 ; multi[i].func; i++) multi[i].func (multi[i].probe_private, call_private, fmt, &args);
Signature · 2 lines
Mathieu Desnoyers OpenPGP key fingerprint: 8CD5 52C3 8E3C 4140 715F BA06 3F25 A8FE 3BAE 9A68