LTTng-ust 2.4.0-rc2: no events when tracing busybox
A message that is not in the archive (sent off-list or not yet received): [email protected]
----- Original Message -----
Quoted 36 lines
From: "Santiago Font" <[email protected]>
To: [email protected]
Sent: Tuesday, March 11, 2014 2:28:11 PM
Subject: [lttng-dev] LTTng-ust 2.4.0-rc2: no events when tracing busyboxHi,
I have an embedded scenario (openwrt over Freescale) working with
LTTng:lttng create TEST
lttng enable-channel MYCHAN -u --buffers-uid --subbuf-size 64k lttng add-context -u -t procname -c MYCHAN
lttng enable-event -u "*" -c MYCHAN
lttng start
/usr/sbin/sample&
lttng stop
lttng view- Several ust_baddr_statedump:soinfo events
- An example of the events I defined
(See below for details:dump_1)So far, so good.
Now, I'm trying to add my events to busybox to trace telnetd (very
same provider .c file and event definition .h file, changing only the provider name).
When I follow exactly the same steps but changing "/usr/sbin/sample
&" for "/usr/sbin/telnetd-F &", I get the ust_baddr_statedump:soinfo events, but none of my events (seedump_2)
I have tried with/withoutTRACEPOINT_PROBE_DYNAMIC_LINKAGE,
with/without LD_PRELOAD=liblttng-ust-fork.so, but not success.
Taking a look to the symbols inside the binary (dump 3), all LTTng
stuff seems to be there.
Quoted 3 lines
LTTng (modules, tools, ust): 2.4.0
Any idea?Could you share with us your patch that adds your specific tracepoints into the busybox codebase, along with the specific links/version info needed for us to see how it integrate into the busybox build system ?
Thanks,
Mathieu
Quoted 159 lines
Thank you,
Santi
-------
dump_1------------------[00:05:04.281094007] (+10.405305121) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x10000000, sopath = "/usr/sbin/sample", size = 9176, mtime = 1394554355 } [00:05:04.281173138] (+0.000079131) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48018000, sopath = "/lib/libdl-0.9.33.2.so", size = 12436, mtime = 1394229945 } [00:05:04.281214310] (+0.000041172) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4802C000, sopath = "/usr/lib/liblttng-ust.so.0.0.0", size = 224696, mtime = 1394554355 } [00:05:04.281239239] (+0.000024929) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48074000, sopath = "/lib/libgcc_s.so.1", size = 88200, mtime = 1394229944 } [00:05:04.281271259] (+0.000032020) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4809A000, sopath = "/lib/libuClibc-0.9.33.2.so", size = 326616, mtime = 1394229945 } [00:05:04.281303562] (+0.000032303) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48000000, sopath = "/lib/ld-uClibc-0.9.33.2.so", size = 29052, mtime = 1394229945 } [00:05:04.281344714] (+0.000041152) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x480FF000, sopath = "/usr/lib/liblttng-ust-tracepoint.so.0.0.0", size = 25276, mtime = 1394554355 }
[00:05:04.281376996] (+0.000032282) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4811E000, sopath = "/lib/librt-0.9.33.2.so", size = 12404, mtime = 1394229945 } [00:05:04.281416532] (+0.000039536) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48132000, sopath = "/usr/lib/liburcu-bp.so.1.0.0", size = 15388, mtime = 1394548454 } [00:05:04.281456411] (+0.000039879) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48146000, sopath = "/usr/lib/liburcu-cds.so.1.0.0", size = 18216, mtime = 1394548454 } [00:05:04.281489138] (+0.000032727) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4815B000, sopath = "/lib/libpthread-0.9.33.2.so", size = 70104, mtime = 1394229945 } [00:05:04.281529501] (+0.000040363) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4817F000, sopath = "/usr/lib/liburcu-common.so.1.0.0", size = 3188, mtime = 1394548454 } [00:05:04.282903966] (+0.001374465) OpenWrt busybox_telnetd2:info: {cpu_id= 0 }, { procname = "sample" }, { msg = "Hello World" } [00:05:04.282922512] (+0.000018546) OpenWrt busybox_telnetd2:session: {cpu_id= 0 }, { procname = "sample" }, { msg = "Session", client = "10.0.2.5", server = "10.0.2.4",session_pid= 0 } [00:05:04.282929643] (+0.000007131) OpenWrt busybox_telnetd2:err: {cpu_id= 0 }, { procname = "sample" }, { call = "arg1", msg = "arg2",errno_val= 0 }-------
dump_2------------------
[00:14:16.375740554] (+11.778441605) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x10000000, sopath = "/bin/busybox", size = 438834, mtime = 1394559555 } [00:14:16.375818817] (+0.000078263) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48018000, sopath = "/lib/libcrypt-0.9.33.2.so", size = 20724, mtime = 1394229945 } [00:14:16.375852150] (+0.000033333) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x4803F000, sopath = "/lib/libdl-0.9.33.2.so", size = 12436, mtime = 1394229945 } [00:14:16.375892474] (+0.000040324) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48053000, sopath = "/usr/lib/liblttng-ust.so.0.0.0", size = 224696, mtime = 1394554355 } [00:14:16.375941827] (+0.000049353) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x4809B000, sopath = "/lib/libm-0.9.33.2.so", size = 61540, mtime = 1394229945 } [00:14:16.375967524] (+0.000025697) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x480BB000, sopath = "/lib/libgcc_s.so.1", size = 88200, mtime = 1394229944 } [00:14:16.375999484] (+0.000031960) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x480E1000, sopath = "/lib/libuClibc-0.9.33.2.so", size = 326616, mtime = 1394229945 } [00:14:16.376031585] (+0.000032101) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48000000, sopath = "/lib/ld-uClibc-0.9.33.2.so", size = 29052, mtime = 1394229945 } [00:14:16.376072696] (+0.000041111) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48146000, sopath = "/usr/lib/liblttng-ust-tracepoint.so.0.0.0", size = 25276, mtime = 1394554355 }
[00:14:16.376104938] (+0.000032242) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48165000, sopath = "/lib/librt-0.9.33.2.so", size = 12404, mtime = 1394229945 } [00:14:16.376144635] (+0.000039697) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48179000, sopath = "/usr/lib/liburcu-bp.so.1.0.0", size = 15388, mtime = 1394548454 } [00:14:16.376184373] (+0.000039738) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x4818D000, sopath = "/usr/lib/liburcu-cds.so.1.0.0", size = 18216, mtime = 1394548454 } [00:14:16.376217363] (+0.000032990) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x481A2000, sopath = "/lib/libpthread-0.9.33.2.so", size = 70104, mtime = 1394229945 } [00:14:16.376257908] (+0.000040545) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x481C6000, sopath = "/usr/lib/liburcu-common.so.1.0.0", size = 3188, mtime = 1394548454 }----- dump 3 ------------
nm ipkg-install/bin/busybox | grep 'tracepoint\|busybox_telnetd\|lttng'
1007b124d__event_desc___busybox_telnetd1005f7d0R__event_desc___busybox_telnetd_err1005fee4R__event_desc___busybox_telnetd_info1005fea4R__event_desc___busybox_telnetd_session1005f998r__event_fields___busybox_telnetd___err1005f868r__event_fields___busybox_telnetd___info1005ff24r__event_fields___busybox_telnetd___session10016624 t__event_probe__busybox_telnetd___err100164a4t__event_probe__busybox_telnetd___info10016878 t__event_probe__busybox_telnetd___session1007b134d_format___busybox_telnetd___err1007b130d_format___busybox_telnetd___info1007b138d_format___busybox_telnetd___session
w_loglevel___busybox_telnetd___err
w_loglevel___busybox_telnetd___info
w_loglevel___busybox_telnetd___session10016ca0t__lttng_events_exit__busybox_telnetd10016c3ct__lttng_events_init__busybox_telnetd
Ulttng_probe_register
Ulttng_probe_unregister
w_model_emf_uri___busybox_telnetd___errw_model_emf_uri___busybox_telnetd___infow_model_emf_uri___busybox_telnetd___session1007b13cd__probe_desc___busybox_telnetd1007c228b__probe_register_refcount___busybox_telnetd1007b1ecA__start___tracepoints_ptrs1007b1f8A__stop___tracepoints_ptrs1005fe70R__tp_event_signature___busybox_telnetd___err1005f858R__tp_event_signature___busybox_telnetd___info1005f810R__tp_event_signature___busybox_telnetd___session1006ac80r__tp_strtab_busybox_telnetd___err1006ac94r__tp_strtab_busybox_telnetd___info1006ac68r__tp_strtab_busybox_telnetd___session1007b180D__tracepoint_busybox_telnetd___err1007b1c8D__tracepoint_busybox_telnetd___info1007b1a4D__tracepoint_busybox_telnetd___session1007c210Vtracepoint_dlopen100155e8t__tracepoint__init_urcu_sym1007b250S__tracepoint_provider_busybox_telnetd1007b1f0d__tracepoint_ptr_busybox_telnetd___err1007b1f4d__tracepoint_ptr_busybox_telnetd___info1007b1ecd__tracepoint_ptr_busybox_telnetd___session1007b248V__tracepoint_ptrs_registered1007b24cV__tracepoint_registered
10015708 t__tracepoints__destroy10016ba4t__tracepoints__destroy
10015684 t__tracepoints__init10016ac4t__tracepoints__init
10015868 t__tracepoints__ptrs_destroy100157a0t__tracepoints__ptrs_init_______________________________________________
lttng-dev mailing list
[email protected]
http://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev
Signature · 3 lines
Mathieu Desnoyers EfficiOS Inc. http://www.efficios.com
A message that is not in the archive (sent off-list or not yet received): [email protected]
Hi,
As I mentioned, I'm building OpenWRT, therefore, part of the
integration of LTTng into Busybox is managed at OpenWRT package level, but it is also true that you only need to add the dependency on lttng-ust (Makefile.patch and Makefile, where you can see the Busybox version being used). Adding the dependency directly into Busybox build system should be easy too.
Regarding the patch to add tracepoints to Busybox codebase, it is
an addition to the patches applied by OpenWRT (new patch 904-telnetd_lttng_events.patch), but no black magic there neither:
- add a couple of new files for LTTng tracepoints
definition/declaration: networking/telnetd_lttng_events.c and networking/telnetd_lttng_events.h
- add tracepoints calls to telnetd.c
- add tracepoint provider to telnetd built: (Kbuild.src:
lib-$(CONFIG_TELNETD) += telnetd.o telnetd_lttng_events.o)
And that's all. If this is not the info you are asking for, let me
know.
Thanks,
Santi
Quoted 39 lines · Mathieu Desnoyers
----- Original Message -----
Quoted 38 lines
From: "Santiago Font" <[email protected]>
To: [email protected]
Sent: Tuesday, March 11, 2014 2:28:11 PM
Subject: [lttng-dev] LTTng-ust 2.4.0-rc2: no events when tracing busyboxHi,
I have an embedded scenario (openwrt over Freescale) working with
LTTng:lttng create TEST
lttng enable-channel MYCHAN -u --buffers-uid --subbuf-size 64k lttng add-context -u -t procname -c MYCHAN
lttng enable-event -u "*" -c MYCHAN
lttng start
/usr/sbin/sample&
lttng stop
lttng view- Several ust_baddr_statedump:soinfo events
- An example of the events I defined
(See below for details:dump_1)So far, so good.
Now, I'm trying to add my events to busybox to trace telnetd (very
same provider .c file and event definition .h file, changing only the provider name).
When I follow exactly the same steps but changing "/usr/sbin/sample
&" for "/usr/sbin/telnetd-F &", I get the ust_baddr_statedump:soinfo events, but none of my events (seedump_2)
I have tried with/withoutTRACEPOINT_PROBE_DYNAMIC_LINKAGE,
with/without LD_PRELOAD=liblttng-ust-fork.so, but not success.
Taking a look to the symbols inside the binary (dump 3), all LTTng
stuff seems to be there.LTTng (modules, tools, ust): 2.4.0
Quoted 168 lines
Quoted 1 line
Any idea?
Could you share with us your patch that adds your specific tracepoints into the busybox codebase, along with the specific links/version info needed for us to see how it integrate into the busybox build system ?
Thanks,
Mathieu
Quoted 159 lines
Thank you,
Santi
-------
dump_1------------------[00:05:04.281094007] (+10.405305121) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x10000000, sopath = "/usr/sbin/sample", size = 9176, mtime = 1394554355 } [00:05:04.281173138] (+0.000079131) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48018000, sopath = "/lib/libdl-0.9.33.2.so", size = 12436, mtime = 1394229945 } [00:05:04.281214310] (+0.000041172) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4802C000, sopath = "/usr/lib/liblttng-ust.so.0.0.0", size = 224696, mtime = 1394554355 } [00:05:04.281239239] (+0.000024929) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48074000, sopath = "/lib/libgcc_s.so.1", size = 88200, mtime = 1394229944 } [00:05:04.281271259] (+0.000032020) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4809A000, sopath = "/lib/libuClibc-0.9.33.2.so", size = 326616, mtime = 1394229945 } [00:05:04.281303562] (+0.000032303) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48000000, sopath = "/lib/ld-uClibc-0.9.33.2.so", size = 29052, mtime = 1394229945 } [00:05:04.281344714] (+0.000041152) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x480FF000, sopath = "/usr/lib/liblttng-ust-tracepoint.so.0.0.0", size = 25276, mtime = 1394554355 }
[00:05:04.281376996] (+0.000032282) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4811E000, sopath = "/lib/librt-0.9.33.2.so", size = 12404, mtime = 1394229945 } [00:05:04.281416532] (+0.000039536) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48132000, sopath = "/usr/lib/liburcu-bp.so.1.0.0", size = 15388, mtime = 1394548454 } [00:05:04.281456411] (+0.000039879) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48146000, sopath = "/usr/lib/liburcu-cds.so.1.0.0", size = 18216, mtime = 1394548454 } [00:05:04.281489138] (+0.000032727) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4815B000, sopath = "/lib/libpthread-0.9.33.2.so", size = 70104, mtime = 1394229945 } [00:05:04.281529501] (+0.000040363) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4817F000, sopath = "/usr/lib/liburcu-common.so.1.0.0", size = 3188, mtime = 1394548454 } [00:05:04.282903966] (+0.001374465) OpenWrt busybox_telnetd2:info: {cpu_id= 0 }, { procname = "sample" }, { msg = "Hello World" } [00:05:04.282922512] (+0.000018546) OpenWrt busybox_telnetd2:session: {cpu_id= 0 }, { procname = "sample" }, { msg = "Session", client = "10.0.2.5", server = "10.0.2.4",session_pid= 0 } [00:05:04.282929643] (+0.000007131) OpenWrt busybox_telnetd2:err: {cpu_id= 0 }, { procname = "sample" }, { call = "arg1", msg = "arg2",errno_val= 0 }-------
dump_2------------------
[00:14:16.375740554] (+11.778441605) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x10000000, sopath = "/bin/busybox", size = 438834, mtime = 1394559555 } [00:14:16.375818817] (+0.000078263) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48018000, sopath = "/lib/libcrypt-0.9.33.2.so", size = 20724, mtime = 1394229945 } [00:14:16.375852150] (+0.000033333) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x4803F000, sopath = "/lib/libdl-0.9.33.2.so", size = 12436, mtime = 1394229945 } [00:14:16.375892474] (+0.000040324) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48053000, sopath = "/usr/lib/liblttng-ust.so.0.0.0", size = 224696, mtime = 1394554355 } [00:14:16.375941827] (+0.000049353) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x4809B000, sopath = "/lib/libm-0.9.33.2.so", size = 61540, mtime = 1394229945 } [00:14:16.375967524] (+0.000025697) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x480BB000, sopath = "/lib/libgcc_s.so.1", size = 88200, mtime = 1394229944 } [00:14:16.375999484] (+0.000031960) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x480E1000, sopath = "/lib/libuClibc-0.9.33.2.so", size = 326616, mtime = 1394229945 } [00:14:16.376031585] (+0.000032101) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48000000, sopath = "/lib/ld-uClibc-0.9.33.2.so", size = 29052, mtime = 1394229945 } [00:14:16.376072696] (+0.000041111) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48146000, sopath = "/usr/lib/liblttng-ust-tracepoint.so.0.0.0", size = 25276, mtime = 1394554355 }
[00:14:16.376104938] (+0.000032242) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48165000, sopath = "/lib/librt-0.9.33.2.so", size = 12404, mtime = 1394229945 } [00:14:16.376144635] (+0.000039697) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48179000, sopath = "/usr/lib/liburcu-bp.so.1.0.0", size = 15388, mtime = 1394548454 } [00:14:16.376184373] (+0.000039738) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x4818D000, sopath = "/usr/lib/liburcu-cds.so.1.0.0", size = 18216, mtime = 1394548454 } [00:14:16.376217363] (+0.000032990) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x481A2000, sopath = "/lib/libpthread-0.9.33.2.so", size = 70104, mtime = 1394229945 } [00:14:16.376257908] (+0.000040545) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x481C6000, sopath = "/usr/lib/liburcu-common.so.1.0.0", size = 3188, mtime = 1394548454 }----- dump 3 ------------
nm ipkg-install/bin/busybox | grep 'tracepoint\|busybox_telnetd\|lttng'
1007b124d__event_desc___busybox_telnetd1005f7d0R__event_desc___busybox_telnetd_err1005fee4R__event_desc___busybox_telnetd_info1005fea4R__event_desc___busybox_telnetd_session1005f998r__event_fields___busybox_telnetd___err1005f868r__event_fields___busybox_telnetd___info1005ff24r__event_fields___busybox_telnetd___session10016624 t__event_probe__busybox_telnetd___err100164a4t__event_probe__busybox_telnetd___info10016878 t__event_probe__busybox_telnetd___session1007b134d_format___busybox_telnetd___err1007b130d_format___busybox_telnetd___info1007b138d_format___busybox_telnetd___session
w_loglevel___busybox_telnetd___err
w_loglevel___busybox_telnetd___info
w_loglevel___busybox_telnetd___session10016ca0t__lttng_events_exit__busybox_telnetd10016c3ct__lttng_events_init__busybox_telnetd
Ulttng_probe_register
Ulttng_probe_unregister
w_model_emf_uri___busybox_telnetd___errw_model_emf_uri___busybox_telnetd___infow_model_emf_uri___busybox_telnetd___session1007b13cd__probe_desc___busybox_telnetd1007c228b__probe_register_refcount___busybox_telnetd1007b1ecA__start___tracepoints_ptrs1007b1f8A__stop___tracepoints_ptrs1005fe70R__tp_event_signature___busybox_telnetd___err1005f858R__tp_event_signature___busybox_telnetd___info1005f810R__tp_event_signature___busybox_telnetd___session1006ac80r__tp_strtab_busybox_telnetd___err1006ac94r__tp_strtab_busybox_telnetd___info1006ac68r__tp_strtab_busybox_telnetd___session1007b180D__tracepoint_busybox_telnetd___err1007b1c8D__tracepoint_busybox_telnetd___info1007b1a4D__tracepoint_busybox_telnetd___session1007c210Vtracepoint_dlopen100155e8t__tracepoint__init_urcu_sym1007b250S__tracepoint_provider_busybox_telnetd1007b1f0d__tracepoint_ptr_busybox_telnetd___err1007b1f4d__tracepoint_ptr_busybox_telnetd___info1007b1ecd__tracepoint_ptr_busybox_telnetd___session1007b248V__tracepoint_ptrs_registered1007b24cV__tracepoint_registered
10015708 t__tracepoints__destroy10016ba4t__tracepoints__destroy
10015684 t__tracepoints__init10016ac4t__tracepoints__init
10015868 t__tracepoints__ptrs_destroy100157a0t__tracepoints__ptrs_init_______________________________________________
lttng-dev mailing list
[email protected]
http://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev
package/utils/busybox/Makefile +7 -1
@@ -46,7 +46,7 @@ define Package/busybox MAINTAINER:=Nicolas Thill <[email protected]> TITLE:=Core utilities for embedded Linux URL:=http://busybox.net/ - DEPENDS:=+BUSYBOX_CONFIG_FEATURE_HAVE_RPC:librpc + DEPENDS:=+BUSYBOX_CONFIG_FEATURE_HAVE_RPC:librpc +lttng-ust MENU:=1 endef
@@ -76,12 +76,18 @@ ifdef CONFIG_GCC_VERSION_LLVM endif LDLIBS:=m crypt + ifdef CONFIG_BUSYBOX_CONFIG_FEATURE_HAVE_RPC TARGET_CFLAGS += -I$(STAGING_DIR)/usr/include export LDFLAGS=$(TARGET_LDFLAGS) LDLIBS += rpc endif +ifdef CONFIG_PACKAGE_lttng-ust + TARGET_CFLAGS += -I. + LDLIBS += lttng-ust dl +endif + define Build/Compile +$(MAKE) $(PKG_JOBS) -C $(PKG_BUILD_DIR) \ CC="$(TARGET_CC)" \
#
# Copyright (C) 2006-2013 OpenWrt.org
#
# This is free software, licensed under the GNU General Public License v2. # See /LICENSE for more information.
#
include $(TOPDIR)/rules.mk
PKG_NAME:=busybox
PKG_VERSION:=1.19.4
PKG_RELEASE:=7
PKG_FLAGS:=essential
PKG_SOURCE:=$(PKG_NAME)-$(PKG_VERSION).tar.bz2 PKG_SOURCE_URL:=http://www.busybox.net/downloads \
http://distfiles.gentoo.org/distfiles/
PKG_MD5SUM:=9c0cae5a0379228e7b55e5b29528df8e
PKG_BUILD_DEPENDS:=BUSYBOX_CONFIG_FEATURE_HAVE_RPC:librpc PKG_BUILD_PARALLEL:=1
PKG_LICENSE:=GPLv2 BSD-4c PKG_LICENSE_FILES:=LICENSE archival/libarchive/bz/LICENSE
include $(INCLUDE_DIR)/package.mk
ifeq ($(DUMP),)
STAMP_CONFIGURED:=$(strip $(STAMP_CONFIGURED))_$(shell $(SH_FUNC) grep '^CONFIG_BUSYBOX_' $(TOPDIR)/.config | md5s)
endif
ifneq ($(findstring c,$(OPENWRT_VERBOSE)),)
BB_MAKE_VERBOSE := V=1
else
BB_MAKE_VERBOSE :=
endif
init-y :=
init-$(CONFIG_BUSYBOX_CONFIG_CROND) += cron
init-$(CONFIG_BUSYBOX_CONFIG_NTPD) += sysntpd
init-$(CONFIG_BUSYBOX_CONFIG_TELNETD) += telnet
define Package/busybox
SECTION:=base
CATEGORY:=Base system
MAINTAINER:=Nicolas Thill <[email protected]> TITLE:=Core utilities for embedded Linux URL:=http://busybox.net/ DEPENDS:=+BUSYBOX_CONFIG_FEATURE_HAVE_RPC:librpc +lttng-ust MENU:=1
endef
define Package/busybox/description
The Swiss Army Knife of embedded Linux.
It slices, it dices, it makes Julian Fries.
endef
define Package/busybox/config
source "$(SOURCE)/Config.in"
endef
define Build/Configure
rm -f $(PKG_BUILD_DIR)/.configured* grep 'CONFIG_BUSYBOX_' $(TOPDIR)/.config | sed -e "s,\\(# \)\\?CONFIG_BUSYBOX_\\(.*\\),\\1\\2,g" > $(PKG_BUILD_DIR)/.config yes 'n' | $(MAKE) -C $(PKG_BUILD_DIR) \ CC="$(TARGET_CC)" \ CROSS_COMPILE="$(TARGET_CROSS)" \ KBUILD_HAVE_NLS=no \ ARCH="$(ARCH)" \ $(BB_MAKE_VERBOSE) \ oldconfig
endef
ifdef CONFIG_GCC_VERSION_LLVM
TARGET_CFLAGS += -fnested-functions
endif
LDLIBS:=m crypt
ifdef CONFIG_BUSYBOX_CONFIG_FEATURE_HAVE_RPC
TARGET_CFLAGS += -I$(STAGING_DIR)/usr/include
export LDFLAGS=$(TARGET_LDFLAGS)
LDLIBS += rpc
endif
ifdef CONFIG_PACKAGE_lttng-ust
TARGET_CFLAGS += -I.
LDLIBS += lttng-ust dl
endif
define Build/Compile
+$(MAKE) $(PKG_JOBS) -C $(PKG_BUILD_DIR) \
CC="$(TARGET_CC)" \
CROSS_COMPILE="$(TARGET_CROSS)" \
KBUILD_HAVE_NLS=no \
EXTRA_CFLAGS="$(TARGET_CFLAGS)" \
ARCH="$(ARCH)" \
SKIP_STRIP=y \
LDLIBS="$(LDLIBS)" \
$(BB_MAKE_VERBOSE) \
all
rm -rf $(PKG_INSTALL_DIR)
$(FIND) $(PKG_BUILD_DIR) -lname "*busybox" -exec rm \{\} \;
$(MAKE) -C $(PKG_BUILD_DIR) \
CC="$(TARGET_CC)" \
CROSS_COMPILE="$(TARGET_CROSS)" \
EXTRA_CFLAGS="$(TARGET_CFLAGS)" \
ARCH="$(ARCH)" \
CONFIG_PREFIX="$(PKG_INSTALL_DIR)" \
LDLIBS="$(LDLIBS)" \
$(BB_MAKE_VERBOSE) \
installendef
define Package/busybox/install
$(INSTALL_DIR) $(1)/etc/init.d $(CP) $(PKG_INSTALL_DIR)/* $(1)/ for tmp in $(init-y); do \ $(INSTALL_BIN) ./files/$$$$tmp $(1)/etc/init.d/$$$$tmp; \ done -rm -rf $(1)/lib64
endef
$(eval $(call BuildPackage,busybox))
networking/Kbuild.src +1 -1
@@ -36,7 +36,7 @@ lib-$(CONFIG_SLATTACH) += slattach.o lib-$(CONFIG_TC) += tc.o lib-$(CONFIG_TELNET) += telnet.o -lib-$(CONFIG_TELNETD) += telnetd.o +lib-$(CONFIG_TELNETD) += telnetd.o telnetd_lttng_events.o lib-$(CONFIG_TFTP) += tftp.o lib-$(CONFIG_TFTPD) += tftp.o lib-$(CONFIG_TRACEROUTE) += traceroute.o
networking/telnetd.c +36 -1
@@ -45,6 +45,8 @@#include "libbb.h" #include <syslog.h> +#define TRACEPOINT_DEFINE +#include "telnetd_lttng_events.h" #if DEBUG # define TELCMDS
@@ -68,6 +70,10 @@#define TS_BUF2 (ts) (((unsigned char*)(ts + 1)) + BUFSIZE)int rdidx1, wridx1, size1;int rdidx2, wridx2, size2; +struct { +char *client; +char *server; + } tp; };/* Two buffers are directly after tsession in malloced memory.
@@ -252,6 +258,11 @@char tty_name[GETPTY_BUFSIZE ];struct tsession *ts =xzalloc (sizeof (struct tsession ) +BUFSIZE *2 ); +if (!ts) { +tracepoint (busybox_telnetd, err,"xzalloc" ,"struct tsession" , errno); +return 0 ; + } +/*ts->buf1 = (char *)(ts + 1);*/ /*ts->buf2 = ts->buf1 + BUFSIZE;*/
@@ -317,6 +328,7 @@close (fd);/* sock will be closed by caller */ bb_perror_msg ("vfork" ); +tracepoint (busybox_telnetd, err,"vfork" ,"session" , errno);return NULL ; }if (pid >0 ) {
@@ -344,7 +356,22 @@write_new_utmp (pid,LOGIN_PROCESS , tty_name,/*username:*/ "LOGIN" , hostname);free (hostname); } - + +//if (tracepoint_enabled(busybox_telnetd, session)) +if (1 ) + { +len_and_sockaddr *client_lsa =get_peer_lsa (sock); +len_and_sockaddr *server_lsa =get_sock_lsa (sock); +if (client_lsa) { + ts->tp.client =xmalloc_sockaddr2dotted (&client_lsa->u.sa); +free (client_lsa); + } +if (server_lsa) { + ts->tp.server =xmalloc_sockaddr2dotted (&server_lsa->u.sa); +free (server_lsa); + } +tracepoint (busybox_telnetd, session,"new" , ts->tp.client, ts->tp.server, pid); + }/* Make new session and process group */ setsid ();
@@ -384,6 +411,7 @@* fd has CLOEXEC set on it too. These two fds will be closed here. */ BB_EXECVP (G .loginpath, (char **)login_argv); +tracepoint (busybox_telnetd, err,"execv" ,G .loginpath, errno);/* _exit is safer with vfork, and we shouldn't send message * to remote clients anyway */ _exit (EXIT_FAILURE );/*bb_perror_msg_and_die("execv %s", G.loginpath);*/
@@ -421,6 +449,8 @@/* We do not need to close(ts->sockfd_write), it's the same * as sockfd_read unless we are in inetd mode. But in inetd mode * we do not reach this */ +if (ts->tp.client)free (ts->tp.client); +if (ts->tp.server)free (ts->tp.server);free (ts);/* Scan all sessions and find new maxfd */
@@ -462,6 +492,7 @@while (ts) {if (ts->shell_pid == pid) { ts->shell_pid =-1 ; +tracepoint (busybox_telnetd, session,"dead" , ts->tp.client, ts->tp.server, pid);// man utmp: // When init(8) finds that a process has exited, it locates its utmp entry // by ut_pid, sets ut_type to DEAD_PROCESS, and clears ut_user, ut_host
@@ -501,6 +532,8 @@#endif INIT_G (); +tracepoint (busybox_telnetd, info,"Start" ); +/* -w NUM, and implies -F. -w and -i don't mix */ IF_FEATURE_TELNETD_INETD_WAIT(opt_complementary = "wF:w+:i--w:w--i";)/* Even if !STANDALONE, we accept (and ignore) -i, thus people
@@ -513,6 +546,7 @@ IF_FEATURE_TELNETD_INETD_WAIT(, &sec_linger) );if (!IS_INETD /*&& !re_execed*/ ) { +tracepoint (busybox_telnetd, info,"Standalone mode enabled" );/* inform that we start in standalone mode? * May be useful when people forget to give -i */ /*bb_error_msg("listening for connections");*/
@@ -524,6 +558,7 @@ }/* Redirect log to syslog early, if needed */ if (IS_INETD || (opt &OPT_SYSLOG ) || !(opt &OPT_FOREGROUND )) { +tracepoint (busybox_telnetd, info,"Syslog redirection enabled" );openlog (applet_name,LOG_PID ,LOG_DAEMON ); logmode =LOGMODE_SYSLOG ; }
networking/telnetd_lttng_events.h renamed from dev/null +59 -0
59 lines not on this page · raw message
networking/telnetd_lttng_events.c renamed from dev/null +2 -0
@@ -0,0 +1,2 @@ +#define TRACEPOINT_CREATE_PROBES +#include "telnetd_lttng_events.h"
_______________________________________________
lttng-dev mailing list
[email protected]
http://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev
A message that is not in the archive (sent off-list or not yet received): [email protected]
----- Original Message -----
Quoted 24 lines
From: "Santiago Font" <[email protected]>
To: "Mathieu Desnoyers" <[email protected]>
Cc: [email protected]
Sent: Tuesday, March 11, 2014 6:12:10 PM
Subject: Re: [lttng-dev] LTTng-ust 2.4.0-rc2: no events when tracing busyboxHi,
As I mentioned, I'm building OpenWRT, therefore, part of the
integration of LTTng into Busybox is managed at OpenWRT package level, but it is also true that you only need to add the dependency on lttng-ust (Makefile.patch andMakefile, where you can see the Busybox version being used). Adding the dependency directly into Busybox build system should be easy too.
Regarding the patch to add tracepoints to Busybox codebase, it is
an addition to the patches applied by OpenWRT (new patch 904-telnetd_lttng_events.patch), but no black magic there neither:
- add a couple of new files for LTTng tracepoints
definition/declaration:networking/telnetd_lttng_events.candnetworking/telnetd_lttng_events.h
- add tracepoints calls totelnetd.c
- add tracepoint provider to telnetd built: (Kbuild.src:
lib-$(CONFIG_TELNETD) += telnetd.o telnetd_lttng_events.o)
Quoted 2 lines
And that's all. If this is not the info you are asking for, let me
know.
Can you provide the log when doing this:
LTTNG_UST_DEBUG=1 /usr/sbin/telnetd -F
Thanks,
Mathieu
Quoted 214 lines
Thanks,
Santi
Quoted 207 lines · Mathieu Desnoyers
----- Original Message -----
Quoted 36 lines
From: "Santiago Font" <[email protected]>
To: [email protected]
Sent: Tuesday, March 11, 2014 2:28:11 PM
Subject: [lttng-dev] LTTng-ust 2.4.0-rc2: no events when tracing busyboxHi,
I have an embedded scenario (openwrt over Freescale) working with
LTTng:lttng create TEST
lttng enable-channel MYCHAN -u --buffers-uid --subbuf-size 64k lttng add-context -u -t procname -c MYCHAN
lttng enable-event -u "*" -c MYCHAN
lttng start
/usr/sbin/sample&
lttng stop
lttng view- Several ust_baddr_statedump:soinfo events
- An example of the events I defined
(See below for details:dump_1)So far, so good.
Now, I'm trying to add my events to busybox to trace telnetd (very
same provider .c file and event definition .h file, changing only the provider name).
When I follow exactly the same steps but changing "/usr/sbin/sample
&" for "/usr/sbin/telnetd-F &", I get the ust_baddr_statedump:soinfo events, but none of my events (seedump_2)
I have tried with/withoutTRACEPOINT_PROBE_DYNAMIC_LINKAGE,
with/without LD_PRELOAD=liblttng-ust-fork.so, but not success.
Taking a look to the symbols inside the binary (dump 3), all LTTng
stuff seems to be there.Quoted 3 lines
LTTng (modules, tools, ust): 2.4.0 Any idea?Could you share with us your patch that adds your specific tracepoints into the busybox codebase, along with the specific links/version info needed for us to see how it integrate into the busybox build system ?
Thanks,
Mathieu
Quoted 159 lines
Thank you,
Santi
-------
dump_1------------------[00:05:04.281094007] (+10.405305121) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x10000000, sopath = "/usr/sbin/sample", size = 9176, mtime = 1394554355 } [00:05:04.281173138] (+0.000079131) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48018000, sopath = "/lib/libdl-0.9.33.2.so", size = 12436, mtime = 1394229945 } [00:05:04.281214310] (+0.000041172) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4802C000, sopath = "/usr/lib/liblttng-ust.so.0.0.0", size = 224696, mtime = 1394554355 } [00:05:04.281239239] (+0.000024929) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48074000, sopath = "/lib/libgcc_s.so.1", size = 88200, mtime = 1394229944 } [00:05:04.281271259] (+0.000032020) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4809A000, sopath = "/lib/libuClibc-0.9.33.2.so", size = 326616, mtime = 1394229945 } [00:05:04.281303562] (+0.000032303) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48000000, sopath = "/lib/ld-uClibc-0.9.33.2.so", size = 29052, mtime = 1394229945 } [00:05:04.281344714] (+0.000041152) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x480FF000, sopath = "/usr/lib/liblttng-ust-tracepoint.so.0.0.0", size = 25276, mtime = 1394554355 }
[00:05:04.281376996] (+0.000032282) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4811E000, sopath = "/lib/librt-0.9.33.2.so", size = 12404, mtime = 1394229945 } [00:05:04.281416532] (+0.000039536) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48132000, sopath = "/usr/lib/liburcu-bp.so.1.0.0", size = 15388, mtime = 1394548454 } [00:05:04.281456411] (+0.000039879) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48146000, sopath = "/usr/lib/liburcu-cds.so.1.0.0", size = 18216, mtime = 1394548454 } [00:05:04.281489138] (+0.000032727) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4815B000, sopath = "/lib/libpthread-0.9.33.2.so", size = 70104, mtime = 1394229945 } [00:05:04.281529501] (+0.000040363) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4817F000, sopath = "/usr/lib/liburcu-common.so.1.0.0", size = 3188, mtime = 1394548454 } [00:05:04.282903966] (+0.001374465) OpenWrt busybox_telnetd2:info: {cpu_id= 0 }, { procname = "sample" }, { msg = "Hello World" } [00:05:04.282922512] (+0.000018546) OpenWrt busybox_telnetd2:session: {cpu_id= 0 }, { procname = "sample" }, { msg = "Session", client = "10.0.2.5", server = "10.0.2.4",session_pid= 0 } [00:05:04.282929643] (+0.000007131) OpenWrt busybox_telnetd2:err: {cpu_id= 0 }, { procname = "sample" }, { call = "arg1", msg = "arg2",errno_val= 0 }-------
dump_2------------------
[00:14:16.375740554] (+11.778441605) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x10000000, sopath = "/bin/busybox", size = 438834, mtime = 1394559555 } [00:14:16.375818817] (+0.000078263) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48018000, sopath = "/lib/libcrypt-0.9.33.2.so", size = 20724, mtime = 1394229945 } [00:14:16.375852150] (+0.000033333) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x4803F000, sopath = "/lib/libdl-0.9.33.2.so", size = 12436, mtime = 1394229945 } [00:14:16.375892474] (+0.000040324) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48053000, sopath = "/usr/lib/liblttng-ust.so.0.0.0", size = 224696, mtime = 1394554355 } [00:14:16.375941827] (+0.000049353) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x4809B000, sopath = "/lib/libm-0.9.33.2.so", size = 61540, mtime = 1394229945 } [00:14:16.375967524] (+0.000025697) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x480BB000, sopath = "/lib/libgcc_s.so.1", size = 88200, mtime = 1394229944 } [00:14:16.375999484] (+0.000031960) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x480E1000, sopath = "/lib/libuClibc-0.9.33.2.so", size = 326616, mtime = 1394229945 } [00:14:16.376031585] (+0.000032101) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48000000, sopath = "/lib/ld-uClibc-0.9.33.2.so", size = 29052, mtime = 1394229945 } [00:14:16.376072696] (+0.000041111) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48146000, sopath = "/usr/lib/liblttng-ust-tracepoint.so.0.0.0", size = 25276, mtime = 1394554355 }
[00:14:16.376104938] (+0.000032242) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48165000, sopath = "/lib/librt-0.9.33.2.so", size = 12404, mtime = 1394229945 } [00:14:16.376144635] (+0.000039697) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48179000, sopath = "/usr/lib/liburcu-bp.so.1.0.0", size = 15388, mtime = 1394548454 } [00:14:16.376184373] (+0.000039738) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x4818D000, sopath = "/usr/lib/liburcu-cds.so.1.0.0", size = 18216, mtime = 1394548454 } [00:14:16.376217363] (+0.000032990) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x481A2000, sopath = "/lib/libpthread-0.9.33.2.so", size = 70104, mtime = 1394229945 } [00:14:16.376257908] (+0.000040545) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x481C6000, sopath = "/usr/lib/liburcu-common.so.1.0.0", size = 3188, mtime = 1394548454 }----- dump 3 ------------
nm ipkg-install/bin/busybox | grep 'tracepoint\|busybox_telnetd\|lttng'
1007b124d__event_desc___busybox_telnetd1005f7d0R__event_desc___busybox_telnetd_err1005fee4R__event_desc___busybox_telnetd_info1005fea4R__event_desc___busybox_telnetd_session1005f998r__event_fields___busybox_telnetd___err1005f868r__event_fields___busybox_telnetd___info1005ff24r__event_fields___busybox_telnetd___session10016624 t__event_probe__busybox_telnetd___err100164a4t__event_probe__busybox_telnetd___info10016878 t__event_probe__busybox_telnetd___session1007b134d_format___busybox_telnetd___err1007b130d_format___busybox_telnetd___info1007b138d_format___busybox_telnetd___session
w_loglevel___busybox_telnetd___err
w_loglevel___busybox_telnetd___info
w_loglevel___busybox_telnetd___session10016ca0t__lttng_events_exit__busybox_telnetd10016c3ct__lttng_events_init__busybox_telnetd
Ulttng_probe_register
Ulttng_probe_unregister
w_model_emf_uri___busybox_telnetd___errw_model_emf_uri___busybox_telnetd___infow_model_emf_uri___busybox_telnetd___session1007b13cd__probe_desc___busybox_telnetd1007c228b__probe_register_refcount___busybox_telnetd1007b1ecA__start___tracepoints_ptrs1007b1f8A__stop___tracepoints_ptrs1005fe70R__tp_event_signature___busybox_telnetd___err1005f858R__tp_event_signature___busybox_telnetd___info1005f810R__tp_event_signature___busybox_telnetd___session1006ac80r__tp_strtab_busybox_telnetd___err1006ac94r__tp_strtab_busybox_telnetd___info1006ac68r__tp_strtab_busybox_telnetd___session1007b180D__tracepoint_busybox_telnetd___err1007b1c8D__tracepoint_busybox_telnetd___info1007b1a4D__tracepoint_busybox_telnetd___session1007c210Vtracepoint_dlopen100155e8t__tracepoint__init_urcu_sym1007b250S__tracepoint_provider_busybox_telnetd1007b1f0d__tracepoint_ptr_busybox_telnetd___err1007b1f4d__tracepoint_ptr_busybox_telnetd___info1007b1ecd__tracepoint_ptr_busybox_telnetd___session1007b248V__tracepoint_ptrs_registered1007b24cV__tracepoint_registered
10015708 t__tracepoints__destroy10016ba4t__tracepoints__destroy
10015684 t__tracepoints__init10016ac4t__tracepoints__init
10015868 t__tracepoints__ptrs_destroy100157a0t__tracepoints__ptrs_init_______________________________________________
lttng-dev mailing list
[email protected]
http://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev
Signature · 3 lines
Mathieu Desnoyers EfficiOS Inc. http://www.efficios.com
A message that is not in the archive (sent off-list or not yet received): [email protected]
Hi,
Meanwhile, I've tried also the "demo" example (dynamic linkage) and
discovered LDSO support was not enabled in my uClibc; after enabling it, "demo" is working as expected, but it makes no difference in busybox tracing issue.
Here it goes:
root@OpenWrt:/# lttng create TEST root@OpenWrt:/# lttng enable-channel MYCHAN -u --buffers-uid --subbuf-size 64k root@OpenWrt:/# lttng add-context -u -t procname -c MYCHAN root@OpenWrt:/# lttng enable-event -u -a -c MYCHAN root@OpenWrt:/# lttng start
Session TEST created.
Traces will be written in /root/lttng-traces/TEST-19700101-000126
Warning: No tracing group detected
UST channel MYCHAN enabled for session TEST
UST context procname added to channel MYCHAN
All UST events are enabled in channel MYCHAN
Tracing started for session TEST
root@OpenWrt:/# LTTNG_UST_DEBUG=1 /usr/sbin/telnetd -F
liblttng_ust_tracepoint[1806/1806]: just registered a tracepoints section from 0x48099d94 and having 1 tracepoints (in tracepoint_register_lib() at tracepoint.c:758) liblttng_ust_tracepoint[1806/1806]: registered tracepoint: ust_baddr_statedump:soinfo (in tracepoint_register_lib() at tracepoint.c:763) libust[1806/1806]: LTT : ltt ring buffer client "relay-metadata-mmap" init
(in lttng_ring_buffer_metadata_client_init() at
lttng-ring-buffer-metadata-client.h:330)
libust[1806/1806]: LTT : ltt ring buffer client "relay-overwrite-mmap" init
(in lttng_ring_buffer_client_overwrite_init() at
lttng-ring-buffer-client.h:670)
libust[1806/1806]: LTT : ltt ring buffer client "relay-overwrite-rt-mmap" init
(in lttng_ring_buffer_client_overwrite_rt_init() at
lttng-ring-buffer-client.h:670)
libust[1806/1806]: LTT : ltt ring buffer client "relay-discard-mmap" init
(in lttng_ring_buffer_client_discard_init() at
lttng-ring-buffer-client.h:670)
libust[1806/1806]: LTT : ltt ring buffer client "relay-discard-rt-mmap" init
(in lttng_ring_buffer_client_discard_rt_init() at
lttng-ring-buffer-client.h:670)
libust[1806/1808]: Info: sessiond not accepting connections to local apps socket (in ust_listener_thread() at lttng-ust-comm.c:1130) libust[1806/1808]: Waiting for local apps sessiond (in wait_for_sessiond() at lttng-ust-comm.c:1041)
libust[1806/1807]: Message Received "Get Tracer Version" (65), Handle "root" (0) (in print_cmd() at lttng-ust-comm.c:287) libust[1806/1807]: Return value: 0 (in handle_message() at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (in send_reply() at lttng-ust-comm.c:402)
libust[1806/1807]: Message Received "Create Session" (64), Handle "root" (0) (in print_cmd() at lttng-ust-comm.c:287)
libust[1806/1807]: Return value: 1 (in handle_message() at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (in send_reply() at lttng-ust-comm.c:402)
libust[1806/1807]: Message Received "Create Channel" (81), Handle "session" (1) (in print_cmd() at lttng-ust-comm.c:287) libust[1806/1807]: channel data received (in handle_message() at lttng-ust-comm.c:639)
libust[1806/1807]: Return value: 2 (in handle_message() at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (in send_reply() at lttng-ust-comm.c:402)
libust[1806/1807]: Message Received "Create Stream" (96), Handle "channel" (2) (in print_cmd() at lttng-ust-comm.c:287)
libust[1806/1807]: Return value: 0 (in handle_message() at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (in send_reply() at lttng-ust-comm.c:402)
libust[1806/1807]: Message Received "Create Context" (112), Handle "channel" (2) (in print_cmd() at lttng-ust-comm.c:287) libust[1806/1807]: Return value: 0 (in handle_message() at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (in send_reply() at lttng-ust-comm.c:402)
libust[1806/1807]: Message Received "Create Event" (97), Handle "channel" (2) (in print_cmd() at lttng-ust-comm.c:287)
libust[1806/1807]: Return value: 3 (in handle_message() at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (in send_reply() at lttng-ust-comm.c:402)
libust[1806/1807]: Message Received "Enable" (128), Handle "session" (1) (in print_cmd() at lttng-ust-comm.c:287)
libust[1806/1807]: just registered probe ust_baddr_statedump containing 1 events (in lttng_lazy_probe_register() at lttng-probes.c:115) libust[1806/1807]: Sent register event notification for name "ust_baddr_statedump:soinfo": ret_code 0, event_id 0
(in ustcomm_register_event() at lttng-ust-comm.c:1021)
liblttng_ust_tracepoint[1806/1807]: Registering probe to tracepoint ust_baddr_statedump:soinfo (in __tracepoint_probe_register() at tracepoint.c:558) libust[1806/1807]: Sent register channel notification: chan_id 0, header_type 1
(in ustcomm_register_channel() at lttng-ust-comm.c:1128)
libust[1806/1807]: Return value: 0 (in handle_message() at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (in send_reply() at lttng-ust-comm.c:402)
libust[1806/1807]: Message Received "Wait for Quiescent State" (67), Handle "root" (0) (in print_cmd() at lttng-ust-comm.c:287) libust[1806/1807]: Return value: 0 (in handle_message() at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (in send_reply() at lttng-ust-comm.c:402)
libust[1806/1806]: Error: Timed out waiting for lttng-sessiond (in lttng_ust_init() at lttng-ust-comm.c:1423)
libust[1806/1807]: Message Received "Registration Done" (68), Handle "root" (0) (in print_cmd() at lttng-ust-comm.c:287) libust[1806/1807]: Return value: 0 (in handle_message() at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (in send_reply() at lttng-ust-comm.c:402)
Regards,
Santi
Quoted 252 lines · Mathieu Desnoyers
----- Original Message -----
Quoted 24 lines
From: "Santiago Font" <[email protected]>
To: "Mathieu Desnoyers" <[email protected]>
Cc: [email protected]
Sent: Tuesday, March 11, 2014 6:12:10 PM
Subject: Re: [lttng-dev] LTTng-ust 2.4.0-rc2: no events when tracing busyboxHi,
As I mentioned, I'm building OpenWRT, therefore, part of the
integration of LTTng into Busybox is managed at OpenWRT package level, but it is also true that you only need to add the dependency on lttng-ust (Makefile.patch andMakefile, where you can see the Busybox version being used). Adding the dependency directly into Busybox build system should be easy too.
Regarding the patch to add tracepoints to Busybox codebase, it is
an addition to the patches applied by OpenWRT (new patch 904-telnetd_lttng_events.patch), but no black magic there neither:
- add a couple of new files for LTTng tracepoints
definition/declaration:networking/telnetd_lttng_events.candnetworking/telnetd_lttng_events.h
- add tracepoints calls totelnetd.c
- add tracepoint provider to telnetd built: (Kbuild.src:
lib-$(CONFIG_TELNETD) += telnetd.o telnetd_lttng_events.o)Quoted 2 lines
And that's all. If this is not the info you are asking for, let me
know.Can you provide the log when doing this:
LTTNG_UST_DEBUG=1
/usr/sbin/telnetd-FThanks,
Mathieu
Quoted 213 lines
Thanks,
Santi
Quoted 207 lines · Mathieu Desnoyers
----- Original Message -----
Quoted 36 lines
From: "Santiago Font" <[email protected]>
To: [email protected]
Sent: Tuesday, March 11, 2014 2:28:11 PM
Subject: [lttng-dev] LTTng-ust 2.4.0-rc2: no events when tracing busyboxHi,
I have an embedded scenario (openwrt over Freescale) working with
LTTng:lttng create TEST
lttng enable-channel MYCHAN -u --buffers-uid --subbuf-size 64k lttng add-context -u -t procname -c MYCHAN
lttng enable-event -u "*" -c MYCHAN
lttng start
/usr/sbin/sample&
lttng stop
lttng view- Several ust_baddr_statedump:soinfo events
- An example of the events I defined
(See below for details:dump_1)So far, so good.
Now, I'm trying to add my events to busybox to trace telnetd (very
same provider .c file and event definition .h file, changing only the provider name).
When I follow exactly the same steps but changing "/usr/sbin/sample
&" for "/usr/sbin/telnetd-F &", I get the ust_baddr_statedump:soinfo events, but none of my events (seedump_2)
I have tried with/withoutTRACEPOINT_PROBE_DYNAMIC_LINKAGE,
with/without LD_PRELOAD=liblttng-ust-fork.so, but not success.
Taking a look to the symbols inside the binary (dump 3), all LTTng
stuff seems to be there.Quoted 3 lines
LTTng (modules, tools, ust): 2.4.0 Any idea?Could you share with us your patch that adds your specific tracepoints into the busybox codebase, along with the specific links/version info needed for us to see how it integrate into the busybox build system ?
Thanks,
Mathieu
Quoted 159 lines
Thank you,
Santi
-------
dump_1------------------[00:05:04.281094007] (+10.405305121) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x10000000, sopath = "/usr/sbin/sample", size = 9176, mtime = 1394554355 } [00:05:04.281173138] (+0.000079131) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48018000, sopath = "/lib/libdl-0.9.33.2.so", size = 12436, mtime = 1394229945 } [00:05:04.281214310] (+0.000041172) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4802C000, sopath = "/usr/lib/liblttng-ust.so.0.0.0", size = 224696, mtime = 1394554355 } [00:05:04.281239239] (+0.000024929) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48074000, sopath = "/lib/libgcc_s.so.1", size = 88200, mtime = 1394229944 } [00:05:04.281271259] (+0.000032020) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4809A000, sopath = "/lib/libuClibc-0.9.33.2.so", size = 326616, mtime = 1394229945 } [00:05:04.281303562] (+0.000032303) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48000000, sopath = "/lib/ld-uClibc-0.9.33.2.so", size = 29052, mtime = 1394229945 } [00:05:04.281344714] (+0.000041152) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x480FF000, sopath = "/usr/lib/liblttng-ust-tracepoint.so.0.0.0", size = 25276, mtime = 1394554355 }
[00:05:04.281376996] (+0.000032282) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4811E000, sopath = "/lib/librt-0.9.33.2.so", size = 12404, mtime = 1394229945 } [00:05:04.281416532] (+0.000039536) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48132000, sopath = "/usr/lib/liburcu-bp.so.1.0.0", size = 15388, mtime = 1394548454 } [00:05:04.281456411] (+0.000039879) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48146000, sopath = "/usr/lib/liburcu-cds.so.1.0.0", size = 18216, mtime = 1394548454 } [00:05:04.281489138] (+0.000032727) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4815B000, sopath = "/lib/libpthread-0.9.33.2.so", size = 70104, mtime = 1394229945 } [00:05:04.281529501] (+0.000040363) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4817F000, sopath = "/usr/lib/liburcu-common.so.1.0.0", size = 3188, mtime = 1394548454 } [00:05:04.282903966] (+0.001374465) OpenWrt busybox_telnetd2:info: {cpu_id= 0 }, { procname = "sample" }, { msg = "Hello World" } [00:05:04.282922512] (+0.000018546) OpenWrt busybox_telnetd2:session: {cpu_id= 0 }, { procname = "sample" }, { msg = "Session", client = "10.0.2.5", server = "10.0.2.4",session_pid= 0 } [00:05:04.282929643] (+0.000007131) OpenWrt busybox_telnetd2:err: {cpu_id= 0 }, { procname = "sample" }, { call = "arg1", msg = "arg2",errno_val= 0 }-------
dump_2------------------
[00:14:16.375740554] (+11.778441605) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x10000000, sopath = "/bin/busybox", size = 438834, mtime = 1394559555 } [00:14:16.375818817] (+0.000078263) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48018000, sopath = "/lib/libcrypt-0.9.33.2.so", size = 20724, mtime = 1394229945 } [00:14:16.375852150] (+0.000033333) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x4803F000, sopath = "/lib/libdl-0.9.33.2.so", size = 12436, mtime = 1394229945 } [00:14:16.375892474] (+0.000040324) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48053000, sopath = "/usr/lib/liblttng-ust.so.0.0.0", size = 224696, mtime = 1394554355 } [00:14:16.375941827] (+0.000049353) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x4809B000, sopath = "/lib/libm-0.9.33.2.so", size = 61540, mtime = 1394229945 } [00:14:16.375967524] (+0.000025697) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x480BB000, sopath = "/lib/libgcc_s.so.1", size = 88200, mtime = 1394229944 } [00:14:16.375999484] (+0.000031960) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x480E1000, sopath = "/lib/libuClibc-0.9.33.2.so", size = 326616, mtime = 1394229945 } [00:14:16.376031585] (+0.000032101) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48000000, sopath = "/lib/ld-uClibc-0.9.33.2.so", size = 29052, mtime = 1394229945 } [00:14:16.376072696] (+0.000041111) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48146000, sopath = "/usr/lib/liblttng-ust-tracepoint.so.0.0.0", size = 25276, mtime = 1394554355 }
[00:14:16.376104938] (+0.000032242) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48165000, sopath = "/lib/librt-0.9.33.2.so", size = 12404, mtime = 1394229945 } [00:14:16.376144635] (+0.000039697) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48179000, sopath = "/usr/lib/liburcu-bp.so.1.0.0", size = 15388, mtime = 1394548454 } [00:14:16.376184373] (+0.000039738) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x4818D000, sopath = "/usr/lib/liburcu-cds.so.1.0.0", size = 18216, mtime = 1394548454 } [00:14:16.376217363] (+0.000032990) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x481A2000, sopath = "/lib/libpthread-0.9.33.2.so", size = 70104, mtime = 1394229945 } [00:14:16.376257908] (+0.000040545) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x481C6000, sopath = "/usr/lib/liburcu-common.so.1.0.0", size = 3188, mtime = 1394548454 }----- dump 3 ------------
nm ipkg-install/bin/busybox | grep 'tracepoint\|busybox_telnetd\|lttng'
1007b124d__event_desc___busybox_telnetd1005f7d0R__event_desc___busybox_telnetd_err1005fee4R__event_desc___busybox_telnetd_info1005fea4R__event_desc___busybox_telnetd_session1005f998r__event_fields___busybox_telnetd___err1005f868r__event_fields___busybox_telnetd___info1005ff24r__event_fields___busybox_telnetd___session10016624 t__event_probe__busybox_telnetd___err100164a4t__event_probe__busybox_telnetd___info10016878 t__event_probe__busybox_telnetd___session1007b134d_format___busybox_telnetd___err1007b130d_format___busybox_telnetd___info1007b138d_format___busybox_telnetd___session
w_loglevel___busybox_telnetd___err
w_loglevel___busybox_telnetd___info
w_loglevel___busybox_telnetd___session10016ca0t__lttng_events_exit__busybox_telnetd10016c3ct__lttng_events_init__busybox_telnetd
Ulttng_probe_register
Ulttng_probe_unregister
w_model_emf_uri___busybox_telnetd___errw_model_emf_uri___busybox_telnetd___infow_model_emf_uri___busybox_telnetd___session1007b13cd__probe_desc___busybox_telnetd1007c228b__probe_register_refcount___busybox_telnetd1007b1ecA__start___tracepoints_ptrs1007b1f8A__stop___tracepoints_ptrs1005fe70R__tp_event_signature___busybox_telnetd___err1005f858R__tp_event_signature___busybox_telnetd___info1005f810R__tp_event_signature___busybox_telnetd___session1006ac80r__tp_strtab_busybox_telnetd___err1006ac94r__tp_strtab_busybox_telnetd___info1006ac68r__tp_strtab_busybox_telnetd___session1007b180D__tracepoint_busybox_telnetd___err1007b1c8D__tracepoint_busybox_telnetd___info1007b1a4D__tracepoint_busybox_telnetd___session1007c210Vtracepoint_dlopen100155e8t__tracepoint__init_urcu_sym1007b250S__tracepoint_provider_busybox_telnetd1007b1f0d__tracepoint_ptr_busybox_telnetd___err1007b1f4d__tracepoint_ptr_busybox_telnetd___info1007b1ecd__tracepoint_ptr_busybox_telnetd___session1007b248V__tracepoint_ptrs_registered1007b24cV__tracepoint_registered
10015708 t__tracepoints__destroy10016ba4t__tracepoints__destroy
10015684 t__tracepoints__init10016ac4t__tracepoints__init
10015868 t__tracepoints__ptrs_destroy100157a0t__tracepoints__ptrs_init_______________________________________________
lttng-dev mailing list
[email protected]
http://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev--
Mathieu Desnoyers
EfficiOS Inc.
http://www.efficios.com
A message that is not in the archive (sent off-list or not yet received): [email protected]
----- Original Message -----
Quoted 22 lines
From: "Santiago Font" <[email protected]>
To: "Mathieu Desnoyers" <[email protected]>
Cc: [email protected]
Sent: Wednesday, March 12, 2014 8:22:55 PM
Subject: Re: [lttng-dev] LTTng-ust 2.4.0-rc2: no events when tracing busyboxHi,
Meanwhile, I've tried also the "demo" example (dynamic linkage) and
discovered LDSO support was not enabled in my uClibc; after enabling it, "demo" is working as expected, but it makes no difference in busybox tracing issue.Here it goes:
root@OpenWrt:/# lttng create TEST root@OpenWrt:/# lttng enable-channel MYCHAN -u --buffers-uid --subbuf-size 64k root@OpenWrt:/# lttng add-context -u -t procname -c MYCHAN root@OpenWrt:/# lttng enable-event -u -a -c MYCHAN root@OpenWrt:/# lttng start
Quoted 7 lines
Session TEST created.
Traces will be written in/root/lttng-traces/TEST-19700101-000126
Warning: No tracing group detected
UST channel MYCHAN enabled for session TEST
UST context procname added to channel MYCHAN
All UST events are enabled in channel MYCHAN
Tracing started for session TEST
With the log below, it appears that the "baddr" tracepoints and probes are registered (which is why they work), but not your own event.
My recommendation as a next step is to try adding
#define _LGPL_SOURCE
At the very top of each implementation C file that uses the tracepoints (both the code calling tracepoint() and the code where the probe provider is located).
It appears that there might be some issue with dynamic linking of lttng-ust-tracepoint.so on your system, so let's try this to try cornering the issue. (FYI, these are dlopen/dlsym performed within include/lttng/tracepoint.h).
One way to try understanding the problem is to add printf of the error values near dlopen in this header. Another way is to use strace to see what is going on.
Thanks,
Mathieu
Quoted 364 lines
root@OpenWrt:/# LTTNG_UST_DEBUG=1 /usr/sbin/telnetd -Fliblttng_ust_tracepoint[1806/1806]: just registered a tracepoints section from
0x48099d94and having 1 tracepoints (intracepoint_register_lib()at tracepoint.c:758) liblttng_ust_tracepoint[1806/1806]: registered tracepoint:
ust_baddr_statedump:soinfo (intracepoint_register_lib()at tracepoint.c:763)
libust[1806/1806]: LTT : ltt ring buffer client "relay-metadata-mmap" init
(inlttng_ring_buffer_metadata_client_init()at
lttng-ring-buffer-metadata-client.h:330)
libust[1806/1806]: LTT : ltt ring buffer client "relay-overwrite-mmap" init
(inlttng_ring_buffer_client_overwrite_init()at
lttng-ring-buffer-client.h:670)
libust[1806/1806]: LTT : ltt ring buffer client "relay-overwrite-rt-mmap" init
(inlttng_ring_buffer_client_overwrite_rt_init()at
lttng-ring-buffer-client.h:670)
libust[1806/1806]: LTT : ltt ring buffer client "relay-discard-mmap" init
(inlttng_ring_buffer_client_discard_init()at
lttng-ring-buffer-client.h:670)
libust[1806/1806]: LTT : ltt ring buffer client "relay-discard-rt-mmap" init
(inlttng_ring_buffer_client_discard_rt_init()at
lttng-ring-buffer-client.h:670)
libust[1806/1808]: Info: sessiond not accepting connections to local apps socket (inust_listener_thread()at lttng-ust-comm.c:1130) libust[1806/1808]: Waiting for local apps sessiond (inwait_for_sessiond()at lttng-ust-comm.c:1041)
libust[1806/1807]: Message Received "Get Tracer Version" (65), Handle "root" (0) (inprint_cmd()at lttng-ust-comm.c:287) libust[1806/1807]: Return value: 0 (inhandle_message()at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (insend_reply()at lttng-ust-comm.c:402)
libust[1806/1807]: Message Received "Create Session" (64), Handle "root"
(0) (inprint_cmd()at lttng-ust-comm.c:287)
libust[1806/1807]: Return value: 1 (inhandle_message()at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (insend_reply()at lttng-ust-comm.c:402)
libust[1806/1807]: Message Received "Create Channel" (81), Handle "session" (1) (inprint_cmd()at lttng-ust-comm.c:287) libust[1806/1807]: channel data received (inhandle_message()at lttng-ust-comm.c:639)
libust[1806/1807]: Return value: 2 (inhandle_message()at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (insend_reply()at lttng-ust-comm.c:402)
libust[1806/1807]: Message Received "Create Stream" (96), Handle "channel" (2) (inprint_cmd()at lttng-ust-comm.c:287) libust[1806/1807]: Return value: 0 (inhandle_message()at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (insend_reply()at lttng-ust-comm.c:402)
libust[1806/1807]: Message Received "Create Context" (112), Handle "channel" (2) (inprint_cmd()at lttng-ust-comm.c:287) libust[1806/1807]: Return value: 0 (inhandle_message()at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (insend_reply()at lttng-ust-comm.c:402)
libust[1806/1807]: Message Received "Create Event" (97), Handle "channel" (2) (inprint_cmd()at lttng-ust-comm.c:287) libust[1806/1807]: Return value: 3 (inhandle_message()at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (insend_reply()at lttng-ust-comm.c:402)
libust[1806/1807]: Message Received "Enable" (128), Handle "session" (1) (inprint_cmd()at lttng-ust-comm.c:287)
libust[1806/1807]: just registered probeust_baddr_statedumpcontaining 1 events (inlttng_lazy_probe_register()at lttng-probes.c:115) libust[1806/1807]: Sent register event notification for name "ust_baddr_statedump:soinfo":ret_code0,event_id0
(inustcomm_register_event()at lttng-ust-comm.c:1021)
liblttng_ust_tracepoint[1806/1807]: Registering probe to tracepoint ust_baddr_statedump:soinfo (in__tracepoint_probe_register()at tracepoint.c:558)
libust[1806/1807]: Sent register channel notification:chan_id0,header_type1
(inustcomm_register_channel()at lttng-ust-comm.c:1128)
libust[1806/1807]: Return value: 0 (inhandle_message()at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (insend_reply()at lttng-ust-comm.c:402)
libust[1806/1807]: Message Received "Wait for Quiescent State" (67), Handle "root" (0) (inprint_cmd()at lttng-ust-comm.c:287) libust[1806/1807]: Return value: 0 (inhandle_message()at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (insend_reply()at lttng-ust-comm.c:402)
libust[1806/1806]: Error: Timed out waiting for lttng-sessiond (inlttng_ust_init()at lttng-ust-comm.c:1423)
libust[1806/1807]: Message Received "Registration Done" (68), Handle "root" (0) (inprint_cmd()at lttng-ust-comm.c:287) libust[1806/1807]: Return value: 0 (inhandle_message()at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (insend_reply()at lttng-ust-comm.c:402)Regards,
Santi
Quoted 258 lines · Mathieu Desnoyers
----- Original Message -----
Quoted 25 lines
From: "Santiago Font" <[email protected]>
To: "Mathieu Desnoyers" <[email protected]>
Cc: [email protected]
Sent: Tuesday, March 11, 2014 6:12:10 PM
Subject: Re: [lttng-dev] LTTng-ust 2.4.0-rc2: no events when tracing
busyboxHi,
As I mentioned, I'm building OpenWRT, therefore, part of the
integration of LTTng into Busybox is managed at OpenWRT package level, but it is also true that you only need to add the dependency on lttng-ust (Makefile.patch andMakefile, where you can see the Busybox version being used). Adding the dependency directly into Busybox build system should be easy too.
Regarding the patch to add tracepoints to Busybox codebase, it is
an addition to the patches applied by OpenWRT (new patch 904-telnetd_lttng_events.patch), but no black magic there neither:
- add a couple of new files for LTTng tracepoints
definition/declaration:networking/telnetd_lttng_events.candnetworking/telnetd_lttng_events.h
- add tracepoints calls totelnetd.c
- add tracepoint provider to telnetd built: (Kbuild.src:
lib-$(CONFIG_TELNETD) += telnetd.o telnetd_lttng_events.o)Quoted 2 lines
And that's all. If this is not the info you are asking for, let me
know.Can you provide the log when doing this:
LTTNG_UST_DEBUG=1
/usr/sbin/telnetd-FThanks,
Mathieu
Quoted 218 lines
Thanks,
Santi
Quoted 212 lines · Mathieu Desnoyers
----- Original Message -----
Quoted 41 lines
From: "Santiago Font" <[email protected]>
To: [email protected]
Sent: Tuesday, March 11, 2014 2:28:11 PM
Subject: [lttng-dev] LTTng-ust 2.4.0-rc2: no events when tracing
busyboxHi,
I have an embedded scenario (openwrt over Freescale) working with
LTTng:lttng create TEST
lttng enable-channel MYCHAN -u --buffers-uid --subbuf-size 64k
lttng add-context -u -t procname -c MYCHAN lttng enable-event -u "*" -c MYCHAN
lttng start
/usr/sbin/sample&
lttng stop
lttng view- Several ust_baddr_statedump:soinfo events
- An example of the events I defined
(See below for details:dump_1)So far, so good.
Now, I'm trying to add my events to busybox to trace telnetd (very
same provider .c file and event definition .h file, changing only the provider name).
When I follow exactly the same steps but changing "/usr/sbin/sample
&" for "/usr/sbin/telnetd-F &", I get the ust_baddr_statedump:soinfo events, but none of my events (seedump_2)
I have tried with/withoutTRACEPOINT_PROBE_DYNAMIC_LINKAGE,
with/without LD_PRELOAD=liblttng-ust-fork.so, but not success.
Taking a look to the symbols inside the binary (dump 3), all LTTng
stuff seems to be there.Quoted 3 lines
LTTng (modules, tools, ust): 2.4.0 Any idea?Could you share with us your patch that adds your specific tracepoints into the busybox codebase, along with the specific links/version info needed for us to see how it integrate into the busybox build system ?
Thanks,
Mathieu
Quoted 159 lines
Thank you,
Santi
-------
dump_1------------------[00:05:04.281094007] (+10.405305121) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x10000000, sopath = "/usr/sbin/sample", size = 9176, mtime = 1394554355 } [00:05:04.281173138] (+0.000079131) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48018000, sopath = "/lib/libdl-0.9.33.2.so", size = 12436, mtime = 1394229945 } [00:05:04.281214310] (+0.000041172) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4802C000, sopath = "/usr/lib/liblttng-ust.so.0.0.0", size = 224696, mtime = 1394554355 } [00:05:04.281239239] (+0.000024929) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48074000, sopath = "/lib/libgcc_s.so.1", size = 88200, mtime = 1394229944 } [00:05:04.281271259] (+0.000032020) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4809A000, sopath = "/lib/libuClibc-0.9.33.2.so", size = 326616, mtime = 1394229945 } [00:05:04.281303562] (+0.000032303) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48000000, sopath = "/lib/ld-uClibc-0.9.33.2.so", size = 29052, mtime = 1394229945 } [00:05:04.281344714] (+0.000041152) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x480FF000, sopath = "/usr/lib/liblttng-ust-tracepoint.so.0.0.0", size = 25276, mtime = 1394554355 }
[00:05:04.281376996] (+0.000032282) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4811E000, sopath = "/lib/librt-0.9.33.2.so", size = 12404, mtime = 1394229945 } [00:05:04.281416532] (+0.000039536) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48132000, sopath = "/usr/lib/liburcu-bp.so.1.0.0", size = 15388, mtime = 1394548454 } [00:05:04.281456411] (+0.000039879) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48146000, sopath = "/usr/lib/liburcu-cds.so.1.0.0", size = 18216, mtime = 1394548454 } [00:05:04.281489138] (+0.000032727) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4815B000, sopath = "/lib/libpthread-0.9.33.2.so", size = 70104, mtime = 1394229945 } [00:05:04.281529501] (+0.000040363) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4817F000, sopath = "/usr/lib/liburcu-common.so.1.0.0", size = 3188, mtime = 1394548454 } [00:05:04.282903966] (+0.001374465) OpenWrt busybox_telnetd2:info: {cpu_id= 0 }, { procname = "sample" }, { msg = "Hello World" } [00:05:04.282922512] (+0.000018546) OpenWrt busybox_telnetd2:session: {cpu_id= 0 }, { procname = "sample" }, { msg = "Session", client = "10.0.2.5", server = "10.0.2.4",session_pid= 0 } [00:05:04.282929643] (+0.000007131) OpenWrt busybox_telnetd2:err: {cpu_id= 0 }, { procname = "sample" }, { call = "arg1", msg = "arg2",errno_val= 0 }-------
dump_2------------------
[00:14:16.375740554] (+11.778441605) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x10000000, sopath = "/bin/busybox", size = 438834, mtime = 1394559555 } [00:14:16.375818817] (+0.000078263) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48018000, sopath = "/lib/libcrypt-0.9.33.2.so", size = 20724, mtime = 1394229945 } [00:14:16.375852150] (+0.000033333) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x4803F000, sopath = "/lib/libdl-0.9.33.2.so", size = 12436, mtime = 1394229945 } [00:14:16.375892474] (+0.000040324) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48053000, sopath = "/usr/lib/liblttng-ust.so.0.0.0", size = 224696, mtime = 1394554355 } [00:14:16.375941827] (+0.000049353) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x4809B000, sopath = "/lib/libm-0.9.33.2.so", size = 61540, mtime = 1394229945 } [00:14:16.375967524] (+0.000025697) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x480BB000, sopath = "/lib/libgcc_s.so.1", size = 88200, mtime = 1394229944 } [00:14:16.375999484] (+0.000031960) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x480E1000, sopath = "/lib/libuClibc-0.9.33.2.so", size = 326616, mtime = 1394229945 } [00:14:16.376031585] (+0.000032101) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48000000, sopath = "/lib/ld-uClibc-0.9.33.2.so", size = 29052, mtime = 1394229945 } [00:14:16.376072696] (+0.000041111) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48146000, sopath = "/usr/lib/liblttng-ust-tracepoint.so.0.0.0", size = 25276, mtime = 1394554355 }
[00:14:16.376104938] (+0.000032242) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48165000, sopath = "/lib/librt-0.9.33.2.so", size = 12404, mtime = 1394229945 } [00:14:16.376144635] (+0.000039697) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48179000, sopath = "/usr/lib/liburcu-bp.so.1.0.0", size = 15388, mtime = 1394548454 } [00:14:16.376184373] (+0.000039738) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x4818D000, sopath = "/usr/lib/liburcu-cds.so.1.0.0", size = 18216, mtime = 1394548454 } [00:14:16.376217363] (+0.000032990) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x481A2000, sopath = "/lib/libpthread-0.9.33.2.so", size = 70104, mtime = 1394229945 } [00:14:16.376257908] (+0.000040545) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x481C6000, sopath = "/usr/lib/liburcu-common.so.1.0.0", size = 3188, mtime = 1394548454 }----- dump 3 ------------
nm ipkg-install/bin/busybox | grep 'tracepoint\|busybox_telnetd\|lttng'
1007b124d__event_desc___busybox_telnetd1005f7d0R__event_desc___busybox_telnetd_err1005fee4R__event_desc___busybox_telnetd_info1005fea4R__event_desc___busybox_telnetd_session1005f998r__event_fields___busybox_telnetd___err1005f868r__event_fields___busybox_telnetd___info1005ff24r__event_fields___busybox_telnetd___session10016624 t__event_probe__busybox_telnetd___err100164a4t__event_probe__busybox_telnetd___info10016878 t__event_probe__busybox_telnetd___session1007b134d_format___busybox_telnetd___err1007b130d_format___busybox_telnetd___info1007b138d_format___busybox_telnetd___session
w_loglevel___busybox_telnetd___err
w_loglevel___busybox_telnetd___info
w_loglevel___busybox_telnetd___session10016ca0t__lttng_events_exit__busybox_telnetd10016c3ct__lttng_events_init__busybox_telnetd
Ulttng_probe_register
Ulttng_probe_unregister
w_model_emf_uri___busybox_telnetd___errw_model_emf_uri___busybox_telnetd___infow_model_emf_uri___busybox_telnetd___session1007b13cd__probe_desc___busybox_telnetd1007c228b__probe_register_refcount___busybox_telnetd1007b1ecA__start___tracepoints_ptrs1007b1f8A__stop___tracepoints_ptrs1005fe70R__tp_event_signature___busybox_telnetd___err1005f858R__tp_event_signature___busybox_telnetd___info1005f810R__tp_event_signature___busybox_telnetd___session1006ac80r__tp_strtab_busybox_telnetd___err1006ac94r__tp_strtab_busybox_telnetd___info1006ac68r__tp_strtab_busybox_telnetd___session1007b180D__tracepoint_busybox_telnetd___err1007b1c8D__tracepoint_busybox_telnetd___info1007b1a4D__tracepoint_busybox_telnetd___session1007c210Vtracepoint_dlopen100155e8t__tracepoint__init_urcu_sym1007b250S__tracepoint_provider_busybox_telnetd1007b1f0d__tracepoint_ptr_busybox_telnetd___err1007b1f4d__tracepoint_ptr_busybox_telnetd___info1007b1ecd__tracepoint_ptr_busybox_telnetd___session1007b248V__tracepoint_ptrs_registered1007b24cV__tracepoint_registered
10015708 t__tracepoints__destroy10016ba4t__tracepoints__destroy
10015684 t__tracepoints__init10016ac4t__tracepoints__init
10015868 t__tracepoints__ptrs_destroy100157a0t__tracepoints__ptrs_init_______________________________________________
lttng-dev mailing list
[email protected]
http://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev--
Mathieu Desnoyers
EfficiOS Inc.
http://www.efficios.com
Signature · 3 lines
Mathieu Desnoyers EfficiOS Inc. http://www.efficios.com
A message that is not in the archive (sent off-list or not yet received): [email protected]
Hi,
Below there's the strace dump: I don't know very much about it, but
it seems it is not reporting any important issue, maybe that is different to your eyes.
The _LGPL_SOURCE and printf strategy:
- intilially, Busybox built complained about liburcu-bp
dependency missing
- when added, it builds but something goes wrong when OpenWRT
boots because it is not completing init scripts
I will try the dynamic linking strategy for the provider...
Thanks,
Santi
------------ strace ----------------
root@OpenWrt:/# strace /usr/sbin/telnetd -F
execve("/usr/sbin/telnetd", ["/usr/sbin/telnetd", "-F"], [/* 5 vars */]) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS|0x4000000, -1, 0) = 0x48007000
stat("/etc/ld.so.cache", 0xbfec08f8) = -1 ENOENT (No such file or directory)
stat("/etc/ld.so.preload", 0xbfec096c) = -1 ENOENT (No such file or directory)
open("/lib/libcrypt.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=20724, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS|0x4000000, -1, 0) = 0x48008000
read(3, "\177ELF\1\2\1\0\0\0\0\0\0\0\0\0\0\3\0\24\0\0\0\1\0\0\7\24\0\0\0004"..., 4096) = 4096
mmap(NULL, 159744, PROT_NONE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x48018000
mmap(0x48018000, 19336, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED, 3, 0) = 0x48018000
mmap(0x4802c000, 4340, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_FIXED, 3, 0x4000) = 0x4802c000
mmap(0x4802e000, 66648, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x4802e000
close(3) = 0
munmap(0x48008000, 4096) = 0
open("/lib/libdl.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=12436, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS|0x4000000, -1, 0) = 0x48008000
read(3, "\177ELF\1\2\1\0\0\0\0\0\0\0\0\0\0\3\0\24\0\0\0\1\0\0\v0\0\0\0004"..., 4096) = 4096
mmap(NULL, 81920, PROT_NONE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x4803f000
mmap(0x4803f000, 8608, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED, 3, 0) = 0x4803f000
mmap(0x48051000, 4244, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_FIXED, 3, 0x2000) = 0x48051000
close(3) = 0
munmap(0x48008000, 4096) = 0
open("/lib/liblttng-ust.so.0", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/liblttng-ust.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=224696, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS|0x4000000, -1, 0) = 0x48008000
read(3, "\177ELF\1\2\1\0\0\0\0\0\0\0\0\0\0\3\0\24\0\0\0\1\0\0s\234\0\0\0004"..., 4096) = 4096
mmap(NULL, 294912, PROT_NONE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x48053000
mmap(0x48053000, 201628, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED, 3, 0) = 0x48053000
mmap(0x48094000, 23992, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_FIXED, 3, 0x31000) = 0x48094000
mmap(0x4809a000, 2820, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x4809a000
close(3) = 0
munmap(0x48008000, 4096) = 0
open("/lib/libm.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=61540, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS|0x4000000, -1, 0) = 0x48008000
read(3, "\177ELF\1\2\1\0\0\0\0\0\0\0\0\0\0\3\0\24\0\0\0\1\0\0\36\10\0\0\0004"..., 4096) = 4096
mmap(NULL, 131072, PROT_NONE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x4809b000
mmap(0x4809b000, 59976, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED, 3, 0) = 0x4809b000
mmap(0x480b9000, 4196, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_FIXED, 3, 0xe000) = 0x480b9000
close(3) = 0
munmap(0x48008000, 4096) = 0
open("/lib/libgcc_s.so.1", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=88200, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS|0x4000000, -1, 0) = 0x48008000
read(3, "\177ELF\1\2\1\0\0\0\0\0\0\0\0\0\0\3\0\24\0\0\0\1\0\0#p\0\0\0004"..., 4096) = 4096
mmap(NULL, 155648, PROT_NONE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x480bb000
mmap(0x480bb000, 87800, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED, 3, 0) = 0x480bb000
mmap(0x480e0000, 2184, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_FIXED, 3, 0x15000) = 0x480e0000
close(3) = 0
munmap(0x48008000, 4096) = 0
open("/lib/libc.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=326616, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS|0x4000000, -1, 0) = 0x48008000
read(3, "\177ELF\1\2\1\0\0\0\0\0\0\0\0\0\0\3\0\24\0\0\0\1\0\0\270`\0\0\0004"..., 4096) = 4096
mmap(NULL, 413696, PROT_NONE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x480e1000
mmap(0x480e1000, 319268, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED, 3, 0) = 0x480e1000
mmap(0x4813f000, 7128, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_FIXED, 3, 0x4e000) = 0x4813f000
mmap(0x48141000, 17332, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x48141000
close(3) = 0
munmap(0x48008000, 4096) = 0
open("/lib/libc.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=326616, ...}) = 0
close(3) = 0
open("/lib/libc.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=326616, ...}) = 0
close(3) = 0
stat("/lib/ld-uClibc.so.0", {st_mode=S_IFREG|0755, st_size=29068, ...}) = 0
open("/lib/liblttng-ust-tracepoint.so.0", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/liblttng-ust-tracepoint.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=25276, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS|0x4000000, -1, 0) = 0x48008000
read(3, "\177ELF\1\2\1\0\0\0\0\0\0\0\0\0\0\3\0\24\0\0\0\1\0\0\17\230\0\0\0004"..., 4096) = 4096
mmap(NULL, 126976, PROT_NONE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x48146000
mmap(0x48146000, 24780, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED, 3, 0) = 0x48146000
mmap(0x4815c000, 700, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_FIXED, 3, 0x6000) = 0x4815c000
mmap(0x4815d000, 30020, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x4815d000
close(3) = 0
munmap(0x48008000, 4096) = 0
open("/lib/librt.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=12404, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS|0x4000000, -1, 0) = 0x48008000
read(3, "\177ELF\1\2\1\0\0\0\0\0\0\0\0\0\0\3\0\24\0\0\0\1\0\0\16\20\0\0\0004"..., 4096) = 4096
mmap(NULL, 81920, PROT_NONE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x48165000
mmap(0x48165000, 8784, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED, 3, 0) = 0x48165000
mmap(0x48177000, 4212, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_FIXED, 3, 0x2000) = 0x48177000
close(3) = 0
munmap(0x48008000, 4096) = 0
open("/lib/liburcu-bp.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/liburcu-bp.so.1", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=15388, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS|0x4000000, -1, 0) = 0x48008000
read(3, "\177ELF\1\2\1\0\0\0\0\0\0\0\0\0\0\3\0\24\0\0\0\1\0\0\22\234\0\0\0004"..., 4096) = 4096
mmap(NULL, 81920, PROT_NONE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x48179000
mmap(0x48179000, 14900, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED, 3, 0) = 0x48179000
mmap(0x4818c000, 3100, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_FIXED, 3, 0x3000) = 0x4818c000
close(3) = 0
munmap(0x48008000, 4096) = 0
open("/lib/liburcu-cds.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/liburcu-cds.so.1", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=18216, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS|0x4000000, -1, 0) = 0x48008000
read(3, "\177ELF\1\2\1\0\0\0\0\0\0\0\0\0\0\3\0\24\0\0\0\1\0\0\16l\0\0\0004"..., 4096) = 4096
mmap(NULL, 86016, PROT_NONE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x4818d000
mmap(0x4818d000, 17584, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED, 3, 0) = 0x4818d000
mmap(0x481a1000, 1832, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_FIXED, 3, 0x4000) = 0x481a1000
close(3) = 0
munmap(0x48008000, 4096) = 0
open("/lib/libpthread.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=70104, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS|0x4000000, -1, 0) = 0x48008000
read(3, "\177ELF\1\2\1\0\0\0\0\0\0\0\0\0\0\3\0\24\0\0\0\1\0\0Et\0\0\0004"..., 4096) = 4096
mmap(NULL, 147456, PROT_NONE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x481a2000
mmap(0x481a2000, 65662, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED, 3, 0) = 0x481a2000
mmap(0x481c2000, 4568, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_FIXED, 3, 0x10000) = 0x481c2000
mmap(0x481c4000, 5868, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x481c4000
close(3) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS|0x4000000, -1, 0) = 0x48009000
munmap(0x48008000, 4096) = 0
open("/lib/libgcc_s.so.1", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=88200, ...}) = 0
close(3) = 0
open("/lib/libc.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=326616, ...}) = 0
close(3) = 0
open("/lib/libc.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=326616, ...}) = 0
close(3) = 0
open("/lib/libc.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=326616, ...}) = 0
close(3) = 0
open("/lib/liburcu-bp.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/liburcu-bp.so.1", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=15388, ...}) = 0
close(3) = 0
open("/lib/liburcu-cds.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/liburcu-cds.so.1", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=18216, ...}) = 0
close(3) = 0
open("/lib/libpthread.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=70104, ...}) = 0
close(3) = 0
open("/lib/libgcc_s.so.1", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=88200, ...}) = 0
close(3) = 0
open("/lib/libc.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=326616, ...}) = 0
close(3) = 0
open("/lib/libc.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=326616, ...}) = 0
close(3) = 0
open("/lib/libdl.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=12436, ...}) = 0
close(3) = 0
open("/lib/libpthread.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=70104, ...}) = 0
close(3) = 0
open("/lib/liburcu-common.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/liburcu-common.so.1", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=3188, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS|0x4000000, -1, 0) = 0x48008000
read(3, "\177ELF\1\2\1\0\0\0\0\0\0\0\0\0\0\3\0\24\0\0\0\1\0\0\5(\0\0\0004"..., 4096) = 3188
mmap(NULL, 69632, PROT_NONE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x481c6000
mmap(0x481c6000, 2912, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED, 3, 0) = 0x481c6000
mmap(0x481d6000, 3188, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_FIXED, 3, 0) = 0x481d6000
close(3) = 0
munmap(0x48008000, 4096) = 0
open("/lib/libpthread.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=70104, ...}) = 0
close(3) = 0
open("/lib/libgcc_s.so.1", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=88200, ...}) = 0
close(3) = 0
open("/lib/libc.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=326616, ...}) = 0
close(3) = 0
open("/lib/liburcu-common.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/liburcu-common.so.1", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=3188, ...}) = 0
close(3) = 0
open("/lib/libpthread.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=70104, ...}) = 0
close(3) = 0
open("/lib/libgcc_s.so.1", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=88200, ...}) = 0
close(3) = 0
open("/lib/libc.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=326616, ...}) = 0
close(3) = 0
open("/lib/libdl.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=12436, ...}) = 0
close(3) = 0
open("/lib/libc.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=326616, ...}) = 0
close(3) = 0
open("/lib/libpthread.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=70104, ...}) = 0
close(3) = 0
open("/lib/libgcc_s.so.1", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=88200, ...}) = 0
close(3) = 0
open("/lib/libc.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=326616, ...}) = 0
close(3) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS|0x4000000, -1, 0) = 0x48008000
mprotect(0x4802c000, 4096, PROT_READ) = 0
mprotect(0x48051000, 4096, PROT_READ) = 0
mprotect(0x480b9000, 4096, PROT_READ) = 0
mprotect(0x4813f000, 4096, PROT_READ) = 0
mprotect(0x48016000, 4096, PROT_READ) = 0
mprotect(0x48177000, 4096, PROT_READ) = 0
mprotect(0x481c2000, 4096, PROT_READ) = 0
set_tid_address(0x48008068) = 1803
set_robust_list(0x48008070, 12) = 0
rt_sigaction(SIGRTMIN, {0x481aaa78, [], SA_SIGINFO}, NULL, 8) = 0
rt_sigaction(SIGRT_1, {0x481aa960, [], SA_RESTART|SA_SIGINFO}, NULL, 8) = 0
rt_sigprocmask(SIG_UNBLOCK, [RTMIN RT_1], NULL, 8) = 0
getrlimit(RLIMIT_STACK, {rlim_cur=8192*1024, rlim_max=RLIM_INFINITY}) = 0
ioctl(0, TCGETS, {B9600 opost isig icanon echo ...}) = 0
ioctl(1, TCGETS, {B9600 opost isig icanon echo ...}) = 0
open("/lib/liblttng-ust-tracepoint.so.0", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/liblttng-ust-tracepoint.so.0", O_RDONLY) = 3
fstat(3, {st_mode=S_IFREG|0755, st_size=25276, ...}) = 0
close(3) = 0
brk(0) = 0x1046a000
brk(0x1046b000) = 0x1046b000
clock_gettime(CLOCK_REALTIME, {155, 519204502}) = 0
getuid() = 0
geteuid() = 0
rt_sigprocmask(SIG_SETMASK, ~[RTMIN RT_1], [], 8) = 0
mmap(NULL, 4194304, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x481d7000
mprotect(0x481d7000, 4096, PROT_NONE) = 0
clone(child_stack=0x485d60a0, flags=CLONE_VM|CLONE_FS|CLONE_FILES|CLONE_SIGHAND|CLONE_THREAD|CLONE_SYSVSEM|CLONE_SETTLS|CLONE_PARENT_SETTID|CLONE_CHILD_CLEARTID, parent_tidptr=0x485d6548, tls=0x485dd920, child_tidptr=0x485d6548) = 1804
mmap(NULL, 4194304, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x485d7000
mprotect(0x485d7000, 4096, PROT_NONE) = 0
clone(child_stack=0x489d60a0, flags=CLONE_VM|CLONE_FS|CLONE_FILES|CLONE_SIGHAND|CLONE_THREAD|CLONE_SYSVSEM|CLONE_SETTLS|CLONE_PARENT_SETTID|CLONE_CHILD_CLEARTID, parent_tidptr=0x489d6548, tls=0x489dd920, child_tidptr=0x489d6548) = 1805
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
getuid() = 0
socket(PF_INET6, SOCK_STREAM, IPPROTO_IP) = 9
setsockopt(9, SOL_SOCKET, SO_REUSEADDR, [1], 4) = 0
bind(9, {sa_family=AF_INET6, sin6_port=htons(23), inet_pton(AF_INET6, "::", &sin6_addr), sin6_flowinfo=0, sin6_scope_id=0}, 28) = 0
listen(9, 1) = 0
fcntl64(9, F_SETFD, FD_CLOEXEC) = 0
rt_sigaction(SIGPIPE, {SIG_IGN, [PIPE], SA_RESTART}, {SIG_IGN, [], 0}, 8) = 0
rt_sigaction(SIGCHLD, {SIG_IGN, [CHLD], SA_RESTART}, {SIG_DFL, [], 0}, 8) = 0
select(10, [9], [], NULL, NULLQuoted 421 lines · Mathieu Desnoyers
----- Original Message -----
Quoted 22 lines
From: "Santiago Font" <[email protected]>
To: "Mathieu Desnoyers" <[email protected]>
Cc: [email protected]
Sent: Wednesday, March 12, 2014 8:22:55 PM
Subject: Re: [lttng-dev] LTTng-ust 2.4.0-rc2: no events when tracing busyboxHi,
Meanwhile, I've tried also the "demo" example (dynamic linkage) and
discovered LDSO support was not enabled in my uClibc; after enabling it, "demo" is working as expected, but it makes no difference in busybox tracing issue.Here it goes:
root@OpenWrt:/# lttng create TEST root@OpenWrt:/# lttng enable-channel MYCHAN -u --buffers-uid --subbuf-size 64k root@OpenWrt:/# lttng add-context -u -t procname -c MYCHAN root@OpenWrt:/# lttng enable-event -u -a -c MYCHAN root@OpenWrt:/# lttng startQuoted 7 lines
Session TEST created.
Traces will be written in/root/lttng-traces/TEST-19700101-000126
Warning: No tracing group detected
UST channel MYCHAN enabled for session TEST
UST context procname added to channel MYCHAN
All UST events are enabled in channel MYCHAN
Tracing started for session TESTWith the log below, it appears that the "baddr" tracepoints and probes are registered (which is why they work), but not your own event.
My recommendation as a next step is to try adding
#define
_LGPL_SOURCEAt the very top of each implementation C file that uses the tracepoints (both the code calling
tracepoint()and the code where the probe provider is located).It appears that there might be some issue with dynamic linking of lttng-ust-tracepoint.so on your system, so let's try this to try cornering the issue. (FYI, these are dlopen/dlsym performed within
include/lttng/tracepoint.h).One way to try understanding the problem is to add printf of the error values near dlopen in this header. Another way is to use strace to see what is going on.
Thanks,
Mathieu
Quoted 98 lines
root@OpenWrt:/# LTTNG_UST_DEBUG=1 /usr/sbin/telnetd -Fliblttng_ust_tracepoint[1806/1806]: just registered a tracepoints section from
0x48099d94and having 1 tracepoints (intracepoint_register_lib()at tracepoint.c:758) liblttng_ust_tracepoint[1806/1806]: registered tracepoint:
ust_baddr_statedump:soinfo (intracepoint_register_lib()at tracepoint.c:763)
libust[1806/1806]: LTT : ltt ring buffer client "relay-metadata-mmap" init
(inlttng_ring_buffer_metadata_client_init()at
lttng-ring-buffer-metadata-client.h:330)
libust[1806/1806]: LTT : ltt ring buffer client "relay-overwrite-mmap" init
(inlttng_ring_buffer_client_overwrite_init()at
lttng-ring-buffer-client.h:670)
libust[1806/1806]: LTT : ltt ring buffer client "relay-overwrite-rt-mmap" init
(inlttng_ring_buffer_client_overwrite_rt_init()at
lttng-ring-buffer-client.h:670)
libust[1806/1806]: LTT : ltt ring buffer client "relay-discard-mmap" init
(inlttng_ring_buffer_client_discard_init()at
lttng-ring-buffer-client.h:670)
libust[1806/1806]: LTT : ltt ring buffer client "relay-discard-rt-mmap" init
(inlttng_ring_buffer_client_discard_rt_init()at
lttng-ring-buffer-client.h:670)
libust[1806/1808]: Info: sessiond not accepting connections to local apps socket (inust_listener_thread()at lttng-ust-comm.c:1130) libust[1806/1808]: Waiting for local apps sessiond (inwait_for_sessiond()at lttng-ust-comm.c:1041)
libust[1806/1807]: Message Received "Get Tracer Version" (65), Handle "root" (0) (inprint_cmd()at lttng-ust-comm.c:287) libust[1806/1807]: Return value: 0 (inhandle_message()at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (insend_reply()at lttng-ust-comm.c:402)
libust[1806/1807]: Message Received "Create Session" (64), Handle "root"
(0) (inprint_cmd()at lttng-ust-comm.c:287)
libust[1806/1807]: Return value: 1 (inhandle_message()at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (insend_reply()at lttng-ust-comm.c:402)
libust[1806/1807]: Message Received "Create Channel" (81), Handle "session" (1) (inprint_cmd()at lttng-ust-comm.c:287) libust[1806/1807]: channel data received (inhandle_message()at lttng-ust-comm.c:639)
libust[1806/1807]: Return value: 2 (inhandle_message()at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (insend_reply()at lttng-ust-comm.c:402)
libust[1806/1807]: Message Received "Create Stream" (96), Handle "channel" (2) (inprint_cmd()at lttng-ust-comm.c:287) libust[1806/1807]: Return value: 0 (inhandle_message()at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (insend_reply()at lttng-ust-comm.c:402)
libust[1806/1807]: Message Received "Create Context" (112), Handle "channel" (2) (inprint_cmd()at lttng-ust-comm.c:287) libust[1806/1807]: Return value: 0 (inhandle_message()at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (insend_reply()at lttng-ust-comm.c:402)
libust[1806/1807]: Message Received "Create Event" (97), Handle "channel" (2) (inprint_cmd()at lttng-ust-comm.c:287) libust[1806/1807]: Return value: 3 (inhandle_message()at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (insend_reply()at lttng-ust-comm.c:402)
libust[1806/1807]: Message Received "Enable" (128), Handle "session" (1) (inprint_cmd()at lttng-ust-comm.c:287)
libust[1806/1807]: just registered probeust_baddr_statedumpcontaining 1 events (inlttng_lazy_probe_register()at lttng-probes.c:115) libust[1806/1807]: Sent register event notification for name "ust_baddr_statedump:soinfo":ret_code0,event_id0
(inustcomm_register_event()at lttng-ust-comm.c:1021)
liblttng_ust_tracepoint[1806/1807]: Registering probe to tracepoint ust_baddr_statedump:soinfo (in__tracepoint_probe_register()at tracepoint.c:558)
libust[1806/1807]: Sent register channel notification:chan_id0,header_type1
(inustcomm_register_channel()at lttng-ust-comm.c:1128)
libust[1806/1807]: Return value: 0 (inhandle_message()at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (insend_reply()at lttng-ust-comm.c:402)
libust[1806/1807]: Message Received "Wait for Quiescent State" (67), Handle "root" (0) (inprint_cmd()at lttng-ust-comm.c:287) libust[1806/1807]: Return value: 0 (inhandle_message()at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (insend_reply()at lttng-ust-comm.c:402)
libust[1806/1806]: Error: Timed out waiting for lttng-sessiond (inlttng_ust_init()at lttng-ust-comm.c:1423)
libust[1806/1807]: Message Received "Registration Done" (68), Handle "root" (0) (inprint_cmd()at lttng-ust-comm.c:287) libust[1806/1807]: Return value: 0 (inhandle_message()at lttng-ust-comm.c:743)
libust[1806/1807]: message successfully sent (insend_reply()at lttng-ust-comm.c:402)Quoted 263 lines
Regards,
Santi
Quoted 257 lines · Mathieu Desnoyers
----- Original Message -----
Quoted 25 lines
From: "Santiago Font" <[email protected]>
To: "Mathieu Desnoyers" <[email protected]>
Cc: [email protected]
Sent: Tuesday, March 11, 2014 6:12:10 PM
Subject: Re: [lttng-dev] LTTng-ust 2.4.0-rc2: no events when tracing
busyboxHi,
As I mentioned, I'm building OpenWRT, therefore, part of the
integration of LTTng into Busybox is managed at OpenWRT package level, but it is also true that you only need to add the dependency on lttng-ust (Makefile.patch andMakefile, where you can see the Busybox version being used). Adding the dependency directly into Busybox build system should be easy too.
Regarding the patch to add tracepoints to Busybox codebase, it is
an addition to the patches applied by OpenWRT (new patch 904-telnetd_lttng_events.patch), but no black magic there neither:
- add a couple of new files for LTTng tracepoints
definition/declaration:networking/telnetd_lttng_events.candnetworking/telnetd_lttng_events.h
- add tracepoints calls totelnetd.c
- add tracepoint provider to telnetd built: (Kbuild.src:
lib-$(CONFIG_TELNETD) += telnetd.o telnetd_lttng_events.o)Quoted 2 lines
And that's all. If this is not the info you are asking for, let me
know.Can you provide the log when doing this:
LTTNG_UST_DEBUG=1
/usr/sbin/telnetd-FThanks,
Mathieu
Quoted 217 lines
Thanks,
Santi
Quoted 212 lines · Mathieu Desnoyers
----- Original Message -----
Quoted 41 lines
From: "Santiago Font" <[email protected]>
To: [email protected]
Sent: Tuesday, March 11, 2014 2:28:11 PM
Subject: [lttng-dev] LTTng-ust 2.4.0-rc2: no events when tracing
busyboxHi,
I have an embedded scenario (openwrt over Freescale) working with
LTTng:lttng create TEST
lttng enable-channel MYCHAN -u --buffers-uid --subbuf-size 64k
lttng add-context -u -t procname -c MYCHAN lttng enable-event -u "*" -c MYCHAN
lttng start
/usr/sbin/sample&
lttng stop
lttng view- Several ust_baddr_statedump:soinfo events
- An example of the events I defined
(See below for details:dump_1)So far, so good.
Now, I'm trying to add my events to busybox to trace telnetd (very
same provider .c file and event definition .h file, changing only the provider name).
When I follow exactly the same steps but changing "/usr/sbin/sample
&" for "/usr/sbin/telnetd-F &", I get the ust_baddr_statedump:soinfo events, but none of my events (seedump_2)
I have tried with/withoutTRACEPOINT_PROBE_DYNAMIC_LINKAGE,
with/without LD_PRELOAD=liblttng-ust-fork.so, but not success.
Taking a look to the symbols inside the binary (dump 3), all LTTng
stuff seems to be there.Quoted 3 lines
LTTng (modules, tools, ust): 2.4.0 Any idea?Could you share with us your patch that adds your specific tracepoints into the busybox codebase, along with the specific links/version info needed for us to see how it integrate into the busybox build system ?
Thanks,
Mathieu
Quoted 159 lines
Thank you,
Santi
-------
dump_1------------------[00:05:04.281094007] (+10.405305121) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x10000000, sopath = "/usr/sbin/sample", size = 9176, mtime = 1394554355 } [00:05:04.281173138] (+0.000079131) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48018000, sopath = "/lib/libdl-0.9.33.2.so", size = 12436, mtime = 1394229945 } [00:05:04.281214310] (+0.000041172) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4802C000, sopath = "/usr/lib/liblttng-ust.so.0.0.0", size = 224696, mtime = 1394554355 } [00:05:04.281239239] (+0.000024929) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48074000, sopath = "/lib/libgcc_s.so.1", size = 88200, mtime = 1394229944 } [00:05:04.281271259] (+0.000032020) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4809A000, sopath = "/lib/libuClibc-0.9.33.2.so", size = 326616, mtime = 1394229945 } [00:05:04.281303562] (+0.000032303) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48000000, sopath = "/lib/ld-uClibc-0.9.33.2.so", size = 29052, mtime = 1394229945 } [00:05:04.281344714] (+0.000041152) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x480FF000, sopath = "/usr/lib/liblttng-ust-tracepoint.so.0.0.0", size = 25276, mtime = 1394554355 }
[00:05:04.281376996] (+0.000032282) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4811E000, sopath = "/lib/librt-0.9.33.2.so", size = 12404, mtime = 1394229945 } [00:05:04.281416532] (+0.000039536) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48132000, sopath = "/usr/lib/liburcu-bp.so.1.0.0", size = 15388, mtime = 1394548454 } [00:05:04.281456411] (+0.000039879) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x48146000, sopath = "/usr/lib/liburcu-cds.so.1.0.0", size = 18216, mtime = 1394548454 } [00:05:04.281489138] (+0.000032727) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4815B000, sopath = "/lib/libpthread-0.9.33.2.so", size = 70104, mtime = 1394229945 } [00:05:04.281529501] (+0.000040363) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "sample" }, { baddr =0x4817F000, sopath = "/usr/lib/liburcu-common.so.1.0.0", size = 3188, mtime = 1394548454 } [00:05:04.282903966] (+0.001374465) OpenWrt busybox_telnetd2:info: {cpu_id= 0 }, { procname = "sample" }, { msg = "Hello World" } [00:05:04.282922512] (+0.000018546) OpenWrt busybox_telnetd2:session: {cpu_id= 0 }, { procname = "sample" }, { msg = "Session", client = "10.0.2.5", server = "10.0.2.4",session_pid= 0 } [00:05:04.282929643] (+0.000007131) OpenWrt busybox_telnetd2:err: {cpu_id= 0 }, { procname = "sample" }, { call = "arg1", msg = "arg2",errno_val= 0 }-------
dump_2------------------
[00:14:16.375740554] (+11.778441605) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x10000000, sopath = "/bin/busybox", size = 438834, mtime = 1394559555 } [00:14:16.375818817] (+0.000078263) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48018000, sopath = "/lib/libcrypt-0.9.33.2.so", size = 20724, mtime = 1394229945 } [00:14:16.375852150] (+0.000033333) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x4803F000, sopath = "/lib/libdl-0.9.33.2.so", size = 12436, mtime = 1394229945 } [00:14:16.375892474] (+0.000040324) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48053000, sopath = "/usr/lib/liblttng-ust.so.0.0.0", size = 224696, mtime = 1394554355 } [00:14:16.375941827] (+0.000049353) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x4809B000, sopath = "/lib/libm-0.9.33.2.so", size = 61540, mtime = 1394229945 } [00:14:16.375967524] (+0.000025697) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x480BB000, sopath = "/lib/libgcc_s.so.1", size = 88200, mtime = 1394229944 } [00:14:16.375999484] (+0.000031960) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x480E1000, sopath = "/lib/libuClibc-0.9.33.2.so", size = 326616, mtime = 1394229945 } [00:14:16.376031585] (+0.000032101) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48000000, sopath = "/lib/ld-uClibc-0.9.33.2.so", size = 29052, mtime = 1394229945 } [00:14:16.376072696] (+0.000041111) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48146000, sopath = "/usr/lib/liblttng-ust-tracepoint.so.0.0.0", size = 25276, mtime = 1394554355 }
[00:14:16.376104938] (+0.000032242) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48165000, sopath = "/lib/librt-0.9.33.2.so", size = 12404, mtime = 1394229945 } [00:14:16.376144635] (+0.000039697) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x48179000, sopath = "/usr/lib/liburcu-bp.so.1.0.0", size = 15388, mtime = 1394548454 } [00:14:16.376184373] (+0.000039738) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x4818D000, sopath = "/usr/lib/liburcu-cds.so.1.0.0", size = 18216, mtime = 1394548454 } [00:14:16.376217363] (+0.000032990) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x481A2000, sopath = "/lib/libpthread-0.9.33.2.so", size = 70104, mtime = 1394229945 } [00:14:16.376257908] (+0.000040545) OpenWrt ust_baddr_statedump:soinfo:
{cpu_id= 0 }, { procname = "telnetd" }, { baddr =0x481C6000, sopath = "/usr/lib/liburcu-common.so.1.0.0", size = 3188, mtime = 1394548454 }----- dump 3 ------------
nm ipkg-install/bin/busybox | grep 'tracepoint\|busybox_telnetd\|lttng'
1007b124d__event_desc___busybox_telnetd1005f7d0R__event_desc___busybox_telnetd_err1005fee4R__event_desc___busybox_telnetd_info1005fea4R__event_desc___busybox_telnetd_session1005f998r__event_fields___busybox_telnetd___err1005f868r__event_fields___busybox_telnetd___info1005ff24r__event_fields___busybox_telnetd___session10016624 t__event_probe__busybox_telnetd___err100164a4t__event_probe__busybox_telnetd___info10016878 t__event_probe__busybox_telnetd___session1007b134d_format___busybox_telnetd___err1007b130d_format___busybox_telnetd___info1007b138d_format___busybox_telnetd___session
w_loglevel___busybox_telnetd___err
w_loglevel___busybox_telnetd___infow_loglevel___busybox_telnetd___session10016ca0t__lttng_events_exit__busybox_telnetd10016c3ct__lttng_events_init__busybox_telnetd
Ulttng_probe_register
Ulttng_probe_unregister
w_model_emf_uri___busybox_telnetd___errw_model_emf_uri___busybox_telnetd___infow_model_emf_uri___busybox_telnetd___session1007b13cd__probe_desc___busybox_telnetd1007c228b__probe_register_refcount___busybox_telnetd1007b1ecA__start___tracepoints_ptrs1007b1f8A__stop___tracepoints_ptrs1005fe70R__tp_event_signature___busybox_telnetd___err1005f858R__tp_event_signature___busybox_telnetd___info1005f810R__tp_event_signature___busybox_telnetd___session1006ac80r__tp_strtab_busybox_telnetd___err1006ac94r__tp_strtab_busybox_telnetd___info1006ac68r__tp_strtab_busybox_telnetd___session1007b180D__tracepoint_busybox_telnetd___err1007b1c8D__tracepoint_busybox_telnetd___info1007b1a4D__tracepoint_busybox_telnetd___session1007c210Vtracepoint_dlopen100155e8t__tracepoint__init_urcu_sym1007b250S__tracepoint_provider_busybox_telnetd1007b1f0d__tracepoint_ptr_busybox_telnetd___err1007b1f4d__tracepoint_ptr_busybox_telnetd___info1007b1ecd__tracepoint_ptr_busybox_telnetd___session1007b248V__tracepoint_ptrs_registered1007b24cV__tracepoint_registered
10015708 t__tracepoints__destroy10016ba4t__tracepoints__destroy
10015684 t__tracepoints__init10016ac4t__tracepoints__init
10015868 t__tracepoints__ptrs_destroy100157a0t__tracepoints__ptrs_init_______________________________________________
lttng-dev mailing list
[email protected]
http://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev--
Mathieu Desnoyers
EfficiOS Inc.
http://www.efficios.com--
Mathieu Desnoyers
EfficiOS Inc.
http://www.efficios.com