Skip to contentSkip to conversation

Viewing userspace apps traces

DISCUSSION Alexandre Montplaisir 7 participants 9 messages Oct 2, 2012 – Oct 5, 2012 8 messages not in the archive

lore
Share & tools
lore

A message that is not in the archive (sent off-list or not yet received): [email protected]

#1 lore raw

Hi Paul,

Quoted 9 lines · Paul Chavent

Hi.

Today, I've tested the tracing of a user space app.

I wonder what is the best solution for viewing it ?

I have tried babeltrace that produce a good comprehensive text outpout. I have tried eclipse that isn't able to use the vtid and vpid context. It's unfortunate as i would like to see a timeline representation...

Do you mean the Events view does not show the event contexts? It should, afaik. It could be a bug.

As for graphical views, like timegraphs, it's not easy to have a general view that can work with any UST trace. Each application defines its own event types, so we have no guarantee for any given event type to be there.

What would you like see in your "timeline representation" exactly? Maybe we could give you some pointers as to how to implement such a view. (We're currently working on making it easy to extend the framework to implement new views, so this could be a good exercise!)

Quoted 1 line

Is it a good solution to use the custom text parser of the eclipse tool ?

Not really, the custom parsers are, for example, when you have a text log and want to import it into the TMF framework. LTTng/UST traces are in CTF format, and that format is already supported in TMF.

Cheers,

Signature · 3 lines
Alexandre Montplaisir
DORSAL lab,
École Polytechnique de Montréal

A message that is not in the archive (sent off-list or not yet received): [email protected]

#3 lore raw

Hi

Thank you for your reply :

Quoted 16 lines · Alexandre Montplaisir

Hi Paul,

Quoted 9 lines · Paul Chavent

Hi.

Today, I've tested the tracing of a user space app.

I wonder what is the best solution for viewing it ?

I have tried babeltrace that produce a good comprehensive text outpout. I have tried eclipse that isn't able to use the vtid and vpid context. It's unfortunate as i would like to see a timeline representation...

Do you mean the Events view does not show the event contexts? It should, afaik. It could be a bug.

Quoted 8 lines

As for graphical views, like timegraphs, it's not easy to have a general view that can work with any UST trace. Each application defines its own event types, so we have no guarantee for any given event type to be there.

What would you like see in your "timeline representation" exactly? Maybe we could give you some pointers as to how to implement such a view. (We're currently working on making it easy to extend the framework to implement new views, so this could be a good exercise!)

I would like to see, eg, one line per tid, and on each line, the value of one context or argument value.

I'm ready to follow an exercise for extending the framework !

Quoted 11 lines
Quoted 2 lines

Is it a good solution to use the custom text parser of the eclipse tool ?

Not really, the custom parsers are, for example, when you have a text log and want to import it into the TMF framework. LTTng/UST traces are in CTF format, and that format is already supported in TMF.

Cheers,

A message that is not in the archive (sent off-list or not yet received): [email protected]

#5 lore raw

Sorry for the late reply, I had to update/rebase some of the stuff first...

(Cross-posting linuxtools-dev, as it might interest some people who follow that list too. This is about extending TMF to implement a graphical view for a specific UST trace type.)

Quoted 10 lines · Paul Chavent

[...]

Quoted 6 lines · Alexandre Montplaisir

[...]

What would you like see in your "timeline representation" exactly? Maybe we could give you some pointers as to how to implement such a view. (We're currently working on making it easy to extend the framework to implement new views, so this could be a good exercise!)

Quoted 4 lines

I would like to see, eg, one line per tid, and on each line, the value of one context or argument value.

I'm ready to follow an exercise for extending the framework !

Ok good! We don't have a nice tutorial ready yet, as most parts are still working their way upstream. But if you want to dig into it and try it out now, you can:

1 - Set up the development environment for TMF:
http://wiki.eclipse.org/Linux_Tools_Project/LTTng_Eclipse_Plug-in_Development_Environement_Setup

2 - Checkout the "lttng-kepler" branch in the git. This is where the latest development happens.

3 - Apply those two patches, in that order:
https://git.eclipse.org/r/#/c/7747/
https://git.eclipse.org/r/#/c/7748/
(you can copy-paste the "cherry-pick" command shown on the page)

4 - Download the example program and view from:
git://git.dorsal.polymtl.ca/~alexmont/ust-example.git

Now at this point you should be able to import and build the example plugins (ust.example.core and ust.example.ui) and the TMF/LTTng ones in the same workspace.

You can try it to make sure it works correctly : take a UST trace of the "myprog" program, and then load it into TMF, and show the "Example -> Connections" view. It should display the yellow and green rectangles corresponding to the states that were defined.

After that, it shouldn't be too hard (famous last words...) to rework the ust.example.* code to fit your application. The points of interest will be (before renames):

MyUstTraceInput, line 85+: This is where you assign your trace events to states
ConnectionsPresentationProvider, line 31-34: This is where you assign the colors to each state in the view
and same file, lines 64-68 and 81-85 : This is where you assign the trace's states to the ones in the view.
(one place is for the actual colored rectangle, the other is for the tooltips, iirc).

If you have any question or problem, please let me know!

Good luck ;)

Signature · 3 lines
Alexandre Montplaisir
DORSAL lab,
École Polytechnique de Montréal

A message that is not in the archive (sent off-list or not yet received): [email protected]

#7 lore raw

Hi Paul

The Eclipse Linux Tools release v1.1.1 (which is also included in the CDT EPP Juno SR1 release) contains an update that displays CTF context information in the events table. So you should be able to see the context information.

Best Regards
Bernd

Quoted 67 lines · Alexandre Montplaisir

Sorry for the late reply, I had to update/rebase some of the stuff first...

(Cross-posting linuxtools-dev, as it might interest some people who follow that list too. This is about extending TMF to implement a graphical view for a specific UST trace type.)

Quoted 5 lines · Paul Chavent

[...]

Quoted 2 lines · Alexandre Montplaisir

[...]

Quoted 8 lines
Quoted 4 lines

What would you like see in your "timeline representation" exactly? Maybe we could give you some pointers as to how to implement such a view. (We're currently working on making it easy to extend the framework to implement new views, so this could be a good exercise!)

I would like to see, eg, one line per tid, and on each line, the value of one context or argument value.

I'm ready to follow an exercise for extending the framework !

Ok good! We don't have a nice tutorial ready yet, as most parts are still working their way upstream. But if you want to dig into it and try it out now, you can:

1 - Set up the development environment for TMF:
http://wiki.eclipse.org/Linux_Tools_Project/LTTng_Eclipse_Plug-in_Development_Environement_Setup

2 - Checkout the "lttng-kepler" branch in the git. This is where the latest development happens.

3 - Apply those two patches, in that order:
https://git.eclipse.org/r/#/c/7747/
https://git.eclipse.org/r/#/c/7748/
(you can copy-paste the "cherry-pick" command shown on the page)

4 - Download the example program and view from:
git://git.dorsal.polymtl.ca/~alexmont/ust-example.git

Now at this point you should be able to import and build the example plugins (ust.example.core and ust.example.ui) and the TMF/LTTng ones in the same workspace.

You can try it to make sure it works correctly : take a UST trace of the "myprog" program, and then load it into TMF, and show the "Example -> Connections" view. It should display the yellow and green rectangles corresponding to the states that were defined.

After that, it shouldn't be too hard (famous last words...) to rework the ust.example.* code to fit your application. The points of interest will be (before renames):

MyUstTraceInput, line 85+: This is where you assign your trace events to states
ConnectionsPresentationProvider, line 31-34: This is where you assign the colors to each state in the view
and same file, lines 64-68 and 81-85 : This is where you assign the trace's states to the ones in the view.
(one place is for the actual colored rectangle, the other is for the tooltips, iirc).

If you have any question or problem, please let me know!

Good luck ;)

A message that is not in the archive (sent off-list or not yet received): [email protected]

#9 lore raw

Hi,

I've follow this link (http://www.eclipse.org/downloads/download.php?file=/technology/epp/downloads/release/juno/SR1/eclipse-cpp-juno-SR1-linux-gtk-x86_64.tar.gz) to download the Eclipse env.

Here is the version notes i can give you :
**************
Eclipse
Version: Juno Release
Build id: 20120614-1722

Eclipse Linux Tools LTTng ... 1.0.0.201206130106
**************

Then i've got my traces with :

lttng create
lttng enable-event -u -a
lttng add-context -u -t vpid -t vtid
lttng start
...
lttng stop
lttng destroy

Here is a sample of the traces :
http://paul.chavent.free.fr/tmp/sample_traces.tar.bz2

I can open the traces in eclipse (i see the "Events" panel), but i can't see the events ordered by pid/tid in the "Time Chart" panel, neither "Control Flow", nor "Ressources" ...)

Is it possible to have the traces displayed sorted by tid for instance ?

Thanks.

Paul.

Quoted 78 lines · eamcs/eedbhu

Hi Paul

The Eclipse Linux Tools release v1.1.1 (which is also included in the CDT EPP Juno SR1 release) contains an update that displays CTF context information in the events table. So you should be able to see the context information.

Best Regards
Bernd

Quoted 67 lines · Alexandre Montplaisir

Sorry for the late reply, I had to update/rebase some of the stuff first...

(Cross-posting linuxtools-dev, as it might interest some people who follow that list too. This is about extending TMF to implement a graphical view for a specific UST trace type.)

Quoted 5 lines · Paul Chavent

[...]

Quoted 2 lines · Alexandre Montplaisir

[...]

Quoted 8 lines
Quoted 4 lines

What would you like see in your "timeline representation" exactly? Maybe we could give you some pointers as to how to implement such a view. (We're currently working on making it easy to extend the framework to implement new views, so this could be a good exercise!)

I would like to see, eg, one line per tid, and on each line, the value of one context or argument value.

I'm ready to follow an exercise for extending the framework !

Ok good! We don't have a nice tutorial ready yet, as most parts are still working their way upstream. But if you want to dig into it and try it out now, you can:

1 - Set up the development environment for TMF:
http://wiki.eclipse.org/Linux_Tools_Project/LTTng_Eclipse_Plug-in_Development_Environement_Setup

2 - Checkout the "lttng-kepler" branch in the git. This is where the latest development happens.

3 - Apply those two patches, in that order:
https://git.eclipse.org/r/#/c/7747/
https://git.eclipse.org/r/#/c/7748/
(you can copy-paste the "cherry-pick" command shown on the page)

4 - Download the example program and view from:
git://git.dorsal.polymtl.ca/~alexmont/ust-example.git

Now at this point you should be able to import and build the example plugins (ust.example.core and ust.example.ui) and the TMF/LTTng ones in the same workspace.

You can try it to make sure it works correctly : take a UST trace of the "myprog" program, and then load it into TMF, and show the "Example -> Connections" view. It should display the yellow and green rectangles corresponding to the states that were defined.

After that, it shouldn't be too hard (famous last words...) to rework the ust.example.* code to fit your application. The points of interest will be (before renames):

MyUstTraceInput, line 85+: This is where you assign your trace events to states
ConnectionsPresentationProvider, line 31-34: This is where you assign the colors to each state in the view
and same file, lines 64-68 and 81-85 : This is where you assign the trace's states to the ones in the view.
(one place is for the actual colored rectangle, the other is for the tooltips, iirc).

If you have any question or problem, please let me know!

Good luck ;)

A message that is not in the archive (sent off-list or not yet received): [email protected]

A message that is not in the archive (sent off-list or not yet received): [email protected]

#12 lore raw

Hi Paul

I was trying your trace with the Eclipse Juno SR1 CDT EPP and you're right the context information is not displayed in the Events Table (I'm not talking about the Time Graph and its table).
I was verifying the commits and the commit that added the support for displaying of context information in the Events Table is in the release. As well as the example trace with context information I generated and tested with works. However, it was a Kernel trace with context information and not a UST trace.

So, that needs to be investigated on our side (Eclipse developer) why the context information is not shown for the UST trace. We'll let you know.

Best Regard
Bernd

Quoted 137 lines · Paul Chavent

Hi,

I've follow this link
(http://www.eclipse.org/downloads/download.php?file=/technology/epp/downloads/release/juno/SR1/eclipse-cpp-juno-SR1-linux-gtk-x86_64.tar.gz)
to download the Eclipse env.

Here is the version notes i can give you :
**************
Eclipse
Version: Juno Release
Build id: 20120614-1722

Eclipse Linux Tools LTTng ... 1.0.0.201206130106
**************

Then i've got my traces with :

lttng create
lttng enable-event -u -a
lttng add-context -u -t vpid -t vtid
lttng start
...
lttng stop
lttng destroy

Here is a sample of the traces :
http://paul.chavent.free.fr/tmp/sample_traces.tar.bz2

I can open the traces in eclipse (i see the "Events" panel), but i can't see the events ordered by pid/tid in the "Time Chart" panel, neither "Control Flow", nor "Ressources" ...)

Is it possible to have the traces displayed sorted by tid for instance ?

Thanks.

Paul.

Quoted 8 lines · eamcs/eedbhu

Hi Paul

The Eclipse Linux Tools release v1.1.1 (which is also included in the CDT EPP Juno SR1 release) contains an update that displays CTF context information in the events table.
So you should be able to see the context information.

Quoted 81 lines

Best Regards
Bernd

Quoted 75 lines · Alexandre Montplaisir

Sorry for the late reply, I had to update/rebase some of the stuff first...

(Cross-posting linuxtools-dev, as it might interest some people who follow that list too. This is about extending TMF to implement a graphical view for a specific UST trace type.)

Quoted 13 lines · Paul Chavent

[...]

Quoted 8 lines · Alexandre Montplaisir

[...]

What would you like see in your "timeline representation" exactly? Maybe
we could give you some pointers as to how to implement such a view. (We're currently working on making it easy to extend the framework to implement new views, so this could be a good exercise!)

Quoted 4 lines

I would like to see, eg, one line per tid, and on each line, the value of one context or argument value.

I'm ready to follow an exercise for extending the framework !

Ok good! We don't have a nice tutorial ready yet, as most parts are still working their way upstream. But if you want to dig into it and try it out now, you can:

1 - Set up the development environment for TMF:

http://wiki.eclipse.org/Linux_Tools_Project/LTTng_Eclipse_Plug-in_Development_Environement_Setup

2 - Checkout the "lttng-kepler" branch in the git. This is where the latest development happens.

3 - Apply those two patches, in that order:
https://git.eclipse.org/r/#/c/7747/
https://git.eclipse.org/r/#/c/7748/
(you can copy-paste the "cherry-pick" command shown on the page)

4 - Download the example program and view from:
git://git.dorsal.polymtl.ca/~alexmont/ust-example.git

Now at this point you should be able to import and build the example plugins (ust.example.core and ust.example.ui) and the TMF/LTTng ones in the same workspace.

You can try it to make sure it works correctly : take a UST trace of the "myprog" program, and then load it into TMF, and show the "Example -> Connections" view. It should display the yellow and green rectangles corresponding to the states that were defined.

After that, it shouldn't be too hard (famous last words...) to rework the ust.example.* code to fit your application. The points of interest will be (before renames):

MyUstTraceInput, line 85+: This is where you assign your trace events to states
ConnectionsPresentationProvider, line 31-34: This is where you assign the colors to each state in the view
and same file, lines 64-68 and 81-85 : This is where you assign the trace's states to the ones in the view.
(one place is for the actual colored rectangle, the other is for the tooltips, iirc).

If you have any question or problem, please let me know!

Good luck ;)

_______________________________________________
lttng-dev mailing list
[email protected]
http://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev

#13 lore raw

Thank you very much for handling this point.

Quoted 157 lines · Bernd Hufmann

Hi Paul

I was trying your trace with the Eclipse Juno SR1 CDT EPP and you're right the context information is not displayed in the Events Table (I'm not talking about the Time Graph and its table).
I was verifying the commits and the commit that added the support for displaying of context information in the Events Table is in the release. As well as the example trace with context information I generated and tested with works. However, it was a Kernel trace with context information and not a UST trace.

So, that needs to be investigated on our side (Eclipse developer) why the context information is not shown for the UST trace. We'll let you know.

Best Regard
Bernd

Quoted 137 lines · Paul Chavent

Hi,

I've follow this link
(http://www.eclipse.org/downloads/download.php?file=/technology/epp/downloads/release/juno/SR1/eclipse-cpp-juno-SR1-linux-gtk-x86_64.tar.gz)
to download the Eclipse env.

Here is the version notes i can give you :
**************
Eclipse
Version: Juno Release
Build id: 20120614-1722

Eclipse Linux Tools LTTng ... 1.0.0.201206130106
**************

Then i've got my traces with :

lttng create
lttng enable-event -u -a
lttng add-context -u -t vpid -t vtid
lttng start
...
lttng stop
lttng destroy

Here is a sample of the traces :
http://paul.chavent.free.fr/tmp/sample_traces.tar.bz2

I can open the traces in eclipse (i see the "Events" panel), but i can't see the events ordered by pid/tid in the "Time Chart" panel, neither "Control Flow", nor "Ressources" ...)

Is it possible to have the traces displayed sorted by tid for instance ?

Thanks.

Paul.

Quoted 8 lines · eamcs/eedbhu

Hi Paul

The Eclipse Linux Tools release v1.1.1 (which is also included in the CDT EPP Juno SR1 release) contains an update that displays CTF context information in the events table.
So you should be able to see the context information.

Quoted 81 lines

Best Regards
Bernd

Quoted 75 lines · Alexandre Montplaisir

Sorry for the late reply, I had to update/rebase some of the stuff first...

(Cross-posting linuxtools-dev, as it might interest some people who follow that list too. This is about extending TMF to implement a graphical view for a specific UST trace type.)

Quoted 13 lines · Paul Chavent

[...]

Quoted 8 lines · Alexandre Montplaisir

[...]

What would you like see in your "timeline representation" exactly? Maybe
we could give you some pointers as to how to implement such a view. (We're currently working on making it easy to extend the framework to implement new views, so this could be a good exercise!)

Quoted 4 lines

I would like to see, eg, one line per tid, and on each line, the value of one context or argument value.

I'm ready to follow an exercise for extending the framework !

Ok good! We don't have a nice tutorial ready yet, as most parts are still working their way upstream. But if you want to dig into it and try it out now, you can:

1 - Set up the development environment for TMF:

http://wiki.eclipse.org/Linux_Tools_Project/LTTng_Eclipse_Plug-in_Development_Environement_Setup

2 - Checkout the "lttng-kepler" branch in the git. This is where the latest development happens.

3 - Apply those two patches, in that order:
https://git.eclipse.org/r/#/c/7747/
https://git.eclipse.org/r/#/c/7748/
(you can copy-paste the "cherry-pick" command shown on the page)

4 - Download the example program and view from:
git://git.dorsal.polymtl.ca/~alexmont/ust-example.git

Now at this point you should be able to import and build the example plugins (ust.example.core and ust.example.ui) and the TMF/LTTng ones in the same workspace.

You can try it to make sure it works correctly : take a UST trace of the "myprog" program, and then load it into TMF, and show the "Example -> Connections" view. It should display the yellow and green rectangles corresponding to the states that were defined.

After that, it shouldn't be too hard (famous last words...) to rework the ust.example.* code to fit your application. The points of interest will be (before renames):

MyUstTraceInput, line 85+: This is where you assign your trace events to states
ConnectionsPresentationProvider, line 31-34: This is where you assign the colors to each state in the view
and same file, lines 64-68 and 81-85 : This is where you assign the trace's states to the ones in the view.
(one place is for the actual colored rectangle, the other is for the tooltips, iirc).

If you have any question or problem, please let me know!

Good luck ;)

_______________________________________________
lttng-dev mailing list
[email protected]
http://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev

A message that is not in the archive (sent off-list or not yet received): 524C960C5DFC794E82BE548D825F05CF5BC6F694@EU-MBX-01.mgc.mentorg.com

#16 lore raw
Quoted 5 lines · * Oestman, Fredrik ([email protected]) wrote:
Quoted 3 lines · Alexandre Montplaisir

As for graphical views, like timegraphs, it's not easy to have a general view that can work with any UST trace. Each application defines its own event types, so we have no guarantee for any given event type to be there.

Quoted 7 lines

Maybe this doesn't really help you, but our commercial tool can do just that.

Cheers,

Fredrik Östman

http://go.mentor.com/sourceryanalyzer/

Hi Fredrik,

Hinting at this tool in this context (discussion of an open source viewer implementation) on lttng-dev (an open source project mailing list) can only mean that you seem to be willing to contribute views to the open source project. That would be very welcome indeed. What are Mentor's plans in contributing to the open source viewer efforts of the LTTng project ?

Thank you,

Mathieu

Signature · 4 lines
Mathieu Desnoyers
Operating System Efficiency R&D Consultant
EfficiOS Inc.
http://www.efficios.com