Hotplug Test Cases or Test Procedures
I have a couple of people that have been tasked to start testing the CompactPCI hotplug
implementation for a couple of platforms, and was wondering if there was an existing test case or test procedure repository for the hotplug project. From poking
around the web site I didn't stumble across anything, but it wouldn't be the first time
I missed the obvious.
If there is no such thing, where would people like to see such contributions? At the
very least, this would consist of a few text documents that detailed step by step manual
procedures for a tester to validate the latest bits on some platform.
Would this be something people would like to see in the hotplug CVS repository?
Maybe I could approach the LTP?
-rustyl
-------------------------------------------------------
This sf.net email is sponsored by: To learn the basics of securing your web site with SSL, click here to get a FREE TRIAL of a Thawte Server Certificate: http://www.gothawte.com/rd524.html
_______________________________________________
Linux-hotplug-devel mailing list http://linux-hotplug.sourceforge.net
[email protected]
https://lists.sourceforge.net/lists/listinfo/linux-hotplug-devel
Quoted 4 lines · Rusty Lynch
I have a couple of people that have been tasked to start testing the CompactPCI hotplug implementation for a couple of platforms, and was wondering if there was an existing test case or test procedure repository for the hotplug project.
Yeah, testers! :)
No, there aren't any published test procedures that I know of. I know a number of different companies have some private ones that they have used to test their specific drivers, but so far, I have not been able to convince anyone of them to make them public.
Quoted 2 lines
From poking around the web site I didn't stumble across anything, but it wouldn't be the first time I missed the obvious.
Um, don't confuse the linux-hotplug project with the PCI hotplug project. They are two different things (but the PCI hotplug code relies on the linux-hotplug userspace code to load any needed modules, so they are intertwined a bit).
Quoted 4 lines
If there is no such thing, where would people like to see such contributions? At the very least, this would consist of a few text documents that detailed step by step manual procedures for a tester to validate the latest bits on some platform.
That would be great, I would love to have this for my use alone in testing new code out.
Quoted 2 lines
Would this be something people would like to see in the hotplug CVS repository?
Um, maybe in the pci hotplug cvs repository, if you really want to use CVS. Or we can just put it up on the web site.
Quoted 1 line
Maybe I could approach the LTP?
Traditionally they have only wanted tests that they can automate, and unfortunately, pci hotplug tests (and most driver tests) can't be automated very easily. But it can't hurt to try asking them :)
thanks,
greg k-h
-------------------------------------------------------
This sf.net email is sponsored by: To learn the basics of securing your web site with SSL, click here to get a FREE TRIAL of a Thawte Server Certificate: http://www.gothawte.com/rd524.html
_______________________________________________
Linux-hotplug-devel mailing list http://linux-hotplug.sourceforge.net
[email protected]
https://lists.sourceforge.net/lists/listinfo/linux-hotplug-devel
----- Original Message -----
From: "Greg KH" <[email protected]>
To: "Rusty Lynch" <[email protected]>
Cc: <[email protected]>
Sent: Tuesday, November 19, 2002 6:47 PM
Subject: Re: Hotplug Test Cases or Test Procedures
Quoted 13 lines · Rusty Lynch
Quoted 4 lines
I have a couple of people that have been tasked to start testing the CompactPCI hotplug implementation for a couple of platforms, and was wondering if there was an existing test case or test procedure repository for the hotplug project.
Yeah, testers! :)
No, there aren't any published test procedures that I know of. I know a number of different companies have some private ones that they have used to test their specific drivers, but so far, I have not been able to convince anyone of them to make them public.
Quoted 8 lines
Quoted 2 lines
From poking around the web site I didn't stumble across anything, but it wouldn't be the first time I missed the obvious.
Um, don't confuse the linux-hotplug project with the PCI hotplug project. They are two different things (but the PCI hotplug code relies on the linux-hotplug userspace code to load any needed modules, so they are intertwined a bit).
Yeap, I'm mixing up the projects. Although I'm betting that the test procedures will end up covering both.
Quoted 5 lines
Quoted 4 lines
If there is no such thing, where would people like to see such contributions? At the very least, this would consist of a few text documents that detailed step by step manual procedures for a tester to validate the latest bits on some platform.
Quoted 8 lines
That would be great, I would love to have this for my use alone in testing new code out.
Quoted 2 lines
Would this be something people would like to see in the hotplug CVS repository?
Um, maybe in the pci hotplug cvs repository, if you really want to use CVS. Or we can just put it up on the web site.
Writing the procedures as html and making them accessable via the web site sounds like a good way to start.
Quoted 6 lines
Quoted 2 lines
Maybe I could approach the LTP?
Traditionally they have only wanted tests that they can automate, and unfortunately, pci hotplug tests (and most driver tests) can't be automated very easily. But it can't hurt to try asking them :)
I'll ping the LTP people to see if they are interested, but that shouldn't slow us down any.
Quoted 6 lines
thanks,
greg k-h
Quoted 8 lines
-------------------------------------------------------
This sf.net email is sponsored by: To learn the basics of securing your web site with SSL, click here to get a FREE TRIAL of a Thawte Server Certificate: http://www.gothawte.com/rd524.html
_______________________________________________
Linux-hotplug-devel mailing list http://linux-hotplug.sourceforge.net
[email protected]
https://lists.sourceforge.net/lists/listinfo/linux-hotplug-devel
-------------------------------------------------------
This sf.net email is sponsored by: To learn the basics of securing your web site with SSL, click here to get a FREE TRIAL of a Thawte Server Certificate: http://www.gothawte.com/rd524.html
_______________________________________________
Linux-hotplug-devel mailing list http://linux-hotplug.sourceforge.net
[email protected]
https://lists.sourceforge.net/lists/listinfo/linux-hotplug-devel
Hi Rusty,
What would you want the testcases or procedures to cover? Are there tools, like 'cardctl eject' for cardbus/pcmcia, that interact with hotplug events in testable ways? Particular drivers/hardware to test, maybe with setup scripts, or just certain core functionality?
I don't know of any particular tests, but it'd be good to have some!
It's easy enough to handle the "do modules X, Y, and Z load" parts, maybe even use a 'cardctl' analogue to simulate card insert/eject, and that part is driver-independent. Stuff like setup scripts is harder to characterize, as well as driver-specific (except for the essentials like "did the script get run").
It's not the same, but there is some info about debugging at the sf.net site (http://linux-hotplug.sourceforge.net/?selectedÞbug) which talks about applying one test technique when debugging ... it could easily get used in regression testing:
- save events
- play back later
- do they produce the intended result?
I suspect a "save the events" routine should be part of the standard hotplug toolset, it'd have more uses than just debug, test, or logging.
Quoted 2 lines
Quoted 2 lines
Quoted 2 lines
Would this be something people would like to see in the hotplug CVS repository?
If it's really addressing the ways that user mode tools are alerted through /sbin/hotplug and /etc/hotplug/* support, I'd hope so! Certainly everything that's shared with the other hotpluggable pci busses should be there, and I agree with you that
Quoted 5 lines
Quoted 1 line
.. Or we can just put it up on the web site.
Writing the procedures as html and making them accessable via the web site sounds like a good way to start.
Yes. Some would need to stay that way (where people need to do things like swap cards around), no matter how much can be automated.
Are you volunteering to maintain those pages?
Quoted 9 lines
Quoted 5 lines
Quoted 1 line
Maybe I could approach the LTP?
Traditionally they have only wanted tests that they can automate, and unfortunately, pci hotplug tests (and most driver tests) can't be automated very easily. But it can't hurt to try asking them :)
I'll ping the LTP people to see if they are interested, but that shouldn't slow us down any.
See above. Some kinds of testing _can_ be automated without needing industrial robotics!
- Dave
-------------------------------------------------------
This sf.net email is sponsored by: To learn the basics of securing your web site with SSL, click here to get a FREE TRIAL of a Thawte Server Certificate: http://www.gothawte.com/rd524.html
_______________________________________________
Linux-hotplug-devel mailing list http://linux-hotplug.sourceforge.net
[email protected]
https://lists.sourceforge.net/lists/listinfo/linux-hotplug-devel
Quoted 6 lines
Hi Rusty,
What would you want the testcases or procedures to cover? Are there tools, like 'cardctl eject' for cardbus/pcmcia, that interact with hotplug events in testable ways? Particular
drivers/hardwareto test, maybe with setup scripts, or just certain core functionality?
We are just starting to scope this work out, so we don't know what it will entail. Initially we need to validate the operation of a couple of cPCI systems ranging from basic functionality of the zt5550 driver to system wide testing to verify once a given peripheral board is inserted, all of the hotplug actions (like loading a driver) happen. Eventually there are other bladed architectures with hotplug capibilities people are dreaming up that my group will need to help implement and test on Linux.
I'm sure a lot of these test will be very specific a given setup (i.e. a given
platform hotpluging a specific device), but at the very least it would be nice
to provide a common way for people to upload other test procedures.
This ping is really my attempt at getting my group to work effectivly in open source. It is just too easy to go off and implement something behind close doors only to find out you did it in a way that is not very useful to the rest of the world.
Quoted 15 lines
I don't know of any particular tests, but it'd be good to have some!
It's easy enough to handle the "do modules X, Y, and Z load" parts, maybe even use a 'cardctl' analogue to simulate card insert/eject, and that part is driver-independent. Stuff like setup scripts is harder to characterize, as well as driver-specific (except for the essentials like "did the script get run").
It's not the same, but there is some info about debugging at the sf.net site (http://linux-hotplug.sourceforge.net/?selectedÞbug) which talks about applying one test technique when debugging ... it could easily get used in regression testing:
Quoted 7 lines
- save events
- play back later
- do they produce the intended result?I suspect a "save the events" routine should be part of the standard hotplug toolset, it'd have more uses than just debug, test, or logging.
Cool. Thanks for the pointer.
Quoted 15 lines
Quoted 3 lines
Quoted 3 lines
Quoted 3 lines
Would this be something people would like to see in the hotplug CVS repository?
If it's really addressing the ways that user mode tools are alerted through
/sbin/hotplugand/etc/hotplug/*support, I'd hope so! Certainly everything that's shared with the other hotpluggable pci busses should be there, and I agree with you thatQuoted 4 lines
Quoted 1 line
.. Or we can just put it up on the web site.
Writing the procedures as html and making them accessable via the web
site
Quoted 7 lines
Quoted 1 line
sounds like a good way to start.
Yes. Some would need to stay that way (where people need to do things like swap cards around), no matter how much can be automated.
Are you volunteering to maintain those pages?
Yeap. I can do that. Actually I will be pulling in Guomin to work on this. Guomin is just starting to get familiar with hotplug and pci hotplug, so there will be some ramp up time.
Quoted 9 lines
Quoted 9 lines
Quoted 6 lines
Quoted 2 lines
Maybe I could approach the LTP?
Traditionally they have only wanted tests that they can automate, and unfortunately, pci hotplug tests (and most driver tests) can't be automated very easily. But it can't hurt to try asking them :)
I'll ping the LTP people to see if they are interested, but that
shouldn't
Quoted 4 lines
Quoted 1 line
slow us down any.
See above. Some kinds of testing _can_ be automated without needing industrial robotics!
BTW, I talked with Stephanie Glass of the LTP project, and she believes that there is a place we can put manual test procedures. There test will just not be part of the "run all" test cases.
I'm thinking adding test to LTP could be a long term goal, but we should know more after something materializes.
Quoted 4 lines
- Dave
-------------------------------------------------------
This sf.net email is sponsored by: To learn the basics of securing your web site with SSL, click here to get a FREE TRIAL of a Thawte Server Certificate: http://www.gothawte.com/rd524.html
_______________________________________________
Linux-hotplug-devel mailing list http://linux-hotplug.sourceforge.net
[email protected]
https://lists.sourceforge.net/lists/listinfo/linux-hotplug-devel