Filesystem test tools open-sourced by SGI
Subsystems (3)
G'day,
SGI is releasing to the Open Source community a number of internal SGI testing and debugging tools for NFS. Some of these tools are also applicable to filesystems in general.
These tools are being released under the GNU General Public License (GPL) version 2, in the hope that the Linux filesystem development community may find them useful. They are provided as-is, without any support. Please do not contact SGI for support on any of these tools.
Some of these tools are unfinished. Others rely on build infrastructure in internal SGI trees which cannot be released. The tools are provided as tarball snapshots of internal SGI source control trees; for a number of technical reasons it is not possible to provide access to those trees or to create external repositories.
The tools are available for download now at
http://oss.sgi.com/projects/nfs/testtools/
A brief description of each tool follows.
Checkstream
-----------
Simple data corruption testing utilities based on the concept of generating a stream of small self-contained records which can be decoded in a way which makes certain common data corruption modes automatically diagnosable. Has been useful for automated testing of NFS, XFS, and CXFS in SGI.
Weber
-----
Test load generator for NFS. Uses multiple threads, multiple sockets and multiple IP addresses to simulate loads from many machines, thus enabling testing of NFS server setups with larger client counts than can be tested with physical infrastructure (or Virtual Machine clients). Has been useful in automated NFS testing and as a pinpoint NFS load generator tool for performance development.
NFS PMDA
--------
PCP Data Agent for extended NFS server statistics. Exports to PCP the new statistics (measuring per-client and per-server performance) which are provided by SGI's EnhancedNFS kernel patches.
Samba PMDA
----------
PCP Data Agent for extended Samba server statistics. Exports to PCP the additional statistics (measuring per-client and per-server performance) which are provided by SGI's patches to Samba.
Ddnfs
-----
Filesystem load generation program designed to simulate the IO load placed on an XFS filesystem by the NFS server in response to certain NFS loads. Intended for use in XFS automated testing, to test performance and correctness of certain XFS functionality not otherwise exercised by the existing XFS test suite, but never integrated into XFSQA.
Pmapload
--------
Test suite for the portmap and rpcbind programs (which are NFS infrastructure components based on code open-sourced by Sun Microsystems and used by every Unix and Linux). Developed by SGI to test changes imported into those programs from newer Sun source code during the NFS on IPv6 work for Irix several years ago.
RPC Exerciser
-------------
Test suite for the userspace RPC infrastructure libraries, (which are NFS infrastructure components based on code open-sourced by Sun Microsystems and used by every Unix and Linux). Developed by SGI to test changes imported into those libraries from newer Sun source code during the NFS on IPv6 work for Irix several years ago.
Testfs
------
Linux kernel module which provides an in-memory filesystem which forgets all data written to it. Also can be configured to simulate timing behaviour on reads and writes. This is useful for NFS performance testing without a fast disk subsystem.
StReplay
--------
Program which reads the system call trace of another program (obtained using the widely available strace utility) and replays the IO pattern. This was intended to be used for automated NFS and XFS testing and for NFS and XFS problem diagnosis, but was never completed as the author transferred to another team. Could be the basis for a very useful filesystem test tool.
Signature · 3 lines
Greg Banks, P.Engineer, SGI Australian Software Group. the brightly coloured sporks of revolution. I don't speak for SGI.
Hi Greg,
Quoted 17 lines · Greg Banks
G'day,
SGI is releasing to the Open Source community a number of internal SGI testing and debugging tools for NFS. Some of these tools are also applicable to filesystems in general.
These tools are being released under the GNU General Public License (GPL) version 2, in the hope that the Linux filesystem development community may find them useful. They are provided as-is, without any support. Please do not contact SGI for support on any of these tools.
Some of these tools are unfinished. Others rely on build infrastructure in internal SGI trees which cannot be released. The tools are provided as tarball snapshots of internal SGI source control trees; for a number of technical reasons it is not possible to provide access to those trees or to create external repositories.
Quoted 3 lines
The tools are available for download now at
Since, these are released under GPL, i hope integrating them inside LTP (
http://ltp.sf.net) after proper analysis will not be an issue. Since, no support for these tests will be available from SGI, i am hoping that having them inside LTP will be beneficial and help these tests to evolve in the long run.
Regards--
Subrata
(Happens to maintain LTP :-))
Quoted 94 lines
A brief description of each tool follows.
Checkstream
-----------Simple data corruption testing utilities based on the concept of generating a stream of small self-contained records which can be decoded in a way which makes certain common data corruption modes automatically diagnosable. Has been useful for automated testing of NFS, XFS, and CXFS in SGI.
Weber
-----Test load generator for NFS. Uses multiple threads, multiple sockets and multiple IP addresses to simulate loads from many machines, thus enabling testing of NFS server setups with larger client counts than can be tested with physical infrastructure (or Virtual Machine clients). Has been useful in automated NFS testing and as a pinpoint NFS load generator tool for performance development.
NFS PMDA
--------PCP Data Agent for extended NFS server statistics. Exports to PCP the new statistics (measuring per-client and per-server performance) which are provided by SGI's EnhancedNFS kernel patches.
Samba PMDA
----------PCP Data Agent for extended Samba server statistics. Exports to PCP the additional statistics (measuring per-client and per-server performance) which are provided by SGI's patches to Samba.
Ddnfs
-----Filesystem load generation program designed to simulate the IO load placed on an XFS filesystem by the NFS server in response to certain NFS loads. Intended for use in XFS automated testing, to test performance and correctness of certain XFS functionality not otherwise exercised by the existing XFS test suite, but never integrated into XFSQA.
Pmapload
--------Test suite for the portmap and rpcbind programs (which are NFS infrastructure components based on code open-sourced by Sun Microsystems and used by every Unix and Linux). Developed by SGI to test changes imported into those programs from newer Sun source code during the NFS on IPv6 work for Irix several years ago.
RPC Exerciser
-------------Test suite for the userspace RPC infrastructure libraries, (which are NFS infrastructure components based on code open-sourced by Sun Microsystems and used by every Unix and Linux). Developed by SGI to test changes imported into those libraries from newer Sun source code during the NFS on IPv6 work for Irix several years ago.
Testfs
------Linux kernel module which provides an in-memory filesystem which forgets all data written to it. Also can be configured to simulate timing behaviour on reads and writes. This is useful for NFS performance testing without a fast disk subsystem.
StReplay
--------Program which reads the system call trace of another program (obtained using the widely available strace utility) and replays the IO pattern. This was intended to be used for automated NFS and XFS testing and for NFS and XFS problem diagnosis, but was never completed as the author transferred to another team. Could be the basis for a very useful filesystem test tool.
--
Greg Banks, P.Engineer, SGI Australian Software Group. the brightly coloured sporks of revolution.
I don't speak for SGI.--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/
Signature · 2 lines
Regards & Thanks-- Subrata
------------------------------------------------------------------------------
_______________________________________________
Ltp-list mailing list [email protected]
https://lists.sourceforge.net/lists/listinfo/ltp-list
Quoted 10 lines · Subrata Modak
Hi Greg,
Quoted 4 lines · Greg Banks
The tools are available for download now at
Since, these are released under GPL, i hope integrating them inside LTP
(http://ltp.sf.net) after proper analysis will not be an issue.
Not an issue at all, in fact it would be the optimal result. The question was asked during the open source review process :-)
Quoted 4 lines
Since, no
support for these tests will be available from SGI, i am hoping that having them inside LTP will be beneficial and help these tests to evolve in the long run.
Great. I'll have some spare time starting from next week and I'm familiar with the tools: how can I help?
Signature · 5 lines
Greg. -- To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
Hi Greg,
Quoted 15 lines · Greg Banks
Quoted 10 lines · Subrata Modak
Hi Greg,
Quoted 4 lines · Greg Banks
The tools are available for download now at
Since, these are released under GPL, i hope integrating them inside LTP
(http://ltp.sf.net) after proper analysis will not be an issue.Not an issue at all, in fact it would be the optimal result. The question was asked during the open source review process :-)
Quoted 7 lines
Quoted 4 lines
Since, no
support for these tests will be available from SGI, i am hoping that having them inside LTP will be beneficial and help these tests to evolve in the long run.Great. I'll have some spare time starting from next week and I'm familiar with the tools: how can I help?
Thanks for offering to help. I will get back to you sooner on any issue(s) i face.
Regards--
Subrata