Mirror a file system on the fly
Hi list,
Not too sure if this is the right forum to ask this question but since my requirement is around linux filesystems, I shall take this liberty to post my question.
My requirement is to develop a kernel/user space module to add an extension to the shell program environment such that this shell forks a mirror look-alike filesystem of the underlying OS to the programs run in that particular shell.
Was trying to look thru the FAQ and a few list archives to look for ideas around my requirement. The archives were overwhelming.
Any ideas/pointers will be a great help,
Gracias,
decebel
Quoted 10 lines · Dave Schwartz
Hi list,
Not too sure if this is the right forum to ask this question but since my requirement is around linux filesystems, I shall take this liberty to post my question.
My requirement is to develop a kernel/user space module to add an extension to the shell program environment such that this shell forks a mirror look-alike filesystem of the underlying OS to the programs run in that particular shell.
u seem to be talking about namespaces, if I get you right.
there is a flag CLONE_NEWNS to the system call 'clone' which does what u r talking about.
RP
Quoted 13 lines
Was trying to look thru the FAQ and a few list archives to look for ideas around my requirement. The archives were overwhelming.
Any ideas/pointers will be a great help,
Gracias,
decebel
-
To unsubscribe from this list: send the line "unsubscribe linux-fsdevel" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Hi Ram,
Thanks for the inputs. I was going over the man pages describing the clone system call and its option of CLONE_NEWNS. Could understand the description only in parts.
The man page suggests that this flag when set, the cloned child is started in a new name space, initialized with a copy of the parent. Now does that mean, a program like a shell when cloned with CLONE_NEWNS set, will have a copy of file hierarchy of the underlying parent process?
Gracias,
decebel
Quoted 37 lines · Ram Pai
Quoted 10 lines · Dave Schwartz
Hi list,
Not too sure if this is the right forum to ask this question but since my requirement is around linux filesystems, I shall take this liberty to post my question.
My requirement is to develop a kernel/user space module to add an extension to the shell program environment such that this shell forks a mirror look-alike filesystem of the underlying OS to the programs run in that particular shell.
u seem to be talking about namespaces, if I get you right.
there is a flag
CLONE_NEWNSto the system call 'clone' which does what u r talking about.RP
Quoted 13 lines
Was trying to look thru the FAQ and a few list archives to look for ideas around my requirement. The archives were overwhelming.
Any ideas/pointers will be a great help,
Gracias,
decebel
-
To unsubscribe from this list: send the line "unsubscribe linux-fsdevel" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Quoted 10 lines · Dave Schwartz
Hi Ram,
Thanks for the inputs. I was going over the man pages describing the clone system call and its option ofCLONE_NEWNS. Could understand the description only in parts.The man page suggests that this flag when set, the cloned child is started in a new name space, initialized with a copy of the parent. Now does that mean, a program like a shell when cloned with
CLONE_NEWNSset, will have a copy of file hierarchy of the underlying parent process?
Yes the child process will see an exact copy of all the mounts of various filesystems as that of the parent. However if you mount/unmount any filesystems in the child, the same will not be mounted/unmounted in the parent and vice-versa. Each has its individual view of the the filesystem heirarchy.
Try the following program that clones off a child process with a mirror namespace and gives you a bash prompt. Try mounting and unmounting in this bash prompt and see if the same is visible in a totally different window.
#include <stdio.h> #include <signal.h> #include <sched.h>
char somemem[4096];
int myfunc(){
system("bash");
}intmain(int argc, char *argv[])
{
if(clone(myfunc, somemem, CLONE_NEWNS|SIGCHLD, NULL)) {
wait(NULL);
} else {
printf("clone failed\n");
}
printf("exit\n");
}Hope this helps,
RP
Quoted 48 lines
Gracias,
decebelQuoted 12 lines · Ram Pai
Quoted 10 lines · Dave Schwartz
Hi list,
Not too sure if this is the right forum to ask this question but since my requirement is around linux filesystems, I shall take this liberty to post my question.
My requirement is to develop a kernel/user space module to add an extension to the shell program environment such that this shell forks a mirror look-alike filesystem of the underlying OS to the programs run in that particular shell.
Quoted 25 lines
u seem to be talking about namespaces, if I get you right.
there is a flag
CLONE_NEWNSto the system call 'clone' which does what u r talking about.RP
Quoted 13 lines
Was trying to look thru the FAQ and a few list archives to look for ideas around my requirement. The archives were overwhelming.
Any ideas/pointers will be a great help,
Gracias,
decebel
-
To unsubscribe from this list: send the line "unsubscribe linux-fsdevel" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html-
To unsubscribe from this list: send the line "unsubscribe linux-fsdevel" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Ram,
Your code snippet seems to work great as discussed. Thanks. :-) However, my requirement is slightly different. What I also want is that any file created from the mirrored/cloned file-system must not be available in the parent file system.
Gracias,
decebel
Quoted 102 lines · Ram Pai
Quoted 10 lines · Dave Schwartz
Hi Ram,
Thanks for the inputs. I was going over the man pages describing the clone system call and its option ofCLONE_NEWNS. Could understand the description only in parts.The man page suggests that this flag when set, the cloned child is started in a new name space, initialized with a copy of the parent. Now does that mean, a program like a shell when cloned with
CLONE_NEWNSset, will have a copy of file hierarchy of the underlying parent process?Yes the child process will see an exact copy of all the mounts of various filesystems as that of the parent. However if you mount/unmount any filesystems in the child, the same will not be mounted/unmounted in the parent and vice-versa. Each has its individual view of the the filesystem heirarchy.
Try the following program that clones off a child process with a mirror namespace and gives you a bash prompt. Try mounting and unmounting in this bash prompt and see if the same is visible in a totally different window.
#include <stdio.h> #include <signal.h> #include <sched.h>char somemem[4096];
int myfunc(){ system("bash"); }int
main(int argc, char *argv[]){ if(clone(myfunc, somemem, CLONE_NEWNS|SIGCHLD, NULL)) { wait(NULL); } else { printf("clone failed\n"); } printf("exit\n"); }Hope this helps,
RPQuoted 48 lines
Gracias,
decebelQuoted 12 lines · Ram Pai
Quoted 10 lines · Dave Schwartz
Hi list,
Not too sure if this is the right forum to ask this question but since my requirement is around linux filesystems, I shall take this liberty to post my question.
My requirement is to develop a kernel/user space module to add an extension to the shell program environment such that this shell forks a mirror look-alike filesystem of the underlying OS to the programs run in that particular shell.
Quoted 25 lines
u seem to be talking about namespaces, if I get you right.
there is a flag
CLONE_NEWNSto the system call 'clone' which does what u r talking about.RP
Quoted 13 lines
Was trying to look thru the FAQ and a few list archives to look for ideas around my requirement. The archives were overwhelming.
Any ideas/pointers will be a great help,
Gracias,
decebel
-
To unsubscribe from this list: send the line "unsubscribe linux-fsdevel" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html-
To unsubscribe from this list: send the line "unsubscribe linux-fsdevel" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Quoted 129 lines · Dave Schwartz
Ram,
Your code snippet seems to work great as discussed. Thanks. :-) However, my requirement is slightly different. What I also want is that any file created from the mirrored/cloned file-system must not be available in the parent file system.
Gracias,
decebelQuoted 49 lines · Ram Pai
Quoted 5 lines · Dave Schwartz
Hi Ram,
Thanks for the inputs. I was going over the man pages describing the clone system call and its option ofCLONE_NEWNS. Could understand the description only in parts.Quoted 7 lines
The man page suggests that this flag when set, the cloned child is started in a new name space, initialized with a copy of the parent. Now does that mean, a program like a shell when cloned with
CLONE_NEWNSset, will have a copy of file hierarchy of the underlying parent process?Yes the child process will see an exact copy of all the mounts of various filesystems as that of the parent. However if you mount/unmount any filesystems in the child, the same will not be mounted/unmounted in the parent and vice-versa. Each has its individual view of the the filesystem heirarchy.
Try the following program that clones off a child process with a mirror namespace and gives you a bash prompt. Try mounting and unmounting in this bash prompt and see if the same is visible in a totally different window.
#include <stdio.h> #include <signal.h> #include <sched.h>char somemem[4096];
int myfunc(){ system("bash"); }int
main(int argc, char *argv[]){ if(clone(myfunc, somemem, CLONE_NEWNS|SIGCHLD, NULL)) { wait(NULL); } else { printf("clone failed\n"); } printf("exit\n"); }Quoted 66 lines
Hope this helps,
RPQuoted 56 lines
Gracias,
decebelQuoted 15 lines · Ram Pai
Quoted 12 lines · Dave Schwartz
Hi list,
Not too sure if this is the right forum to ask this question but since my requirement is around linux filesystems, I shall take this liberty to post my question.
My requirement is to develop a kernel/user space module to add an extension to the shell program environment such that this shell forks a mirror look-alike filesystem of the underlying OS to the programs run in that particular shell.
Quoted 27 lines
u seem to be talking about namespaces, if I get you right.
there is a flag
CLONE_NEWNSto the system call 'clone' which does what u r talking about.RP
Quoted 13 lines
Was trying to look thru the FAQ and a few list archives to look for ideas around my requirement. The archives were overwhelming.
Any ideas/pointers will be a great help,
Gracias,
decebel
-
To unsubscribe from this list: send the line "unsubscribe linux-fsdevel" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html-
To unsubscribe from this list: send the line "unsubscribe linux-fsdevel" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Quoted 8 lines
-
To unsubscribe from this list: send the line "unsubscribe linux-fsdevel" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
You might want to look into a project I work on called unionfs It contains code for sandboxing which is what your looking to do. The current code base is available for both 2.4 and 2.6 so you can do this with either kernel version. You can find the source at http://www.filesystems.org/project-unionfs.html the split cache source is what you should be looking at. It will give you an example of how to create a small sandbox. If you think unionfs itself can be used for your purposes Ide suggest asking on their mailing list..
Dave Quigley
Quoted 12 lines · Dave Schwartz
Hi list,
Not too sure if this is the right forum to ask this question but since my requirement is around linux filesystems, I shall take this liberty to post my question.
My requirement is to develop a kernel/user space module to add an extension to the shell program environment such that this shell forks a mirror look-alike filesystem of the underlying OS to the programs run in that particular shell.
Quoted 5 lines
Was trying to look thru the FAQ and a few list archives to look for ideas around my requirement. The archives were overwhelming.
Any ideas/pointers will be a great help,
The chroot command and mount --bind should give you a good start.
Quoted 2 lines
Gracias,
decebel
Signature · 2 lines
David Kleikamp IBM Linux Technology Center