package/fakeroot: use TCP for msg passing
PATCH 1/1 package/fakeroot: use TCP for msg passing
fakeroot can be built to either use SYSV IPC or TCP for message passing.
Cases for which the SYSV IPC version fails or causes problems but for which fakeroot-tcp has been observed to work well include the items listed below.
* Multithreaded applications (using pthread)
* Running under realtime-preempt kernel
* Microsoft Windows 10 Services for Linux
Link to readme capturing original upstream bug report #
https://salsa.debian.org/clint/fakeroot/commit/113c6320244c4261f7f7a9ce07cf7b5465573dfe
Fixes
https://bugs.busybox.net/show_bug.cgi?id=11366
---
I can't find a good reason to not make this the new default in the Buildroot host build of fakeroot. vs auto detecting which to build depending on what the host env can support.
For good measure, in-addition to this change, I will submit an upstream patch for the suggested configure.as update (pending a little cleanup in that proposed patch). https://bugs.busybox.net/attachment.cgi?id=7791
--- package/fakeroot/fakeroot.mk | 2 ++ 1 file changed, 2 insertions(+)
package/fakeroot/fakeroot.mk +2 -0
@@ -16,6 +16,8 @@ HOST_FAKEROOT_CONF_ENV = \ ac_cv_header_sys_capability_h=no \ ac_cv_func_capset=no +HOST_FAKEROOT_CONF_OPTS = --with-ipc=tcp + FAKEROOT_LICENSE = GPL-3.0+ FAKEROOT_LICENSE_FILES = COPYING
Signature · 1 line
2.17.1
PATCH 1/1 package/fakeroot: use TCP for msg passing
Matt, All,
On 2019-07-11 14:36 -0500, Matt Weber spake thusly:
Quoted 7 lines
fakeroot can be built to either use SYSV IPC or TCP for message passing.
Cases for which the SYSV IPC version fails or causes problems but for which fakeroot-tcp has been observed to work well include the items listed below.
* Multithreaded applications (using pthread)
I know you used the commit log from upstream, but that was written 12 year ago now. 12 years ago NPTL was still new-ish, and LinuxThreads were still alive. Is it still true that fakeroot misbehaves when using pthreads at all nowadays?
Quoted 6 lines
* Running under realtime-preempt kernel
* Microsoft Windows 10 Services for LinuxLink to readme capturing original upstream bug report #
https://salsa.debian.org/clint/fakeroot/commit/113c6320244c4261f7f7a9ce07cf7b5465573dfe
Quoted 8 lines
Fixes
https://bugs.busybox.net/show_bug.cgi?id=11366Signed-off-by Matthew Weber <[email protected]>---
I can't find a good reason to not make this the new default in the Buildroot host build of fakeroot. vs auto detecting which to build depending on what the host env can support.
I have two questions:
- can we run two unrelated fakeroot concurrently? E.g. if we have two buildsin parallel, which happen to each call their fakeroot at about the same time that the two fakeroot will run in parallel, won;t that clash? I think it boils down to how fakeroot chooses the port to listen on;
- is there a performance issue? I wonder how it behaves for very big rootfs content, when compared to the sysv ipc.
Regards,
Yann E. MORIN.
Quoted 27 lines
For good measure, in-addition to this change, I will submit an upstream patch for the suggested configure.as update (pending a little cleanup in that proposed patch). https://bugs.busybox.net/attachment.cgi?id=7791
--- package/fakeroot/fakeroot.mk | 2 ++ 1 file changed, 2 insertions(+)package/fakeroot/fakeroot.mk +2
-0@@ -16,6 +16,8 @@ HOST_FAKEROOT_CONF_ENV = \ ac_cv_header_sys_capability_h=no \ ac_cv_func_capset=no +HOST_FAKEROOT_CONF_OPTS = --with-ipc=tcp + FAKEROOT_LICENSE = GPL-3.0+ FAKEROOT_LICENSE_FILES = COPYINGSignature · 6 lines
2.17.1 _______________________________________________ buildroot mailing list buildroot at busybox.net http://lists.busybox.net/mailman/listinfo/buildroot
Signature · 6 lines
.-----------------.--------------------.------------------.--------------------. | Yann E. MORIN | Real-Time Embedded | /"\ ASCII RIBBON | Erics' conspiracy: | | +33 662 376 056 | Software Designer | \ / CAMPAIGN | ___ | | +33 561 099 427 `------------.-------: X AGAINST | \e/ There is no | | http://ymorin.is-a-geek.org/ | _/*\_ | / \ HTML MAIL | v conspiracy. | '------------------------------^-------^------------------^--------------------'
PATCH 1/1 package/fakeroot: use TCP for msg passing
Yann,
Quoted 10 lines · Yann E. MORIN
Matt, All,
On 2019-07-11 14:36 -0500, Matt Weber spake thusly:
Quoted 6 lines
fakeroot can be built to either use SYSV IPC or TCP for message passing.
Cases for which the SYSV IPC version fails or causes problems but for which fakeroot-tcp has been observed to work well include the items listed below.
Quoted 6 lines
Quoted 1 line
* Multithreaded applications (using pthread)
I know you used the commit log from upstream, but that was written 12 year ago now. 12 years ago NPTL was still new-ish, and LinuxThreads were still alive. Is it still true that fakeroot misbehaves when using pthreads at all nowadays?
Unsure. Maybe better to just refer to the project readme instead of stating it in the commit?
Quoted 16 lines
Quoted 7 lines
* Running under realtime-preempt kernel
* Microsoft Windows 10 Services for LinuxLink to readme capturing original upstream bug report #
https://salsa.debian.org/clint/fakeroot/commit/113c6320244c4261f7f7a9ce07cf7b5465573dfeQuoted 8 lines
Fixes
https://bugs.busybox.net/show_bug.cgi?id=11366Signed-off-by Matthew Weber <[email protected]>---
I can't find a good reason to not make this the new default in the Buildroot host build of fakeroot. vs auto detecting which to build depending on what the host env can support.
Quoted 7 lines
I have two questions:
- can we run two unrelated fakeroot concurrently? E.g. if we have two buildsin parallel, which happen to each call their fakeroot at about the same time that the two fakeroot will run in parallel, won;t that clash? I think it boils down to how fakeroot chooses the port to listen on;
Oh good point, I looked and it seems they are letting the system pick the port on the server side and then publishing it to the client. So we should be good with concurrent builds/fs assembly.
Quoted 3 lines
- is there a performance issue? I wonder how it behaves for very big rootfs content, when compared to the sysv ipc.
I'm guessing there are definitely more context switches as the data would hit the IP stack. This really feels like something that should be only enabled when the host build system doesn't support SYSV IPC.
Regards,
Matt
PATCH 1/1 package/fakeroot: use TCP for msg passing
Yann,
Quoted 17 lines · Matthew Weber
Yann,
Quoted 12 lines · Yann E. MORIN
Matt, All,
On 2019-07-11 14:36 -0500, Matt Weber spake thusly:
Quoted 7 lines
fakeroot can be built to either use SYSV IPC or TCP for message passing.
Cases for which the SYSV IPC version fails or causes problems but for which fakeroot-tcp has been observed to work well include the items listed below.
* Multithreaded applications (using pthread)
Quoted 7 lines
Quoted 4 lines
I know you used the commit log from upstream, but that was written 12 year ago now. 12 years ago NPTL was still new-ish, and LinuxThreads were still alive. Is it still true that fakeroot misbehaves when using pthreads at all nowadays?
Unsure. Maybe better to just refer to the project readme instead of stating it in the commit?
I forgot to note, I was able to find a upstream for this one. I emailed Clint Adams at debian and he pointed me at doing a pull request here: https://salsa.debian.org/clint/fakeroot/tree/upstream
I'll get something started this weekend so the configure time check of sysv ipc is upstream.
Matt