9pfs: macOS host fixes
v3 cover 9pfs: macOS host fixes
A bunch of fixes for recently (in QEMU 7.0) added 9p support on macOS hosts.
Note: there are still issues to address with case-insensitive file systems on macOS hosts. I sent a separate RFC on that icase issue:
https://lore.kernel.org/qemu-devel/1757498.AyhHxzoH2B@silver/
v2 -> v3:
* Explicit check whether filename fits into addr.sun_path. [patch 2]
* s/close/close_preserve_errno/ [patch 2]
* Fix qemu_mknodat() from having returned a negative result != -1 on error and not having set errno. [NEW patch 6]
Christian Schoenebeck (6):
9pfs: fix qemu_mknodat(S_IFREG) on macOS
9pfs: fix qemu_mknodat(S_IFSOCK) on macOS
9pfs: fix wrong encoding of rdev field in Rgetattr on macOS 9pfs: fix wrong errno being sent to Linux client on macOS host 9pfs: fix removing non-existent POSIX ACL xattr on macOS host 9pfs: fix qemu_mknodat() to always return -1 on error on macOS host
hw/9pfs/9p-posix-acl.c | 12 +++++-- hw/9pfs/9p-util-darwin.c | 46 +++++++++++++++++++++++++-- hw/9pfs/9p-util.h | 69 ++++++++++++++++++++++++++++++++++++++++ hw/9pfs/9p.c | 4 ++- 4 files changed, 126 insertions(+), 5 deletions(-)
Signature · 1 line
2.32.0 (Apple Git-132)
PATCH v3 3/6 9pfs: fix wrong encoding of rdev field in Rgetattr on macOS
The 'rdev' field in 9p reponse 'Rgetattr' is of type dev_t, which is actually a system dependant type and therefore both the size and encoding of dev_t differ between macOS and Linux.
So far we have sent 'rdev' to guest in host's dev_t format as-is, which caused devices to appear with wrong device numbers on guests running on macOS hosts, eventually leading to various misbehaviours on guest in conjunction with device files.
This patch fixes this issue by converting the device number from host's dev_t format to Linux dev_t format. As 9p request 'Tgettattr' is exclusive to protocol version 9p2000.L, it should be fair to assume that 'rdev' field is assumed to be in Linux dev_t format by client as well.
--- hw/9pfs/9p-util.h | 39 +++++++++++++++++++++++++++++++++++++++ hw/9pfs/9p.c | 2 +- 2 files changed, 40 insertions(+), 1 deletion(-)
hw/9pfs/9p-util.h +39 -0
@@ -19,6 +19,45 @@#define O_PATH_9P_UTIL 0#endif +#if !defined(CONFIG_LINUX ) + +/* +* Generates a Linux device number (a.k.a. dev_t) for given device major +* and minor numbers. +* +* To be more precise: it generates a device number in glibc's format +* (MMMM_Mmmm_mmmM_MMmm, 64 bits) actually, which is compatible with +* Linux's format (mmmM_MMmm, 32 bits), as described in <bits/sysmacros.h>. +*/ +static inline uint64_t makedev_dotl (uint32_t dev_major,uint32_t dev_minor) +{ +uint64_t dev; + +// from glibc sysmacros.h: + dev = (((uint64_t ) (dev_major &0x00000fffu )) <<8 ); + dev |= (((uint64_t ) (dev_major &0xfffff000u )) <<32 ); + dev |= (((uint64_t ) (dev_minor &0x000000ffu )) <<0 ); + dev |= (((uint64_t ) (dev_minor &0xffffff00u )) <<12 ); +return dev; +} + +#endif + +/* +* Converts given device number from host's device number format to Linux +* device number format. As both the size of type dev_t and encoding of +* dev_t is system dependant, we have to convert them for Linux guests if +* host is not running Linux. +*/ +static inline uint64_t host_dev_to_dotl_dev (dev_t dev) +{ +#ifdef CONFIG_LINUX +return dev; +#else +return makedev_dotl (major (dev),minor (dev)); +#endif +} +#ifdef CONFIG_DARWIN #define qemu_fgetxattr (...) fgetxattr(__VA_ARGS__, 0, 0)#define qemu_lgetxattr (...) getxattr(__VA_ARGS__, 0, XATTR_NOFOLLOW)
hw/9pfs/9p.c +1 -1
@@ -1327,7 +1327,7 @@ static int stat_to_v9stat_dotl(V9fsPDU *pdu, const struct stat *stbuf, v9lstat->st_nlink = stbuf->st_nlink; v9lstat->st_uid = stbuf->st_uid; v9lstat->st_gid = stbuf->st_gid; - v9lstat->st_rdev = stbuf->st_rdev; + v9lstat->st_rdev =host_dev_to_dotl_dev (stbuf->st_rdev); v9lstat->st_size = stbuf->st_size; v9lstat->st_blksize =stat_to_iounit (pdu, stbuf); v9lstat->st_blocks = stbuf->st_blocks;
Signature · 1 line
2.32.0 (Apple Git-132)
PATCH v3 1/6 9pfs: fix qemu_mknodat(S_IFREG) on macOS
In reply to Christian Schoenebeckmknod() on macOS does not support creating regular files, so divert to openat_file() if S_IFREG is passed with mode argument.
Furthermore, 'man 2 mknodat' on Linux says: "Zero file type is equivalent to type S_IFREG".
--- hw/9pfs/9p-util-darwin.c | 9 +++++++++ 1 file changed, 9 insertions(+)
hw/9pfs/9p-util-darwin.c +9 -0
@@ -77,6 +77,15 @@ int fsetxattrat_nofollow(int dirfd, const char *filename, const char *name,int qemu_mknodat (int dirfd,const char *filename,mode_t mode,dev_t dev) {int preserved_errno, err; + +if (S_ISREG (mode) || !(mode &S_IFMT )) { +int fd =openat_file (dirfd, filename,O_CREAT , mode); +if (fd ==-1 ) { +return fd; + } +close (fd); +return 0 ; + }if (!pthread_fchdir_np) {error_report_once ("pthread_fchdir_np() not available on this version of macOS" );return -ENOTSUP ;
Signature · 1 line
2.32.0 (Apple Git-132)
PATCH v3 5/6 9pfs: fix removing non-existent POSIX ACL xattr on macOS host
In reply to Christian SchoenebeckWhen mapped POSIX ACL is used, we are ignoring errors when trying to remove a POSIX ACL xattr that does not exist. On Linux hosts we would get ENODATA in such cases, on macOS hosts however we get ENOATTR instead.
As we can be sure that ENOATTR is defined as being identical on Linux hosts (at least by qemu/xattr.h), it is safe to fix this issue by simply comparing against ENOATTR instead of ENODATA.
This patch fixes e.g. a command on Linux guest like:
cp --preserve=mode old new
--- hw/9pfs/9p-posix-acl.c | 12 ++++++++++-- 1 file changed, 10 insertions(+), 2 deletions(-)
hw/9pfs/9p-posix-acl.c +10 -2
@@ -65,7 +65,11 @@ static int mp_pacl_removexattr(FsContext *ctx,int ret; ret =local_removexattr_nofollow (ctx, path,MAP_ACL_ACCESS ); -if (ret ==-1 && errno ==ENODATA ) { +/* +* macOS returns ENOATTR (!=ENODATA on macOS), whereas Linux returns +* ENODATA (==ENOATTR on Linux), so checking for ENOATTR is fine +*/ +if (ret ==-1 && errno ==ENOATTR ) {/* * We don't get ENODATA error when trying to remove a * posix acl that is not present. So don't throw the error
@@ -115,7 +119,11 @@ static int mp_dacl_removexattr(FsContext *ctx,int ret; ret =local_removexattr_nofollow (ctx, path,MAP_ACL_DEFAULT ); -if (ret ==-1 && errno ==ENODATA ) { +/* +* macOS returns ENOATTR (!=ENODATA on macOS), whereas Linux returns +* ENODATA (==ENOATTR on Linux), so checking for ENOATTR is fine +*/ +if (ret ==-1 && errno ==ENOATTR ) {/* * We don't get ENODATA error when trying to remove a * posix acl that is not present. So don't throw the error
Signature · 1 line
2.32.0 (Apple Git-132)
PATCH v3 6/6 9pfs: fix qemu_mknodat() to always return -1 on error on macOS host
In reply to Christian Schoenebeckqemu_mknodat() is expected to behave according to its POSIX API, and therefore should always return exactly -1 on any error, and errno should be set for the actual error code.
--- hw/9pfs/9p-util-darwin.c | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-)
hw/9pfs/9p-util-darwin.c +2 -1
@@ -116,7 +116,8 @@ int qemu_mknodat(int dirfd, const char *filename, mode_t mode, dev_t dev) }if (!pthread_fchdir_np) {error_report_once ("pthread_fchdir_np() not available on this version of macOS" ); -return -ENOTSUP ; + errno =ENOTSUP ; +return -1 ; }if (pthread_fchdir_np (dirfd) <0 ) {return -1 ;
Signature · 1 line
2.32.0 (Apple Git-132)
PATCH v3 4/6 9pfs: fix wrong errno being sent to Linux client on macOS host
In reply to Christian SchoenebeckLinux and macOS only share some errno definitions with equal macro name and value. In fact most mappings for errno are completely different on the two systems.
This patch converts some important errno values from macOS host to corresponding Linux errno values before eventually sending such error codes along with 'Rlerror' replies (if 9p2000.L is used that is). Not having translated errnos before violated the 9p2000.L protocol spec, which says:
"
size[4] Rlerror tag[2] ecode[4]
... ecode is a numerical Linux errno.
"
https://github.com/chaos/diod/wiki/protocol#lerror----return-error-code
This patch fixes a bunch of misbehaviours when running a Linux client on macOS host. For instance this patch fixes:
mount -t 9p -o posixacl ...
on Linux guest if security_mode=mapped was used for 9p server, which refused to mount successfully, because macOS returned ENOATTR==93 when client tried to retrieve POSIX ACL xattrs, because errno 93 is defined as EPROTONOSUPPORT==93 on Linux, so Linux client believed that xattrs were not supported by filesystem on host in general.
--- hw/9pfs/9p-util.h | 30 ++++++++++++++++++++++++++++++ hw/9pfs/9p.c | 2 ++ 2 files changed, 32 insertions(+)
hw/9pfs/9p-util.h +30 -0
@@ -58,6 +58,36 @@ static inline uint64_t host_dev_to_dotl_dev(dev_t dev)#endif } +/* Translates errno from host -> Linux if needed */ +static inline int errno_to_dotl (int err) { +#if defined(CONFIG_LINUX ) +/* nothing to translate (Linux -> Linux) */ +#elif defined(CONFIG_DARWIN ) +/* +* translation mandatory for macOS hosts +* +* FIXME: Only most important errnos translated here yet, this should be +* extended to as many errnos being translated as possible in future. +*/ +if (err ==ENAMETOOLONG ) { + err =36 ;/* ==ENAMETOOLONG on Linux */ + }else if (err ==ENOTEMPTY ) { + err =39 ;/* ==ENOTEMPTY on Linux */ + }else if (err ==ELOOP ) { + err =40 ;/* ==ELOOP on Linux */ + }else if (err ==ENOATTR ) { + err =61 ;/* ==ENODATA on Linux */ + }else if (err ==ENOTSUP ) { + err =95 ;/* ==EOPNOTSUPP on Linux */ + }else if (err ==EOPNOTSUPP ) { + err =95 ;/* ==EOPNOTSUPP on Linux */ + } +#else +#error Missing errno translation to Linux for this host system +#endif +return err; +} +#ifdef CONFIG_DARWIN #define qemu_fgetxattr (...) fgetxattr(__VA_ARGS__, 0, 0)#define qemu_lgetxattr (...) getxattr(__VA_ARGS__, 0, XATTR_NOFOLLOW)
hw/9pfs/9p.c +2 -0
@@ -1054,6 +1054,8 @@ static void coroutine_fn pdu_complete(V9fsPDU *pdu, ssize_t len) } len += ret; id =P9_RERROR ; + }else { + err =errno_to_dotl (err); } ret =pdu_marshal (pdu, len,"d" , err);
Signature · 1 line
2.32.0 (Apple Git-132)
PATCH v3 2/6 9pfs: fix qemu_mknodat(S_IFSOCK) on macOS
In reply to Christian Schoenebeckmknod() on macOS does not support creating sockets, so divert to call sequence socket(), bind() and chmod() respectively if S_IFSOCK was passed with mode argument.
--- hw/9pfs/9p-util-darwin.c | 34 +++++++++++++++++++++++++++++++++- 1 file changed, 33 insertions(+), 1 deletion(-)
hw/9pfs/9p-util-darwin.c +33 -1
@@ -74,6 +74,34 @@ int fsetxattrat_nofollow(int dirfd, const char *filename, const char *name,*/ #if definedCONFIG_PTHREAD_FCHDIR_NP +static int create_socket_file_at_cwd (const char *filename,mode_t mode) { +int fd, err; +struct sockaddr_un addr = { + .sun_family =AF_UNIX + }; + +/* +* sun_path is only 104 bytes, explicit filename length check required +*/ +if (sizeof (addr.sun_path) -1 <strlen (filename) +2 ) { + errno =ENAMETOOLONG ; +return -1 ; + } + fd =socket (PF_UNIX ,SOCK_DGRAM ,0 ); +if (fd ==-1 ) { +return fd; + } +snprintf (addr.sun_path,sizeof (addr.sun_path),"./%s" , filename); + err =bind (fd, (struct sockaddr *) &addr,sizeof (addr)); +if (err ==-1 ) { + goto out; + } + err =chmod (addr.sun_path, mode); +out: +close_preserve_errno (fd); +return err; +} +int qemu_mknodat (int dirfd,const char *filename,mode_t mode,dev_t dev) {int preserved_errno, err;
@@ -93,7 +121,11 @@ int qemu_mknodat(int dirfd, const char *filename, mode_t mode, dev_t dev)if (pthread_fchdir_np (dirfd) <0 ) {return -1 ; } - err =mknod (filename, mode, dev); +if (S_ISSOCK (mode)) { + err =create_socket_file_at_cwd (filename, mode); + }else { + err =mknod (filename, mode, dev); + } preserved_errno = errno;/* Stop using the thread-local cwd */ pthread_fchdir_np (-1 );
Signature · 1 line
2.32.0 (Apple Git-132)
Re: [PATCH v3 6/6] 9pfs: fix qemu_mknodat() to always return -1 on error on macOS host
In reply to Christian SchoenebeckQuoted 6 lines · On Mon, 25 Apr 2022 14:21:00 +0200 Christian Schoenebeck…
qemu_mknodat()is expected to behave according to its POSIX API, and therefore should always return exactly -1 on any error, and errno should be set for the actual error code.Signed-off-by Christian Schoenebeck <[email protected]>---
Quoted 17 lines
hw/9pfs/9p-util-darwin.c | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-)hw/9pfs/9p-util-darwin.c +2
-1@@ -116,7 +116,8 @@ int qemu_mknodat(int dirfd, const char *filename, mode_t mode, dev_t dev) }if (!pthread_fchdir_np) {error_report_once ("pthread_fchdir_np() not available on this version of macOS" ); -return -ENOTSUP ; + errno =ENOTSUP ; +return -1 ; }if (pthread_fchdir_np (dirfd) <0 ) {return -1 ;
Re: [PATCH v3 2/6] 9pfs: fix qemu_mknodat(S_IFSOCK) on macOS
In reply to Christian SchoenebeckQuoted 9 lines · On Mon, 25 Apr 2022 14:20:46 +0200 Christian Schoenebeck…
mknod()on macOS does not support creating sockets, so divert to call sequencesocket(),bind()andchmod()respectively ifS_IFSOCKwas passed with mode argument.Signed-off-by Christian Schoenebeck <[email protected]>Reviewed-by Will Cohen <[email protected]>Reviewed-by Greg Kurz <[email protected]>---
Nack until the chmod() issue is addressed. :-\
Quoted 55 lines
hw/9pfs/9p-util-darwin.c | 34 +++++++++++++++++++++++++++++++++- 1 file changed, 33 insertions(+), 1 deletion(-)hw/9pfs/9p-util-darwin.c +33
-1@@ -74,6 +74,34 @@ int fsetxattrat_nofollow(int dirfd, const char *filename, const char *name,*/ #if definedCONFIG_PTHREAD_FCHDIR_NP +static int create_socket_file_at_cwd (const char *filename,mode_t mode) { +int fd, err; +struct sockaddr_un addr = { + .sun_family =AF_UNIX + }; + +/* +* sun_path is only 104 bytes, explicit filename length check required +*/ +if (sizeof (addr.sun_path) -1 <strlen (filename) +2 ) { + errno =ENAMETOOLONG ; +return -1 ; + } + fd =socket (PF_UNIX ,SOCK_DGRAM ,0 ); +if (fd ==-1 ) { +return fd; + } +snprintf (addr.sun_path,sizeof (addr.sun_path),"./%s" , filename); + err =bind (fd, (struct sockaddr *) &addr,sizeof (addr)); +if (err ==-1 ) { + goto out; + } + err =chmod (addr.sun_path, mode); +out: +close_preserve_errno (fd); +return err; +} +int qemu_mknodat (int dirfd,const char *filename,mode_t mode,dev_t dev) {int preserved_errno, err;@@ -93,7 +121,11 @@ int qemu_mknodat(int dirfd, const char *filename, mode_t mode, dev_t dev)if (pthread_fchdir_np (dirfd) <0 ) {return -1 ; } - err =mknod (filename, mode, dev); +if (S_ISSOCK (mode)) { + err =create_socket_file_at_cwd (filename, mode); + }else { + err =mknod (filename, mode, dev); + } preserved_errno = errno;/* Stop using the thread-local cwd */ pthread_fchdir_np (-1 );