Skip to contentSkip to conversation

Mark AT_* path flags as deprecated and add missing RESOLVE_ flags

RFC PATCH In review David Howells 3 participants 7 messages Mar 5, 2020 – Mar 6, 2020 2 messages not in the archive

Subsystems (3)
lore
Share & tools
lore
#0 lore raw

RFC PATCH 1/1 Mark AT_* path flags as deprecated and add missing RESOLVE_ flags

Do we want to do this? Or should we duplicate the RESOLVE_* flags to AT_* flags so that existing *at() syscalls can make use of them?

David
---
commit 448731bf3b29f2b1f7c969d7efe1f0673ae13b5e

Author: David Howells <[email protected]>
Date:   Thu Mar 5 17:40:02 2020 +0000

Mark AT_* flags as deprecated and add missing RESOLVE_ flags

It has been suggested that new path-using system calls should use RESOLVE_* flags instead of AT_* flags, but the RESOLVE_* flag functions are not a superset of the AT_* flag functions. So formalise this by:

(1) In linux/fcntl.h, add a comment noting that the AT_* flags are deprecated for new system calls and that RESOLVE_* flags should be used instead.

(2) Add some missing flags:

RESOLVE_NO_TERMINAL_SYMLINKS for AT_SYMLINK_NOFOLLOW
RESOLVE_NO_TERMINAL_AUTOMOUNTS for AT_NO_AUTOMOUNT
RESOLVE_EMPTY_PATH for AT_EMPTY_PATH

(3) Make openat2() support RESOLVE_NO_TERMINAL_SYMLINKS. LOOKUP_OPEN internally implies LOOKUP_AUTOMOUNT, and AT_EMPTY_PATH is probably not worth supporting (maybe use dup2() instead?).

fs/open.c +5 -3
index 0788b3715731..6946ad09b42b 100644
@@ -977,7 +977,7 @@ inline struct open_how build_open_how(int flags, umode_t mode)
 inline int build_open_flags(const struct open_how *how, struct open_flags *op)
 {
 	int flags = how->flags;
-	int lookup_flags = 0;
+	int lookup_flags = LOOKUP_FOLLOW | LOOKUP_AUTOMOUNT;
 	int acc_mode = ACC_MODE(flags);
 
 	/* Must never be set by userspace */
@@ -1055,8 +1055,8 @@ inline int build_open_flags(const struct open_how *how, struct open_flags *op)
 
 	if (flags & O_DIRECTORY)
 		lookup_flags |= LOOKUP_DIRECTORY;
-	if (!(flags & O_NOFOLLOW))
-		lookup_flags |= LOOKUP_FOLLOW;
+	if (flags & O_NOFOLLOW)
+		lookup_flags &= ~LOOKUP_FOLLOW;
 
 	if (how->resolve & RESOLVE_NO_XDEV)
 		lookup_flags |= LOOKUP_NO_XDEV;
@@ -1068,6 +1068,8 @@ inline int build_open_flags(const struct open_how *how, struct open_flags *op)
 		lookup_flags |= LOOKUP_BENEATH;
 	if (how->resolve & RESOLVE_IN_ROOT)
 		lookup_flags |= LOOKUP_IN_ROOT;
+	if (how->resolve & RESOLVE_NO_TERMINAL_SYMLINKS)
+		lookup_flags &= ~LOOKUP_FOLLOW;
 
 	op->lookup_flags = lookup_flags;
 	return 0;
include/linux/fcntl.h +2 -1
index 7bcdcf4f6ab2..fd6ee34cce0f 100644
@@ -19,7 +19,8 @@
 /* List of all valid flags for the how->resolve argument: */
 #define VALID_RESOLVE_FLAGS \
 	(RESOLVE_NO_XDEV | RESOLVE_NO_MAGICLINKS | RESOLVE_NO_SYMLINKS | \
-	 RESOLVE_BENEATH | RESOLVE_IN_ROOT)
+	 RESOLVE_BENEATH | RESOLVE_IN_ROOT | RESOLVE_NO_TERMINAL_SYMLINKS | \
+	 RESOLVE_NO_TERMINAL_AUTOMOUNTS | RESOLVE_EMPTY_PATH)
 
 /* List of all open_how "versions". */
 #define OPEN_HOW_SIZE_VER0	24 /* sizeof first published struct */
include/uapi/linux/fcntl.h +14 -3
index ca88b7bce553..9f5432dbd213 100644
@@ -84,9 +84,20 @@
 #define DN_ATTRIB	0x00000020	/* File changed attibutes */
 #define DN_MULTISHOT	0x80000000	/* Don't remove notifier */
 
-#define AT_FDCWD		-100    /* Special value used to indicate
-                                           openat should use the current
-                                           working directory. */
+
+/*
+ * Special dfd/dirfd file descriptor value used to indicate that *at() system
+ * calls should use the current working directory for relative paths.
+ */
+#define AT_FDCWD		-100
+
+/*
+ * Pathwalk control flags, used for the *at() syscalls.  These should be
+ * considered deprecated and should not be used for new system calls.  The
+ * RESOLVE_* flags in <linux/openat2.h> should be used instead.
+ *
+ * There are also system call-specific flags here (REMOVEDIR, STATX, RECURSIVE).
+ */
 #define AT_SYMLINK_NOFOLLOW	0x100   /* Do not follow symbolic links.  */
 #define AT_REMOVEDIR		0x200   /* Remove directory instead of
                                            unlinking file.  */
include/uapi/linux/openat2.h +7 -1
index 58b1eb711360..bb8d0a7f82c2 100644
@@ -22,7 +22,10 @@ struct open_how {
 	__u64 resolve;
 };
 
-/* how->resolve flags for openat2(2). */
+/*
+ * Path resolution paths to replace AT_* paths in all new syscalls that would
+ * use them.
+ */
 #define RESOLVE_NO_XDEV		0x01 /* Block mount-point crossings
 					(includes bind-mounts). */
 #define RESOLVE_NO_MAGICLINKS	0x02 /* Block traversal through procfs-style
@@ -35,5 +38,8 @@ struct open_how {
 #define RESOLVE_IN_ROOT		0x10 /* Make all jumps to "/" and ".."
 					be scoped inside the dirfd
 					(similar to chroot(2)). */
+#define RESOLVE_NO_TERMINAL_SYMLINKS	0x20 /* Don't follow terminal symlinks in the path */
+#define RESOLVE_NO_TERMINAL_AUTOMOUNTS	0x40 /* Don't follow terminal automounts in the path */
+#define RESOLVE_EMPTY_PATH	0x80	/* Permit a path of "" to indicate the dfd exactly */
 
 #endif /* _UAPI_LINUX_OPENAT2_H */
#1 lore raw

Hi David,

Quoted 19 lines

Do we want to do this? Or should we duplicate the RESOLVE_* flags to AT_* flags so that existing *at() syscalls can make use of them?

David
---
commit 448731bf3b29f2b1f7c969d7efe1f0673ae13b5e

Author: David Howells <[email protected]>
Date:   Thu Mar 5 17:40:02 2020 +0000

Mark AT_* flags as deprecated and add missing RESOLVE_ flags

It has been suggested that new path-using system calls should use RESOLVE_* flags instead of AT_* flags, but the RESOLVE_* flag functions are not a superset of the AT_* flag functions. So formalise this by:

(1) In linux/fcntl.h, add a comment noting that the AT_* flags are deprecated for new system calls and that RESOLVE_* flags should be used instead.

Quoted 5 lines

(2) Add some missing flags:

RESOLVE_NO_TERMINAL_SYMLINKS for AT_SYMLINK_NOFOLLOW
RESOLVE_NO_TERMINAL_AUTOMOUNTS for AT_NO_AUTOMOUNT
RESOLVE_EMPTY_PATH for AT_EMPTY_PATH

For me "TERMINAL" sounds strange here (I'm not a native speaker, so feel free to ignore me...). I'd use "BASENAME" instead.

Quoted 33 lines

(3) Make openat2() support RESOLVE_NO_TERMINAL_SYMLINKS. LOOKUP_OPEN internally implies LOOKUP_AUTOMOUNT, and AT_EMPTY_PATH is probably not worth supporting (maybe use dup2() instead?).

fs/open.c +3 -3
index 0788b3715731..6946ad09b42b 100644
@@ -977,7 +977,7 @@ inline struct open_how build_open_how(int flags, umode_t mode)
 inline int build_open_flags(const struct open_how *how, struct open_flags *op)
 {
 	int flags = how->flags;
-	int lookup_flags = 0;
+	int lookup_flags = LOOKUP_FOLLOW | LOOKUP_AUTOMOUNT;
 	int acc_mode = ACC_MODE(flags);
 
 	/* Must never be set by userspace */
@@ -1055,8 +1055,8 @@ inline int build_open_flags(const struct open_how *how, struct open_flags *op)
 
 	if (flags & O_DIRECTORY)
 		lookup_flags |= LOOKUP_DIRECTORY;
-	if (!(flags & O_NOFOLLOW))
-		lookup_flags |= LOOKUP_FOLLOW;
+	if (flags & O_NOFOLLOW)
+		lookup_flags &= ~LOOKUP_FOLLOW;
 
 	if (how->resolve & RESOLVE_NO_XDEV)
 		lookup_flags |= LOOKUP_NO_XDEV;

fs/open.c inline int build_open_flags(const struct open_how *how, struct open_flags *op) · line 1072

Quoted 5 lines
fs/open.c +2 -0
@@ -1068,6 +1068,8 @@ inline int build_open_flags(const struct open_how *how, struct open_flags *op)
 		lookup_flags |= LOOKUP_BENEATH;
 	if (how->resolve & RESOLVE_IN_ROOT)
 		lookup_flags |= LOOKUP_IN_ROOT;
+	if (how->resolve & RESOLVE_NO_TERMINAL_SYMLINKS)
+		lookup_flags &= ~LOOKUP_FOLLOW;

Where's the RESOLVE_NO_TERMINAL_AUTOMOUNTS check?

metze

#2 lore raw
Quoted 1 line · Stefan Metzmacher

Where's the RESOLVE_NO_TERMINAL_AUTOMOUNTS check?

See:

(3) Make openat2() support RESOLVE_NO_TERMINAL_SYMLINKS. LOOKUP_OPEN internally implies LOOKUP_AUTOMOUNT, and AT_EMPTY_PATH is probably not worth supporting (maybe use dup2() instead?).

As things currently stand, automount following is explicitly forced on for open and create. We can make it error out instead if this is desirable if RESOLVE_NO_TERMINAL_AUTOMOUNTS in such a case.

David

#3 lore raw
In reply to David Howells
Quoted 47 lines · David Howells

Do we want to do this? Or should we duplicate the RESOLVE_* flags to AT_* flags so that existing *at() syscalls can make use of them?

David
---
commit 448731bf3b29f2b1f7c969d7efe1f0673ae13b5e

Author: David Howells <[email protected]>
Date:   Thu Mar 5 17:40:02 2020 +0000

Mark AT_* flags as deprecated and add missing RESOLVE_ flags

It has been suggested that new path-using system calls should use RESOLVE_* flags instead of AT_* flags, but the RESOLVE_* flag functions are not a superset of the AT_* flag functions. So formalise this by:

(1) In linux/fcntl.h, add a comment noting that the AT_* flags are deprecated for new system calls and that RESOLVE_* flags should be used instead.

(2) Add some missing flags:

RESOLVE_NO_TERMINAL_SYMLINKS for AT_SYMLINK_NOFOLLOW
RESOLVE_NO_TERMINAL_AUTOMOUNTS for AT_NO_AUTOMOUNT
RESOLVE_EMPTY_PATH for AT_EMPTY_PATH

(3) Make openat2() support RESOLVE_NO_TERMINAL_SYMLINKS. LOOKUP_OPEN internally implies LOOKUP_AUTOMOUNT, and AT_EMPTY_PATH is probably not worth supporting (maybe use dup2() instead?).

fs/open.c +1 -1
index 0788b3715731..6946ad09b42b 100644
@@ -977,7 +977,7 @@ inline struct open_how build_open_how(int flags, umode_t mode)
 inline int build_open_flags(const struct open_how *how, struct open_flags *op)
 {
 	int flags = how->flags;
-	int lookup_flags = 0;
+	int lookup_flags = LOOKUP_FOLLOW | LOOKUP_AUTOMOUNT;
 	int acc_mode = ACC_MODE(flags);
 
 	/* Must never be set by userspace */

fs/open.c inline int build_open_flags(const struct open_how *how, struct open_flags *op) · line 1059

Quoted 7 lines
fs/open.c +2 -2
@@ -1055,8 +1055,8 @@ inline int build_open_flags(const struct open_how *how, struct open_flags *op)
 
 	if (flags & O_DIRECTORY)
 		lookup_flags |= LOOKUP_DIRECTORY;
-	if (!(flags & O_NOFOLLOW))
-		lookup_flags |= LOOKUP_FOLLOW;
+	if (flags & O_NOFOLLOW)
+		lookup_flags &= ~LOOKUP_FOLLOW;

Odd change. But I guess you're doing it for the sake of consistency because of how you treat NO_TERMINAL_SYMLINKS below.

Quoted 38 lines
fs/open.c +2 -0
 	if (how->resolve & RESOLVE_NO_XDEV)
 		lookup_flags |= LOOKUP_NO_XDEV;
@@ -1068,6 +1068,8 @@ inline int build_open_flags(const struct open_how *how, struct open_flags *op)
 		lookup_flags |= LOOKUP_BENEATH;
 	if (how->resolve & RESOLVE_IN_ROOT)
 		lookup_flags |= LOOKUP_IN_ROOT;
+	if (how->resolve & RESOLVE_NO_TERMINAL_SYMLINKS)
+		lookup_flags &= ~LOOKUP_FOLLOW;
 
 	op->lookup_flags = lookup_flags;
 	return 0;
include/linux/fcntl.h +2 -1
index 7bcdcf4f6ab2..fd6ee34cce0f 100644
@@ -19,7 +19,8 @@
 /* List of all valid flags for the how->resolve argument: */
 #define VALID_RESOLVE_FLAGS \
 	(RESOLVE_NO_XDEV | RESOLVE_NO_MAGICLINKS | RESOLVE_NO_SYMLINKS | \
-	 RESOLVE_BENEATH | RESOLVE_IN_ROOT)
+	 RESOLVE_BENEATH | RESOLVE_IN_ROOT | RESOLVE_NO_TERMINAL_SYMLINKS | \
+	 RESOLVE_NO_TERMINAL_AUTOMOUNTS | RESOLVE_EMPTY_PATH)
 
 /* List of all open_how "versions". */
 #define OPEN_HOW_SIZE_VER0	24 /* sizeof first published struct */
include/uapi/linux/fcntl.h +1 -3
index ca88b7bce553..9f5432dbd213 100644
@@ -84,9 +84,20 @@
 #define DN_ATTRIB	0x00000020	/* File changed attibutes */
 #define DN_MULTISHOT	0x80000000	/* Don't remove notifier */
 
-#define AT_FDCWD		-100    /* Special value used to indicate
-                                           openat should use the current
-                                           working directory. */
+

include/uapi/linux/fcntl.h line 97

Quoted 10 lines
include/uapi/linux/fcntl.h +10 -0
+/*
+ * Special dfd/dirfd file descriptor value used to indicate that *at() system
+ * calls should use the current working directory for relative paths.
+ */
+#define AT_FDCWD		-100
+
+/*
+ * Pathwalk control flags, used for the *at() syscalls.  These should be
+ * considered deprecated and should not be used for new system calls.  The
+ * RESOLVE_* flags in <linux/openat2.h> should be used instead.

Agreed.

#4 lore raw
Quoted 5 lines · Christian Brauner

fs/open.c inline int build_open_flags(const struct open_how *how, struct open_flags *op) · line 1059

Quoted 2 lines
fs/open.c +2 -0
+	if (flags & O_NOFOLLOW)
+		lookup_flags &= ~LOOKUP_FOLLOW;

Odd change. But I guess you're doing it for the sake of consistency because of how you treat NO_TERMINAL_SYMLINKS below.

Not really. The default is to follow. Both remove the LOOKUP_FOLLOW flag and neither set it.

David

A message that is not in the archive (sent off-list or not yet received): 20200306134116.qfa2gj6os4weru7o@yavin

#6 lore raw
Quoted 20 lines · Aleksa Sarai
Quoted 11 lines · David Howells

Do we want to do this? Or should we duplicate the RESOLVE_* flags to AT_* flags so that existing *at() syscalls can make use of them?

David
---
commit 448731bf3b29f2b1f7c969d7efe1f0673ae13b5e

Author: David Howells <[email protected]>
Date:   Thu Mar 5 17:40:02 2020 +0000

Mark AT_* flags as deprecated and add missing RESOLVE_ flags

Quoted 7 lines

It has been suggested that new path-using system calls should use RESOLVE_* flags instead of AT_* flags, but the RESOLVE_* flag functions are not a superset of the AT_* flag functions. So formalise this by:

(1) In linux/fcntl.h, add a comment noting that the AT_* flags are deprecated for new system calls and that RESOLVE_* flags should be used instead.

Quoted 5 lines

I wouldn't say it that way -- the RESOLVE_* flags should be used by syscalls *where it makes sense to change the path resolution rules*. If it makes more sense for them to have their own flag set, they should arguably make a separate one (like renameat2 did -- though renameat2 can never take AT_EMPTY_PATH because it isn't sufficiently extensible).

Yeah, we should clearly state that they are not a replacement for _all_ the AT_* flags. I think it makes sense to think of RESOLVE_* flags as a superset of the path-resolution portions of AT_* flags.

Maybe in openat2.h:

/*
* Flags available to syscalls wanting to modify how paths are resolved.
* RESOLVE_* flags are intended to as a superset of those AT_* flags
* concerned with path resolution. All syscalls modifying their path
* resolution behavior are expected to use RESOLVE_* flags. */

Something like this (Native speaker can probably do this way nicer.)?

A message that is not in the archive (sent off-list or not yet received): 20200306134407.zjiiieg3m6ce5uts@yavin

#8 lore raw
Quoted 2 lines · Aleksa Sarai

But please (for now) also reserve RESOLVE_NO_AUTOMOUNTS, which would apply the same restriction for all path components.

I'm not going to do that for the moment. There will be objections if it isn't wired up for at least something - but at the moment Al doesn't want people going and making conflicting changes in fs/namei.c with what he's doing.

David