Skip to contentSkip to conversation

Add support for async buffered reads

PATCH Superseded Jens Axboe 7 participants 66 messages May 26, 2020 – Jun 6, 2020

Subsystems (31)

v5 of 7 Superseded Latest is v7 →

lore
Share & tools
lore

Jens Axboe

author maintainer
#0 lore raw

v5 cover Add support for async buffered reads

We technically support this already through io_uring, but it's implemented with a thread backend to support cases where we would block. This isn't ideal.

After a few prep patches, the core of this patchset is adding support for async callbacks on page unlock. With this primitive, we can simply retry the IO operation. With io_uring, this works a lot like poll based retry for files that support it. If a page is currently locked and needed, -EIOCBQUEUED is returned with a callback armed. The callers callback is responsible for restarting the operation.

With this callback primitive, we can add support for generic_file_buffered_read(), which is what most file systems end up using for buffered reads. XFS/ext4/btrfs/bdev is wired up, but probably trivial to add more.

The file flags support for this by setting FMODE_BUF_RASYNC, similar to what we do for FMODE_NOWAIT. Open to suggestions here if this is the preferred method or not.

In terms of results, I wrote a small test app that randomly reads 4G of data in 4K chunks from a file hosted by ext4. The app uses a queue depth of 32. If you want to test yourself, you can just use buffered=1 with ioengine=io_uring with fio. No application changes are needed to use the more optimized buffered async read.

preadv for comparison:

	real    1m13.821s
	user    0m0.558s
	sys     0m11.125s
	CPU	~13%

Mainline:

	real    0m12.054s
	user    0m0.111s
	sys     0m5.659s
	CPU	~32% + ~50% == ~82%

This patchset:

	real    0m9.283s
	user    0m0.147s
	sys     0m4.619s
	CPU	~52%

The CPU numbers are just a rough estimate. For the mainline io_uring run, this includes the app itself and all the threads doing IO on its behalf (32% for the app, ~1.6% per worker and 32 of them). Context switch rate is much smaller with the patchset, since we only have the one task performing IO.

Also ran a simple fio based test case, varying the queue depth from 1 to 16, doubling every time:

[buf-test]
filename=/data/file
direct=0
ioengine=io_uring
norandommap
rw=randread
bs=4k
iodepth=${QD}
randseed=89
runtime=10s

QD/Test Patchset IOPS Mainline IOPS
1 9046 8294
2 19.8k 18.9k
4 39.2k 28.5k
8 64.4k 31.4k
16 65.7k 37.8k

Outside of my usual environment, so this is just running on a virtualized NVMe device in qemu, using ext4 as the file system. NVMe isn't very efficient virtualized, so we run out of steam at ~65K which is why we flatline on the patched side (nvme_submit_cmd() eats ~75% of the test app CPU). Before that happens, it's a linear increase. Not shown is context switch rate, which is massively lower with the new code. The old thread offload adds a blocking thread per pending IO, so context rate quickly goes through the roof.

The goal here is efficiency. Async thread offload adds latency, and it also adds noticable overhead on items such as adding pages to the page cache. By allowing proper async buffered read support, we don't have X threads hammering on the same inode page cache, we have just the single app actually doing IO.

Been beating on this and it's solid for me, and I'm now pretty happy with how it all turned out. Not aware of any missing bits/pieces or code cleanups that need doing.

Series can also be found here:

https://git.kernel.dk/cgit/linux-block/log/?h=async-buffered.5

or pull from:

git://git.kernel.dk/linux-block async-buffered.5

 fs/block_dev.c            |   2 +-
 fs/btrfs/file.c           |   2 +-
 fs/ext4/file.c            |   2 +-
 fs/io_uring.c             | 130 ++++++++++++++++++++++++++++++++++++--
 fs/xfs/xfs_file.c         |   2 +-
 include/linux/blk_types.h |   3 +-
 include/linux/fs.h        |  10 ++-
 include/linux/pagemap.h   |  67 ++++++++++++++++++++
 mm/filemap.c              | 111 ++++++++++++++++++++------------
 9 files changed, 279 insertions(+), 50 deletions(-)

Changes since v5:
- Correct commit message, iocb->private -> iocb->ki_waitq
- Get rid of io_uring goto, use an iter read helper
Changes since v3:
- io_uring: don't retry if REQ_F_NOWAIT is set
- io_uring: alloc req->io if the request type didn't already
- Add iocb->ki_waitq instead of (ab)using iocb->private Changes since v2:
- Get rid of unnecessary wait_page_async struct, just use wait_page_async
- Add another prep handler, adding wake_page_match()
- Use wake_page_match() in both callers
Changes since v1:
- Fix an issue with inline page locking
- Fix a potential race with __wait_on_page_locked_async()
- Fix a hang related to not setting page_match, thus missing a wakeup

Signature · 1 line
Jens Axboe
author maintainer
#1 lore raw

PATCH v5 1/12 block: read-ahead submission should imply no-wait as well

As read-ahead is opportunistic, don't block for request allocation.

---
 include/linux/blk_types.h | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)
include/linux/blk_types.h +2 -1
index ccb895f911b1..c296463c15eb 100644
@@ -374,7 +374,8 @@ enum req_flag_bits {
 #define REQ_INTEGRITY		(1ULL << __REQ_INTEGRITY)
 #define REQ_FUA			(1ULL << __REQ_FUA)
 #define REQ_PREFLUSH		(1ULL << __REQ_PREFLUSH)
-#define REQ_RAHEAD		(1ULL << __REQ_RAHEAD)
+#define REQ_RAHEAD		\
+	((1ULL << __REQ_RAHEAD) | (1ULL << __REQ_NOWAIT))
 #define REQ_BACKGROUND		(1ULL << __REQ_BACKGROUND)
 #define REQ_NOWAIT		(1ULL << __REQ_NOWAIT)
 #define REQ_CGROUP_PUNT		(1ULL << __REQ_CGROUP_PUNT)
Signature · 1 line
2.26.2
author maintainer
#2 lore raw

PATCH v5 2/12 mm: allow read-ahead with IOCB_NOWAIT set

In reply to Jens Axboe

The read-ahead shouldn't block, so allow it to be done even if IOCB_NOWAIT is set in the kiocb.

---
 mm/filemap.c | 2 --
 1 file changed, 2 deletions(-)
mm/filemap.c +0 -2
index 23a051a7ef0f..80747f1377d5 100644
@@ -2031,8 +2031,6 @@ static ssize_t generic_file_buffered_read(struct kiocb *iocb,
 
 		page = find_get_page(mapping, index);
 		if (!page) {
-			if (iocb->ki_flags & IOCB_NOWAIT)
-				goto would_block;
 			page_cache_sync_readahead(mapping,
 					ra, filp,
 					index, last_index - index);
Signature · 1 line
2.26.2
Acked-by on v5 2/12
#3 lore raw

Re: [PATCH 02/12] mm: allow read-ahead with IOCB_NOWAIT set

Quoted 4 lines · Jens Axboe

The read-ahead shouldn't block, so allow it to be done even if IOCB_NOWAIT is set in the kiocb.

Looks reasonable. Especially after patch 1 - although it seems that even before that, IOCB_NOWAIT could have occasionally ended up in page_cache_async_readahead(), which isn't too different from the sync variant except for the range calculations, and may have blocked on IO submission in the past.

author maintainer
#4 lore raw

PATCH v5 3/12 mm: abstract out wake_page_match() from wake_page_function()

In reply to Jens Axboe

No functional changes in this patch, just in preparation for allowing more callers.

---
 include/linux/pagemap.h | 37 +++++++++++++++++++++++++++++++++++++
 mm/filemap.c            | 35 ++++-------------------------------
 2 files changed, 41 insertions(+), 31 deletions(-)
include/linux/pagemap.h +37 -0
index a8f7bd8ea1c6..53d980f2208d 100644
@@ -456,6 +456,43 @@ static inline pgoff_t linear_page_index(struct vm_area_struct *vma,
 	return pgoff;
 }
 
+/* This has the same layout as wait_bit_key - see fs/cachefiles/rdwr.c */
+struct wait_page_key {
+	struct page *page;
+	int bit_nr;
+	int page_match;
+};
+
+struct wait_page_queue {
+	struct page *page;
+	int bit_nr;
+	wait_queue_entry_t wait;
+};
+
+static inline int wake_page_match(struct wait_page_queue *wait_page,
+				  struct wait_page_key *key)
+{
+	if (wait_page->page != key->page)
+	       return 0;
+	key->page_match = 1;
+
+	if (wait_page->bit_nr != key->bit_nr)
+		return 0;
+
+	/*
+	 * Stop walking if it's locked.
+	 * Is this safe if put_and_wait_on_page_locked() is in use?
+	 * Yes: the waker must hold a reference to this page, and if PG_locked
+	 * has now already been set by another task, that task must also hold
+	 * a reference to the *same usage* of this page; so there is no need
+	 * to walk on to wake even the put_and_wait_on_page_locked() callers.
+	 */
+	if (test_bit(key->bit_nr, &key->page->flags))
+		return -1;
+
+	return 1;
+}
+
 extern void __lock_page(struct page *page);
 extern int __lock_page_killable(struct page *page);
 extern int __lock_page_or_retry(struct page *page, struct mm_struct *mm,
mm/filemap.c +4 -31
index 80747f1377d5..e891b5bee8fd 100644
@@ -990,43 +990,16 @@ void __init pagecache_init(void)
 	page_writeback_init();
 }
 
-/* This has the same layout as wait_bit_key - see fs/cachefiles/rdwr.c */
-struct wait_page_key {
-	struct page *page;
-	int bit_nr;
-	int page_match;
-};
-
-struct wait_page_queue {
-	struct page *page;
-	int bit_nr;
-	wait_queue_entry_t wait;
-};
-
 static int wake_page_function(wait_queue_entry_t *wait, unsigned mode, int sync, void *arg)
 {
 	struct wait_page_key *key = arg;
 	struct wait_page_queue *wait_page
 		= container_of(wait, struct wait_page_queue, wait);
+	int ret;
 
-	if (wait_page->page != key->page)
-	       return 0;
-	key->page_match = 1;
-
-	if (wait_page->bit_nr != key->bit_nr)
-		return 0;
-
-	/*
-	 * Stop walking if it's locked.
-	 * Is this safe if put_and_wait_on_page_locked() is in use?
-	 * Yes: the waker must hold a reference to this page, and if PG_locked
-	 * has now already been set by another task, that task must also hold
-	 * a reference to the *same usage* of this page; so there is no need
-	 * to walk on to wake even the put_and_wait_on_page_locked() callers.
-	 */
-	if (test_bit(key->bit_nr, &key->page->flags))
-		return -1;
-
+	ret = wake_page_match(wait_page, key);
+	if (ret != 1)
+		return ret;
 	return autoremove_wake_function(wait, mode, sync, key);
 }
 
Signature · 1 line
2.26.2
maintainer
#6 lore raw

Re: [PATCH 03/12] mm: abstract out wake_page_match() from wake_page_function()

In reply to Jens Axboe

include/linux/pagemap.h static inline pgoff_t linear_page_index(struct vm_area_struct *vma, · line 464

Quoted 11 lines · Jens Axboe

+++ b/include/linux/pagemap.h

include/linux/pagemap.h +6 -0
@@ -456,6 +456,43 @@ static inline pgoff_t linear_page_index(struct vm_area_struct *vma,
 	return pgoff;
 }
 
+/* This has the same layout as wait_bit_key - see fs/cachefiles/rdwr.c */
+struct wait_page_key {
+	struct page *page;
+	int bit_nr;
+	int page_match;
+};

I know you only moved the struct, and the comment along with it, but now that this struct is in pagemap.h, I think cachefiles should be updated to use wait_page_key instead of wait_bit_key. Dave?

author maintainer
#7 lore raw

PATCH v5 4/12 mm: add support for async page locking

In reply to Jens Axboe

Normally waiting for a page to become unlocked, or locking the page, requires waiting for IO to complete. Add support for lock_page_async() and wait_on_page_locked_async(), which are callback based instead. This allows a caller to get notified when a page becomes unlocked, rather than wait for it.

We add a new iocb field, ki_waitq, to pass in the necessary data for this to happen. We can unionize this with ki_cookie, since that is only used for polled IO. Polled IO can never co-exist with async callbacks, as it is (by definition) polled completions. struct wait_page_key is made public, and we define struct wait_page_async as the interface between the caller and the core.

---
 include/linux/fs.h      |  7 ++++++-
 include/linux/pagemap.h |  9 +++++++++
 mm/filemap.c            | 41 +++++++++++++++++++++++++++++++++++++++++
 3 files changed, 56 insertions(+), 1 deletion(-)
include/linux/fs.h +6 -1
index d3ebb49189df..ba1fff0e7bca 100644
@@ -314,6 +314,8 @@ enum rw_hint {
 #define IOCB_SYNC		(1 << 5)
 #define IOCB_WRITE		(1 << 6)
 #define IOCB_NOWAIT		(1 << 7)
+/* iocb->ki_waitq is valid */
+#define IOCB_WAITQ		(1 << 8)
 
 struct kiocb {
 	struct file		*ki_filp;
@@ -327,7 +329,10 @@ struct kiocb {
 	int			ki_flags;
 	u16			ki_hint;
 	u16			ki_ioprio; /* See linux/ioprio.h */
-	unsigned int		ki_cookie; /* for ->iopoll */
+	union {
+		unsigned int		ki_cookie; /* for ->iopoll */
+		struct wait_page_queue	*ki_waitq; /* for async buffered IO */
+	};
 
 	randomized_struct_fields_end
 };
include/linux/pagemap.h +9 -0
index 53d980f2208d..d3e63c9c61ae 100644
@@ -495,6 +495,7 @@ static inline int wake_page_match(struct wait_page_queue *wait_page,
 
 extern void __lock_page(struct page *page);
 extern int __lock_page_killable(struct page *page);
+extern int __lock_page_async(struct page *page, struct wait_page_queue *wait);
 extern int __lock_page_or_retry(struct page *page, struct mm_struct *mm,
 				unsigned int flags);
 extern void unlock_page(struct page *page);
@@ -531,6 +532,14 @@ static inline int lock_page_killable(struct page *page)
 	return 0;
 }
 
+static inline int lock_page_async(struct page *page,
+				  struct wait_page_queue *wait)
+{
+	if (!trylock_page(page))
+		return __lock_page_async(page, wait);
+	return 0;
+}
+
 /*
  * lock_page_or_retry - Lock the page, unless this would block and the
  * caller indicated that it can handle a retry.
mm/filemap.c +41 -0

53 lines not on this page · raw message

Signature · 1 line
2.26.2
Acked-by on v5 4/12
#8 lore raw

Re: [PATCH 04/12] mm: add support for async page locking

Quoted 3 lines · Jens Axboe

Normally waiting for a page to become unlocked, or locking the page, requires waiting for IO to complete. Add support for lock_page_async() and wait_on_page_locked_async(), which are callback based instead. This

wait_on_page_locked_async() is actually in the next patch, requiring some back and forth to review. I wonder if this and the next patch could be merged to have the new API and callers introduced together?

Quoted 11 lines

allows a caller to get notified when a page becomes unlocked, rather than wait for it.

We add a new iocb field, ki_waitq, to pass in the necessary data for this to happen. We can unionize this with ki_cookie, since that is only used for polled IO. Polled IO can never co-exist with async callbacks, as it is (by definition) polled completions. struct wait_page_key is made public, and we define struct wait_page_async as the interface between the caller and the core.

author maintainer
#9 lore raw

Re: [PATCH 04/12] mm: add support for async page locking

Quoted 8 lines · Johannes Weiner
Quoted 3 lines · Jens Axboe

Normally waiting for a page to become unlocked, or locking the page, requires waiting for IO to complete. Add support for lock_page_async() and wait_on_page_locked_async(), which are callback based instead. This

wait_on_page_locked_async() is actually in the next patch, requiring some back and forth to review. I wonder if this and the next patch could be merged to have the new API and callers introduced together?

I'm fine with that, if that is preferable. Don't feel strongly about that at all, just tried to do it as piecemeal as possible to make it easier to review.

Signature · 1 line
Jens Axboe
#10 lore raw

Re: [PATCH 04/12] mm: add support for async page locking

Quoted 6 lines · Jens Axboe
Quoted 5 lines · Johannes Weiner
Quoted 3 lines · Jens Axboe

Normally waiting for a page to become unlocked, or locking the page, requires waiting for IO to complete. Add support for lock_page_async() and wait_on_page_locked_async(), which are callback based instead. This

Quoted 7 lines
Quoted 3 lines

wait_on_page_locked_async() is actually in the next patch, requiring some back and forth to review. I wonder if this and the next patch could be merged to have the new API and callers introduced together?

I'm fine with that, if that is preferable. Don't feel strongly about that at all, just tried to do it as piecemeal as possible to make it easier to review.

Not worth sending a new iteration over, IMO.

maintainer
#11 lore raw

Re: [PATCH 04/12] mm: add support for async page locking

In reply to Jens Axboe
Quoted 11 lines · Jens Axboe
mm/filemap.c +11 -0
+static int __wait_on_page_locked_async(struct page *page,
+				       struct wait_page_queue *wait, bool set)
+{
+	struct wait_queue_head *q = page_waitqueue(page);
+	int ret = 0;
+
+	wait->page = page;
+	wait->bit_nr = PG_locked;
+
+	spin_lock_irq(&q->lock);
+	if (set)

mm/filemap.c int wait_on_page_bit_killable(struct page *page, int bit_nr) · line 1206

Quoted 10 lines
mm/filemap.c +10 -0
+		ret = !trylock_page(page);
+	else
+		ret = PageLocked(page);
+	if (ret) {
+		__add_wait_queue_entry_tail(q, &wait->wait);
+		SetPageWaiters(page);
+		if (set)
+			ret = !trylock_page(page);
+		else
+			ret = PageLocked(page);

Between the callers and this function, we actually look at PG_lock three times; once in the caller, then after taking the spinlock, then after adding ourselves to the waitqueue. I understand the first and third, but is it really worth doing the second test? It feels unlikely to succeed and only saves us setting PageWaiters.

author maintainer
#12 lore raw

Re: [PATCH 04/12] mm: add support for async page locking

Quoted 20 lines · Matthew Wilcox
Quoted 19 lines · Jens Axboe
mm/filemap.c +19 -0
+static int __wait_on_page_locked_async(struct page *page,
+				       struct wait_page_queue *wait, bool set)
+{
+	struct wait_queue_head *q = page_waitqueue(page);
+	int ret = 0;
+
+	wait->page = page;
+	wait->bit_nr = PG_locked;
+
+	spin_lock_irq(&q->lock);
+	if (set)
+		ret = !trylock_page(page);
+	else
+		ret = PageLocked(page);
+	if (ret) {
+		__add_wait_queue_entry_tail(q, &wait->wait);
+		SetPageWaiters(page);
+		if (set)
+			ret = !trylock_page(page);
Quoted 8 lines

Review

Quoted 2 lines
(quoted diff) +2 -0
+		else
+			ret = PageLocked(page);

Between the callers and this function, we actually look at PG_lock three times; once in the caller, then after taking the spinlock, then after adding ourselves to the waitqueue. I understand the first and third, but is it really worth doing the second test? It feels unlikely to succeed and only saves us setting PageWaiters.

That's probably true, and we can skip the 2nd one. I'll make the change.

Signature · 1 line
Jens Axboe
author maintainer
#13 lore raw

PATCH v5 5/12 mm: support async buffered reads in generic_file_buffered_read()

In reply to Jens Axboe

Use the async page locking infrastructure, if IOCB_WAITQ is set in the passed in iocb. The caller must expect an -EIOCBQUEUED return value, which means that IO is started but not done yet. This is similar to how O_DIRECT signals the same operation. Once the callback is received by the caller for IO completion, the caller must retry the operation.

---
 mm/filemap.c | 33 ++++++++++++++++++++++++++-------
 1 file changed, 26 insertions(+), 7 deletions(-)
mm/filemap.c +26 -7
index c746541b1d49..18022de7dc33 100644
@@ -1219,6 +1219,14 @@ static int __wait_on_page_locked_async(struct page *page,
 	return ret;
 }
 
+static int wait_on_page_locked_async(struct page *page,
+				     struct wait_page_queue *wait)
+{
+	if (!PageLocked(page))
+		return 0;
+	return __wait_on_page_locked_async(compound_head(page), wait, false);
+}
+
 /**
  * put_and_wait_on_page_locked - Drop a reference and wait for it to be unlocked
  * @page: The page to wait for.
@@ -2058,17 +2066,25 @@ static ssize_t generic_file_buffered_read(struct kiocb *iocb,
 					index, last_index - index);
 		}
 		if (!PageUptodate(page)) {
-			if (iocb->ki_flags & IOCB_NOWAIT) {
-				put_page(page);
-				goto would_block;
-			}
-
 			/*
 			 * See comment in do_read_cache_page on why
 			 * wait_on_page_locked is used to avoid unnecessarily
 			 * serialisations and why it's safe.
 			 */
-			error = wait_on_page_locked_killable(page);
+			if (iocb->ki_flags & IOCB_WAITQ) {
+				if (written) {
+					put_page(page);
+					goto out;
+				}
+				error = wait_on_page_locked_async(page,
+								iocb->ki_waitq);
+			} else {
+				if (iocb->ki_flags & IOCB_NOWAIT) {
+					put_page(page);
+					goto would_block;
+				}
+				error = wait_on_page_locked_killable(page);
+			}
 			if (unlikely(error))
 				goto readpage_error;
 			if (PageUptodate(page))
@@ -2156,7 +2172,10 @@ static ssize_t generic_file_buffered_read(struct kiocb *iocb,
 
 page_not_up_to_date:
 		/* Get exclusive access to the page ... */
-		error = lock_page_killable(page);
+		if (iocb->ki_flags & IOCB_WAITQ)
+			error = lock_page_async(page, iocb->ki_waitq);
+		else
+			error = lock_page_killable(page);
 		if (unlikely(error))
 			goto readpage_error;
 
Signature · 1 line
2.26.2
Acked-by on v5 5/12
#14 lore raw

Re: [PATCH 05/12] mm: support async buffered reads in generic_file_buffered_read()

Quoted 7 lines · Jens Axboe

Use the async page locking infrastructure, if IOCB_WAITQ is set in the passed in iocb. The caller must expect an -EIOCBQUEUED return value, which means that IO is started but not done yet. This is similar to how O_DIRECT signals the same operation. Once the callback is received by the caller for IO completion, the caller must retry the operation.

author maintainer
#15 lore raw

PATCH v5 6/12 fs: add FMODE_BUF_RASYNC

In reply to Jens Axboe

If set, this indicates that the file system supports IOCB_WAITQ for buffered reads.

---
 include/linux/fs.h | 3 +++
 1 file changed, 3 insertions(+)
include/linux/fs.h +3 -0
index ba1fff0e7bca..5ffc6d236b01 100644
@@ -175,6 +175,9 @@ typedef int (dio_iodone_t)(struct kiocb *iocb, loff_t offset,
 /* File does not contribute to nr_files count */
 #define FMODE_NOACCOUNT		((__force fmode_t)0x20000000)
 
+/* File supports async buffered reads */
+#define FMODE_BUF_RASYNC	((__force fmode_t)0x40000000)
+
 /*
  * Flag for rw_copy_check_uvector and compat_rw_copy_check_uvector
  * that indicates that they should check the contents of the iovec are
Signature · 1 line
2.26.2
author maintainer
#16 lore raw

PATCH v5 7/12 ext4: flag as supporting buffered async reads

In reply to Jens Axboe
---
 fs/ext4/file.c | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
fs/ext4/file.c +1 -1
index 0d624250a62b..9f7d9bf427b4 100644
@@ -826,7 +826,7 @@ static int ext4_file_open(struct inode * inode, struct file * filp)
 			return ret;
 	}
 
-	filp->f_mode |= FMODE_NOWAIT;
+	filp->f_mode |= FMODE_NOWAIT | FMODE_BUF_RASYNC;
 	return dquot_file_open(inode, filp);
 }
 
Signature · 1 line
2.26.2
author maintainer
#17 lore raw

PATCH v5 8/12 block: flag block devices as supporting IOCB_WAITQ

In reply to Jens Axboe
---
 fs/block_dev.c | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
fs/block_dev.c +1 -1
index d1e08bba925a..980cfce01c9a 100644
@@ -1851,7 +1851,7 @@ static int blkdev_open(struct inode * inode, struct file * filp)
 	 */
 	filp->f_flags |= O_LARGEFILE;
 
-	filp->f_mode |= FMODE_NOWAIT;
+	filp->f_mode |= FMODE_NOWAIT | FMODE_BUF_RASYNC;
 
 	if (filp->f_flags & O_NDELAY)
 		filp->f_mode |= FMODE_NDELAY;
Signature · 1 line
2.26.2
author maintainer
#18 lore raw

PATCH v5 9/12 xfs: flag files as supporting buffered async reads

In reply to Jens Axboe

XFS uses generic_file_read_iter(), which already supports this.

---
 fs/xfs/xfs_file.c | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
fs/xfs/xfs_file.c +1 -1
index 4b8bdecc3863..97f44fbf17f2 100644
@@ -1080,7 +1080,7 @@ xfs_file_open(
 		return -EFBIG;
 	if (XFS_FORCED_SHUTDOWN(XFS_M(inode->i_sb)))
 		return -EIO;
-	file->f_mode |= FMODE_NOWAIT;
+	file->f_mode |= FMODE_NOWAIT | FMODE_BUF_RASYNC;
 	return 0;
 }
 
Signature · 1 line
2.26.2
Acked-by on v5 9/12
#19 lore raw

Re: [PATCH 09/12] xfs: flag files as supporting buffered async reads

Quoted 3 lines · Jens Axboe

XFS uses generic_file_read_iter(), which already supports this.

Er... I guess that looks ok? Assuming you've done enough qa on io_uring to be able to tell if this breaks anything, since touching the mm always feels murky to me:

--D

Quoted 20 lines
---
 fs/xfs/xfs_file.c | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
fs/xfs/xfs_file.c +1 -1
index 4b8bdecc3863..97f44fbf17f2 100644
@@ -1080,7 +1080,7 @@ xfs_file_open(
 		return -EFBIG;
 	if (XFS_FORCED_SHUTDOWN(XFS_M(inode->i_sb)))
 		return -EIO;
-	file->f_mode |= FMODE_NOWAIT;
+	file->f_mode |= FMODE_NOWAIT | FMODE_BUF_RASYNC;
 	return 0;
 }
 
Signature · 1 line
2.26.2
author maintainer
#20 lore raw

Re: [PATCH 09/12] xfs: flag files as supporting buffered async reads

Quoted 9 lines · Darrick J. Wong
Quoted 3 lines · Jens Axboe

XFS uses generic_file_read_iter(), which already supports this.

Er... I guess that looks ok? Assuming you've done enough qa on io_uring to be able to tell if this breaks anything, since touching the mm always feels murky to me:

The mm bits should be fine, haven't seen anything odd in testing. And it's not like the mm changes are super complicated, I think they turned out pretty clean and straight forward.

Quoted 1 line

Thanks!

Signature · 1 line
Jens Axboe
author maintainer
#21 lore raw

PATCH v5 10/12 btrfs: flag files as supporting buffered async reads

In reply to Jens Axboe

btrfs uses generic_file_read_iter(), which already supports this.

---
 fs/btrfs/file.c | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
fs/btrfs/file.c +1 -1
index 719e68ab552c..c933b6a1b4a8 100644
@@ -3480,7 +3480,7 @@ static loff_t btrfs_file_llseek(struct file *file, loff_t offset, int whence)
 
 static int btrfs_file_open(struct inode *inode, struct file *filp)
 {
-	filp->f_mode |= FMODE_NOWAIT;
+	filp->f_mode |= FMODE_NOWAIT | FMODE_BUF_RASYNC;
 	return generic_file_open(inode, filp);
 }
 
Signature · 1 line
2.26.2
author maintainer
#23 lore raw

PATCH v5 11/12 mm: add kiocb_wait_page_queue_init() helper

In reply to Jens Axboe

Checks if the file supports it, and initializes the values that we need. Caller passes in 'data' pointer, if any, and the callback function to be used.

---
 include/linux/pagemap.h | 21 +++++++++++++++++++++
 1 file changed, 21 insertions(+)
include/linux/pagemap.h +21 -0
index d3e63c9c61ae..8b65420410ee 100644
@@ -493,6 +493,27 @@ static inline int wake_page_match(struct wait_page_queue *wait_page,
 	return 1;
 }
 
+static inline int kiocb_wait_page_queue_init(struct kiocb *kiocb,
+					     struct wait_page_queue *wait,
+					     wait_queue_func_t func,
+					     void *data)
+{
+	/* Can't support async wakeup with polled IO */
+	if (kiocb->ki_flags & IOCB_HIPRI)
+		return -EINVAL;
+	if (kiocb->ki_filp->f_mode & FMODE_BUF_RASYNC) {
+		wait->wait.func = func;
+		wait->wait.private = data;
+		wait->wait.flags = 0;
+		INIT_LIST_HEAD(&wait->wait.entry);
+		kiocb->ki_flags |= IOCB_WAITQ;
+		kiocb->ki_waitq = wait;
+		return 0;
+	}
+
+	return -EOPNOTSUPP;
+}
+
 extern void __lock_page(struct page *page);
 extern int __lock_page_killable(struct page *page);
 extern int __lock_page_async(struct page *page, struct wait_page_queue *wait);
Signature · 1 line
2.26.2
author maintainer
#25 lore raw

PATCH v5 12/12 io_uring: support true async buffered reads, if file provides it

In reply to Jens Axboe

If the file is flagged with FMODE_BUF_RASYNC, then we don't have to punt the buffered read to an io-wq worker. Instead we can rely on page unlocking callbacks to support retry based async IO. This is a lot more efficient than doing async thread offload.

The retry is done similarly to how we handle poll based retry. From the unlock callback, we simply queue the retry to a task_work based handler.

---
 fs/io_uring.c | 130 ++++++++++++++++++++++++++++++++++++++++++++++++--
 1 file changed, 126 insertions(+), 4 deletions(-)
fs/io_uring.c +126 -4
index e6865afa8467..95df63b0b2ce 100644
@@ -79,6 +79,7 @@
 #include <linux/fs_struct.h>
 #include <linux/splice.h>
 #include <linux/task_work.h>
+#include <linux/pagemap.h>
 
 #define CREATE_TRACE_POINTS
 #include <trace/events/io_uring.h>
@@ -498,6 +499,8 @@ struct io_async_rw {
 	struct iovec			*iov;
 	ssize_t				nr_segs;
 	ssize_t				size;
+	struct wait_page_queue		wpq;
+	struct callback_head		task_work;
 };
 
 struct io_async_ctx {
@@ -2568,6 +2571,119 @@ static int io_read_prep(struct io_kiocb *req, const struct io_uring_sqe *sqe,
 	return 0;
 }
 
+static void io_async_buf_cancel(struct callback_head *cb)
+{
+	struct io_async_rw *rw;
+	struct io_ring_ctx *ctx;
+	struct io_kiocb *req;
+
+	rw = container_of(cb, struct io_async_rw, task_work);
+	req = rw->wpq.wait.private;
+	ctx = req->ctx;
+
+	spin_lock_irq(&ctx->completion_lock);
+	io_cqring_fill_event(req, -ECANCELED);
+	io_commit_cqring(ctx);
+	spin_unlock_irq(&ctx->completion_lock);
+
+	io_cqring_ev_posted(ctx);
+	req_set_fail_links(req);
+	io_double_put_req(req);
+}
+
+static void io_async_buf_retry(struct callback_head *cb)
+{
+	struct io_async_rw *rw;
+	struct io_ring_ctx *ctx;
+	struct io_kiocb *req;
+
+	rw = container_of(cb, struct io_async_rw, task_work);
+	req = rw->wpq.wait.private;
+	ctx = req->ctx;
+
+	__set_current_state(TASK_RUNNING);
+	mutex_lock(&ctx->uring_lock);
+	__io_queue_sqe(req, NULL);
+	mutex_unlock(&ctx->uring_lock);
+}
+
+static int io_async_buf_func(struct wait_queue_entry *wait, unsigned mode,
+			     int sync, void *arg)
+{
+	struct wait_page_queue *wpq;
+	struct io_kiocb *req = wait->private;
+	struct io_async_rw *rw = &req->io->rw;
+	struct wait_page_key *key = arg;
+	struct task_struct *tsk;
+	int ret;
+
+	wpq = container_of(wait, struct wait_page_queue, wait);
+
+	ret = wake_page_match(wpq, key);
+	if (ret != 1)
+		return ret;
+
+	list_del_init(&wait->entry);
+
+	init_task_work(&rw->task_work, io_async_buf_retry);
+	/* submit ref gets dropped, acquire a new one */
+	refcount_inc(&req->refs);
+	tsk = req->task;
+	ret = task_work_add(tsk, &rw->task_work, true);
+	if (unlikely(ret)) {
+		/* queue just for cancelation */
+		init_task_work(&rw->task_work, io_async_buf_cancel);
+		tsk = io_wq_get_task(req->ctx->io_wq);
+		task_work_add(tsk, &rw->task_work, true);
+	}
+	wake_up_process(tsk);
+	return 1;
+}
+
+static bool io_rw_should_retry(struct io_kiocb *req)
+{
+	struct kiocb *kiocb = &req->rw.kiocb;
+	int ret;
+
+	/* never retry for NOWAIT, we just complete with -EAGAIN */
+	if (req->flags & REQ_F_NOWAIT)
+		return false;
+
+	/* already tried, or we're doing O_DIRECT */
+	if (kiocb->ki_flags & (IOCB_DIRECT | IOCB_WAITQ))
+		return false;
+	/*
+	 * just use poll if we can, and don't attempt if the fs doesn't
+	 * support callback based unlocks
+	 */
+	if (file_can_poll(req->file) || !(req->file->f_mode & FMODE_BUF_RASYNC))
+		return false;
+
+	/*
+	 * If request type doesn't require req->io to defer in general,
+	 * we need to allocate it here
+	 */
+	if (!req->io && __io_alloc_async_ctx(req))
+		return false;
+
+	ret = kiocb_wait_page_queue_init(kiocb, &req->io->rw.wpq,
+						io_async_buf_func, req);
+	if (!ret) {
+		get_task_struct(current);
+		req->task = current;
+		return true;
+	}
+
+	return false;
+}
+
+static int io_iter_do_read(struct io_kiocb *req, struct iov_iter *iter)
+{
+	if (req->file->f_op->read_iter)
+		return call_read_iter(req->file, &req->rw.kiocb, iter);
+	return loop_rw_iter(READ, req->file, &req->rw.kiocb, iter);
+}
+
 static int io_read(struct io_kiocb *req, bool force_nonblock)
 {
 	struct iovec inline_vecs[UIO_FASTIOV], *iovec = inline_vecs;
@@ -2601,10 +2717,7 @@ static int io_read(struct io_kiocb *req, bool force_nonblock)
 	if (!ret) {
 		ssize_t ret2;
 
-		if (req->file->f_op->read_iter)
-			ret2 = call_read_iter(req->file, kiocb, &iter);
-		else
-			ret2 = loop_rw_iter(READ, req->file, kiocb, &iter);
+		ret2 = io_iter_do_read(req, &iter);
 
 		/* Catch -EAGAIN return for forced non-blocking submission */
 		if (!force_nonblock || ret2 != -EAGAIN) {
@@ -2619,6 +2732,15 @@ static int io_read(struct io_kiocb *req, bool force_nonblock)
 			if (!(req->flags & REQ_F_NOWAIT) &&
 			    !file_can_poll(req->file))
 				req->flags |= REQ_F_MUST_PUNT;
+			/* if we can retry, do so with the callbacks armed */
+			if (io_rw_should_retry(req)) {
+				ret2 = io_iter_do_read(req, &iter);
+				if (ret2 != -EAGAIN) {
+					kiocb_done(kiocb, ret2);
+					goto out_free;
+				}
+			}
+			kiocb->ki_flags &= ~IOCB_WAITQ;
 			return -EAGAIN;
 		}
 	}
Signature · 1 line
2.26.2
#26 lore raw
In reply to Jens Axboe
Quoted 91 lines · Jens Axboe

We technically support this already through io_uring, but it's implemented with a thread backend to support cases where we would block. This isn't ideal.

After a few prep patches, the core of this patchset is adding support for async callbacks on page unlock. With this primitive, we can simply retry the IO operation. With io_uring, this works a lot like poll based retry for files that support it. If a page is currently locked and needed, -EIOCBQUEUED is returned with a callback armed. The callers callback is responsible for restarting the operation.

With this callback primitive, we can add support for generic_file_buffered_read(), which is what most file systems end up using for buffered reads. XFS/ext4/btrfs/bdev is wired up, but probably trivial to add more.

The file flags support for this by setting FMODE_BUF_RASYNC, similar to what we do for FMODE_NOWAIT. Open to suggestions here if this is the preferred method or not.

In terms of results, I wrote a small test app that randomly reads 4G of data in 4K chunks from a file hosted by ext4. The app uses a queue depth of 32. If you want to test yourself, you can just use buffered=1 with ioengine=io_uring with fio. No application changes are needed to use the more optimized buffered async read.

preadv for comparison:

        real    1m13.821s
        user    0m0.558s
        sys     0m11.125s
        CPU     ~13%

Mainline:

        real    0m12.054s
        user    0m0.111s
        sys     0m5.659s
        CPU     ~32% + ~50% == ~82%

This patchset:

        real    0m9.283s
        user    0m0.147s
        sys     0m4.619s
        CPU     ~52%

The CPU numbers are just a rough estimate. For the mainline io_uring run, this includes the app itself and all the threads doing IO on its behalf (32% for the app, ~1.6% per worker and 32 of them). Context switch rate is much smaller with the patchset, since we only have the one task performing IO.

Also ran a simple fio based test case, varying the queue depth from 1 to 16, doubling every time:

[buf-test]
filename=/data/file
direct=0
ioengine=io_uring
norandommap
rw=randread
bs=4k
iodepth=${QD}
randseed=89
runtime=10s

QD/Test         Patchset IOPS           Mainline IOPS
1               9046                    8294
2               19.8k                   18.9k
4               39.2k                   28.5k
8               64.4k                   31.4k
16              65.7k                   37.8k

Outside of my usual environment, so this is just running on a virtualized NVMe device in qemu, using ext4 as the file system. NVMe isn't very efficient virtualized, so we run out of steam at ~65K which is why we flatline on the patched side (nvme_submit_cmd() eats ~75% of the test app CPU). Before that happens, it's a linear increase. Not shown is context switch rate, which is massively lower with the new code. The old thread offload adds a blocking thread per pending IO, so context rate quickly goes through the roof.

The goal here is efficiency. Async thread offload adds latency, and it also adds noticable overhead on items such as adding pages to the page cache. By allowing proper async buffered read support, we don't have X threads hammering on the same inode page cache, we have just the single app actually doing IO.

Been beating on this and it's solid for me, and I'm now pretty happy with how it all turned out. Not aware of any missing bits/pieces or code cleanups that need doing.

Quoted 8 lines

Series can also be found here:

https://git.kernel.dk/cgit/linux-block/log/?h=async-buffered.5

or pull from:

git://git.kernel.dk/linux-block async-buffered.5

Hi Jens,

I have pulled linux-block.git#async-buffered.5 on top of Linux v5.7-rc7.

From first feelings:
The booting into the system (until sddm display-login-manager) took a bit longer.
The same after login and booting into KDE/Plasma.

I am building/linking with LLVM/Clang/LLD v10.0.1-rc1 on Debian/testing AMD64.

Here I have an internal HDD (SATA) and my Debian-system is on an external HDD connected via USB-3.0.
Primarily, I use Ext4-FS.

As said above is the "emotional" side, but I need some technical instructions.

How can I see Async Buffer Reads is active on a Ext4-FS-formatted partition?

Do I need a special boot-parameter (GRUB line)?

Do I need to activate some cool variables via sysfs?

Do I need to pass an option via fstab entry?

Are any Async Buffer Reads related linux-kconfig options not set? Which make sense?

I am asking all this before doing some FIO testing.

Attached are my linux-config and dmesg-output files.

Thanks.

Regards,
- Sedat -

Quoted 27 lines
 fs/block_dev.c            |   2 +-
 fs/btrfs/file.c           |   2 +-
 fs/ext4/file.c            |   2 +-
 fs/io_uring.c             | 130 ++++++++++++++++++++++++++++++++++++--
 fs/xfs/xfs_file.c         |   2 +-
 include/linux/blk_types.h |   3 +-
 include/linux/fs.h        |  10 ++-
 include/linux/pagemap.h   |  67 ++++++++++++++++++++
 mm/filemap.c              | 111 ++++++++++++++++++++------------
 9 files changed, 279 insertions(+), 50 deletions(-)

Changes since v5:
- Correct commit message, iocb->private -> iocb->ki_waitq
- Get rid of io_uring goto, use an iter read helper
Changes since v3:
- io_uring: don't retry if REQ_F_NOWAIT is set
- io_uring: alloc req->io if the request type didn't already
- Add iocb->ki_waitq instead of (ab)using iocb->private Changes since v2:
- Get rid of unnecessary wait_page_async struct, just use wait_page_async
- Add another prep handler, adding wake_page_match()
- Use wake_page_match() in both callers
Changes since v1:
- Fix an issue with inline page locking
- Fix a potential race with __wait_on_page_locked_async()
- Fix a hang related to not setting page_match, thus missing a wakeup

Quoted 4 lines

--
Jens Axboe

[Thu May 28 18:21:00 2020] microcode: microcode updated early to revision 0x2f, date = 2019-02-17
[Thu May 28 18:21:00 2020] Linux version 5.7.0-rc7-4-amd64-clang ([email protected]@iniza) (clang version 10.0.1rc1, LLD 10.0.1rc1) #4~bullseye+dileks1 SMP 2020-05-28
[Thu May 28 18:21:00 2020] Command line: BOOT_IMAGE=/boot/vmlinuz-5.7.0-rc7-4-amd64-clang root=UUID=5f730cbc-abda-410c-9ea9-f0bdeda41926 ro
[Thu May 28 18:21:00 2020] Disabled fast string operations
[Thu May 28 18:21:00 2020] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[Thu May 28 18:21:00 2020] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[Thu May 28 18:21:00 2020] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[Thu May 28 18:21:00 2020] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[Thu May 28 18:21:00 2020] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[Thu May 28 18:21:00 2020] BIOS-provided physical RAM map:
[Thu May 28 18:21:00 2020] BIOS-e820: [mem 0x0000000000000000-0x000000000009d7ff] usable
[Thu May 28 18:21:00 2020] BIOS-e820: [mem 0x000000000009d800-0x000000000009ffff] reserved
[Thu May 28 18:21:00 2020] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[Thu May 28 18:21:00 2020] BIOS-e820: [mem 0x0000000000100000-0x000000001fffffff] usable
[Thu May 28 18:21:00 2020] BIOS-e820: [mem 0x0000000020000000-0x00000000201fffff] reserved
[Thu May 28 18:21:00 2020] BIOS-e820: [mem 0x0000000020200000-0x000000003fffffff] usable
[Thu May 28 18:21:00 2020] BIOS-e820: [mem 0x0000000040000000-0x00000000401fffff] reserved
[Thu May 28 18:21:00 2020] BIOS-e820: [mem 0x0000000040200000-0x00000000d9c9efff] usable
[Thu May 28 18:21:00 2020] BIOS-e820: [mem 0x00000000d9c9f000-0x00000000dae7efff] reserved
[Thu May 28 18:21:00 2020] BIOS-e820: [mem 0x00000000dae7f000-0x00000000daf9efff] ACPI NVS
[Thu May 28 18:21:00 2020] BIOS-e820: [mem 0x00000000daf9f000-0x00000000daffefff] ACPI data
[Thu May 28 18:21:00 2020] BIOS-e820: [mem 0x00000000dafff000-0x00000000daffffff] usable
[Thu May 28 18:21:00 2020] BIOS-e820: [mem 0x00000000db000000-0x00000000df9fffff] reserved
[Thu May 28 18:21:00 2020] BIOS-e820: [mem 0x00000000f8000000-0x00000000fbffffff] reserved
[Thu May 28 18:21:00 2020] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[Thu May 28 18:21:00 2020] BIOS-e820: [mem 0x00000000fed08000-0x00000000fed08fff] reserved
[Thu May 28 18:21:00 2020] BIOS-e820: [mem 0x00000000fed10000-0x00000000fed19fff] reserved
[Thu May 28 18:21:00 2020] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[Thu May 28 18:21:00 2020] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[Thu May 28 18:21:00 2020] BIOS-e820: [mem 0x00000000ffd80000-0x00000000ffffffff] reserved
[Thu May 28 18:21:00 2020] BIOS-e820: [mem 0x0000000100000000-0x000000021fdfffff] usable
[Thu May 28 18:21:00 2020] NX (Execute Disable) protection: active
[Thu May 28 18:21:00 2020] SMBIOS 2.6 present.
[Thu May 28 18:21:00 2020] DMI: SAMSUNG ELECTRONICS CO., LTD. 530U3BI/530U4BI/530U4BH/530U3BI/530U4BI/530U4BH, BIOS 13XK 03/28/2013
[Thu May 28 18:21:00 2020] tsc: Fast TSC calibration using PIT
[Thu May 28 18:21:00 2020] tsc: Detected 1596.387 MHz processor
[Thu May 28 18:21:00 2020] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[Thu May 28 18:21:00 2020] e820: remove [mem 0x000a0000-0x000fffff] usable
[Thu May 28 18:21:00 2020] last_pfn = 0x21fe00 max_arch_pfn = 0x400000000
[Thu May 28 18:21:00 2020] MTRR default type: uncachable
[Thu May 28 18:21:00 2020] MTRR fixed ranges enabled:
[Thu May 28 18:21:00 2020]   00000-9FFFF write-back
[Thu May 28 18:21:00 2020]   A0000-BFFFF uncachable
[Thu May 28 18:21:00 2020]   C0000-FFFFF write-protect
[Thu May 28 18:21:00 2020] MTRR variable ranges enabled:
[Thu May 28 18:21:00 2020]   0 base 000000000 mask F80000000 write-back
[Thu May 28 18:21:00 2020]   1 base 080000000 mask FC0000000 write-back
[Thu May 28 18:21:00 2020]   2 base 0C0000000 mask FE0000000 write-back
[Thu May 28 18:21:00 2020]   3 base 0DC000000 mask FFC000000 uncachable
[Thu May 28 18:21:00 2020]   4 base 0DB000000 mask FFF000000 uncachable
[Thu May 28 18:21:00 2020]   5 base 100000000 mask F00000000 write-back
[Thu May 28 18:21:00 2020]   6 base 200000000 mask FE0000000 write-back
[Thu May 28 18:21:00 2020]   7 base 21FE00000 mask FFFE00000 uncachable
[Thu May 28 18:21:00 2020]   8 base 0FFC00000 mask FFFC00000 write-protect
[Thu May 28 18:21:00 2020]   9 disabled
[Thu May 28 18:21:00 2020] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[Thu May 28 18:21:00 2020] last_pfn = 0xdb000 max_arch_pfn = 0x400000000
[Thu May 28 18:21:00 2020] found SMP MP-table at [mem 0x000f00e0-0x000f00ef]
[Thu May 28 18:21:00 2020] reserving inaccessible SNB gfx pages
[Thu May 28 18:21:00 2020] BRK [0x112401000, 0x112401fff] PGTABLE
[Thu May 28 18:21:00 2020] BRK [0x112402000, 0x112402fff] PGTABLE
[Thu May 28 18:21:00 2020] BRK [0x112403000, 0x112403fff] PGTABLE
[Thu May 28 18:21:00 2020] BRK [0x112404000, 0x112404fff] PGTABLE
[Thu May 28 18:21:00 2020] BRK [0x112405000, 0x112405fff] PGTABLE
[Thu May 28 18:21:00 2020] BRK [0x112406000, 0x112406fff] PGTABLE
[Thu May 28 18:21:00 2020] BRK [0x112407000, 0x112407fff] PGTABLE
[Thu May 28 18:21:00 2020] BRK [0x112408000, 0x112408fff] PGTABLE
[Thu May 28 18:21:00 2020] BRK [0x112409000, 0x112409fff] PGTABLE
[Thu May 28 18:21:00 2020] BRK [0x11240a000, 0x11240afff] PGTABLE
[Thu May 28 18:21:00 2020] BRK [0x11240b000, 0x11240bfff] PGTABLE
[Thu May 28 18:21:00 2020] RAMDISK: [mem 0x35169000-0x368abfff]
[Thu May 28 18:21:00 2020] ACPI: Early table checksum verification disabled
[Thu May 28 18:21:00 2020] ACPI: RSDP 0x00000000000F0100 000024 (v02 SECCSD)
[Thu May 28 18:21:00 2020] ACPI: XSDT 0x00000000DAFFE170 000084 (v01 SECCSD LH43STAR 00000002 PTEC 00000002)
[Thu May 28 18:21:00 2020] ACPI: FACP 0x00000000DAFEF000 00010C (v05 SECCSD LH43STAR 00000002 PTL  00000002)
[Thu May 28 18:21:00 2020] ACPI: DSDT 0x00000000DAFF2000 0083AC (v02 SECCSD SNB-CPT  00000000 INTL 20061109)
[Thu May 28 18:21:00 2020] ACPI: FACS 0x00000000DAF47000 000040
[Thu May 28 18:21:00 2020] ACPI: SLIC 0x00000000DAFFD000 000176 (v01 SECCSD LH43STAR 00000002 PTEC 00000001)
[Thu May 28 18:21:00 2020] ACPI: SSDT 0x00000000DAFFB000 001068 (v01 SECCSD PtidDevc 00001000 INTL 20061109)
[Thu May 28 18:21:00 2020] ACPI: ASF! 0x00000000DAFF1000 0000A5 (v32 SECCSD LH43STAR 00000002 PTL  00000002)
[Thu May 28 18:21:00 2020] ACPI: HPET 0x00000000DAFEE000 000038 (v01 SECCSD LH43STAR 00000002 PTL  00000002)
[Thu May 28 18:21:00 2020] ACPI: APIC 0x00000000DAFED000 000098 (v03 SECCSD LH43STAR 00000002 PTL  00000002)
[Thu May 28 18:21:00 2020] ACPI: MCFG 0x00000000DAFEC000 00003C (v01 SECCSD LH43STAR 00000002 PTL  00000002)
[Thu May 28 18:21:00 2020] ACPI: SSDT 0x00000000DAFEB000 000804 (v01 PmRef  Cpu0Ist  00003000 INTL 20061109)
[Thu May 28 18:21:00 2020] ACPI: SSDT 0x00000000DAFEA000 000996 (v01 PmRef  CpuPm    00003000 INTL 20061109)
[Thu May 28 18:21:00 2020] ACPI: UEFI 0x00000000DAFE9000 00003E (v01 SECCSD LH43STAR 00000002 PTL  00000002)
[Thu May 28 18:21:00 2020] ACPI: UEFI 0x00000000DAFE8000 000042 (v01 PTL    COMBUF   00000001 PTL  00000001)
[Thu May 28 18:21:00 2020] ACPI: UEFI 0x00000000DAFE7000 00026A (v01 SECCSD LH43STAR 00000002 PTL  00000002)
[Thu May 28 18:21:00 2020] ACPI: Local APIC address 0xfee00000
[Thu May 28 18:21:00 2020] No NUMA configuration found
[Thu May 28 18:21:00 2020] Faking a node at [mem 0x0000000000000000-0x000000021fdfffff]
[Thu May 28 18:21:00 2020] NODE_DATA(0) allocated [mem 0x21fdf8000-0x21fdfcfff]
[Thu May 28 18:21:00 2020] Zone ranges:
[Thu May 28 18:21:00 2020]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[Thu May 28 18:21:00 2020]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[Thu May 28 18:21:00 2020]   Normal   [mem 0x0000000100000000-0x000000021fdfffff]
[Thu May 28 18:21:00 2020]   Device   empty
[Thu May 28 18:21:00 2020] Movable zone start for each node
[Thu May 28 18:21:00 2020] Early memory node ranges
[Thu May 28 18:21:00 2020]   node   0: [mem 0x0000000000001000-0x000000000009cfff]
[Thu May 28 18:21:00 2020]   node   0: [mem 0x0000000000100000-0x000000001fffffff]
[Thu May 28 18:21:00 2020]   node   0: [mem 0x0000000020200000-0x000000003fffffff]
[Thu May 28 18:21:00 2020]   node   0: [mem 0x0000000040200000-0x00000000d9c9efff]
[Thu May 28 18:21:00 2020]   node   0: [mem 0x00000000dafff000-0x00000000daffffff]
[Thu May 28 18:21:00 2020]   node   0: [mem 0x0000000100000000-0x000000021fdfffff]
[Thu May 28 18:21:00 2020] Zeroed struct page in unavailable ranges: 27076 pages
[Thu May 28 18:21:00 2020] Initmem setup node 0 [mem 0x0000000000001000-0x000000021fdfffff]
[Thu May 28 18:21:00 2020] On node 0 totalpages: 2070076
[Thu May 28 18:21:00 2020]   DMA zone: 64 pages used for memmap
[Thu May 28 18:21:00 2020]   DMA zone: 156 pages reserved
[Thu May 28 18:21:00 2020]   DMA zone: 3996 pages, LIFO batch:0
[Thu May 28 18:21:00 2020]   DMA32 zone: 13859 pages used for memmap
[Thu May 28 18:21:00 2020]   DMA32 zone: 886944 pages, LIFO batch:63
[Thu May 28 18:21:00 2020]   Normal zone: 18424 pages used for memmap
[Thu May 28 18:21:00 2020]   Normal zone: 1179136 pages, LIFO batch:63
[Thu May 28 18:21:00 2020] Reserving Intel graphics memory at [mem 0xdba00000-0xdf9fffff]
[Thu May 28 18:21:00 2020] ACPI: PM-Timer IO Port: 0x408
[Thu May 28 18:21:00 2020] ACPI: Local APIC address 0xfee00000
[Thu May 28 18:21:00 2020] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
[Thu May 28 18:21:00 2020] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
[Thu May 28 18:21:00 2020] IOAPIC[0]: apic_id 14, version 32, address 0xfec00000, GSI 0-23
[Thu May 28 18:21:00 2020] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[Thu May 28 18:21:00 2020] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[Thu May 28 18:21:00 2020] ACPI: IRQ0 used by override.
[Thu May 28 18:21:00 2020] ACPI: IRQ9 used by override.
[Thu May 28 18:21:00 2020] Using ACPI (MADT) for SMP configuration information
[Thu May 28 18:21:00 2020] ACPI: HPET id: 0x8086a301 base: 0xfed00000
[Thu May 28 18:21:00 2020] smpboot: Allowing 8 CPUs, 4 hotplug CPUs
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0x0009d000-0x0009dfff]
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0x0009e000-0x0009ffff]
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0x20000000-0x201fffff]
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0x40000000-0x401fffff]
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0xd9c9f000-0xdae7efff]
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0xdae7f000-0xdaf9efff]
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0xdaf9f000-0xdaffefff]
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0xdb000000-0xdf9fffff]
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0xdfa00000-0xf7ffffff]
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0xf8000000-0xfbffffff]
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0xfc000000-0xfebfffff]
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0xfec01000-0xfed07fff]
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0xfed08000-0xfed08fff]
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0xfed09000-0xfed0ffff]
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0xfed10000-0xfed19fff]
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0xfed1a000-0xfed1bfff]
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0xfed20000-0xfedfffff]
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0xfee00000-0xfee00fff]
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0xfee01000-0xffd7ffff]
[Thu May 28 18:21:00 2020] PM: hibernation: Registered nosave memory: [mem 0xffd80000-0xffffffff]
[Thu May 28 18:21:00 2020] [mem 0xdfa00000-0xf7ffffff] available for PCI devices
[Thu May 28 18:21:00 2020] Booting paravirtualized kernel on bare hardware
[Thu May 28 18:21:00 2020] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[Thu May 28 18:21:00 2020] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:8 nr_node_ids:1
[Thu May 28 18:21:00 2020] percpu: Embedded 55 pages/cpu s187160 r8192 d29928 u262144
[Thu May 28 18:21:00 2020] pcpu-alloc: s187160 r8192 d29928 u262144 alloc=1*2097152
[Thu May 28 18:21:00 2020] pcpu-alloc: [0] 0 1 2 3 4 5 6 7 
[Thu May 28 18:21:00 2020] Built 1 zonelists, mobility grouping on.  Total pages: 2037573
[Thu May 28 18:21:00 2020] Policy zone: Normal
[Thu May 28 18:21:00 2020] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.7.0-rc7-4-amd64-clang root=UUID=5f730cbc-abda-410c-9ea9-f0bdeda41926 ro
[Thu May 28 18:21:00 2020] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)
[Thu May 28 18:21:00 2020] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)
[Thu May 28 18:21:00 2020] mem auto-init: stack:off, heap alloc:off, heap free:off
[Thu May 28 18:21:00 2020] Memory: 3604852K/8280304K available (12291K kernel code, 1199K rwdata, 3700K rodata, 1676K init, 2700K bss, 262260K reserved, 0K cma-reserved)
[Thu May 28 18:21:00 2020] random: get_random_u64 called from __kmem_cache_create+0xd9/0x870 with crng_init=0
[Thu May 28 18:21:00 2020] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1
[Thu May 28 18:21:00 2020] Kernel/User page tables isolation: enabled
[Thu May 28 18:21:00 2020] ftrace: allocating 32446 entries in 127 pages
[Thu May 28 18:21:00 2020] ftrace: allocated 127 pages with 7 groups
[Thu May 28 18:21:00 2020] rcu: Hierarchical RCU implementation.
[Thu May 28 18:21:00 2020] rcu: 	RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=8.
[Thu May 28 18:21:00 2020] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[Thu May 28 18:21:00 2020] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8
[Thu May 28 18:21:00 2020] NR_IRQS: 33024, nr_irqs: 488, preallocated irqs: 16
[Thu May 28 18:21:00 2020] Console: colour VGA+ 80x25
[Thu May 28 18:21:00 2020] printk: console [tty0] enabled
[Thu May 28 18:21:00 2020] ACPI: Core revision 20200326
[Thu May 28 18:21:00 2020] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns
[Thu May 28 18:21:00 2020] APIC: Switch to symmetric I/O mode setup
[Thu May 28 18:21:00 2020] x2apic: IRQ remapping doesn't support X2APIC mode
[Thu May 28 18:21:00 2020] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[Thu May 28 18:21:00 2020] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x1702cfcff4a, max_idle_ns: 440795212315 ns
[Thu May 28 18:21:00 2020] Calibrating delay loop (skipped), value calculated using timer frequency.. 3192.77 BogoMIPS (lpj=6385548)
[Thu May 28 18:21:00 2020] pid_max: default: 32768 minimum: 301
[Thu May 28 18:21:00 2020] LSM: Security Framework initializing
[Thu May 28 18:21:00 2020] Yama: becoming mindful.
[Thu May 28 18:21:00 2020] AppArmor: AppArmor initialized
[Thu May 28 18:21:00 2020] TOMOYO Linux initialized
[Thu May 28 18:21:00 2020] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)
[Thu May 28 18:21:00 2020] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)
[Thu May 28 18:21:00 2020] Disabled fast string operations
[Thu May 28 18:21:00 2020] mce: CPU0: Thermal monitoring enabled (TM1)
[Thu May 28 18:21:00 2020] process: using mwait in idle threads
[Thu May 28 18:21:00 2020] Last level iTLB entries: 4KB 512, 2MB 8, 4MB 8
[Thu May 28 18:21:00 2020] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32, 1GB 0
[Thu May 28 18:21:00 2020] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[Thu May 28 18:21:00 2020] Spectre V2 : Mitigation: Full generic retpoline
[Thu May 28 18:21:00 2020] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[Thu May 28 18:21:00 2020] Spectre V2 : Enabling Restricted Speculation for firmware calls
[Thu May 28 18:21:00 2020] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier
[Thu May 28 18:21:00 2020] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl
[Thu May 28 18:21:00 2020] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[Thu May 28 18:21:00 2020] MDS: Mitigation: Clear CPU buffers
[Thu May 28 18:21:00 2020] Freeing SMP alternatives memory: 36K
[Thu May 28 18:21:00 2020] smpboot: CPU0: Intel(R) Core(TM) i5-2467M CPU @ 1.60GHz (family: 0x6, model: 0x2a, stepping: 0x7)
[Thu May 28 18:21:00 2020] Performance Events: PEBS fmt1+, SandyBridge events, 16-deep LBR, full-width counters, Intel PMU driver.
[Thu May 28 18:21:00 2020] ... version:                3
[Thu May 28 18:21:00 2020] ... bit width:              48
[Thu May 28 18:21:00 2020] ... generic registers:      4
[Thu May 28 18:21:00 2020] ... value mask:             0000ffffffffffff
[Thu May 28 18:21:00 2020] ... max period:             00007fffffffffff
[Thu May 28 18:21:00 2020] ... fixed-purpose events:   3
[Thu May 28 18:21:00 2020] ... event mask:             000000070000000f
[Thu May 28 18:21:00 2020] rcu: Hierarchical SRCU implementation.
[Thu May 28 18:21:00 2020] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter.
[Thu May 28 18:21:00 2020] smp: Bringing up secondary CPUs ...
[Thu May 28 18:21:00 2020] x86: Booting SMP configuration:
[Thu May 28 18:21:00 2020] .... node  #0, CPUs:      #1
[Thu May 28 18:21:00 2020] Disabled fast string operations
[Thu May 28 18:21:00 2020] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details.
[Thu May 28 18:21:00 2020]  #2
[Thu May 28 18:21:00 2020] Disabled fast string operations
[Thu May 28 18:21:00 2020]  #3
[Thu May 28 18:21:00 2020] Disabled fast string operations
[Thu May 28 18:21:00 2020] smp: Brought up 1 node, 4 CPUs
[Thu May 28 18:21:00 2020] smpboot: Max logical packages: 2
[Thu May 28 18:21:00 2020] smpboot: Total of 4 processors activated (12771.09 BogoMIPS)
[Thu May 28 18:21:00 2020] node 0 initialised, 1103298 pages in 20ms
[Thu May 28 18:21:00 2020] devtmpfs: initialized
[Thu May 28 18:21:00 2020] x86/mm: Memory block size: 128MB
[Thu May 28 18:21:00 2020] PM: Registering ACPI NVS region [mem 0xdae7f000-0xdaf9efff] (1179648 bytes)
[Thu May 28 18:21:00 2020] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[Thu May 28 18:21:00 2020] futex hash table entries: 2048 (order: 5, 131072 bytes, linear)
[Thu May 28 18:21:00 2020] pinctrl core: initialized pinctrl subsystem
[Thu May 28 18:21:00 2020] thermal_sys: Registered thermal governor 'fair_share'
[Thu May 28 18:21:00 2020] thermal_sys: Registered thermal governor 'bang_bang'
[Thu May 28 18:21:00 2020] thermal_sys: Registered thermal governor 'step_wise'
[Thu May 28 18:21:00 2020] thermal_sys: Registered thermal governor 'user_space'
[Thu May 28 18:21:00 2020] NET: Registered protocol family 16
[Thu May 28 18:21:00 2020] audit: initializing netlink subsys (disabled)
[Thu May 28 18:21:00 2020] audit: type=2000 audit(1590682861.068:1): state=initialized audit_enabled=0 res=1
[Thu May 28 18:21:00 2020] cpuidle: using governor ladder
[Thu May 28 18:21:00 2020] cpuidle: using governor menu
[Thu May 28 18:21:00 2020] ACPI: bus type PCI registered
[Thu May 28 18:21:00 2020] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[Thu May 28 18:21:00 2020] PCI: MMCONFIG for domain 0000 [bus 00-3f] at [mem 0xf8000000-0xfbffffff] (base 0xf8000000)
[Thu May 28 18:21:00 2020] PCI: MMCONFIG at [mem 0xf8000000-0xfbffffff] reserved in E820
[Thu May 28 18:21:00 2020] PCI: Using configuration type 1 for base access
[Thu May 28 18:21:00 2020] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[Thu May 28 18:21:00 2020] ENERGY_PERF_BIAS: Set to 'normal', was 'performance'
[Thu May 28 18:21:00 2020] mtrr: your CPUs had inconsistent variable MTRR settings
[Thu May 28 18:21:00 2020] mtrr: probably your BIOS does not setup all CPUs.
[Thu May 28 18:21:00 2020] mtrr: corrected configuration.
[Thu May 28 18:21:00 2020] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[Thu May 28 18:21:00 2020] ACPI: Added _OSI(Module Device)
[Thu May 28 18:21:00 2020] ACPI: Added _OSI(Processor Device)
[Thu May 28 18:21:00 2020] ACPI: Added _OSI(3.0 _SCP Extensions)
[Thu May 28 18:21:00 2020] ACPI: Added _OSI(Processor Aggregator Device)
[Thu May 28 18:21:00 2020] ACPI: Added _OSI(Linux-Dell-Video)
[Thu May 28 18:21:00 2020] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[Thu May 28 18:21:00 2020] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
[Thu May 28 18:21:00 2020] ACPI: 4 ACPI AML tables successfully acquired and loaded
[Thu May 28 18:21:00 2020] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[Thu May 28 18:21:00 2020] ACPI: Dynamic OEM Table Load:
[Thu May 28 18:21:00 2020] ACPI: SSDT 0xFFFF9F2AC7FA6000 000688 (v01 PmRef  Cpu0Cst  00003001 INTL 20061109)
[Thu May 28 18:21:00 2020] ACPI: Dynamic OEM Table Load:
[Thu May 28 18:21:00 2020] ACPI: SSDT 0xFFFF9F2AC7FBC800 000303 (v01 PmRef  ApIst    00003000 INTL 20061109)
[Thu May 28 18:21:00 2020] ACPI: Dynamic OEM Table Load:
[Thu May 28 18:21:00 2020] ACPI: SSDT 0xFFFF9F2AD24FCC00 000119 (v01 PmRef  ApCst    00003000 INTL 20061109)
[Thu May 28 18:21:00 2020] ACPI: EC: EC started
[Thu May 28 18:21:00 2020] ACPI: EC: interrupt blocked
[Thu May 28 18:21:00 2020] ACPI: EC: EC_CMD/EC_SC=0x66, EC_DATA=0x62
[Thu May 28 18:21:00 2020] ACPI: \_SB_.PCI0.LPCB.H_EC: Boot DSDT EC used to handle transactions
[Thu May 28 18:21:00 2020] ACPI: Interpreter enabled
[Thu May 28 18:21:00 2020] ACPI: (supports S0 S1 S3 S4 S5)
[Thu May 28 18:21:00 2020] ACPI: Using IOAPIC for interrupt routing
[Thu May 28 18:21:00 2020] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[Thu May 28 18:21:00 2020] ACPI: Enabled 8 GPEs in block 00 to 3F
[Thu May 28 18:21:00 2020] ACPI: Power Resource [FN00] (off)
[Thu May 28 18:21:00 2020] ACPI: Power Resource [FN01] (off)
[Thu May 28 18:21:00 2020] ACPI: Power Resource [FN02] (off)
[Thu May 28 18:21:00 2020] ACPI: Power Resource [FN03] (off)
[Thu May 28 18:21:00 2020] ACPI: Power Resource [FN04] (off)
[Thu May 28 18:21:00 2020] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-3e])
[Thu May 28 18:21:00 2020] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[Thu May 28 18:21:00 2020] acpi PNP0A08:00: _OSC failed (AE_ERROR); disabling ASPM
[Thu May 28 18:21:00 2020] PCI host bridge to bus 0000:00
[Thu May 28 18:21:00 2020] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[Thu May 28 18:21:00 2020] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[Thu May 28 18:21:00 2020] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[Thu May 28 18:21:00 2020] pci_bus 0000:00: root bus resource [mem 0xdfa00000-0xfeafffff window]
[Thu May 28 18:21:00 2020] pci_bus 0000:00: root bus resource [mem 0xfed40000-0xfed44fff window]
[Thu May 28 18:21:00 2020] pci_bus 0000:00: root bus resource [bus 00-3e]
[Thu May 28 18:21:00 2020] pci 0000:00:00.0: [8086:0104] type 00 class 0x060000
[Thu May 28 18:21:00 2020] pci 0000:00:02.0: [8086:0116] type 00 class 0x030000
[Thu May 28 18:21:00 2020] pci 0000:00:02.0: reg 0x10: [mem 0xf0000000-0xf03fffff 64bit]
[Thu May 28 18:21:00 2020] pci 0000:00:02.0: reg 0x18: [mem 0xe0000000-0xefffffff 64bit pref]
[Thu May 28 18:21:00 2020] pci 0000:00:02.0: reg 0x20: [io  0x3000-0x303f]
[Thu May 28 18:21:00 2020] pci 0000:00:16.0: [8086:1c3a] type 00 class 0x078000
[Thu May 28 18:21:00 2020] pci 0000:00:16.0: reg 0x10: [mem 0xf0705000-0xf070500f 64bit]
[Thu May 28 18:21:00 2020] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
[Thu May 28 18:21:00 2020] pci 0000:00:1a.0: [8086:1c2d] type 00 class 0x0c0320
[Thu May 28 18:21:00 2020] pci 0000:00:1a.0: reg 0x10: [mem 0xf070a000-0xf070a3ff]
[Thu May 28 18:21:00 2020] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
[Thu May 28 18:21:00 2020] pci 0000:00:1b.0: [8086:1c20] type 00 class 0x040300
[Thu May 28 18:21:00 2020] pci 0000:00:1b.0: reg 0x10: [mem 0xf0700000-0xf0703fff 64bit]
[Thu May 28 18:21:00 2020] pci 0000:00:1b.0: PME# supported from D0 D3hot D3cold
[Thu May 28 18:21:00 2020] pci 0000:00:1c.0: [8086:1c10] type 01 class 0x060400
[Thu May 28 18:21:00 2020] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[Thu May 28 18:21:00 2020] pci 0000:00:1c.3: [8086:1c16] type 01 class 0x060400
[Thu May 28 18:21:00 2020] pci 0000:00:1c.3: PME# supported from D0 D3hot D3cold
[Thu May 28 18:21:00 2020] pci 0000:00:1c.4: [8086:1c18] type 01 class 0x060400
[Thu May 28 18:21:00 2020] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold
[Thu May 28 18:21:00 2020] pci 0000:00:1d.0: [8086:1c26] type 00 class 0x0c0320
[Thu May 28 18:21:00 2020] pci 0000:00:1d.0: reg 0x10: [mem 0xf0709000-0xf07093ff]
[Thu May 28 18:21:00 2020] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
[Thu May 28 18:21:00 2020] pci 0000:00:1f.0: [8086:1c49] type 00 class 0x060100
[Thu May 28 18:21:00 2020] pci 0000:00:1f.2: [8086:1c03] type 00 class 0x010601
[Thu May 28 18:21:00 2020] pci 0000:00:1f.2: reg 0x10: [io  0x3088-0x308f]
[Thu May 28 18:21:00 2020] pci 0000:00:1f.2: reg 0x14: [io  0x3094-0x3097]
[Thu May 28 18:21:00 2020] pci 0000:00:1f.2: reg 0x18: [io  0x3080-0x3087]
[Thu May 28 18:21:00 2020] pci 0000:00:1f.2: reg 0x1c: [io  0x3090-0x3093]
[Thu May 28 18:21:00 2020] pci 0000:00:1f.2: reg 0x20: [io  0x3060-0x307f]
[Thu May 28 18:21:00 2020] pci 0000:00:1f.2: reg 0x24: [mem 0xf0708000-0xf07087ff]
[Thu May 28 18:21:00 2020] pci 0000:00:1f.2: PME# supported from D3hot
[Thu May 28 18:21:00 2020] pci 0000:00:1f.3: [8086:1c22] type 00 class 0x0c0500
[Thu May 28 18:21:00 2020] pci 0000:00:1f.3: reg 0x10: [mem 0xf0704000-0xf07040ff 64bit]
[Thu May 28 18:21:00 2020] pci 0000:00:1f.3: reg 0x20: [io  0xefa0-0xefbf]
[Thu May 28 18:21:00 2020] pci 0000:01:00.0: [8086:0091] type 00 class 0x028000
[Thu May 28 18:21:00 2020] pci 0000:01:00.0: reg 0x10: [mem 0xf0600000-0xf0601fff 64bit]
[Thu May 28 18:21:00 2020] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[Thu May 28 18:21:00 2020] pci 0000:00:1c.0: PCI bridge to [bus 01]
[Thu May 28 18:21:00 2020] pci 0000:00:1c.0:   bridge window [mem 0xf0600000-0xf06fffff]
[Thu May 28 18:21:00 2020] pci 0000:02:00.0: [10ec:8168] type 00 class 0x020000
[Thu May 28 18:21:00 2020] pci 0000:02:00.0: reg 0x10: [io  0x2000-0x20ff]
[Thu May 28 18:21:00 2020] pci 0000:02:00.0: reg 0x18: [mem 0xf0404000-0xf0404fff 64bit pref]
[Thu May 28 18:21:00 2020] pci 0000:02:00.0: reg 0x20: [mem 0xf0400000-0xf0403fff 64bit pref]
[Thu May 28 18:21:00 2020] pci 0000:02:00.0: supports D1 D2
[Thu May 28 18:21:00 2020] pci 0000:02:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[Thu May 28 18:21:00 2020] pci 0000:00:1c.3: PCI bridge to [bus 02]
[Thu May 28 18:21:00 2020] pci 0000:00:1c.3:   bridge window [io  0x2000-0x2fff]
[Thu May 28 18:21:00 2020] pci 0000:00:1c.3:   bridge window [mem 0xf0400000-0xf04fffff 64bit pref]
[Thu May 28 18:21:00 2020] pci 0000:03:00.0: [1b21:1042] type 00 class 0x0c0330
[Thu May 28 18:21:00 2020] pci 0000:03:00.0: reg 0x10: [mem 0xf0500000-0xf0507fff 64bit]
[Thu May 28 18:21:00 2020] pci 0000:03:00.0: PME# supported from D3cold
[Thu May 28 18:21:00 2020] pci 0000:00:1c.4: PCI bridge to [bus 03]
[Thu May 28 18:21:00 2020] pci 0000:00:1c.4:   bridge window [mem 0xf0500000-0xf05fffff]
[Thu May 28 18:21:00 2020] ACPI: PCI Interrupt Link [LNKA] (IRQs 1 3 4 5 6 10 *11 12 14 15)
[Thu May 28 18:21:00 2020] ACPI: PCI Interrupt Link [LNKB] (IRQs 1 3 4 5 6 10 11 12 14 15) *0, disabled.
[Thu May 28 18:21:00 2020] ACPI: PCI Interrupt Link [LNKC] (IRQs 1 3 4 5 6 *10 11 12 14 15)
[Thu May 28 18:21:00 2020] ACPI: PCI Interrupt Link [LNKD] (IRQs 1 3 4 5 6 *10 11 12 14 15)
[Thu May 28 18:21:00 2020] ACPI: PCI Interrupt Link [LNKE] (IRQs 1 3 4 5 6 10 11 12 14 15) *9
[Thu May 28 18:21:00 2020] ACPI: PCI Interrupt Link [LNKF] (IRQs 1 3 4 5 6 10 11 12 14 15) *0, disabled.
[Thu May 28 18:21:00 2020] ACPI: PCI Interrupt Link [LNKG] (IRQs 1 3 4 5 6 10 *11 12 14 15)
[Thu May 28 18:21:00 2020] ACPI: PCI Interrupt Link [LNKH] (IRQs 1 3 4 5 6 10 11 12 14 15) *9
[Thu May 28 18:21:00 2020] ACPI: EC: interrupt unblocked
[Thu May 28 18:21:00 2020] ACPI: EC: event unblocked
[Thu May 28 18:21:00 2020] ACPI: EC: 0 stale EC events cleared
[Thu May 28 18:21:00 2020] ACPI: EC: EC_CMD/EC_SC=0x66, EC_DATA=0x62
[Thu May 28 18:21:00 2020] ACPI: EC: GPE=0x17
[Thu May 28 18:21:00 2020] ACPI: \_SB_.PCI0.LPCB.H_EC: Boot DSDT EC initialization complete
[Thu May 28 18:21:00 2020] ACPI: \_SB_.PCI0.LPCB.H_EC: EC: Used to handle transactions and events
[Thu May 28 18:21:00 2020] iommu: Default domain type: Translated 
[Thu May 28 18:21:00 2020] pci 0000:00:02.0: vgaarb: setting as boot VGA device
[Thu May 28 18:21:00 2020] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[Thu May 28 18:21:00 2020] pci 0000:00:02.0: vgaarb: bridge control possible
[Thu May 28 18:21:00 2020] vgaarb: loaded
[Thu May 28 18:21:00 2020] EDAC MC: Ver: 3.0.0
[Thu May 28 18:21:00 2020] PCI: Using ACPI for IRQ routing
[Thu May 28 18:21:00 2020] PCI: pci_cache_line_size set to 64 bytes
[Thu May 28 18:21:00 2020] e820: reserve RAM buffer [mem 0x0009d800-0x0009ffff]
[Thu May 28 18:21:00 2020] e820: reserve RAM buffer [mem 0xd9c9f000-0xdbffffff]
[Thu May 28 18:21:00 2020] e820: reserve RAM buffer [mem 0xdb000000-0xdbffffff]
[Thu May 28 18:21:00 2020] e820: reserve RAM buffer [mem 0x21fe00000-0x21fffffff]
[Thu May 28 18:21:00 2020] NetLabel: Initializing
[Thu May 28 18:21:00 2020] NetLabel:  domain hash size = 128
[Thu May 28 18:21:00 2020] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[Thu May 28 18:21:00 2020] NetLabel:  unlabeled traffic allowed by default
[Thu May 28 18:21:00 2020] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[Thu May 28 18:21:00 2020] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[Thu May 28 18:21:00 2020] clocksource: Switched to clocksource tsc-early
[Thu May 28 18:21:00 2020] VFS: Disk quotas dquot_6.6.0
[Thu May 28 18:21:00 2020] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[Thu May 28 18:21:00 2020] AppArmor: AppArmor Filesystem Enabled
[Thu May 28 18:21:00 2020] pnp: PnP ACPI init
[Thu May 28 18:21:00 2020] system 00:00: [io  0x0680-0x069f] has been reserved
[Thu May 28 18:21:00 2020] system 00:00: [io  0x1000-0x100f] has been reserved
[Thu May 28 18:21:00 2020] system 00:00: [io  0x5000-0x5003] has been reserved
[Thu May 28 18:21:00 2020] system 00:00: [io  0xffff] has been reserved
[Thu May 28 18:21:00 2020] system 00:00: [io  0x0400-0x0453] has been reserved
[Thu May 28 18:21:00 2020] system 00:00: [io  0x0458-0x047f] has been reserved
[Thu May 28 18:21:00 2020] system 00:00: [io  0x0500-0x057f] has been reserved
[Thu May 28 18:21:00 2020] system 00:00: [io  0x0a00-0x0a0f] has been reserved
[Thu May 28 18:21:00 2020] system 00:00: [io  0x164e-0x164f] has been reserved
[Thu May 28 18:21:00 2020] system 00:00: [io  0x5000-0x500f] could not be reserved
[Thu May 28 18:21:00 2020] system 00:00: Plug and Play ACPI device, IDs PNP0c02 (active)
[Thu May 28 18:21:00 2020] pnp 00:01: Plug and Play ACPI device, IDs PNP0b00 (active)
[Thu May 28 18:21:00 2020] system 00:02: [io  0x0454-0x0457] has been reserved
[Thu May 28 18:21:00 2020] system 00:02: Plug and Play ACPI device, IDs INT3f0d PNP0c02 (active)
[Thu May 28 18:21:00 2020] pnp 00:03: Plug and Play ACPI device, IDs PNP0303 (active)
[Thu May 28 18:21:00 2020] pnp 00:04: Plug and Play ACPI device, IDs ETD0b00 SYN0002 PNP0f13 (active)
[Thu May 28 18:21:00 2020] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved
[Thu May 28 18:21:00 2020] system 00:05: [mem 0xfed10000-0xfed17fff] has been reserved
[Thu May 28 18:21:00 2020] system 00:05: [mem 0xfed18000-0xfed18fff] has been reserved
[Thu May 28 18:21:00 2020] system 00:05: [mem 0xfed19000-0xfed19fff] has been reserved
[Thu May 28 18:21:00 2020] system 00:05: [mem 0xf8000000-0xfbffffff] has been reserved
[Thu May 28 18:21:00 2020] system 00:05: [mem 0xfed20000-0xfed3ffff] has been reserved
[Thu May 28 18:21:00 2020] system 00:05: [mem 0xfed90000-0xfed93fff] has been reserved
[Thu May 28 18:21:00 2020] system 00:05: [mem 0xfed45000-0xfed8ffff] has been reserved
[Thu May 28 18:21:00 2020] system 00:05: [mem 0xff000000-0xffffffff] could not be reserved
[Thu May 28 18:21:00 2020] system 00:05: [mem 0xfee00000-0xfeefffff] could not be reserved
[Thu May 28 18:21:00 2020] system 00:05: Plug and Play ACPI device, IDs PNP0c02 (active)
[Thu May 28 18:21:00 2020] system 00:06: Plug and Play ACPI device, IDs PNP0c01 (active)
[Thu May 28 18:21:00 2020] pnp: PnP ACPI: found 7 devices
[Thu May 28 18:21:00 2020] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[Thu May 28 18:21:00 2020] pci 0000:00:1c.0: PCI bridge to [bus 01]
[Thu May 28 18:21:00 2020] pci 0000:00:1c.0:   bridge window [mem 0xf0600000-0xf06fffff]
[Thu May 28 18:21:00 2020] pci 0000:00:1c.3: PCI bridge to [bus 02]
[Thu May 28 18:21:00 2020] pci 0000:00:1c.3:   bridge window [io  0x2000-0x2fff]
[Thu May 28 18:21:00 2020] pci 0000:00:1c.3:   bridge window [mem 0xf0400000-0xf04fffff 64bit pref]
[Thu May 28 18:21:00 2020] pci 0000:00:1c.4: PCI bridge to [bus 03]
[Thu May 28 18:21:00 2020] pci 0000:00:1c.4:   bridge window [mem 0xf0500000-0xf05fffff]
[Thu May 28 18:21:00 2020] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
[Thu May 28 18:21:00 2020] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]
[Thu May 28 18:21:00 2020] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[Thu May 28 18:21:00 2020] pci_bus 0000:00: resource 7 [mem 0xdfa00000-0xfeafffff window]
[Thu May 28 18:21:00 2020] pci_bus 0000:00: resource 8 [mem 0xfed40000-0xfed44fff window]
[Thu May 28 18:21:00 2020] pci_bus 0000:01: resource 1 [mem 0xf0600000-0xf06fffff]
[Thu May 28 18:21:00 2020] pci_bus 0000:02: resource 0 [io  0x2000-0x2fff]
[Thu May 28 18:21:00 2020] pci_bus 0000:02: resource 2 [mem 0xf0400000-0xf04fffff 64bit pref]
[Thu May 28 18:21:00 2020] pci_bus 0000:03: resource 1 [mem 0xf0500000-0xf05fffff]
[Thu May 28 18:21:00 2020] NET: Registered protocol family 2
[Thu May 28 18:21:00 2020] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)
[Thu May 28 18:21:00 2020] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)
[Thu May 28 18:21:00 2020] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear)
[Thu May 28 18:21:00 2020] TCP: Hash tables configured (established 65536 bind 65536)
[Thu May 28 18:21:00 2020] UDP hash table entries: 4096 (order: 5, 131072 bytes, linear)
[Thu May 28 18:21:00 2020] UDP-Lite hash table entries: 4096 (order: 5, 131072 bytes, linear)
[Thu May 28 18:21:00 2020] NET: Registered protocol family 1
[Thu May 28 18:21:00 2020] NET: Registered protocol family 44
[Thu May 28 18:21:00 2020] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[Thu May 28 18:21:00 2020] PCI: CLS 64 bytes, default 64
[Thu May 28 18:21:00 2020] Trying to unpack rootfs image as initramfs...
[Thu May 28 18:21:00 2020] Freeing initrd memory: 23820K
[Thu May 28 18:21:00 2020] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[Thu May 28 18:21:00 2020] software IO TLB: mapped [mem 0xd5c9f000-0xd9c9f000] (64MB)
[Thu May 28 18:21:00 2020] Initialise system trusted keyrings
[Thu May 28 18:21:00 2020] Key type blacklist registered
[Thu May 28 18:21:00 2020] workingset: timestamp_bits=40 max_order=21 bucket_order=0
[Thu May 28 18:21:00 2020] zbud: loaded
[Thu May 28 18:21:00 2020] integrity: Platform Keyring initialized
[Thu May 28 18:21:00 2020] Key type asymmetric registered
[Thu May 28 18:21:00 2020] Asymmetric key parser 'x509' registered
[Thu May 28 18:21:00 2020] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251)
[Thu May 28 18:21:00 2020] io scheduler mq-deadline registered
[Thu May 28 18:21:00 2020] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[Thu May 28 18:21:00 2020] intel_idle: MWAIT substates: 0x21120
[Thu May 28 18:21:00 2020] intel_idle: v0.5.1 model 0x2A
[Thu May 28 18:21:00 2020] intel_idle: Local APIC timer is reliable in all C-states
[Thu May 28 18:21:00 2020] thermal LNXTHERM:00: registered as thermal_zone0
[Thu May 28 18:21:00 2020] ACPI: Thermal Zone [TZ00] (70 C)
[Thu May 28 18:21:00 2020] thermal LNXTHERM:01: registered as thermal_zone1
[Thu May 28 18:21:00 2020] ACPI: Thermal Zone [TZ01] (30 C)
[Thu May 28 18:21:00 2020] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[Thu May 28 18:21:00 2020] Linux agpgart interface v0.103
[Thu May 28 18:21:00 2020] AMD-Vi: AMD IOMMUv2 driver by Joerg Roedel <[email protected]>
[Thu May 28 18:21:00 2020] AMD-Vi: AMD IOMMUv2 functionality not available on this system
[Thu May 28 18:21:00 2020] i8042: PNP: PS/2 Controller [PNP0303:PS2K,PNP0f13:EPAD] at 0x60,0x64 irq 1,12
[Thu May 28 18:21:00 2020] serio: i8042 KBD port at 0x60,0x64 irq 1
[Thu May 28 18:21:00 2020] serio: i8042 AUX port at 0x60,0x64 irq 12
[Thu May 28 18:21:00 2020] mousedev: PS/2 mouse device common for all mice
[Thu May 28 18:21:00 2020] rtc_cmos 00:01: registered as rtc0
[Thu May 28 18:21:00 2020] rtc_cmos 00:01: setting system clock to 2020-05-28T16:21:01 UTC (1590682861)
[Thu May 28 18:21:00 2020] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
[Thu May 28 18:21:00 2020] intel_pstate: Intel P-state driver initializing
[Thu May 28 18:21:00 2020] ledtrig-cpu: registered to indicate activity on CPUs
[Thu May 28 18:21:00 2020] NET: Registered protocol family 10
[Thu May 28 18:21:00 2020] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0
[Thu May 28 18:21:01 2020] Segment Routing with IPv6
[Thu May 28 18:21:01 2020] mip6: Mobile IPv6
[Thu May 28 18:21:01 2020] NET: Registered protocol family 17
[Thu May 28 18:21:01 2020] mpls_gso: MPLS GSO support
[Thu May 28 18:21:01 2020] microcode: sig=0x206a7, pf=0x10, revision=0x2f
[Thu May 28 18:21:01 2020] microcode: Microcode Update Driver: v2.2.
[Thu May 28 18:21:01 2020] IPI shorthand broadcast: enabled
[Thu May 28 18:21:01 2020] sched_clock: Marking stable (992745555, 11923387)->(1019941935, -15272993)
[Thu May 28 18:21:01 2020] registered taskstats version 1
[Thu May 28 18:21:01 2020] Loading compiled-in X.509 certificates
[Thu May 28 18:21:01 2020] zswap: loaded using pool zstd/zbud
[Thu May 28 18:21:01 2020] Key type ._fscrypt registered
[Thu May 28 18:21:01 2020] Key type .fscrypt registered
[Thu May 28 18:21:01 2020] Key type fscrypt-provisioning registered
[Thu May 28 18:21:01 2020] AppArmor: AppArmor sha1 policy hashing enabled
[Thu May 28 18:21:01 2020] Freeing unused kernel image (initmem) memory: 1676K
[Thu May 28 18:21:01 2020] Write protecting the kernel read-only data: 18432k
[Thu May 28 18:21:01 2020] Freeing unused kernel image (text/rodata gap) memory: 2044K
[Thu May 28 18:21:01 2020] Freeing unused kernel image (rodata/data gap) memory: 396K
[Thu May 28 18:21:01 2020] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[Thu May 28 18:21:01 2020] x86/mm: Checking user space page tables
[Thu May 28 18:21:01 2020] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[Thu May 28 18:21:01 2020] Run /init as init process
[Thu May 28 18:21:01 2020]   with arguments:
[Thu May 28 18:21:01 2020]     /init
[Thu May 28 18:21:01 2020]   with environment:
[Thu May 28 18:21:01 2020]     HOME=/
[Thu May 28 18:21:01 2020]     TERM=linux
[Thu May 28 18:21:01 2020]     BOOT_IMAGE=/boot/vmlinuz-5.7.0-rc7-4-amd64-clang
[Thu May 28 18:21:01 2020] fjes: module verification failed: signature and/or required key missing - tainting kernel
[Thu May 28 18:21:01 2020] battery: ACPI: Battery Slot [BAT1] (battery present)
[Thu May 28 18:21:01 2020] ACPI: bus type USB registered
[Thu May 28 18:21:01 2020] usbcore: registered new interface driver usbfs
[Thu May 28 18:21:01 2020] usbcore: registered new interface driver hub
[Thu May 28 18:21:01 2020] ACPI Warning: SystemIO range 0x0000000000000428-0x000000000000042F conflicts with OpRegion 0x0000000000000400-0x000000000000047F (\PMIO) (20200326/utaddress-204)
[Thu May 28 18:21:01 2020] ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
[Thu May 28 18:21:01 2020] ACPI Warning: SystemIO range 0x0000000000000540-0x000000000000054F conflicts with OpRegion 0x0000000000000500-0x0000000000000563 (\GPIO) (20200326/utaddress-204)
[Thu May 28 18:21:01 2020] ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
[Thu May 28 18:21:01 2020] ACPI Warning: SystemIO range 0x0000000000000530-0x000000000000053F conflicts with OpRegion 0x0000000000000500-0x0000000000000563 (\GPIO) (20200326/utaddress-204)
[Thu May 28 18:21:01 2020] ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
[Thu May 28 18:21:01 2020] ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000052F conflicts with OpRegion 0x0000000000000500-0x0000000000000563 (\GPIO) (20200326/utaddress-204)
[Thu May 28 18:21:01 2020] ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
[Thu May 28 18:21:01 2020] lpc_ich: Resource conflict(s) found affecting gpio_ich
[Thu May 28 18:21:01 2020] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[Thu May 28 18:21:01 2020] usbcore: registered new device driver usb
[Thu May 28 18:21:01 2020] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[Thu May 28 18:21:01 2020] ehci-pci: EHCI PCI platform driver
[Thu May 28 18:21:01 2020] ehci-pci 0000:00:1a.0: EHCI Host Controller
[Thu May 28 18:21:01 2020] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[Thu May 28 18:21:01 2020] ehci-pci 0000:00:1a.0: debug port 2
[Thu May 28 18:21:01 2020] r8169 0000:02:00.0: can't disable ASPM; OS doesn't have ASPM control
[Thu May 28 18:21:01 2020] libphy: r8169: probed
[Thu May 28 18:21:01 2020] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported
[Thu May 28 18:21:01 2020] r8169 0000:02:00.0 eth0: RTL8168evl/8111evl, e8:03:9a:36:17:a9, XID 2c9, IRQ 27
[Thu May 28 18:21:01 2020] r8169 0000:02:00.0 eth0: jumbo features [frames: 9200 bytes, tx checksumming: ko]
[Thu May 28 18:21:01 2020] ehci-pci 0000:00:1a.0: irq 16, io mem 0xf070a000
[Thu May 28 18:21:01 2020] r8169 0000:02:00.0 enp2s0: renamed from eth0
[Thu May 28 18:21:01 2020] SCSI subsystem initialized
[Thu May 28 18:21:01 2020] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[Thu May 28 18:21:01 2020] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.07
[Thu May 28 18:21:01 2020] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[Thu May 28 18:21:01 2020] usb usb1: Product: EHCI Host Controller
[Thu May 28 18:21:01 2020] usb usb1: Manufacturer: Linux 5.7.0-rc7-4-amd64-clang ehci_hcd
[Thu May 28 18:21:01 2020] usb usb1: SerialNumber: 0000:00:1a.0
[Thu May 28 18:21:01 2020] hub 1-0:1.0: USB hub found
[Thu May 28 18:21:01 2020] hub 1-0:1.0: 2 ports detected
[Thu May 28 18:21:01 2020] xhci_hcd 0000:03:00.0: xHCI Host Controller
[Thu May 28 18:21:01 2020] xhci_hcd 0000:03:00.0: new USB bus registered, assigned bus number 2
[Thu May 28 18:21:01 2020] xhci_hcd 0000:03:00.0: hcc params 0x0200f180 hci version 0x96 quirks 0x0000000000080000
[Thu May 28 18:21:01 2020] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.07
[Thu May 28 18:21:01 2020] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[Thu May 28 18:21:01 2020] usb usb2: Product: xHCI Host Controller
[Thu May 28 18:21:01 2020] usb usb2: Manufacturer: Linux 5.7.0-rc7-4-amd64-clang xhci-hcd
[Thu May 28 18:21:01 2020] usb usb2: SerialNumber: 0000:03:00.0
[Thu May 28 18:21:01 2020] hub 2-0:1.0: USB hub found
[Thu May 28 18:21:01 2020] hub 2-0:1.0: 2 ports detected
[Thu May 28 18:21:01 2020] ehci-pci 0000:00:1d.0: EHCI Host Controller
[Thu May 28 18:21:01 2020] xhci_hcd 0000:03:00.0: xHCI Host Controller
[Thu May 28 18:21:01 2020] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 3
[Thu May 28 18:21:01 2020] xhci_hcd 0000:03:00.0: new USB bus registered, assigned bus number 4
[Thu May 28 18:21:01 2020] ehci-pci 0000:00:1d.0: debug port 2
[Thu May 28 18:21:01 2020] xhci_hcd 0000:03:00.0: Host supports USB 3.0 SuperSpeed
[Thu May 28 18:21:01 2020] usb usb4: We don't know the algorithms for LPM for this host, disabling LPM.
[Thu May 28 18:21:01 2020] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.07
[Thu May 28 18:21:01 2020] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[Thu May 28 18:21:01 2020] usb usb4: Product: xHCI Host Controller
[Thu May 28 18:21:01 2020] usb usb4: Manufacturer: Linux 5.7.0-rc7-4-amd64-clang xhci-hcd
[Thu May 28 18:21:01 2020] usb usb4: SerialNumber: 0000:03:00.0
[Thu May 28 18:21:01 2020] hub 4-0:1.0: USB hub found
[Thu May 28 18:21:01 2020] hub 4-0:1.0: 2 ports detected
[Thu May 28 18:21:01 2020] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported
[Thu May 28 18:21:01 2020] ehci-pci 0000:00:1d.0: irq 23, io mem 0xf0709000
[Thu May 28 18:21:01 2020] libata version 3.00 loaded.
[Thu May 28 18:21:01 2020] ahci 0000:00:1f.2: version 3.0
[Thu May 28 18:21:01 2020] ahci 0000:00:1f.2: SSS flag set, parallel bus scan disabled
[Thu May 28 18:21:01 2020] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[Thu May 28 18:21:01 2020] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.07
[Thu May 28 18:21:01 2020] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[Thu May 28 18:21:01 2020] usb usb3: Product: EHCI Host Controller
[Thu May 28 18:21:01 2020] usb usb3: Manufacturer: Linux 5.7.0-rc7-4-amd64-clang ehci_hcd
[Thu May 28 18:21:01 2020] usb usb3: SerialNumber: 0000:00:1d.0
[Thu May 28 18:21:01 2020] hub 3-0:1.0: USB hub found
[Thu May 28 18:21:01 2020] hub 3-0:1.0: 2 ports detected
[Thu May 28 18:21:01 2020] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x1b impl SATA mode
[Thu May 28 18:21:01 2020] ahci 0000:00:1f.2: flags: 64bit ncq sntf ilck stag pm led clo pio slum part ems sxs apst 
[Thu May 28 18:21:01 2020] scsi host0: ahci
[Thu May 28 18:21:01 2020] scsi host1: ahci
[Thu May 28 18:21:01 2020] scsi host2: ahci
[Thu May 28 18:21:01 2020] scsi host3: ahci
[Thu May 28 18:21:01 2020] scsi host4: ahci
[Thu May 28 18:21:01 2020] scsi host5: ahci
[Thu May 28 18:21:01 2020] ata1: SATA max UDMA/133 abar m2048@0xf0708000 port 0xf0708100 irq 33
[Thu May 28 18:21:01 2020] ata2: SATA max UDMA/133 abar m2048@0xf0708000 port 0xf0708180 irq 33
[Thu May 28 18:21:01 2020] ata3: DUMMY
[Thu May 28 18:21:01 2020] ata4: SATA max UDMA/133 abar m2048@0xf0708000 port 0xf0708280 irq 33
[Thu May 28 18:21:01 2020] ata5: SATA max UDMA/133 abar m2048@0xf0708000 port 0xf0708300 irq 33
[Thu May 28 18:21:01 2020] ata6: DUMMY
[Thu May 28 18:21:01 2020] usb 1-1: new high-speed USB device number 2 using ehci-pci
[Thu May 28 18:21:01 2020] usb 3-1: new high-speed USB device number 2 using ehci-pci
[Thu May 28 18:21:01 2020] usb 4-1: new SuperSpeed Gen 1 USB device number 2 using xhci_hcd
[Thu May 28 18:21:01 2020] ata1: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[Thu May 28 18:21:01 2020] usb 1-1: New USB device found, idVendor=8087, idProduct=0024, bcdDevice= 0.00
[Thu May 28 18:21:01 2020] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[Thu May 28 18:21:01 2020] hub 1-1:1.0: USB hub found
[Thu May 28 18:21:01 2020] ata1.00: ATA-8: Hitachi HTS545050A7E380, GG2OA6C0, max UDMA/133
[Thu May 28 18:21:01 2020] ata1.00: 976773168 sectors, multi 16: LBA48 NCQ (depth 32), AA
[Thu May 28 18:21:01 2020] hub 1-1:1.0: 6 ports detected
[Thu May 28 18:21:01 2020] ata1.00: configured for UDMA/133
[Thu May 28 18:21:01 2020] scsi 0:0:0:0: Direct-Access     ATA      Hitachi HTS54505 A6C0 PQ: 0 ANSI: 5
[Thu May 28 18:21:01 2020] usb 4-1: New USB device found, idVendor=174c, idProduct=55aa, bcdDevice= 1.00
[Thu May 28 18:21:01 2020] usb 4-1: New USB device strings: Mfr=2, Product=3, SerialNumber=1
[Thu May 28 18:21:01 2020] usb 4-1: Product: MEDION HDDrive-n-GO
[Thu May 28 18:21:01 2020] usb 4-1: Manufacturer: MEDION
[Thu May 28 18:21:01 2020] usb 4-1: SerialNumber: 3180000000000000092C
[Thu May 28 18:21:01 2020] usb-storage 4-1:1.0: USB Mass Storage device detected
[Thu May 28 18:21:01 2020] usb-storage 4-1:1.0: Quirks match for vid 174c pid 55aa: 400000
[Thu May 28 18:21:01 2020] scsi host6: usb-storage 4-1:1.0
[Thu May 28 18:21:01 2020] usbcore: registered new interface driver usb-storage
[Thu May 28 18:21:01 2020] usbcore: registered new interface driver uas
[Thu May 28 18:21:01 2020] usb 3-1: New USB device found, idVendor=8087, idProduct=0024, bcdDevice= 0.00
[Thu May 28 18:21:01 2020] usb 3-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[Thu May 28 18:21:01 2020] hub 3-1:1.0: USB hub found
[Thu May 28 18:21:01 2020] hub 3-1:1.0: 6 ports detected
[Thu May 28 18:21:01 2020] tsc: Refined TSC clocksource calibration: 1596.373 MHz
[Thu May 28 18:21:01 2020] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x1702c2a0637, max_idle_ns: 440795222505 ns
[Thu May 28 18:21:01 2020] clocksource: Switched to clocksource tsc
[Thu May 28 18:21:02 2020] usb 1-1.4: new high-speed USB device number 3 using ehci-pci
[Thu May 28 18:21:02 2020] ata2: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[Thu May 28 18:21:02 2020] ata2.00: ATA-8: SanDisk iSSD P4 16GB, SSD 9.14, max UDMA/133
[Thu May 28 18:21:02 2020] ata2.00: 31277232 sectors, multi 1: LBA48 
[Thu May 28 18:21:02 2020] ata2.00: configured for UDMA/133
[Thu May 28 18:21:02 2020] scsi 1:0:0:0: Direct-Access     ATA      SanDisk iSSD P4  9.14 PQ: 0 ANSI: 5
[Thu May 28 18:21:02 2020] psmouse serio1: elantech: assuming hardware version 3 (with firmware version 0x450f00)
[Thu May 28 18:21:02 2020] psmouse serio1: elantech: Synaptics capabilities query result 0x08, 0x17, 0x0c.
[Thu May 28 18:21:02 2020] usb 3-1.4: new low-speed USB device number 3 using ehci-pci
[Thu May 28 18:21:02 2020] random: fast init done
[Thu May 28 18:21:02 2020] psmouse serio1: elantech: Elan sample query result 03, 3f, 86
[Thu May 28 18:21:02 2020] input: ETPS/2 Elantech Touchpad as /devices/platform/i8042/serio1/input/input3
[Thu May 28 18:21:02 2020] usb 3-1.4: New USB device found, idVendor=046d, idProduct=c00e, bcdDevice=11.10
[Thu May 28 18:21:02 2020] usb 3-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[Thu May 28 18:21:02 2020] usb 3-1.4: Product: USB-PS/2 Optical Mouse
[Thu May 28 18:21:02 2020] usb 3-1.4: Manufacturer: Logitech
[Thu May 28 18:21:02 2020] hid: raw HID events driver (C) Jiri Kosina
[Thu May 28 18:21:02 2020] usbcore: registered new interface driver usbhid
[Thu May 28 18:21:02 2020] usbhid: USB HID core driver
[Thu May 28 18:21:02 2020] input: Logitech USB-PS/2 Optical Mouse as /devices/pci0000:00/0000:00:1d.0/usb3/3-1/3-1.4/3-1.4:1.0/0003:046D:C00E.0001/input/input4
[Thu May 28 18:21:02 2020] hid-generic 0003:046D:C00E.0001: input,hidraw0: USB HID v1.10 Mouse [Logitech USB-PS/2 Optical Mouse] on usb-0000:00:1d.0-1.4/input0
[Thu May 28 18:21:02 2020] usb 1-1.4: New USB device found, idVendor=2232, idProduct=1018, bcdDevice= 0.01
[Thu May 28 18:21:02 2020] usb 1-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[Thu May 28 18:21:02 2020] usb 1-1.4: Product: WebCam SC-13HDL11431N
[Thu May 28 18:21:02 2020] usb 1-1.4: Manufacturer: 123
[Thu May 28 18:21:02 2020] usb 3-1.5: new full-speed USB device number 4 using ehci-pci
[Thu May 28 18:21:02 2020] ata4: SATA link down (SStatus 0 SControl 300)
[Thu May 28 18:21:02 2020] usb 3-1.5: New USB device found, idVendor=8086, idProduct=0189, bcdDevice=69.19
[Thu May 28 18:21:02 2020] usb 3-1.5: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[Thu May 28 18:21:02 2020] ata5: SATA link down (SStatus 0 SControl 300)
[Thu May 28 18:21:02 2020] sd 0:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/466 GiB)
[Thu May 28 18:21:02 2020] sd 1:0:0:0: [sdb] 31277232 512-byte logical blocks: (16.0 GB/14.9 GiB)
[Thu May 28 18:21:02 2020] sd 1:0:0:0: [sdb] Write Protect is off
[Thu May 28 18:21:02 2020] sd 0:0:0:0: [sda] 4096-byte physical blocks
[Thu May 28 18:21:02 2020] sd 1:0:0:0: [sdb] Mode Sense: 00 3a 00 00
[Thu May 28 18:21:02 2020] sd 0:0:0:0: [sda] Write Protect is off
[Thu May 28 18:21:02 2020] sd 1:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[Thu May 28 18:21:02 2020] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
[Thu May 28 18:21:02 2020] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[Thu May 28 18:21:02 2020]  sdb: sdb1
[Thu May 28 18:21:02 2020] sd 1:0:0:0: [sdb] Attached SCSI disk
[Thu May 28 18:21:02 2020]  sda: sda1 sda2 sda3
[Thu May 28 18:21:02 2020] sd 0:0:0:0: [sda] Attached SCSI disk
[Thu May 28 18:21:02 2020] scsi 6:0:0:0: Direct-Access     ASMT     2105             0    PQ: 0 ANSI: 6
[Thu May 28 18:21:02 2020] sd 6:0:0:0: [sdc] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB)
[Thu May 28 18:21:02 2020] sd 6:0:0:0: [sdc] 4096-byte physical blocks
[Thu May 28 18:21:02 2020] sd 6:0:0:0: [sdc] Write Protect is off
[Thu May 28 18:21:02 2020] sd 6:0:0:0: [sdc] Mode Sense: 43 00 00 00
[Thu May 28 18:21:02 2020] sd 6:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[Thu May 28 18:21:03 2020]  sdc: sdc1 sdc2 sdc3 sdc4 < sdc5 >
[Thu May 28 18:21:03 2020] sd 6:0:0:0: [sdc] Attached SCSI disk
[Thu May 28 18:21:04 2020] random: crng init done
[Thu May 28 18:21:04 2020] process '/usr/bin/fstype' started with executable stack
[Thu May 28 18:21:04 2020] PM: Image not found (code -22)
[Thu May 28 18:21:04 2020] EXT4-fs (sdc2): mounted filesystem with ordered data mode. Opts: (null)
[Thu May 28 18:21:04 2020] Not activating Mandatory Access Control as /sbin/tomoyo-init does not exist.
[Thu May 28 18:21:06 2020] systemd[1]: Inserted module 'autofs4'
[Thu May 28 18:21:07 2020] systemd[1]: systemd 245.5-3 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid)
[Thu May 28 18:21:07 2020] systemd[1]: Detected architecture x86-64.
[Thu May 28 18:21:07 2020] systemd[1]: Set hostname to <iniza>.
[Thu May 28 18:21:08 2020] systemd[1]: /lib/systemd/system/dbus.socket:5: ListenStream= references a path below legacy directory /var/run/, updating /var/run/dbus/system_bus_socket \xe2\x86\x92 /run/dbus/system_bus_socket; please update the unit file accordingly.
[Thu May 28 18:21:09 2020] systemd[1]: Created slice system-getty.slice.
[Thu May 28 18:21:09 2020] systemd[1]: Created slice system-modprobe.slice.
[Thu May 28 18:21:09 2020] systemd[1]: Created slice User and Session Slice.
[Thu May 28 18:21:09 2020] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[Thu May 28 18:21:09 2020] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[Thu May 28 18:21:09 2020] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[Thu May 28 18:21:09 2020] systemd[1]: Reached target Local Encrypted Volumes.
[Thu May 28 18:21:09 2020] systemd[1]: Reached target User and Group Name Lookups.
[Thu May 28 18:21:09 2020] systemd[1]: Reached target Remote File Systems.
[Thu May 28 18:21:09 2020] systemd[1]: Reached target Slices.
[Thu May 28 18:21:09 2020] systemd[1]: Listening on Syslog Socket.
[Thu May 28 18:21:09 2020] systemd[1]: Listening on fsck to fsckd communication Socket.
[Thu May 28 18:21:09 2020] systemd[1]: Listening on initctl Compatibility Named Pipe.
[Thu May 28 18:21:09 2020] systemd[1]: Listening on Journal Audit Socket.
[Thu May 28 18:21:09 2020] systemd[1]: Listening on Journal Socket (/dev/log).
[Thu May 28 18:21:09 2020] systemd[1]: Listening on Journal Socket.
[Thu May 28 18:21:09 2020] systemd[1]: Listening on udev Control Socket.
[Thu May 28 18:21:09 2020] systemd[1]: Listening on udev Kernel Socket.
[Thu May 28 18:21:09 2020] systemd[1]: Mounting Huge Pages File System...
[Thu May 28 18:21:09 2020] systemd[1]: Mounting POSIX Message Queue File System...
[Thu May 28 18:21:09 2020] systemd[1]: Mounting Kernel Debug File System...
[Thu May 28 18:21:09 2020] systemd[1]: Mounting Kernel Trace File System...
[Thu May 28 18:21:09 2020] systemd[1]: Starting Wait for network to be configured by ifupdown...
[Thu May 28 18:21:09 2020] systemd[1]: Starting Set the console keyboard layout...
[Thu May 28 18:21:09 2020] systemd[1]: Starting Create list of static device nodes for the current kernel...
[Thu May 28 18:21:09 2020] systemd[1]: Starting Load Kernel Module drm...
[Thu May 28 18:21:09 2020] systemd[1]: Condition check resulted in Set Up Additional Binary Formats being skipped.
[Thu May 28 18:21:09 2020] systemd[1]: Condition check resulted in File System Check on Root Device being skipped.
[Thu May 28 18:21:09 2020] systemd[1]: Starting Journal Service...
[Thu May 28 18:21:09 2020] systemd[1]: Starting Load Kernel Modules...
[Thu May 28 18:21:09 2020] systemd[1]: Starting Remount Root and Kernel File Systems...
[Thu May 28 18:21:09 2020] systemd[1]: Starting udev Coldplug all Devices...
[Thu May 28 18:21:09 2020] systemd[1]: Finished Create list of static device nodes for the current kernel.
[Thu May 28 18:21:10 2020] systemd[1]: Mounted Huge Pages File System.
[Thu May 28 18:21:10 2020] systemd[1]: Mounted POSIX Message Queue File System.
[Thu May 28 18:21:10 2020] systemd[1]: Mounted Kernel Debug File System.
[Thu May 28 18:21:10 2020] EXT4-fs (sdc2): re-mounted. Opts: errors=remount-ro
[Thu May 28 18:21:10 2020] systemd[1]: Finished Remount Root and Kernel File Systems.
[Thu May 28 18:21:10 2020] systemd[1]: Condition check resulted in Rebuild Hardware Database being skipped.
[Thu May 28 18:21:10 2020] systemd[1]: Condition check resulted in Platform Persistent Storage Archival being skipped.
[Thu May 28 18:21:10 2020] systemd[1]: Starting Load/Save Random Seed...
[Thu May 28 18:21:10 2020] systemd[1]: Starting Create System Users...
[Thu May 28 18:21:10 2020] systemd[1]: Mounted Kernel Trace File System.
[Thu May 28 18:21:10 2020] systemd[1]: Finished Wait for network to be configured by ifupdown.
[Thu May 28 18:21:10 2020] lp: driver loaded but no devices found
[Thu May 28 18:21:10 2020] systemd[1]: Started Journal Service.
[Thu May 28 18:21:10 2020] ppdev: user-space parallel port driver
[Thu May 28 18:21:10 2020] systemd-journald[256]: Received client request to flush runtime journal.
[Thu May 28 18:21:16 2020] audit: type=1400 audit(1590682876.569:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="libreoffice-xpdfimport" pid=298 comm="apparmor_parser"
[Thu May 28 18:21:16 2020] audit: type=1400 audit(1590682876.705:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lsb_release" pid=300 comm="apparmor_parser"
[Thu May 28 18:21:16 2020] audit: type=1400 audit(1590682876.865:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="libreoffice-senddoc" pid=302 comm="apparmor_parser"
[Thu May 28 18:21:16 2020] audit: type=1400 audit(1590682876.885:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/haveged" pid=303 comm="apparmor_parser"
[Thu May 28 18:21:16 2020] audit: type=1400 audit(1590682877.085:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="libreoffice-oopslash" pid=304 comm="apparmor_parser"
[Thu May 28 18:21:17 2020] audit: type=1400 audit(1590682877.721:7): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/cups-browsed" pid=305 comm="apparmor_parser"
[Thu May 28 18:21:17 2020] audit: type=1400 audit(1590682877.989:8): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/cups/backend/cups-pdf" pid=299 comm="apparmor_parser"
[Thu May 28 18:21:17 2020] audit: type=1400 audit(1590682877.989:9): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/cupsd" pid=299 comm="apparmor_parser"
[Thu May 28 18:21:17 2020] audit: type=1400 audit(1590682877.989:10): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/cupsd//third_party" pid=299 comm="apparmor_parser"
[Thu May 28 18:21:17 2020] audit: type=1400 audit(1590682878.141:11): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/man" pid=307 comm="apparmor_parser"
[Thu May 28 18:21:20 2020] ACPI: AC Adapter [ADP1] (on-line)
[Thu May 28 18:21:20 2020] input: Lid Switch as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0D:00/input/input5
[Thu May 28 18:21:20 2020] ACPI: Lid Switch [LID0]
[Thu May 28 18:21:20 2020] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input6
[Thu May 28 18:21:20 2020] ACPI: Power Button [PWRB]
[Thu May 28 18:21:20 2020] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input7
[Thu May 28 18:21:20 2020] ACPI: Power Button [PWRF]
[Thu May 28 18:21:21 2020] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
[Thu May 28 18:21:21 2020] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
[Thu May 28 18:21:21 2020] RAPL PMU: hw unit of domain package 2^-16 Joules
[Thu May 28 18:21:21 2020] RAPL PMU: hw unit of domain pp1-gpu 2^-16 Joules
[Thu May 28 18:21:22 2020] input: PC Speaker as /devices/platform/pcspkr/input/input8
[Thu May 28 18:21:22 2020] iTCO_vendor_support: vendor-support=0
[Thu May 28 18:21:22 2020] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[Thu May 28 18:21:22 2020] iTCO_wdt: Found a Cougar Point TCO device (Version=2, TCOBASE=0x0460)
[Thu May 28 18:21:22 2020] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0)
[Thu May 28 18:21:23 2020] samsung_laptop: detected SABI interface: SwSmi@
[Thu May 28 18:21:23 2020] sd 0:0:0:0: Attached scsi generic sg0 type 0
[Thu May 28 18:21:23 2020] sd 1:0:0:0: Attached scsi generic sg1 type 0
[Thu May 28 18:21:23 2020] sd 6:0:0:0: Attached scsi generic sg2 type 0
[Thu May 28 18:21:23 2020] usb 3-1.5: USB disconnect, device number 4
[Thu May 28 18:21:25 2020] cryptd: max_cpu_qlen set to 1000
[Thu May 28 18:21:26 2020] Error: Driver 'pcspkr' is already registered, aborting...
[Thu May 28 18:21:29 2020] AVX version of gcm_enc/dec engaged.
[Thu May 28 18:21:29 2020] AES CTR mode by8 optimization enabled
[Thu May 28 18:21:29 2020] mc: Linux media interface: v0.10
[Thu May 28 18:21:30 2020] alg: No test for fips(ansi_cprng) (fips_ansi_cprng)
[Thu May 28 18:21:31 2020] videodev: Linux video capture interface: v2.00
[Thu May 28 18:21:32 2020] cfg80211: Loading compiled-in X.509 certificates for regulatory database
[Thu May 28 18:21:32 2020] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'
[Thu May 28 18:21:32 2020] cfg80211: loaded regulatory.db is malformed or signature is missing/invalid
[Thu May 28 18:21:33 2020] Bluetooth: Core ver 2.22
[Thu May 28 18:21:33 2020] NET: Registered protocol family 31
[Thu May 28 18:21:33 2020] Bluetooth: HCI device and connection manager initialized
[Thu May 28 18:21:33 2020] Bluetooth: HCI socket layer initialized
[Thu May 28 18:21:33 2020] Bluetooth: L2CAP socket layer initialized
[Thu May 28 18:21:33 2020] Bluetooth: SCO socket layer initialized
[Thu May 28 18:21:34 2020] usbcore: registered new interface driver btusb
[Thu May 28 18:21:34 2020] Intel(R) Wireless WiFi driver for Linux
[Thu May 28 18:21:34 2020] Copyright(c) 2003- 2015 Intel Corporation
[Thu May 28 18:21:34 2020] iwlwifi 0000:01:00.0: can't disable ASPM; OS doesn't have ASPM control
[Thu May 28 18:21:34 2020] uvcvideo: Found UVC 1.00 device WebCam SC-13HDL11431N (2232:1018)
[Thu May 28 18:21:34 2020] uvcvideo 1-1.4:1.0: Entity type for entity Extension 3 was not initialized!
[Thu May 28 18:21:34 2020] uvcvideo 1-1.4:1.0: Entity type for entity Processing 2 was not initialized!
[Thu May 28 18:21:34 2020] uvcvideo 1-1.4:1.0: Entity type for entity Camera 1 was not initialized!
[Thu May 28 18:21:34 2020] input: WebCam SC-13HDL11431N: WebCam S as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.4/1-1.4:1.0/input/input9
[Thu May 28 18:21:34 2020] usbcore: registered new interface driver uvcvideo
[Thu May 28 18:21:34 2020] USB Video Class driver (1.1.1)
[Thu May 28 18:21:36 2020] iwlwifi 0000:01:00.0: loaded firmware version 18.168.6.1 6000g2b-6.ucode op_mode iwldvm
[Thu May 28 18:21:36 2020] iwlwifi 0000:01:00.0: Direct firmware load for iwl-debug-yoyo.bin failed with error -2
[Thu May 28 18:21:37 2020] intel_rapl_common: Found RAPL domain package
[Thu May 28 18:21:37 2020] intel_rapl_common: Found RAPL domain core
[Thu May 28 18:21:37 2020] intel_rapl_common: Found RAPL domain uncore
[Thu May 28 18:21:37 2020] intel_rapl_common: RAPL package-0 domain package locked by BIOS
[Thu May 28 18:21:37 2020] Adding 31249404k swap on /dev/sdc1.  Priority:-2 extents:1 across:31249404k FS
[Thu May 28 18:21:38 2020] i915 0000:00:02.0: vgaarb: deactivate vga console
[Thu May 28 18:21:38 2020] Console: switching to colour dummy device 80x25
[Thu May 28 18:21:38 2020] [drm] Supports vblank timestamp caching Rev 2 (21.10.2013).
[Thu May 28 18:21:38 2020] i915 0000:00:02.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=io+mem
[Thu May 28 18:21:38 2020] [drm] Initialized i915 1.6.0 20200313 for 0000:00:02.0 on minor 0
[Thu May 28 18:21:38 2020] ACPI: Video Device [GFX0] (multi-head: yes  rom: no  post: no)
[Thu May 28 18:21:38 2020] input: Video Bus as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/LNXVIDEO:00/input/input10
[Thu May 28 18:21:38 2020] snd_hda_intel 0000:00:1b.0: bound 0000:00:02.0 (ops i915_audio_component_bind_ops [i915])
[Thu May 28 18:21:38 2020] fbcon: i915drmfb (fb0) is primary device
[Thu May 28 18:21:39 2020] Console: switching to colour frame buffer device 170x48
[Thu May 28 18:21:39 2020] i915 0000:00:02.0: fb0: i915drmfb frame buffer device
[Thu May 28 18:21:40 2020] iwlwifi 0000:01:00.0: CONFIG_IWLWIFI_DEBUG disabled
[Thu May 28 18:21:40 2020] iwlwifi 0000:01:00.0: CONFIG_IWLWIFI_DEBUGFS disabled
[Thu May 28 18:21:40 2020] iwlwifi 0000:01:00.0: CONFIG_IWLWIFI_DEVICE_TRACING disabled
[Thu May 28 18:21:40 2020] iwlwifi 0000:01:00.0: Detected Intel(R) Centrino(R) Advanced-N 6230 AGN, REV=0xB0
[Thu May 28 18:21:40 2020] ieee80211 phy0: Selected rate control algorithm 'iwl-agn-rs'
[Thu May 28 18:21:40 2020] iwlwifi 0000:01:00.0 wlp1s0: renamed from wlan0
[Thu May 28 18:21:40 2020] snd_hda_codec_realtek hdaudioC0D0: autoconfig for ALC269VC: line_outs=1 (0x14/0x0/0x0/0x0/0x0) type:speaker
[Thu May 28 18:21:40 2020] snd_hda_codec_realtek hdaudioC0D0:    speaker_outs=0 (0x0/0x0/0x0/0x0/0x0)
[Thu May 28 18:21:40 2020] snd_hda_codec_realtek hdaudioC0D0:    hp_outs=1 (0x15/0x0/0x0/0x0/0x0)
[Thu May 28 18:21:40 2020] snd_hda_codec_realtek hdaudioC0D0:    mono: mono_out=0x0
[Thu May 28 18:21:40 2020] snd_hda_codec_realtek hdaudioC0D0:    inputs:
[Thu May 28 18:21:40 2020] snd_hda_codec_realtek hdaudioC0D0:      Internal Mic=0x19
[Thu May 28 18:21:40 2020] snd_hda_codec_realtek hdaudioC0D0:      Mic=0x18
[Thu May 28 18:21:40 2020] input: HDA Intel PCH Mic as /devices/pci0000:00/0000:00:1b.0/sound/card0/input11
[Thu May 28 18:21:40 2020] input: HDA Intel PCH Headphone as /devices/pci0000:00/0000:00:1b.0/sound/card0/input12
[Thu May 28 18:21:40 2020] input: HDA Intel PCH HDMI/DP,pcm=3 as /devices/pci0000:00/0000:00:1b.0/sound/card0/input13
[Thu May 28 18:22:26 2020] kauditd_printk_skb: 14 callbacks suppressed
[Thu May 28 18:22:26 2020] audit: type=1400 audit(1590682947.073:26): apparmor="DENIED" operation="capable" profile="/usr/sbin/cups-browsed" pid=803 comm="cups-browsed" capability=23  capname="sys_nice"
[Thu May 28 18:22:34 2020] RTL8211E Gigabit Ethernet r8169-200:00: attached PHY driver [RTL8211E Gigabit Ethernet] (mii_bus:phy_addr=r8169-200:00, irq=IGNORE)
[Thu May 28 18:22:34 2020] r8169 0000:02:00.0 enp2s0: Link is Down
[Thu May 28 18:22:35 2020] iwlwifi 0000:01:00.0: Radio type=0x1-0x2-0x0
[Thu May 28 18:22:35 2020] iwlwifi 0000:01:00.0: Radio type=0x1-0x2-0x0
[Thu May 28 18:22:35 2020] iwlwifi 0000:01:00.0: Radio type=0x1-0x2-0x0
[Thu May 28 18:22:35 2020] iwlwifi 0000:01:00.0: Radio type=0x1-0x2-0x0
[Thu May 28 18:23:01 2020] fuse: init (API version 7.31)
[Thu May 28 18:23:20 2020] Bluetooth: BNEP (Ethernet Emulation) ver 1.3
[Thu May 28 18:23:20 2020] Bluetooth: BNEP filters: protocol multicast
[Thu May 28 18:23:20 2020] Bluetooth: BNEP socket layer initialized
[Thu May 28 18:23:39 2020] iwlwifi 0000:01:00.0: Radio type=0x1-0x2-0x0
[Thu May 28 18:23:39 2020] iwlwifi 0000:01:00.0: Radio type=0x1-0x2-0x0
[Thu May 28 18:23:40 2020] iwlwifi 0000:01:00.0: Radio type=0x1-0x2-0x0
[Thu May 28 18:23:40 2020] iwlwifi 0000:01:00.0: Radio type=0x1-0x2-0x0
[Thu May 28 18:25:33 2020] iwlwifi 0000:01:00.0: Radio type=0x1-0x2-0x0
[Thu May 28 18:25:33 2020] iwlwifi 0000:01:00.0: Radio type=0x1-0x2-0x0
[Thu May 28 18:25:38 2020] wlp1s0: authenticate with f6:f5:24:2e:54:f5
[Thu May 28 18:25:38 2020] wlp1s0: send auth to f6:f5:24:2e:54:f5 (try 1/3)
[Thu May 28 18:25:38 2020] wlp1s0: send auth to f6:f5:24:2e:54:f5 (try 2/3)
[Thu May 28 18:25:38 2020] wlp1s0: authenticated
[Thu May 28 18:25:38 2020] wlp1s0: associate with f6:f5:24:2e:54:f5 (try 1/3)
[Thu May 28 18:25:38 2020] wlp1s0: RX AssocResp from f6:f5:24:2e:54:f5 (capab=0x431 status=0 aid=1)
[Thu May 28 18:25:38 2020] wlp1s0: associated
[Thu May 28 18:25:38 2020] IPv6: ADDRCONF(NETDEV_CHANGE): wlp1s0: link becomes ready
author maintainer
#27 lore raw
Quoted 101 lines · Sedat Dilek
Quoted 91 lines · Jens Axboe

We technically support this already through io_uring, but it's implemented with a thread backend to support cases where we would block. This isn't ideal.

After a few prep patches, the core of this patchset is adding support for async callbacks on page unlock. With this primitive, we can simply retry the IO operation. With io_uring, this works a lot like poll based retry for files that support it. If a page is currently locked and needed, -EIOCBQUEUED is returned with a callback armed. The callers callback is responsible for restarting the operation.

With this callback primitive, we can add support for generic_file_buffered_read(), which is what most file systems end up using for buffered reads. XFS/ext4/btrfs/bdev is wired up, but probably trivial to add more.

The file flags support for this by setting FMODE_BUF_RASYNC, similar to what we do for FMODE_NOWAIT. Open to suggestions here if this is the preferred method or not.

In terms of results, I wrote a small test app that randomly reads 4G of data in 4K chunks from a file hosted by ext4. The app uses a queue depth of 32. If you want to test yourself, you can just use buffered=1 with ioengine=io_uring with fio. No application changes are needed to use the more optimized buffered async read.

preadv for comparison:

        real    1m13.821s
        user    0m0.558s
        sys     0m11.125s
        CPU     ~13%

Mainline:

        real    0m12.054s
        user    0m0.111s
        sys     0m5.659s
        CPU     ~32% + ~50% == ~82%

This patchset:

        real    0m9.283s
        user    0m0.147s
        sys     0m4.619s
        CPU     ~52%

The CPU numbers are just a rough estimate. For the mainline io_uring run, this includes the app itself and all the threads doing IO on its behalf (32% for the app, ~1.6% per worker and 32 of them). Context switch rate is much smaller with the patchset, since we only have the one task performing IO.

Also ran a simple fio based test case, varying the queue depth from 1 to 16, doubling every time:

[buf-test]
filename=/data/file
direct=0
ioengine=io_uring
norandommap
rw=randread
bs=4k
iodepth=${QD}
randseed=89
runtime=10s

QD/Test         Patchset IOPS           Mainline IOPS
1               9046                    8294
2               19.8k                   18.9k
4               39.2k                   28.5k
8               64.4k                   31.4k
16              65.7k                   37.8k

Outside of my usual environment, so this is just running on a virtualized NVMe device in qemu, using ext4 as the file system. NVMe isn't very efficient virtualized, so we run out of steam at ~65K which is why we flatline on the patched side (nvme_submit_cmd() eats ~75% of the test app CPU). Before that happens, it's a linear increase. Not shown is context switch rate, which is massively lower with the new code. The old thread offload adds a blocking thread per pending IO, so context rate quickly goes through the roof.

The goal here is efficiency. Async thread offload adds latency, and it also adds noticable overhead on items such as adding pages to the page cache. By allowing proper async buffered read support, we don't have X threads hammering on the same inode page cache, we have just the single app actually doing IO.

Been beating on this and it's solid for me, and I'm now pretty happy with how it all turned out. Not aware of any missing bits/pieces or code cleanups that need doing.

Quoted 8 lines

Series can also be found here:

https://git.kernel.dk/cgit/linux-block/log/?h=async-buffered.5

or pull from:

git://git.kernel.dk/linux-block async-buffered.5

Quoted 8 lines

Hi Jens,

I have pulled linux-block.git#async-buffered.5 on top of Linux v5.7-rc7.

From first feelings:
The booting into the system (until sddm display-login-manager) took a bit longer.
The same after login and booting into KDE/Plasma.

There is no difference for "regular" use cases, only io_uring with buffered reads will behave differently. So I don't think you have longer boot times due to this.

Quoted 9 lines

I am building/linking with LLVM/Clang/LLD v10.0.1-rc1 on Debian/testing AMD64.

Here I have an internal HDD (SATA) and my Debian-system is on an external HDD connected via USB-3.0.
Primarily, I use Ext4-FS.

As said above is the "emotional" side, but I need some technical instructions.

How can I see Async Buffer Reads is active on a Ext4-FS-formatted partition?

You can't see that. It'll always be available on ext4 with this series, and you can watch io_uring instances to see if anyone is using it.

Quoted 5 lines

Do I need a special boot-parameter (GRUB line)?

Do I need to activate some cool variables via sysfs?

Do I need to pass an option via fstab entry?

No to all of these, you don't need anything to activate it. You need the program to use io_uring to do buffered reads.

Quoted 2 lines

Are any Async Buffer Reads related linux-kconfig options not set? Which make sense?

No kconfig options are needed.

Signature · 1 line
Jens Axboe
#28 lore raw
Quoted 122 lines · Jens Axboe
Quoted 101 lines · Sedat Dilek
Quoted 91 lines · Jens Axboe

We technically support this already through io_uring, but it's implemented with a thread backend to support cases where we would block. This isn't ideal.

After a few prep patches, the core of this patchset is adding support for async callbacks on page unlock. With this primitive, we can simply retry the IO operation. With io_uring, this works a lot like poll based retry for files that support it. If a page is currently locked and needed, -EIOCBQUEUED is returned with a callback armed. The callers callback is responsible for restarting the operation.

With this callback primitive, we can add support for generic_file_buffered_read(), which is what most file systems end up using for buffered reads. XFS/ext4/btrfs/bdev is wired up, but probably trivial to add more.

The file flags support for this by setting FMODE_BUF_RASYNC, similar to what we do for FMODE_NOWAIT. Open to suggestions here if this is the preferred method or not.

In terms of results, I wrote a small test app that randomly reads 4G of data in 4K chunks from a file hosted by ext4. The app uses a queue depth of 32. If you want to test yourself, you can just use buffered=1 with ioengine=io_uring with fio. No application changes are needed to use the more optimized buffered async read.

preadv for comparison:

        real    1m13.821s
        user    0m0.558s
        sys     0m11.125s
        CPU     ~13%

Mainline:

        real    0m12.054s
        user    0m0.111s
        sys     0m5.659s
        CPU     ~32% + ~50% == ~82%

This patchset:

        real    0m9.283s
        user    0m0.147s
        sys     0m4.619s
        CPU     ~52%

The CPU numbers are just a rough estimate. For the mainline io_uring run, this includes the app itself and all the threads doing IO on its behalf (32% for the app, ~1.6% per worker and 32 of them). Context switch rate is much smaller with the patchset, since we only have the one task performing IO.

Also ran a simple fio based test case, varying the queue depth from 1 to 16, doubling every time:

[buf-test]
filename=/data/file
direct=0
ioengine=io_uring
norandommap
rw=randread
bs=4k
iodepth=${QD}
randseed=89
runtime=10s

QD/Test         Patchset IOPS           Mainline IOPS
1               9046                    8294
2               19.8k                   18.9k
4               39.2k                   28.5k
8               64.4k                   31.4k
16              65.7k                   37.8k

Outside of my usual environment, so this is just running on a virtualized NVMe device in qemu, using ext4 as the file system. NVMe isn't very efficient virtualized, so we run out of steam at ~65K which is why we flatline on the patched side (nvme_submit_cmd() eats ~75% of the test app CPU). Before that happens, it's a linear increase. Not shown is context switch rate, which is massively lower with the new code. The old thread offload adds a blocking thread per pending IO, so context rate quickly goes through the roof.

The goal here is efficiency. Async thread offload adds latency, and it also adds noticable overhead on items such as adding pages to the page cache. By allowing proper async buffered read support, we don't have X threads hammering on the same inode page cache, we have just the single app actually doing IO.

Been beating on this and it's solid for me, and I'm now pretty happy with how it all turned out. Not aware of any missing bits/pieces or code cleanups that need doing.

Quoted 8 lines

Series can also be found here:

https://git.kernel.dk/cgit/linux-block/log/?h=async-buffered.5

or pull from:

git://git.kernel.dk/linux-block async-buffered.5

Quoted 8 lines

Hi Jens,

I have pulled linux-block.git#async-buffered.5 on top of Linux v5.7-rc7.

From first feelings:
The booting into the system (until sddm display-login-manager) took a bit longer.
The same after login and booting into KDE/Plasma.

There is no difference for "regular" use cases, only io_uring with buffered reads will behave differently. So I don't think you have longer boot times due to this.

Quoted 6 lines

I am building/linking with LLVM/Clang/LLD v10.0.1-rc1 on Debian/testing AMD64.

Here I have an internal HDD (SATA) and my Debian-system is on an external HDD connected via USB-3.0.
Primarily, I use Ext4-FS.

Quoted 7 lines
Quoted 3 lines

As said above is the "emotional" side, but I need some technical instructions.

How can I see Async Buffer Reads is active on a Ext4-FS-formatted partition?

You can't see that. It'll always be available on ext4 with this series, and you can watch io_uring instances to see if anyone is using it.

Thanks for answering my questions.

How can I "watch io_uring instances"?

FIO?
Debian has fio version 3.19-2 in its apt repositories. Version OK?

- Sedat -

Quoted 17 lines
Quoted 5 lines

Do I need a special boot-parameter (GRUB line)?

Do I need to activate some cool variables via sysfs?

Do I need to pass an option via fstab entry?

No to all of these, you don't need anything to activate it. You need the program to use io_uring to do buffered reads.

Quoted 2 lines

Are any Async Buffer Reads related linux-kconfig options not set? Which make sense?

No kconfig options are needed.

--
Jens Axboe

author maintainer
#29 lore raw
Quoted 127 lines · Sedat Dilek
Quoted 126 lines · Jens Axboe
Quoted 101 lines · Sedat Dilek
Quoted 91 lines · Jens Axboe

We technically support this already through io_uring, but it's implemented with a thread backend to support cases where we would block. This isn't ideal.

After a few prep patches, the core of this patchset is adding support for async callbacks on page unlock. With this primitive, we can simply retry the IO operation. With io_uring, this works a lot like poll based retry for files that support it. If a page is currently locked and needed, -EIOCBQUEUED is returned with a callback armed. The callers callback is responsible for restarting the operation.

With this callback primitive, we can add support for generic_file_buffered_read(), which is what most file systems end up using for buffered reads. XFS/ext4/btrfs/bdev is wired up, but probably trivial to add more.

The file flags support for this by setting FMODE_BUF_RASYNC, similar to what we do for FMODE_NOWAIT. Open to suggestions here if this is the preferred method or not.

In terms of results, I wrote a small test app that randomly reads 4G of data in 4K chunks from a file hosted by ext4. The app uses a queue depth of 32. If you want to test yourself, you can just use buffered=1 with ioengine=io_uring with fio. No application changes are needed to use the more optimized buffered async read.

preadv for comparison:

        real    1m13.821s
        user    0m0.558s
        sys     0m11.125s
        CPU     ~13%

Mainline:

        real    0m12.054s
        user    0m0.111s
        sys     0m5.659s
        CPU     ~32% + ~50% == ~82%

This patchset:

        real    0m9.283s
        user    0m0.147s
        sys     0m4.619s
        CPU     ~52%

The CPU numbers are just a rough estimate. For the mainline io_uring run, this includes the app itself and all the threads doing IO on its behalf (32% for the app, ~1.6% per worker and 32 of them). Context switch rate is much smaller with the patchset, since we only have the one task performing IO.

Also ran a simple fio based test case, varying the queue depth from 1 to 16, doubling every time:

[buf-test]
filename=/data/file
direct=0
ioengine=io_uring
norandommap
rw=randread
bs=4k
iodepth=${QD}
randseed=89
runtime=10s

QD/Test         Patchset IOPS           Mainline IOPS
1               9046                    8294
2               19.8k                   18.9k
4               39.2k                   28.5k
8               64.4k                   31.4k
16              65.7k                   37.8k

Outside of my usual environment, so this is just running on a virtualized NVMe device in qemu, using ext4 as the file system. NVMe isn't very efficient virtualized, so we run out of steam at ~65K which is why we flatline on the patched side (nvme_submit_cmd() eats ~75% of the test app CPU). Before that happens, it's a linear increase. Not shown is context switch rate, which is massively lower with the new code. The old thread offload adds a blocking thread per pending IO, so context rate quickly goes through the roof.

The goal here is efficiency. Async thread offload adds latency, and it also adds noticable overhead on items such as adding pages to the page cache. By allowing proper async buffered read support, we don't have X threads hammering on the same inode page cache, we have just the single app actually doing IO.

Been beating on this and it's solid for me, and I'm now pretty happy with how it all turned out. Not aware of any missing bits/pieces or code cleanups that need doing.

Quoted 8 lines

Series can also be found here:

https://git.kernel.dk/cgit/linux-block/log/?h=async-buffered.5

or pull from:

git://git.kernel.dk/linux-block async-buffered.5

Quoted 8 lines

Hi Jens,

I have pulled linux-block.git#async-buffered.5 on top of Linux v5.7-rc7.

From first feelings:
The booting into the system (until sddm display-login-manager) took a bit longer.
The same after login and booting into KDE/Plasma.

There is no difference for "regular" use cases, only io_uring with buffered reads will behave differently. So I don't think you have longer boot times due to this.

Quoted 9 lines

I am building/linking with LLVM/Clang/LLD v10.0.1-rc1 on Debian/testing AMD64.

Here I have an internal HDD (SATA) and my Debian-system is on an external HDD connected via USB-3.0.
Primarily, I use Ext4-FS.

As said above is the "emotional" side, but I need some technical instructions.

How can I see Async Buffer Reads is active on a Ext4-FS-formatted partition?

Quoted 7 lines
Quoted 3 lines

You can't see that. It'll always be available on ext4 with this series, and you can watch io_uring instances to see if anyone is using it.

Thanks for answering my questions.

How can I "watch io_uring instances"?

You can enable io_uring tracing:

# echo 1 > /sys/kernel/debug/tracing/events/io_uring/io_uring_create/enable
# tail /sys/kernel/debug/tracing/trace

and see if you get any events for setup. Generally you can also look for the existence of io_wq_manager processes, these will exist for an io_uring instance.

Quoted 3 lines

FIO?
Debian has fio version 3.19-2 in its apt repositories. Version OK?

Yeah that should work.

Signature · 1 line
Jens Axboe
#30 lore raw
Quoted 146 lines · Jens Axboe
Quoted 127 lines · Sedat Dilek
Quoted 126 lines · Jens Axboe
Quoted 101 lines · Sedat Dilek
Quoted 91 lines · Jens Axboe

We technically support this already through io_uring, but it's implemented with a thread backend to support cases where we would block. This isn't ideal.

After a few prep patches, the core of this patchset is adding support for async callbacks on page unlock. With this primitive, we can simply retry the IO operation. With io_uring, this works a lot like poll based retry for files that support it. If a page is currently locked and needed, -EIOCBQUEUED is returned with a callback armed. The callers callback is responsible for restarting the operation.

With this callback primitive, we can add support for generic_file_buffered_read(), which is what most file systems end up using for buffered reads. XFS/ext4/btrfs/bdev is wired up, but probably trivial to add more.

The file flags support for this by setting FMODE_BUF_RASYNC, similar to what we do for FMODE_NOWAIT. Open to suggestions here if this is the preferred method or not.

In terms of results, I wrote a small test app that randomly reads 4G of data in 4K chunks from a file hosted by ext4. The app uses a queue depth of 32. If you want to test yourself, you can just use buffered=1 with ioengine=io_uring with fio. No application changes are needed to use the more optimized buffered async read.

preadv for comparison:

        real    1m13.821s
        user    0m0.558s
        sys     0m11.125s
        CPU     ~13%

Mainline:

        real    0m12.054s
        user    0m0.111s
        sys     0m5.659s
        CPU     ~32% + ~50% == ~82%

This patchset:

        real    0m9.283s
        user    0m0.147s
        sys     0m4.619s
        CPU     ~52%

The CPU numbers are just a rough estimate. For the mainline io_uring run, this includes the app itself and all the threads doing IO on its behalf (32% for the app, ~1.6% per worker and 32 of them). Context switch rate is much smaller with the patchset, since we only have the one task performing IO.

Also ran a simple fio based test case, varying the queue depth from 1 to 16, doubling every time:

[buf-test]
filename=/data/file
direct=0
ioengine=io_uring
norandommap
rw=randread
bs=4k
iodepth=${QD}
randseed=89
runtime=10s

QD/Test         Patchset IOPS           Mainline IOPS
1               9046                    8294
2               19.8k                   18.9k
4               39.2k                   28.5k
8               64.4k                   31.4k
16              65.7k                   37.8k

Outside of my usual environment, so this is just running on a virtualized NVMe device in qemu, using ext4 as the file system. NVMe isn't very efficient virtualized, so we run out of steam at ~65K which is why we flatline on the patched side (nvme_submit_cmd() eats ~75% of the test app CPU). Before that happens, it's a linear increase. Not shown is context switch rate, which is massively lower with the new code. The old thread offload adds a blocking thread per pending IO, so context rate quickly goes through the roof.

The goal here is efficiency. Async thread offload adds latency, and it also adds noticable overhead on items such as adding pages to the page cache. By allowing proper async buffered read support, we don't have X threads hammering on the same inode page cache, we have just the single app actually doing IO.

Been beating on this and it's solid for me, and I'm now pretty happy with how it all turned out. Not aware of any missing bits/pieces or code cleanups that need doing.

Quoted 8 lines

Series can also be found here:

https://git.kernel.dk/cgit/linux-block/log/?h=async-buffered.5

or pull from:

git://git.kernel.dk/linux-block async-buffered.5

Quoted 8 lines

Hi Jens,

I have pulled linux-block.git#async-buffered.5 on top of Linux v5.7-rc7.

From first feelings:
The booting into the system (until sddm display-login-manager) took a bit longer.
The same after login and booting into KDE/Plasma.

There is no difference for "regular" use cases, only io_uring with buffered reads will behave differently. So I don't think you have longer boot times due to this.

Quoted 9 lines

I am building/linking with LLVM/Clang/LLD v10.0.1-rc1 on Debian/testing AMD64.

Here I have an internal HDD (SATA) and my Debian-system is on an external HDD connected via USB-3.0.
Primarily, I use Ext4-FS.

As said above is the "emotional" side, but I need some technical instructions.

How can I see Async Buffer Reads is active on a Ext4-FS-formatted partition?

Quoted 7 lines
Quoted 3 lines

You can't see that. It'll always be available on ext4 with this series, and you can watch io_uring instances to see if anyone is using it.

Thanks for answering my questions.

How can I "watch io_uring instances"?

You can enable io_uring tracing:

# echo 1 > /sys/kernel/debug/tracing/events/io_uring/io_uring_create/enable
# tail /sys/kernel/debug/tracing/trace

and see if you get any events for setup. Generally you can also look for the existence of io_wq_manager processes, these will exist for an io_uring instance.

Quoted 6 lines
Quoted 3 lines

FIO?
Debian has fio version 3.19-2 in its apt repositories. Version OK?

Yeah that should work.

I did:

# echo 1 > /sys/kernel/debug/tracing/events/io_uring/io_uring_create/enable
# cat /sys/kernel/debug/tracing/events/io_uring/io_uring_create/enable
1
# cat ./buf-test-dileks-min
[buf-test-dileks-min]
filename=/path/to/iso-image-file
buffered=1
ioengine=io_uring
# fio --showcmd ./buf-test-dileks-min
fio --name=buf-test-dileks-min --buffered=1 --ioengine=io_uring
--filename=filename=/path/to/iso-image-file
# fio ./buf-test-dileks-min
# ps -ef | egrep 'f[i]o|i[o]_wq'
root        6695    6066 24 20:13 pts/2    00:00:00 fio ./buf-test-dileks-min
root        6701    6695 22 20:13 ?        00:00:00 fio ./buf-test-dileks-min
root        6702       2  0 20:13 ?        00:00:00 [io_wq_manager]
root        6703       2  0 20:13 ?        00:00:00 [io_wqe_worker-0]

# LC_ALL=C tail -f /sys/kernel/debug/tracing/trace
...
# entries-in-buffer/entries-written: 16/16 #P:4
#
# _-----=> irqs-off
# / _----=> need-resched

#                            | / _---=> hardirq/softirq
#                            || / _--=> preempt-depth
#                            ||| /     delay
#           TASK-PID   CPU#  ||||    TIMESTAMP  FUNCTION
#              | |       |   ||||       |         |
...
             fio-6701  [001] ....  6775.117015: io_uring_create: ring

00000000ef052188, fd 5 sq size 1, cq size 2, flags 0

Looks like this works.

Thanks Jens.

- Sedat -

#31 lore raw
In reply to Jens Axboe

[ ... ]

Quoted 4 lines
Quoted 4 lines

Hi Jens,

I have pulled linux-block.git#async-buffered.5 on top of Linux v5.7-rc7.

Quoted 9 lines
Quoted 4 lines

From first feelings:
The booting into the system (until sddm display-login-manager) took a bit longer.
The same after login and booting into KDE/Plasma.

There is no difference for "regular" use cases, only io_uring with buffered reads will behave differently. So I don't think you have longer boot times due to this.

Yupp, you are right.

The previous Linux v5.7-rc7 without your patchset shows the same symptoms.

I did some debugging and optimizing with systemd-analyze boot and time.

I optimized systemd-journald.service and systemd-journal-flush.service...

# cat /etc/systemd/journald.conf.d/00-journal-size.conf
[Journal]
SystemMaxUse=50M

...and reduced the time spent flushing systemd's journal from ~30s down to 1,6s...

# journalctl -b --unit systemd-journald.service
-- Logs begin at Fri 2020-05-29 00:58:37 CEST, end at Fri 2020-05-29
11:42:18 CEST. --
Mai 29 11:34:52 iniza systemd-journald[281]: Journal started
Mai 29 11:34:52 iniza systemd-journald[281]: Runtime Journal
(/run/log/journal/566abbcb226b405db834b17a26fe4727) is 8.0M, max
78.5M, 70.5M free.
Mai 29 11:34:53 iniza systemd-journald[281]: Time spent on flushing to
/var/log/journal/566abbcb226b405db834b17a26fe4727 is 1.656233s for 765
entries.
Mai 29 11:34:53 iniza systemd-journald[281]: System Journal
(/var/log/journal/566abbcb226b405db834b17a26fe4727) is 56.2M, max
50.0M, 0B free.

Unfortunately, I upgraded some user-space stuff like udisks2 and libblockdev packages.
Downgrading did not help and disabling the systemd-unit also.

As I saw stallings with e2scrub_reap.service and swap partition (partly seen in the boot-process and noted the UUID 3f8e).
I disabled e2scrub_reap.service and deactivated swap partition in /etc/fstab.

Doing all above together did not help.

Finally, I checked the health of the HDD where my root-fs is. smartmontools says everything is OK.

I have not checked the status of the Ext4-FS where my root-fs is. Such things I do with a linux-live-system - as a Debianist I admit I use an ArchLinux ISO on USB-stick :-).

Unsure, if I will contact the systemd (and mabye udisks) Debian folks to hear their opinion.

Thanks Jens and your patchset.
I don't know when I last run systemd-analyze & stuff and investigated so deeply :-).

A lot of Hygge (I love to write wrong Huegge - see English hugs) to you Jens.

- Sedat -

[1] http://ftp.halifax.rwth-aachen.de/archlinux/iso/

#32 lore raw

On Fri, May 29, 2020 at 12:02 PM Sedat Dilek <[email protected]> wrote:

[ ... ]

Quoted 4 lines

As I saw stallings with e2scrub_reap.service and swap partition (partly seen in the boot-process and noted the UUID 3f8e).
I disabled e2scrub_reap.service and deactivated swap partition in /etc/fstab.

I switched over from using a swap-partition to a swap-file.

The boot-slowdown is "gone" in sense of 1m30s stalls or better in sense of boot-time is shorter.

# cat systemd-analyze-time.txt
Startup finished in 6.903s (kernel) + 1min 13.501s (userspace) = 1min 20.404s
graphical.target reached after 1min 13.481s in userspace
# cat systemd-analyze-time_swapfile.txt
Startup finished in 6.721s (kernel) + 1min 9.470s (userspace) = 1min 16.192s
graphical.target reached after 1min 9.451s in userspace
# cat systemd-analyze-blame.txt | head -20
35.943s udisks2.service
32.559s accounts-daemon.service
27.925s smartmontools.service
26.561s NetworkManager.service
24.543s dev-sdc2.device
24.478s polkit.service
20.426s NetworkManager-wait-online.service
19.785s avahi-daemon.service
19.586s switcheroo-control.service
19.185s rtkit-daemon.service
18.661s wpa_supplicant.service
18.269s systemd-logind.service
17.627s rsyslog.service
16.312s gpm.service
14.842s e2scrub_reap.service
14.387s packagekit.service
12.017s ModemManager.service
10.584s alsa-restore.service
 8.407s atd.service
 6.025s exim4.service
# cat systemd-analyze-blame_swapfile.txt | head -20
29.571s udisks2.service
26.383s accounts-daemon.service
24.564s smartmontools.service
20.735s NetworkManager.service
19.254s NetworkManager-wait-online.service
18.675s polkit.service
15.523s dev-sdc2.device
14.152s avahi-daemon.service
14.006s switcheroo-control.service
13.800s rtkit-daemon.service
13.662s packagekit.service
13.353s wpa_supplicant.service
13.178s rsyslog.service
12.788s systemd-logind.service
12.313s e2scrub_reap.service
11.105s ModemManager.service
11.003s gpm.service
10.018s networking.service
 6.608s apparmor.service
 5.858s exim4.service

Thanks.

Time to experience with ZRAM :-).

- Sedat -

mount -t auto /dev/sdb1 /mnt/sandisk

fallocate -l 8g /mnt/sandisk/swapfile

8 x 1024 x 1024 = 8388608

dd if=/dev/zero bs=1024 count=8388608 of=/mnt/sandisk/swapfile 8388608+0 Datensätze ein
8388608+0 Datensätze aus
8589934592 bytes (8,6 GB, 8,0 GiB) copied, 176,511 s, 48,7 MB/s

# chmod 600 /mnt/sandisk/swapfile
# ll /mnt/sandisk/swapfile
-rw------- 1 root root 8,0G Mai 29 12:23 /mnt/sandisk/swapfile
# mkswap /mnt/sandisk/swapfile
Setting up swapspace version 1, size = 8 GiB (8589930496 bytes)
no label, UUID=d3b72e81-c0fc-49fa-9704-cbbaba3822fc
# swapon /mnt/sandisk/swapfile
# free -h
              total        used        free      shared  buff/cache   available
Mem:          7,7Gi       1,6Gi       4,8Gi       167Mi       1,3Gi       5,7Gi
Swap:         8,0Gi          0B       8,0Gi

- EOT -

#33 lore raw
Quoted 1 line

Time to experience with ZRAM :-).

I switched over from swap-file to zramswap.

And I can definitely say, my last kernel w/o your patchset does not show the symptoms.

# cat systemd-analyze-time_5.7.0-rc7-2-amd64-clang_2nd-try.txt
Startup finished in 6.129s (kernel) + 44.192s (userspace) = 50.322s
graphical.target reached after 44.168s in userspace
# cat systemd-analyze-blame_5.7.0-rc7-2-amd64-clang_2nd-try.txt
24.050s udisks2.service
23.711s accounts-daemon.service
18.615s dev-sdc2.device
17.119s polkit.service
16.980s avahi-daemon.service
16.879s NetworkManager.service
16.112s rtkit-daemon.service
15.126s switcheroo-control.service
15.117s wpa_supplicant.service
15.105s systemd-logind.service
14.475s NetworkManager-wait-online.service
14.258s smartmontools.service
13.161s zramswap.service
 9.522s rsyslog.service
 8.337s gpm.service
 6.026s packagekit.service
 5.871s ModemManager.service
 5.746s networking.service
 5.383s e2scrub_reap.service
 3.960s systemd-udevd.service
 3.396s apparmor.service
 3.231s exim4.service
 2.795s systemd-journal-flush.service
 2.359s alsa-restore.service
 2.186s systemd-rfkill.service
 1.878s atd.service
 1.164s keyboard-setup.service
 1.098s bluetooth.service
 1.089s systemd-tmpfiles-setup.service
 1.021s pppd-dns.service
  968ms systemd-backlight@backlight:intel_backlight.service
  964ms upower.service
  937ms binfmt-support.service
  873ms systemd-modules-load.service
  849ms systemd-sysusers.service
  845ms systemd-journald.service
  683ms systemd-timesyncd.service
  676ms [email protected]
  641ms systemd-udev-trigger.service
  620ms dev-hugepages.mount
  618ms dev-mqueue.mount
  618ms sys-kernel-debug.mount
  617ms sys-kernel-tracing.mount
  501ms ifupdown-wait-online.service
  434ms systemd-sysctl.service
  419ms systemd-random-seed.service
  413ms systemd-tmpfiles-setup-dev.service
  405ms [email protected]
  389ms systemd-remount-fs.service
  383ms console-setup.service
  301ms kmod-static-nodes.service
  181ms proc-sys-fs-binfmt_misc.mount
  174ms systemd-update-utmp.service
   85ms systemd-user-sessions.service
   22ms [email protected]
   19ms systemd-update-utmp-runlevel.service
    5ms ifupdown-pre.service
    4ms sys-fs-fuse-connections.mount

[ /etc/zramswap.conf ]

ZRAM_SIZE_PERCENT=20
# ZSTD support for ZRAM and ZSWAP requires Linux >= 5.7-rc+. -dileks ZRAM_COMPRESSION_ALGO=zstd

[ /etc/fstab ]

# /etc/fstab: static file system information.
#
# Use 'blkid' to print the universally unique identifier for a # device; this may be used with UUID= as a more robust way to name devices

# that works even if disks are added and removed. See fstab(5).
#
# <file system> || <mount point> || <type> || <options> || <dump> || <pass>
#
# Root-FS (here: /dev/sdc2)
UUID=<myUUID>       /       ext4    errors=remount-ro       0       1
# SWAP (here: /dev/zram0)
# Zram-based swap (compressed RAM block devices), for details see
zramswap.service and zramswap.conf
# dmesg | egrep 'zram|zswap'
[    1.041958] zswap: loaded using pool zstd/zbud
[   29.569355] zram: Added device: zram0
[   29.581631] zram0: detected capacity change from 0 to 1647824896
[   30.562279] Adding 1609200k swap on /dev/zram0.  Priority:100
extents:1 across:1609200k SSFS
# cat /sys/devices/virtual/block/zram0/comp_algorithm
lzo lzo-rle lz4 lz4hc [zstd]
# swapon --show
NAME       TYPE      SIZE USED PRIO
/dev/zram0 partition 1,5G   0B  100
# cat /proc/swaps
Filename                                Type            Size    Used    Priority
/dev/zram0                              partition       1609200 0       100

If you have any ideas let me know.

Ah, I see there is async-buffered.6.

- Sedat -

[1] https://aur.archlinux.org/packages/zramswap/
[2] https://aur.archlinux.org/cgit/aur.git/tree/zramswap.conf?h=zramswap
[3] https://aur.archlinux.org/cgit/aur.git/tree/zramswap.service?h=zramswap

#34 lore raw

Here are the numbers with your patchset:

# cat systemd-analyze-time_5.7.0-rc7-4-amd64-clang_2nd-try.txt
Startup finished in 7.229s (kernel) + 1min 18.304s (userspace) = 1min 25.534s
graphical.target reached after 1min 18.286s in userspace
# cat systemd-analyze-blame_5.7.0-rc7-4-amd64-clang_2nd-try.txt
53.727s udisks2.service
47.043s accounts-daemon.service
40.252s NetworkManager.service
38.916s polkit.service
38.730s smartmontools.service
36.970s zramswap.service
35.556s dev-sdc2.device
30.307s switcheroo-control.service
29.179s wpa_supplicant.service
29.051s avahi-daemon.service
28.817s rtkit-daemon.service
27.697s systemd-logind.service
23.913s rsyslog.service
22.616s NetworkManager-wait-online.service
22.357s e2scrub_reap.service
19.579s gpm.service
14.879s ModemManager.service
14.126s packagekit.service
14.047s networking.service
 6.137s alsa-restore.service
 5.330s exim4.service
 4.331s systemd-udevd.service
 3.954s apparmor.service
 2.606s atd.service
 2.342s [email protected]
 2.046s systemd-journal-flush.service
 1.519s bluetooth.service
 1.459s systemd-journald.service
 1.386s systemd-udev-trigger.service
 1.271s systemd-modules-load.service
 1.210s keyboard-setup.service
 1.136s systemd-sysusers.service
  930ms upower.service
  896ms pppd-dns.service
  826ms systemd-tmpfiles-setup.service
  807ms dev-hugepages.mount
  807ms dev-mqueue.mount
  806ms sys-kernel-debug.mount
  806ms sys-kernel-tracing.mount
  712ms ifupdown-wait-online.service
  617ms systemd-remount-fs.service
  588ms systemd-timesyncd.service
  509ms binfmt-support.service
  506ms systemd-backlight@backlight:intel_backlight.service
  497ms systemd-random-seed.service
  490ms systemd-rfkill.service
  376ms [email protected]
  343ms systemd-tmpfiles-setup-dev.service
  305ms console-setup.service
  303ms systemd-update-utmp.service
  300ms systemd-user-sessions.service
  295ms kmod-static-nodes.service
  267ms systemd-sysctl.service
   71ms proc-sys-fs-binfmt_misc.mount
   19ms [email protected]
   13ms systemd-update-utmp-runlevel.service
    5ms sys-fs-fuse-connections.mount
    4ms ifupdown-pre.service

[ diffconfig ]

$ scripts/diffconfig /boot/config-5.7.0-rc7-2-amd64-clang
/boot/config-5.7.0-rc7-4-amd64-clang
 BUILD_SALT "5.7.0-rc7-2-amd64-clang" -> "5.7.0-rc7-4-amd64-clang"
+BLK_INLINE_ENCRYPTION n

- Sedat -

- Sedat -

author maintainer
#35 lore raw
Quoted 5 lines · Sedat Dilek

Here are the numbers with your patchset:

# cat systemd-analyze-time_5.7.0-rc7-4-amd64-clang_2nd-try.txt
Startup finished in 7.229s (kernel) + 1min 18.304s (userspace) = 1min 25.534s
graphical.target reached after 1min 18.286s in userspace

Can you see if this makes a difference?

include/linux/blk_types.h +1 -2
index c296463c15eb..ccb895f911b1 100644
@@ -374,8 +374,7 @@ enum req_flag_bits {
 #define REQ_INTEGRITY		(1ULL << __REQ_INTEGRITY)
 #define REQ_FUA			(1ULL << __REQ_FUA)
 #define REQ_PREFLUSH		(1ULL << __REQ_PREFLUSH)
-#define REQ_RAHEAD		\
-	((1ULL << __REQ_RAHEAD) | (1ULL << __REQ_NOWAIT))
+#define REQ_RAHEAD		(1ULL << __REQ_RAHEAD)
 #define REQ_BACKGROUND		(1ULL << __REQ_BACKGROUND)
 #define REQ_NOWAIT		(1ULL << __REQ_NOWAIT)
 #define REQ_CGROUP_PUNT		(1ULL << __REQ_CGROUP_PUNT)
Signature · 1 line
Jens Axboe
Tested-by
#36 lore raw
Quoted 16 lines · Jens Axboe
Quoted 5 lines · Sedat Dilek

Here are the numbers with your patchset:

# cat systemd-analyze-time_5.7.0-rc7-4-amd64-clang_2nd-try.txt
Startup finished in 7.229s (kernel) + 1min 18.304s (userspace) = 1min 25.534s
graphical.target reached after 1min 18.286s in userspace

Can you see if this makes a difference?

include/linux/blk_types.h +0 -0
index c296463c15eb..ccb895f911b1 100644

include/linux/blk_types.h enum req_flag_bits { · line 380

Quoted 9 lines
include/linux/blk_types.h +1 -2
@@ -374,8 +374,7 @@ enum req_flag_bits {
 #define REQ_INTEGRITY          (1ULL << __REQ_INTEGRITY)
 #define REQ_FUA                        (1ULL << __REQ_FUA)
 #define REQ_PREFLUSH           (1ULL << __REQ_PREFLUSH)
-#define REQ_RAHEAD             \
-       ((1ULL << __REQ_RAHEAD) | (1ULL << __REQ_NOWAIT))
+#define REQ_RAHEAD             (1ULL << __REQ_RAHEAD)
 #define REQ_BACKGROUND         (1ULL << __REQ_BACKGROUND)
 #define REQ_NOWAIT             (1ULL << __REQ_NOWAIT)
 #define REQ_CGROUP_PUNT                (1ULL << __REQ_CGROUP_PUNT)

Looks good!

With your patch I now get...

# cat systemd-analyze-time_5.7.0-rc7-6-amd64-clang.txt
Startup finished in 6.199s (kernel) + 45.143s (userspace) = 51.343s
graphical.target reached after 45.123s in userspace
# cat systemd-analyze-blame_5.7.0-rc7-6-amd64-clang.txt
25.029s udisks2.service
24.582s accounts-daemon.service
19.257s dev-sdc2.device
18.016s polkit.service
17.857s avahi-daemon.service
17.730s NetworkManager.service
17.433s rtkit-daemon.service
16.558s switcheroo-control.service
16.547s wpa_supplicant.service
16.538s systemd-logind.service
16.078s smartmontools.service
14.982s fwupd-refresh.service
14.580s NetworkManager-wait-online.service
13.630s zramswap.service
11.286s fwupd.service
 8.153s rsyslog.service
 6.858s gpm.service
 6.835s e2scrub_reap.service
 6.449s ModemManager.service
 6.439s networking.service
 5.881s packagekit.service
 3.696s systemd-udevd.service
 3.322s apparmor.service
 3.277s exim4.service
 2.910s alsa-restore.service
 1.611s systemd-tmpfiles-setup.service
 1.540s bluetooth.service
 1.448s systemd-journal-flush.service
 1.353s keyboard-setup.service
 1.322s atd.service
 1.239s systemd-modules-load.service
 1.216s binfmt-support.service
 1.060s [email protected]
  994ms systemd-journald.service
  983ms upower.service
  937ms systemd-sysusers.service
  914ms ifupdown-wait-online.service
  904ms pppd-dns.service
  710ms systemd-udev-trigger.service
  666ms dev-hugepages.mount
  650ms dev-mqueue.mount
  649ms sys-kernel-debug.mount
  647ms sys-kernel-tracing.mount
  607ms console-setup.service
  590ms systemd-tmpfiles-setup-dev.service
  570ms systemd-timesyncd.service
  508ms systemd-random-seed.service
  461ms systemd-backlight@backlight:intel_backlight.service
  433ms [email protected]
  422ms systemd-remount-fs.service
  365ms systemd-sysctl.service
  279ms kmod-static-nodes.service
  246ms proc-sys-fs-binfmt_misc.mount
  202ms systemd-rfkill.service
  130ms systemd-user-sessions.service
  104ms systemd-update-utmp.service
   25ms [email protected]
   14ms systemd-update-utmp-runlevel.service
    6ms sys-fs-fuse-connections.mount
    4ms ifupdown-pre.service
# cat systemd-analyze-critical-chain_5.7.0-rc7-6-amd64-clang.txt
The time when unit became active or started is printed after the "@" character.
The time the unit took to start is printed after the "+" character.

graphical.target @45.123s

└─multi-user.target @45.122s
  └─exim4.service @41.842s +3.277s
    └─network-online.target @41.840s
      └─NetworkManager-wait-online.service @27.259s +14.580s
        └─NetworkManager.service @9.522s +17.730s
          └─dbus.service @9.514s
            └─basic.target @9.328s
              └─sockets.target @9.327s
                └─dbus.socket @9.327s
                  └─sysinit.target @9.202s
└─systemd-backlight@backlight:intel_backlight.service @21.927s +461ms
                      └─system-systemd\x2dbacklight.slice @21.925s
                        └─system.slice @2.529s
                          └─-.slice @2.529s

Will you send a separate patch on this?

Feel free to add:

My kernel-config and dmesg-output are attached.

Thanks Jens!

- Sedat -

[Sun May 31 08:55:20 2020] microcode: microcode updated early to revision 0x2f, date = 2019-02-17
[Sun May 31 08:55:20 2020] Linux version 5.7.0-rc7-6-amd64-clang ([email protected]@iniza) (clang version 10.0.1rc1, LLD 10.0.1rc1) #6~bullseye+dileks1 SMP 2020-05-30
[Sun May 31 08:55:20 2020] Command line: BOOT_IMAGE=/boot/vmlinuz-5.7.0-rc7-6-amd64-clang root=UUID=5f730cbc-abda-410c-9ea9-f0bdeda41926 ro
[Sun May 31 08:55:20 2020] Disabled fast string operations
[Sun May 31 08:55:20 2020] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[Sun May 31 08:55:20 2020] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[Sun May 31 08:55:20 2020] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[Sun May 31 08:55:20 2020] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[Sun May 31 08:55:20 2020] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[Sun May 31 08:55:20 2020] BIOS-provided physical RAM map:
[Sun May 31 08:55:20 2020] BIOS-e820: [mem 0x0000000000000000-0x000000000009d7ff] usable
[Sun May 31 08:55:20 2020] BIOS-e820: [mem 0x000000000009d800-0x000000000009ffff] reserved
[Sun May 31 08:55:20 2020] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[Sun May 31 08:55:20 2020] BIOS-e820: [mem 0x0000000000100000-0x000000001fffffff] usable
[Sun May 31 08:55:20 2020] BIOS-e820: [mem 0x0000000020000000-0x00000000201fffff] reserved
[Sun May 31 08:55:20 2020] BIOS-e820: [mem 0x0000000020200000-0x000000003fffffff] usable
[Sun May 31 08:55:20 2020] BIOS-e820: [mem 0x0000000040000000-0x00000000401fffff] reserved
[Sun May 31 08:55:20 2020] BIOS-e820: [mem 0x0000000040200000-0x00000000d9c9efff] usable
[Sun May 31 08:55:20 2020] BIOS-e820: [mem 0x00000000d9c9f000-0x00000000dae7efff] reserved
[Sun May 31 08:55:20 2020] BIOS-e820: [mem 0x00000000dae7f000-0x00000000daf9efff] ACPI NVS
[Sun May 31 08:55:20 2020] BIOS-e820: [mem 0x00000000daf9f000-0x00000000daffefff] ACPI data
[Sun May 31 08:55:20 2020] BIOS-e820: [mem 0x00000000dafff000-0x00000000daffffff] usable
[Sun May 31 08:55:20 2020] BIOS-e820: [mem 0x00000000db000000-0x00000000df9fffff] reserved
[Sun May 31 08:55:20 2020] BIOS-e820: [mem 0x00000000f8000000-0x00000000fbffffff] reserved
[Sun May 31 08:55:20 2020] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[Sun May 31 08:55:20 2020] BIOS-e820: [mem 0x00000000fed08000-0x00000000fed08fff] reserved
[Sun May 31 08:55:20 2020] BIOS-e820: [mem 0x00000000fed10000-0x00000000fed19fff] reserved
[Sun May 31 08:55:20 2020] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[Sun May 31 08:55:20 2020] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[Sun May 31 08:55:20 2020] BIOS-e820: [mem 0x00000000ffd80000-0x00000000ffffffff] reserved
[Sun May 31 08:55:20 2020] BIOS-e820: [mem 0x0000000100000000-0x000000021fdfffff] usable
[Sun May 31 08:55:20 2020] NX (Execute Disable) protection: active
[Sun May 31 08:55:20 2020] SMBIOS 2.6 present.
[Sun May 31 08:55:20 2020] DMI: SAMSUNG ELECTRONICS CO., LTD. 530U3BI/530U4BI/530U4BH/530U3BI/530U4BI/530U4BH, BIOS 13XK 03/28/2013
[Sun May 31 08:55:20 2020] tsc: Fast TSC calibration using PIT
[Sun May 31 08:55:20 2020] tsc: Detected 1596.227 MHz processor
[Sun May 31 08:55:20 2020] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[Sun May 31 08:55:20 2020] e820: remove [mem 0x000a0000-0x000fffff] usable
[Sun May 31 08:55:20 2020] last_pfn = 0x21fe00 max_arch_pfn = 0x400000000
[Sun May 31 08:55:20 2020] MTRR default type: uncachable
[Sun May 31 08:55:20 2020] MTRR fixed ranges enabled:
[Sun May 31 08:55:20 2020]   00000-9FFFF write-back
[Sun May 31 08:55:20 2020]   A0000-BFFFF uncachable
[Sun May 31 08:55:20 2020]   C0000-FFFFF write-protect
[Sun May 31 08:55:20 2020] MTRR variable ranges enabled:
[Sun May 31 08:55:20 2020]   0 base 000000000 mask F80000000 write-back
[Sun May 31 08:55:20 2020]   1 base 080000000 mask FC0000000 write-back
[Sun May 31 08:55:20 2020]   2 base 0C0000000 mask FE0000000 write-back
[Sun May 31 08:55:20 2020]   3 base 0DC000000 mask FFC000000 uncachable
[Sun May 31 08:55:20 2020]   4 base 0DB000000 mask FFF000000 uncachable
[Sun May 31 08:55:20 2020]   5 base 100000000 mask F00000000 write-back
[Sun May 31 08:55:20 2020]   6 base 200000000 mask FE0000000 write-back
[Sun May 31 08:55:20 2020]   7 base 21FE00000 mask FFFE00000 uncachable
[Sun May 31 08:55:20 2020]   8 base 0FFC00000 mask FFFC00000 write-protect
[Sun May 31 08:55:20 2020]   9 disabled
[Sun May 31 08:55:20 2020] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[Sun May 31 08:55:20 2020] last_pfn = 0xdb000 max_arch_pfn = 0x400000000
[Sun May 31 08:55:20 2020] found SMP MP-table at [mem 0x000f00e0-0x000f00ef]
[Sun May 31 08:55:20 2020] reserving inaccessible SNB gfx pages
[Sun May 31 08:55:20 2020] BRK [0x1b3c01000, 0x1b3c01fff] PGTABLE
[Sun May 31 08:55:20 2020] BRK [0x1b3c02000, 0x1b3c02fff] PGTABLE
[Sun May 31 08:55:20 2020] BRK [0x1b3c03000, 0x1b3c03fff] PGTABLE
[Sun May 31 08:55:20 2020] BRK [0x1b3c04000, 0x1b3c04fff] PGTABLE
[Sun May 31 08:55:20 2020] BRK [0x1b3c05000, 0x1b3c05fff] PGTABLE
[Sun May 31 08:55:20 2020] BRK [0x1b3c06000, 0x1b3c06fff] PGTABLE
[Sun May 31 08:55:20 2020] BRK [0x1b3c07000, 0x1b3c07fff] PGTABLE
[Sun May 31 08:55:20 2020] BRK [0x1b3c08000, 0x1b3c08fff] PGTABLE
[Sun May 31 08:55:20 2020] BRK [0x1b3c09000, 0x1b3c09fff] PGTABLE
[Sun May 31 08:55:20 2020] BRK [0x1b3c0a000, 0x1b3c0afff] PGTABLE
[Sun May 31 08:55:20 2020] BRK [0x1b3c0b000, 0x1b3c0bfff] PGTABLE
[Sun May 31 08:55:20 2020] RAMDISK: [mem 0x35161000-0x368a7fff]
[Sun May 31 08:55:20 2020] ACPI: Early table checksum verification disabled
[Sun May 31 08:55:20 2020] ACPI: RSDP 0x00000000000F0100 000024 (v02 SECCSD)
[Sun May 31 08:55:20 2020] ACPI: XSDT 0x00000000DAFFE170 000084 (v01 SECCSD LH43STAR 00000002 PTEC 00000002)
[Sun May 31 08:55:20 2020] ACPI: FACP 0x00000000DAFEF000 00010C (v05 SECCSD LH43STAR 00000002 PTL  00000002)
[Sun May 31 08:55:20 2020] ACPI: DSDT 0x00000000DAFF2000 0083AC (v02 SECCSD SNB-CPT  00000000 INTL 20061109)
[Sun May 31 08:55:20 2020] ACPI: FACS 0x00000000DAF47000 000040
[Sun May 31 08:55:20 2020] ACPI: SLIC 0x00000000DAFFD000 000176 (v01 SECCSD LH43STAR 00000002 PTEC 00000001)
[Sun May 31 08:55:20 2020] ACPI: SSDT 0x00000000DAFFB000 001068 (v01 SECCSD PtidDevc 00001000 INTL 20061109)
[Sun May 31 08:55:20 2020] ACPI: ASF! 0x00000000DAFF1000 0000A5 (v32 SECCSD LH43STAR 00000002 PTL  00000002)
[Sun May 31 08:55:20 2020] ACPI: HPET 0x00000000DAFEE000 000038 (v01 SECCSD LH43STAR 00000002 PTL  00000002)
[Sun May 31 08:55:20 2020] ACPI: APIC 0x00000000DAFED000 000098 (v03 SECCSD LH43STAR 00000002 PTL  00000002)
[Sun May 31 08:55:20 2020] ACPI: MCFG 0x00000000DAFEC000 00003C (v01 SECCSD LH43STAR 00000002 PTL  00000002)
[Sun May 31 08:55:20 2020] ACPI: SSDT 0x00000000DAFEB000 000804 (v01 PmRef  Cpu0Ist  00003000 INTL 20061109)
[Sun May 31 08:55:20 2020] ACPI: SSDT 0x00000000DAFEA000 000996 (v01 PmRef  CpuPm    00003000 INTL 20061109)
[Sun May 31 08:55:20 2020] ACPI: UEFI 0x00000000DAFE9000 00003E (v01 SECCSD LH43STAR 00000002 PTL  00000002)
[Sun May 31 08:55:20 2020] ACPI: UEFI 0x00000000DAFE8000 000042 (v01 PTL    COMBUF   00000001 PTL  00000001)
[Sun May 31 08:55:20 2020] ACPI: UEFI 0x00000000DAFE7000 00026A (v01 SECCSD LH43STAR 00000002 PTL  00000002)
[Sun May 31 08:55:20 2020] ACPI: Local APIC address 0xfee00000
[Sun May 31 08:55:20 2020] No NUMA configuration found
[Sun May 31 08:55:20 2020] Faking a node at [mem 0x0000000000000000-0x000000021fdfffff]
[Sun May 31 08:55:20 2020] NODE_DATA(0) allocated [mem 0x21fdf8000-0x21fdfcfff]
[Sun May 31 08:55:20 2020] Zone ranges:
[Sun May 31 08:55:20 2020]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[Sun May 31 08:55:20 2020]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[Sun May 31 08:55:20 2020]   Normal   [mem 0x0000000100000000-0x000000021fdfffff]
[Sun May 31 08:55:20 2020]   Device   empty
[Sun May 31 08:55:20 2020] Movable zone start for each node
[Sun May 31 08:55:20 2020] Early memory node ranges
[Sun May 31 08:55:20 2020]   node   0: [mem 0x0000000000001000-0x000000000009cfff]
[Sun May 31 08:55:20 2020]   node   0: [mem 0x0000000000100000-0x000000001fffffff]
[Sun May 31 08:55:20 2020]   node   0: [mem 0x0000000020200000-0x000000003fffffff]
[Sun May 31 08:55:20 2020]   node   0: [mem 0x0000000040200000-0x00000000d9c9efff]
[Sun May 31 08:55:20 2020]   node   0: [mem 0x00000000dafff000-0x00000000daffffff]
[Sun May 31 08:55:20 2020]   node   0: [mem 0x0000000100000000-0x000000021fdfffff]
[Sun May 31 08:55:20 2020] Zeroed struct page in unavailable ranges: 27076 pages
[Sun May 31 08:55:20 2020] Initmem setup node 0 [mem 0x0000000000001000-0x000000021fdfffff]
[Sun May 31 08:55:20 2020] On node 0 totalpages: 2070076
[Sun May 31 08:55:20 2020]   DMA zone: 64 pages used for memmap
[Sun May 31 08:55:20 2020]   DMA zone: 156 pages reserved
[Sun May 31 08:55:20 2020]   DMA zone: 3996 pages, LIFO batch:0
[Sun May 31 08:55:20 2020]   DMA32 zone: 13859 pages used for memmap
[Sun May 31 08:55:20 2020]   DMA32 zone: 886944 pages, LIFO batch:63
[Sun May 31 08:55:20 2020]   Normal zone: 18424 pages used for memmap
[Sun May 31 08:55:20 2020]   Normal zone: 1179136 pages, LIFO batch:63
[Sun May 31 08:55:20 2020] Reserving Intel graphics memory at [mem 0xdba00000-0xdf9fffff]
[Sun May 31 08:55:20 2020] ACPI: PM-Timer IO Port: 0x408
[Sun May 31 08:55:20 2020] ACPI: Local APIC address 0xfee00000
[Sun May 31 08:55:20 2020] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
[Sun May 31 08:55:20 2020] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
[Sun May 31 08:55:20 2020] IOAPIC[0]: apic_id 14, version 32, address 0xfec00000, GSI 0-23
[Sun May 31 08:55:20 2020] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[Sun May 31 08:55:20 2020] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[Sun May 31 08:55:20 2020] ACPI: IRQ0 used by override.
[Sun May 31 08:55:20 2020] ACPI: IRQ9 used by override.
[Sun May 31 08:55:20 2020] Using ACPI (MADT) for SMP configuration information
[Sun May 31 08:55:20 2020] ACPI: HPET id: 0x8086a301 base: 0xfed00000
[Sun May 31 08:55:20 2020] smpboot: Allowing 8 CPUs, 4 hotplug CPUs
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0x0009d000-0x0009dfff]
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0x0009e000-0x0009ffff]
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0x20000000-0x201fffff]
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0x40000000-0x401fffff]
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0xd9c9f000-0xdae7efff]
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0xdae7f000-0xdaf9efff]
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0xdaf9f000-0xdaffefff]
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0xdb000000-0xdf9fffff]
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0xdfa00000-0xf7ffffff]
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0xf8000000-0xfbffffff]
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0xfc000000-0xfebfffff]
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0xfec01000-0xfed07fff]
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0xfed08000-0xfed08fff]
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0xfed09000-0xfed0ffff]
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0xfed10000-0xfed19fff]
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0xfed1a000-0xfed1bfff]
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0xfed20000-0xfedfffff]
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0xfee00000-0xfee00fff]
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0xfee01000-0xffd7ffff]
[Sun May 31 08:55:20 2020] PM: hibernation: Registered nosave memory: [mem 0xffd80000-0xffffffff]
[Sun May 31 08:55:20 2020] [mem 0xdfa00000-0xf7ffffff] available for PCI devices
[Sun May 31 08:55:20 2020] Booting paravirtualized kernel on bare hardware
[Sun May 31 08:55:20 2020] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[Sun May 31 08:55:20 2020] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:8 nr_node_ids:1
[Sun May 31 08:55:20 2020] percpu: Embedded 55 pages/cpu s187160 r8192 d29928 u262144
[Sun May 31 08:55:20 2020] pcpu-alloc: s187160 r8192 d29928 u262144 alloc=1*2097152
[Sun May 31 08:55:20 2020] pcpu-alloc: [0] 0 1 2 3 4 5 6 7 
[Sun May 31 08:55:20 2020] Built 1 zonelists, mobility grouping on.  Total pages: 2037573
[Sun May 31 08:55:20 2020] Policy zone: Normal
[Sun May 31 08:55:20 2020] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.7.0-rc7-6-amd64-clang root=UUID=5f730cbc-abda-410c-9ea9-f0bdeda41926 ro
[Sun May 31 08:55:20 2020] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)
[Sun May 31 08:55:20 2020] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)
[Sun May 31 08:55:20 2020] mem auto-init: stack:off, heap alloc:off, heap free:off
[Sun May 31 08:55:20 2020] Memory: 3604836K/8280304K available (12291K kernel code, 1199K rwdata, 3700K rodata, 1676K init, 2700K bss, 262276K reserved, 0K cma-reserved)
[Sun May 31 08:55:20 2020] random: get_random_u64 called from __kmem_cache_create+0xd9/0x870 with crng_init=0
[Sun May 31 08:55:20 2020] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1
[Sun May 31 08:55:20 2020] Kernel/User page tables isolation: enabled
[Sun May 31 08:55:20 2020] ftrace: allocating 32448 entries in 127 pages
[Sun May 31 08:55:20 2020] ftrace: allocated 127 pages with 7 groups
[Sun May 31 08:55:20 2020] rcu: Hierarchical RCU implementation.
[Sun May 31 08:55:20 2020] rcu: 	RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=8.
[Sun May 31 08:55:20 2020] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[Sun May 31 08:55:20 2020] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8
[Sun May 31 08:55:20 2020] NR_IRQS: 33024, nr_irqs: 488, preallocated irqs: 16
[Sun May 31 08:55:20 2020] Console: colour VGA+ 80x25
[Sun May 31 08:55:20 2020] printk: console [tty0] enabled
[Sun May 31 08:55:20 2020] ACPI: Core revision 20200326
[Sun May 31 08:55:20 2020] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns
[Sun May 31 08:55:20 2020] APIC: Switch to symmetric I/O mode setup
[Sun May 31 08:55:20 2020] x2apic: IRQ remapping doesn't support X2APIC mode
[Sun May 31 08:55:20 2020] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[Sun May 31 08:55:20 2020] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x170238d5ef2, max_idle_ns: 440795282785 ns
[Sun May 31 08:55:20 2020] Calibrating delay loop (skipped), value calculated using timer frequency.. 3192.45 BogoMIPS (lpj=6384908)
[Sun May 31 08:55:20 2020] pid_max: default: 32768 minimum: 301
[Sun May 31 08:55:20 2020] LSM: Security Framework initializing
[Sun May 31 08:55:20 2020] Yama: becoming mindful.
[Sun May 31 08:55:20 2020] AppArmor: AppArmor initialized
[Sun May 31 08:55:20 2020] TOMOYO Linux initialized
[Sun May 31 08:55:20 2020] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)
[Sun May 31 08:55:20 2020] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)
[Sun May 31 08:55:20 2020] Disabled fast string operations
[Sun May 31 08:55:20 2020] mce: CPU0: Thermal monitoring enabled (TM1)
[Sun May 31 08:55:20 2020] process: using mwait in idle threads
[Sun May 31 08:55:20 2020] Last level iTLB entries: 4KB 512, 2MB 8, 4MB 8
[Sun May 31 08:55:20 2020] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32, 1GB 0
[Sun May 31 08:55:20 2020] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[Sun May 31 08:55:20 2020] Spectre V2 : Mitigation: Full generic retpoline
[Sun May 31 08:55:20 2020] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[Sun May 31 08:55:20 2020] Spectre V2 : Enabling Restricted Speculation for firmware calls
[Sun May 31 08:55:20 2020] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier
[Sun May 31 08:55:20 2020] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl
[Sun May 31 08:55:20 2020] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[Sun May 31 08:55:20 2020] MDS: Mitigation: Clear CPU buffers
[Sun May 31 08:55:20 2020] Freeing SMP alternatives memory: 36K
[Sun May 31 08:55:20 2020] smpboot: CPU0: Intel(R) Core(TM) i5-2467M CPU @ 1.60GHz (family: 0x6, model: 0x2a, stepping: 0x7)
[Sun May 31 08:55:20 2020] Performance Events: PEBS fmt1+, SandyBridge events, 16-deep LBR, full-width counters, Intel PMU driver.
[Sun May 31 08:55:20 2020] ... version:                3
[Sun May 31 08:55:20 2020] ... bit width:              48
[Sun May 31 08:55:20 2020] ... generic registers:      4
[Sun May 31 08:55:20 2020] ... value mask:             0000ffffffffffff
[Sun May 31 08:55:20 2020] ... max period:             00007fffffffffff
[Sun May 31 08:55:20 2020] ... fixed-purpose events:   3
[Sun May 31 08:55:20 2020] ... event mask:             000000070000000f
[Sun May 31 08:55:20 2020] rcu: Hierarchical SRCU implementation.
[Sun May 31 08:55:20 2020] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter.
[Sun May 31 08:55:20 2020] smp: Bringing up secondary CPUs ...
[Sun May 31 08:55:20 2020] x86: Booting SMP configuration:
[Sun May 31 08:55:20 2020] .... node  #0, CPUs:      #1
[Sun May 31 08:55:20 2020] Disabled fast string operations
[Sun May 31 08:55:20 2020] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details.
[Sun May 31 08:55:20 2020]  #2
[Sun May 31 08:55:20 2020] Disabled fast string operations
[Sun May 31 08:55:20 2020]  #3
[Sun May 31 08:55:20 2020] Disabled fast string operations
[Sun May 31 08:55:20 2020] smp: Brought up 1 node, 4 CPUs
[Sun May 31 08:55:20 2020] smpboot: Max logical packages: 2
[Sun May 31 08:55:20 2020] smpboot: Total of 4 processors activated (12769.81 BogoMIPS)
[Sun May 31 08:55:20 2020] node 0 initialised, 1103298 pages in 20ms
[Sun May 31 08:55:20 2020] devtmpfs: initialized
[Sun May 31 08:55:20 2020] x86/mm: Memory block size: 128MB
[Sun May 31 08:55:20 2020] PM: Registering ACPI NVS region [mem 0xdae7f000-0xdaf9efff] (1179648 bytes)
[Sun May 31 08:55:20 2020] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[Sun May 31 08:55:20 2020] futex hash table entries: 2048 (order: 5, 131072 bytes, linear)
[Sun May 31 08:55:20 2020] pinctrl core: initialized pinctrl subsystem
[Sun May 31 08:55:20 2020] thermal_sys: Registered thermal governor 'fair_share'
[Sun May 31 08:55:20 2020] thermal_sys: Registered thermal governor 'bang_bang'
[Sun May 31 08:55:20 2020] thermal_sys: Registered thermal governor 'step_wise'
[Sun May 31 08:55:20 2020] thermal_sys: Registered thermal governor 'user_space'
[Sun May 31 08:55:20 2020] NET: Registered protocol family 16
[Sun May 31 08:55:20 2020] audit: initializing netlink subsys (disabled)
[Sun May 31 08:55:20 2020] audit: type=2000 audit(1590908120.068:1): state=initialized audit_enabled=0 res=1
[Sun May 31 08:55:20 2020] cpuidle: using governor ladder
[Sun May 31 08:55:20 2020] cpuidle: using governor menu
[Sun May 31 08:55:20 2020] ACPI: bus type PCI registered
[Sun May 31 08:55:20 2020] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[Sun May 31 08:55:20 2020] PCI: MMCONFIG for domain 0000 [bus 00-3f] at [mem 0xf8000000-0xfbffffff] (base 0xf8000000)
[Sun May 31 08:55:20 2020] PCI: MMCONFIG at [mem 0xf8000000-0xfbffffff] reserved in E820
[Sun May 31 08:55:20 2020] PCI: Using configuration type 1 for base access
[Sun May 31 08:55:20 2020] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[Sun May 31 08:55:20 2020] ENERGY_PERF_BIAS: Set to 'normal', was 'performance'
[Sun May 31 08:55:20 2020] mtrr: your CPUs had inconsistent variable MTRR settings
[Sun May 31 08:55:20 2020] mtrr: probably your BIOS does not setup all CPUs.
[Sun May 31 08:55:20 2020] mtrr: corrected configuration.
[Sun May 31 08:55:20 2020] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[Sun May 31 08:55:20 2020] ACPI: Added _OSI(Module Device)
[Sun May 31 08:55:20 2020] ACPI: Added _OSI(Processor Device)
[Sun May 31 08:55:20 2020] ACPI: Added _OSI(3.0 _SCP Extensions)
[Sun May 31 08:55:20 2020] ACPI: Added _OSI(Processor Aggregator Device)
[Sun May 31 08:55:20 2020] ACPI: Added _OSI(Linux-Dell-Video)
[Sun May 31 08:55:20 2020] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[Sun May 31 08:55:20 2020] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
[Sun May 31 08:55:20 2020] ACPI: 4 ACPI AML tables successfully acquired and loaded
[Sun May 31 08:55:20 2020] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[Sun May 31 08:55:20 2020] ACPI: Dynamic OEM Table Load:
[Sun May 31 08:55:20 2020] ACPI: SSDT 0xFFFF89D907FA3800 000688 (v01 PmRef  Cpu0Cst  00003001 INTL 20061109)
[Sun May 31 08:55:20 2020] ACPI: Dynamic OEM Table Load:
[Sun May 31 08:55:20 2020] ACPI: SSDT 0xFFFF89D907FBDC00 000303 (v01 PmRef  ApIst    00003000 INTL 20061109)
[Sun May 31 08:55:20 2020] ACPI: Dynamic OEM Table Load:
[Sun May 31 08:55:20 2020] ACPI: SSDT 0xFFFF89D9B3CFF600 000119 (v01 PmRef  ApCst    00003000 INTL 20061109)
[Sun May 31 08:55:20 2020] ACPI: EC: EC started
[Sun May 31 08:55:20 2020] ACPI: EC: interrupt blocked
[Sun May 31 08:55:20 2020] ACPI: EC: EC_CMD/EC_SC=0x66, EC_DATA=0x62
[Sun May 31 08:55:20 2020] ACPI: \_SB_.PCI0.LPCB.H_EC: Boot DSDT EC used to handle transactions
[Sun May 31 08:55:20 2020] ACPI: Interpreter enabled
[Sun May 31 08:55:20 2020] ACPI: (supports S0 S1 S3 S4 S5)
[Sun May 31 08:55:20 2020] ACPI: Using IOAPIC for interrupt routing
[Sun May 31 08:55:20 2020] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[Sun May 31 08:55:20 2020] ACPI: Enabled 8 GPEs in block 00 to 3F
[Sun May 31 08:55:20 2020] ACPI: Power Resource [FN00] (off)
[Sun May 31 08:55:20 2020] ACPI: Power Resource [FN01] (off)
[Sun May 31 08:55:20 2020] ACPI: Power Resource [FN02] (off)
[Sun May 31 08:55:20 2020] ACPI: Power Resource [FN03] (off)
[Sun May 31 08:55:20 2020] ACPI: Power Resource [FN04] (off)
[Sun May 31 08:55:20 2020] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-3e])
[Sun May 31 08:55:20 2020] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[Sun May 31 08:55:20 2020] acpi PNP0A08:00: _OSC failed (AE_ERROR); disabling ASPM
[Sun May 31 08:55:20 2020] PCI host bridge to bus 0000:00
[Sun May 31 08:55:20 2020] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[Sun May 31 08:55:20 2020] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[Sun May 31 08:55:20 2020] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[Sun May 31 08:55:20 2020] pci_bus 0000:00: root bus resource [mem 0xdfa00000-0xfeafffff window]
[Sun May 31 08:55:20 2020] pci_bus 0000:00: root bus resource [mem 0xfed40000-0xfed44fff window]
[Sun May 31 08:55:20 2020] pci_bus 0000:00: root bus resource [bus 00-3e]
[Sun May 31 08:55:20 2020] pci 0000:00:00.0: [8086:0104] type 00 class 0x060000
[Sun May 31 08:55:20 2020] pci 0000:00:02.0: [8086:0116] type 00 class 0x030000
[Sun May 31 08:55:20 2020] pci 0000:00:02.0: reg 0x10: [mem 0xf0000000-0xf03fffff 64bit]
[Sun May 31 08:55:20 2020] pci 0000:00:02.0: reg 0x18: [mem 0xe0000000-0xefffffff 64bit pref]
[Sun May 31 08:55:20 2020] pci 0000:00:02.0: reg 0x20: [io  0x3000-0x303f]
[Sun May 31 08:55:20 2020] pci 0000:00:16.0: [8086:1c3a] type 00 class 0x078000
[Sun May 31 08:55:20 2020] pci 0000:00:16.0: reg 0x10: [mem 0xf0705000-0xf070500f 64bit]
[Sun May 31 08:55:20 2020] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
[Sun May 31 08:55:20 2020] pci 0000:00:1a.0: [8086:1c2d] type 00 class 0x0c0320
[Sun May 31 08:55:20 2020] pci 0000:00:1a.0: reg 0x10: [mem 0xf070a000-0xf070a3ff]
[Sun May 31 08:55:20 2020] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
[Sun May 31 08:55:20 2020] pci 0000:00:1b.0: [8086:1c20] type 00 class 0x040300
[Sun May 31 08:55:20 2020] pci 0000:00:1b.0: reg 0x10: [mem 0xf0700000-0xf0703fff 64bit]
[Sun May 31 08:55:20 2020] pci 0000:00:1b.0: PME# supported from D0 D3hot D3cold
[Sun May 31 08:55:20 2020] pci 0000:00:1c.0: [8086:1c10] type 01 class 0x060400
[Sun May 31 08:55:20 2020] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[Sun May 31 08:55:20 2020] pci 0000:00:1c.3: [8086:1c16] type 01 class 0x060400
[Sun May 31 08:55:20 2020] pci 0000:00:1c.3: PME# supported from D0 D3hot D3cold
[Sun May 31 08:55:20 2020] pci 0000:00:1c.4: [8086:1c18] type 01 class 0x060400
[Sun May 31 08:55:20 2020] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold
[Sun May 31 08:55:20 2020] pci 0000:00:1d.0: [8086:1c26] type 00 class 0x0c0320
[Sun May 31 08:55:20 2020] pci 0000:00:1d.0: reg 0x10: [mem 0xf0709000-0xf07093ff]
[Sun May 31 08:55:20 2020] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
[Sun May 31 08:55:20 2020] pci 0000:00:1f.0: [8086:1c49] type 00 class 0x060100
[Sun May 31 08:55:20 2020] pci 0000:00:1f.2: [8086:1c03] type 00 class 0x010601
[Sun May 31 08:55:20 2020] pci 0000:00:1f.2: reg 0x10: [io  0x3088-0x308f]
[Sun May 31 08:55:20 2020] pci 0000:00:1f.2: reg 0x14: [io  0x3094-0x3097]
[Sun May 31 08:55:20 2020] pci 0000:00:1f.2: reg 0x18: [io  0x3080-0x3087]
[Sun May 31 08:55:20 2020] pci 0000:00:1f.2: reg 0x1c: [io  0x3090-0x3093]
[Sun May 31 08:55:20 2020] pci 0000:00:1f.2: reg 0x20: [io  0x3060-0x307f]
[Sun May 31 08:55:20 2020] pci 0000:00:1f.2: reg 0x24: [mem 0xf0708000-0xf07087ff]
[Sun May 31 08:55:20 2020] pci 0000:00:1f.2: PME# supported from D3hot
[Sun May 31 08:55:20 2020] pci 0000:00:1f.3: [8086:1c22] type 00 class 0x0c0500
[Sun May 31 08:55:20 2020] pci 0000:00:1f.3: reg 0x10: [mem 0xf0704000-0xf07040ff 64bit]
[Sun May 31 08:55:20 2020] pci 0000:00:1f.3: reg 0x20: [io  0xefa0-0xefbf]
[Sun May 31 08:55:20 2020] pci 0000:01:00.0: [8086:0091] type 00 class 0x028000
[Sun May 31 08:55:20 2020] pci 0000:01:00.0: reg 0x10: [mem 0xf0600000-0xf0601fff 64bit]
[Sun May 31 08:55:20 2020] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[Sun May 31 08:55:20 2020] pci 0000:00:1c.0: PCI bridge to [bus 01]
[Sun May 31 08:55:20 2020] pci 0000:00:1c.0:   bridge window [mem 0xf0600000-0xf06fffff]
[Sun May 31 08:55:20 2020] pci 0000:02:00.0: [10ec:8168] type 00 class 0x020000
[Sun May 31 08:55:20 2020] pci 0000:02:00.0: reg 0x10: [io  0x2000-0x20ff]
[Sun May 31 08:55:20 2020] pci 0000:02:00.0: reg 0x18: [mem 0xf0404000-0xf0404fff 64bit pref]
[Sun May 31 08:55:20 2020] pci 0000:02:00.0: reg 0x20: [mem 0xf0400000-0xf0403fff 64bit pref]
[Sun May 31 08:55:20 2020] pci 0000:02:00.0: supports D1 D2
[Sun May 31 08:55:20 2020] pci 0000:02:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[Sun May 31 08:55:20 2020] pci 0000:00:1c.3: PCI bridge to [bus 02]
[Sun May 31 08:55:20 2020] pci 0000:00:1c.3:   bridge window [io  0x2000-0x2fff]
[Sun May 31 08:55:20 2020] pci 0000:00:1c.3:   bridge window [mem 0xf0400000-0xf04fffff 64bit pref]
[Sun May 31 08:55:20 2020] pci 0000:03:00.0: [1b21:1042] type 00 class 0x0c0330
[Sun May 31 08:55:20 2020] pci 0000:03:00.0: reg 0x10: [mem 0xf0500000-0xf0507fff 64bit]
[Sun May 31 08:55:20 2020] pci 0000:03:00.0: PME# supported from D3cold
[Sun May 31 08:55:20 2020] pci 0000:00:1c.4: PCI bridge to [bus 03]
[Sun May 31 08:55:20 2020] pci 0000:00:1c.4:   bridge window [mem 0xf0500000-0xf05fffff]
[Sun May 31 08:55:20 2020] ACPI: PCI Interrupt Link [LNKA] (IRQs 1 3 4 5 6 10 *11 12 14 15)
[Sun May 31 08:55:20 2020] ACPI: PCI Interrupt Link [LNKB] (IRQs 1 3 4 5 6 10 11 12 14 15) *0, disabled.
[Sun May 31 08:55:20 2020] ACPI: PCI Interrupt Link [LNKC] (IRQs 1 3 4 5 6 *10 11 12 14 15)
[Sun May 31 08:55:20 2020] ACPI: PCI Interrupt Link [LNKD] (IRQs 1 3 4 5 6 *10 11 12 14 15)
[Sun May 31 08:55:20 2020] ACPI: PCI Interrupt Link [LNKE] (IRQs 1 3 4 5 6 10 11 12 14 15) *9
[Sun May 31 08:55:20 2020] ACPI: PCI Interrupt Link [LNKF] (IRQs 1 3 4 5 6 10 11 12 14 15) *0, disabled.
[Sun May 31 08:55:20 2020] ACPI: PCI Interrupt Link [LNKG] (IRQs 1 3 4 5 6 10 *11 12 14 15)
[Sun May 31 08:55:20 2020] ACPI: PCI Interrupt Link [LNKH] (IRQs 1 3 4 5 6 10 11 12 14 15) *9
[Sun May 31 08:55:20 2020] ACPI: EC: interrupt unblocked
[Sun May 31 08:55:20 2020] ACPI: EC: event unblocked
[Sun May 31 08:55:20 2020] ACPI: EC: 0 stale EC events cleared
[Sun May 31 08:55:20 2020] ACPI: EC: EC_CMD/EC_SC=0x66, EC_DATA=0x62
[Sun May 31 08:55:20 2020] ACPI: EC: GPE=0x17
[Sun May 31 08:55:20 2020] ACPI: \_SB_.PCI0.LPCB.H_EC: Boot DSDT EC initialization complete
[Sun May 31 08:55:20 2020] ACPI: \_SB_.PCI0.LPCB.H_EC: EC: Used to handle transactions and events
[Sun May 31 08:55:20 2020] iommu: Default domain type: Translated 
[Sun May 31 08:55:20 2020] pci 0000:00:02.0: vgaarb: setting as boot VGA device
[Sun May 31 08:55:20 2020] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[Sun May 31 08:55:20 2020] pci 0000:00:02.0: vgaarb: bridge control possible
[Sun May 31 08:55:20 2020] vgaarb: loaded
[Sun May 31 08:55:20 2020] EDAC MC: Ver: 3.0.0
[Sun May 31 08:55:20 2020] PCI: Using ACPI for IRQ routing
[Sun May 31 08:55:20 2020] PCI: pci_cache_line_size set to 64 bytes
[Sun May 31 08:55:20 2020] e820: reserve RAM buffer [mem 0x0009d800-0x0009ffff]
[Sun May 31 08:55:20 2020] e820: reserve RAM buffer [mem 0xd9c9f000-0xdbffffff]
[Sun May 31 08:55:20 2020] e820: reserve RAM buffer [mem 0xdb000000-0xdbffffff]
[Sun May 31 08:55:20 2020] e820: reserve RAM buffer [mem 0x21fe00000-0x21fffffff]
[Sun May 31 08:55:20 2020] NetLabel: Initializing
[Sun May 31 08:55:20 2020] NetLabel:  domain hash size = 128
[Sun May 31 08:55:20 2020] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[Sun May 31 08:55:20 2020] NetLabel:  unlabeled traffic allowed by default
[Sun May 31 08:55:20 2020] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[Sun May 31 08:55:20 2020] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[Sun May 31 08:55:20 2020] clocksource: Switched to clocksource tsc-early
[Sun May 31 08:55:20 2020] VFS: Disk quotas dquot_6.6.0
[Sun May 31 08:55:20 2020] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[Sun May 31 08:55:20 2020] AppArmor: AppArmor Filesystem Enabled
[Sun May 31 08:55:20 2020] pnp: PnP ACPI init
[Sun May 31 08:55:20 2020] system 00:00: [io  0x0680-0x069f] has been reserved
[Sun May 31 08:55:20 2020] system 00:00: [io  0x1000-0x100f] has been reserved
[Sun May 31 08:55:20 2020] system 00:00: [io  0x5000-0x5003] has been reserved
[Sun May 31 08:55:20 2020] system 00:00: [io  0xffff] has been reserved
[Sun May 31 08:55:20 2020] system 00:00: [io  0x0400-0x0453] has been reserved
[Sun May 31 08:55:20 2020] system 00:00: [io  0x0458-0x047f] has been reserved
[Sun May 31 08:55:20 2020] system 00:00: [io  0x0500-0x057f] has been reserved
[Sun May 31 08:55:20 2020] system 00:00: [io  0x0a00-0x0a0f] has been reserved
[Sun May 31 08:55:20 2020] system 00:00: [io  0x164e-0x164f] has been reserved
[Sun May 31 08:55:20 2020] system 00:00: [io  0x5000-0x500f] could not be reserved
[Sun May 31 08:55:20 2020] system 00:00: Plug and Play ACPI device, IDs PNP0c02 (active)
[Sun May 31 08:55:20 2020] pnp 00:01: Plug and Play ACPI device, IDs PNP0b00 (active)
[Sun May 31 08:55:20 2020] system 00:02: [io  0x0454-0x0457] has been reserved
[Sun May 31 08:55:20 2020] system 00:02: Plug and Play ACPI device, IDs INT3f0d PNP0c02 (active)
[Sun May 31 08:55:20 2020] pnp 00:03: Plug and Play ACPI device, IDs PNP0303 (active)
[Sun May 31 08:55:20 2020] pnp 00:04: Plug and Play ACPI device, IDs ETD0b00 SYN0002 PNP0f13 (active)
[Sun May 31 08:55:20 2020] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved
[Sun May 31 08:55:20 2020] system 00:05: [mem 0xfed10000-0xfed17fff] has been reserved
[Sun May 31 08:55:20 2020] system 00:05: [mem 0xfed18000-0xfed18fff] has been reserved
[Sun May 31 08:55:20 2020] system 00:05: [mem 0xfed19000-0xfed19fff] has been reserved
[Sun May 31 08:55:20 2020] system 00:05: [mem 0xf8000000-0xfbffffff] has been reserved
[Sun May 31 08:55:20 2020] system 00:05: [mem 0xfed20000-0xfed3ffff] has been reserved
[Sun May 31 08:55:20 2020] system 00:05: [mem 0xfed90000-0xfed93fff] has been reserved
[Sun May 31 08:55:20 2020] system 00:05: [mem 0xfed45000-0xfed8ffff] has been reserved
[Sun May 31 08:55:20 2020] system 00:05: [mem 0xff000000-0xffffffff] could not be reserved
[Sun May 31 08:55:20 2020] system 00:05: [mem 0xfee00000-0xfeefffff] could not be reserved
[Sun May 31 08:55:20 2020] system 00:05: Plug and Play ACPI device, IDs PNP0c02 (active)
[Sun May 31 08:55:20 2020] system 00:06: Plug and Play ACPI device, IDs PNP0c01 (active)
[Sun May 31 08:55:20 2020] pnp: PnP ACPI: found 7 devices
[Sun May 31 08:55:20 2020] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[Sun May 31 08:55:20 2020] pci 0000:00:1c.0: PCI bridge to [bus 01]
[Sun May 31 08:55:20 2020] pci 0000:00:1c.0:   bridge window [mem 0xf0600000-0xf06fffff]
[Sun May 31 08:55:20 2020] pci 0000:00:1c.3: PCI bridge to [bus 02]
[Sun May 31 08:55:20 2020] pci 0000:00:1c.3:   bridge window [io  0x2000-0x2fff]
[Sun May 31 08:55:20 2020] pci 0000:00:1c.3:   bridge window [mem 0xf0400000-0xf04fffff 64bit pref]
[Sun May 31 08:55:20 2020] pci 0000:00:1c.4: PCI bridge to [bus 03]
[Sun May 31 08:55:20 2020] pci 0000:00:1c.4:   bridge window [mem 0xf0500000-0xf05fffff]
[Sun May 31 08:55:20 2020] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
[Sun May 31 08:55:20 2020] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]
[Sun May 31 08:55:20 2020] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[Sun May 31 08:55:20 2020] pci_bus 0000:00: resource 7 [mem 0xdfa00000-0xfeafffff window]
[Sun May 31 08:55:20 2020] pci_bus 0000:00: resource 8 [mem 0xfed40000-0xfed44fff window]
[Sun May 31 08:55:20 2020] pci_bus 0000:01: resource 1 [mem 0xf0600000-0xf06fffff]
[Sun May 31 08:55:20 2020] pci_bus 0000:02: resource 0 [io  0x2000-0x2fff]
[Sun May 31 08:55:20 2020] pci_bus 0000:02: resource 2 [mem 0xf0400000-0xf04fffff 64bit pref]
[Sun May 31 08:55:20 2020] pci_bus 0000:03: resource 1 [mem 0xf0500000-0xf05fffff]
[Sun May 31 08:55:20 2020] NET: Registered protocol family 2
[Sun May 31 08:55:20 2020] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)
[Sun May 31 08:55:20 2020] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)
[Sun May 31 08:55:20 2020] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear)
[Sun May 31 08:55:20 2020] TCP: Hash tables configured (established 65536 bind 65536)
[Sun May 31 08:55:20 2020] UDP hash table entries: 4096 (order: 5, 131072 bytes, linear)
[Sun May 31 08:55:20 2020] UDP-Lite hash table entries: 4096 (order: 5, 131072 bytes, linear)
[Sun May 31 08:55:20 2020] NET: Registered protocol family 1
[Sun May 31 08:55:20 2020] NET: Registered protocol family 44
[Sun May 31 08:55:20 2020] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[Sun May 31 08:55:20 2020] PCI: CLS 64 bytes, default 64
[Sun May 31 08:55:20 2020] Trying to unpack rootfs image as initramfs...
[Sun May 31 08:55:20 2020] Freeing initrd memory: 23836K
[Sun May 31 08:55:20 2020] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[Sun May 31 08:55:20 2020] software IO TLB: mapped [mem 0xd5c9f000-0xd9c9f000] (64MB)
[Sun May 31 08:55:20 2020] Initialise system trusted keyrings
[Sun May 31 08:55:20 2020] Key type blacklist registered
[Sun May 31 08:55:20 2020] workingset: timestamp_bits=40 max_order=21 bucket_order=0
[Sun May 31 08:55:20 2020] zbud: loaded
[Sun May 31 08:55:20 2020] integrity: Platform Keyring initialized
[Sun May 31 08:55:20 2020] Key type asymmetric registered
[Sun May 31 08:55:20 2020] Asymmetric key parser 'x509' registered
[Sun May 31 08:55:20 2020] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251)
[Sun May 31 08:55:20 2020] io scheduler mq-deadline registered
[Sun May 31 08:55:20 2020] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[Sun May 31 08:55:20 2020] intel_idle: MWAIT substates: 0x21120
[Sun May 31 08:55:20 2020] intel_idle: v0.5.1 model 0x2A
[Sun May 31 08:55:20 2020] intel_idle: Local APIC timer is reliable in all C-states
[Sun May 31 08:55:20 2020] thermal LNXTHERM:00: registered as thermal_zone0
[Sun May 31 08:55:20 2020] ACPI: Thermal Zone [TZ00] (59 C)
[Sun May 31 08:55:20 2020] thermal LNXTHERM:01: registered as thermal_zone1
[Sun May 31 08:55:20 2020] ACPI: Thermal Zone [TZ01] (30 C)
[Sun May 31 08:55:20 2020] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[Sun May 31 08:55:20 2020] Linux agpgart interface v0.103
[Sun May 31 08:55:20 2020] AMD-Vi: AMD IOMMUv2 driver by Joerg Roedel <[email protected]>
[Sun May 31 08:55:20 2020] AMD-Vi: AMD IOMMUv2 functionality not available on this system
[Sun May 31 08:55:20 2020] i8042: PNP: PS/2 Controller [PNP0303:PS2K,PNP0f13:EPAD] at 0x60,0x64 irq 1,12
[Sun May 31 08:55:20 2020] serio: i8042 KBD port at 0x60,0x64 irq 1
[Sun May 31 08:55:20 2020] serio: i8042 AUX port at 0x60,0x64 irq 12
[Sun May 31 08:55:20 2020] mousedev: PS/2 mouse device common for all mice
[Sun May 31 08:55:20 2020] rtc_cmos 00:01: registered as rtc0
[Sun May 31 08:55:20 2020] rtc_cmos 00:01: setting system clock to 2020-05-31T06:55:21 UTC (1590908121)
[Sun May 31 08:55:20 2020] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
[Sun May 31 08:55:20 2020] intel_pstate: Intel P-state driver initializing
[Sun May 31 08:55:20 2020] ledtrig-cpu: registered to indicate activity on CPUs
[Sun May 31 08:55:20 2020] NET: Registered protocol family 10
[Sun May 31 08:55:20 2020] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0
[Sun May 31 08:55:20 2020] Segment Routing with IPv6
[Sun May 31 08:55:20 2020] mip6: Mobile IPv6
[Sun May 31 08:55:20 2020] NET: Registered protocol family 17
[Sun May 31 08:55:20 2020] mpls_gso: MPLS GSO support
[Sun May 31 08:55:20 2020] microcode: sig=0x206a7, pf=0x10, revision=0x2f
[Sun May 31 08:55:20 2020] microcode: Microcode Update Driver: v2.2.
[Sun May 31 08:55:20 2020] IPI shorthand broadcast: enabled
[Sun May 31 08:55:20 2020] sched_clock: Marking stable (985910304, 11911765)->(1010873490, -13051421)
[Sun May 31 08:55:20 2020] registered taskstats version 1
[Sun May 31 08:55:20 2020] Loading compiled-in X.509 certificates
[Sun May 31 08:55:20 2020] zswap: loaded using pool zstd/zbud
[Sun May 31 08:55:21 2020] Key type ._fscrypt registered
[Sun May 31 08:55:21 2020] Key type .fscrypt registered
[Sun May 31 08:55:21 2020] Key type fscrypt-provisioning registered
[Sun May 31 08:55:21 2020] AppArmor: AppArmor sha1 policy hashing enabled
[Sun May 31 08:55:21 2020] Freeing unused kernel image (initmem) memory: 1676K
[Sun May 31 08:55:21 2020] Write protecting the kernel read-only data: 18432k
[Sun May 31 08:55:21 2020] Freeing unused kernel image (text/rodata gap) memory: 2044K
[Sun May 31 08:55:21 2020] Freeing unused kernel image (rodata/data gap) memory: 396K
[Sun May 31 08:55:21 2020] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[Sun May 31 08:55:21 2020] x86/mm: Checking user space page tables
[Sun May 31 08:55:21 2020] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[Sun May 31 08:55:21 2020] Run /init as init process
[Sun May 31 08:55:21 2020]   with arguments:
[Sun May 31 08:55:21 2020]     /init
[Sun May 31 08:55:21 2020]   with environment:
[Sun May 31 08:55:21 2020]     HOME=/
[Sun May 31 08:55:21 2020]     TERM=linux
[Sun May 31 08:55:21 2020]     BOOT_IMAGE=/boot/vmlinuz-5.7.0-rc7-6-amd64-clang
[Sun May 31 08:55:21 2020] fjes: module verification failed: signature and/or required key missing - tainting kernel
[Sun May 31 08:55:21 2020] battery: ACPI: Battery Slot [BAT1] (battery present)
[Sun May 31 08:55:21 2020] ACPI Warning: SystemIO range 0x0000000000000428-0x000000000000042F conflicts with OpRegion 0x0000000000000400-0x000000000000047F (\PMIO) (20200326/utaddress-204)
[Sun May 31 08:55:21 2020] ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
[Sun May 31 08:55:21 2020] ACPI Warning: SystemIO range 0x0000000000000540-0x000000000000054F conflicts with OpRegion 0x0000000000000500-0x0000000000000563 (\GPIO) (20200326/utaddress-204)
[Sun May 31 08:55:21 2020] ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
[Sun May 31 08:55:21 2020] ACPI Warning: SystemIO range 0x0000000000000530-0x000000000000053F conflicts with OpRegion 0x0000000000000500-0x0000000000000563 (\GPIO) (20200326/utaddress-204)
[Sun May 31 08:55:21 2020] ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
[Sun May 31 08:55:21 2020] ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000052F conflicts with OpRegion 0x0000000000000500-0x0000000000000563 (\GPIO) (20200326/utaddress-204)
[Sun May 31 08:55:21 2020] ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver
[Sun May 31 08:55:21 2020] lpc_ich: Resource conflict(s) found affecting gpio_ich
[Sun May 31 08:55:21 2020] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[Sun May 31 08:55:21 2020] ACPI: bus type USB registered
[Sun May 31 08:55:21 2020] SCSI subsystem initialized
[Sun May 31 08:55:21 2020] usbcore: registered new interface driver usbfs
[Sun May 31 08:55:21 2020] usbcore: registered new interface driver hub
[Sun May 31 08:55:21 2020] usbcore: registered new device driver usb
[Sun May 31 08:55:21 2020] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[Sun May 31 08:55:21 2020] libata version 3.00 loaded.
[Sun May 31 08:55:21 2020] ehci-pci: EHCI PCI platform driver
[Sun May 31 08:55:21 2020] r8169 0000:02:00.0: can't disable ASPM; OS doesn't have ASPM control
[Sun May 31 08:55:21 2020] ehci-pci 0000:00:1a.0: EHCI Host Controller
[Sun May 31 08:55:21 2020] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[Sun May 31 08:55:21 2020] ehci-pci 0000:00:1a.0: debug port 2
[Sun May 31 08:55:21 2020] ahci 0000:00:1f.2: version 3.0
[Sun May 31 08:55:21 2020] ahci 0000:00:1f.2: SSS flag set, parallel bus scan disabled
[Sun May 31 08:55:21 2020] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported
[Sun May 31 08:55:21 2020] ehci-pci 0000:00:1a.0: irq 16, io mem 0xf070a000
[Sun May 31 08:55:21 2020] libphy: r8169: probed
[Sun May 31 08:55:21 2020] r8169 0000:02:00.0 eth0: RTL8168evl/8111evl, e8:03:9a:36:17:a9, XID 2c9, IRQ 28
[Sun May 31 08:55:21 2020] r8169 0000:02:00.0 eth0: jumbo features [frames: 9200 bytes, tx checksumming: ko]
[Sun May 31 08:55:21 2020] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x1b impl SATA mode
[Sun May 31 08:55:21 2020] ahci 0000:00:1f.2: flags: 64bit ncq sntf ilck stag pm led clo pio slum part ems sxs apst 
[Sun May 31 08:55:21 2020] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[Sun May 31 08:55:21 2020] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.07
[Sun May 31 08:55:21 2020] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[Sun May 31 08:55:21 2020] usb usb1: Product: EHCI Host Controller
[Sun May 31 08:55:21 2020] usb usb1: Manufacturer: Linux 5.7.0-rc7-6-amd64-clang ehci_hcd
[Sun May 31 08:55:21 2020] usb usb1: SerialNumber: 0000:00:1a.0
[Sun May 31 08:55:21 2020] hub 1-0:1.0: USB hub found
[Sun May 31 08:55:21 2020] hub 1-0:1.0: 2 ports detected
[Sun May 31 08:55:21 2020] xhci_hcd 0000:03:00.0: xHCI Host Controller
[Sun May 31 08:55:21 2020] xhci_hcd 0000:03:00.0: new USB bus registered, assigned bus number 2
[Sun May 31 08:55:21 2020] r8169 0000:02:00.0 enp2s0: renamed from eth0
[Sun May 31 08:55:21 2020] scsi host0: ahci
[Sun May 31 08:55:21 2020] scsi host1: ahci
[Sun May 31 08:55:21 2020] scsi host2: ahci
[Sun May 31 08:55:21 2020] scsi host3: ahci
[Sun May 31 08:55:21 2020] scsi host4: ahci
[Sun May 31 08:55:21 2020] scsi host5: ahci
[Sun May 31 08:55:21 2020] ata1: SATA max UDMA/133 abar m2048@0xf0708000 port 0xf0708100 irq 27
[Sun May 31 08:55:21 2020] ata2: SATA max UDMA/133 abar m2048@0xf0708000 port 0xf0708180 irq 27
[Sun May 31 08:55:21 2020] ata3: DUMMY
[Sun May 31 08:55:21 2020] ata4: SATA max UDMA/133 abar m2048@0xf0708000 port 0xf0708280 irq 27
[Sun May 31 08:55:21 2020] ata5: SATA max UDMA/133 abar m2048@0xf0708000 port 0xf0708300 irq 27
[Sun May 31 08:55:21 2020] ata6: DUMMY
[Sun May 31 08:55:21 2020] xhci_hcd 0000:03:00.0: hcc params 0x0200f180 hci version 0x96 quirks 0x0000000000080000
[Sun May 31 08:55:21 2020] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.07
[Sun May 31 08:55:21 2020] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[Sun May 31 08:55:21 2020] usb usb2: Product: xHCI Host Controller
[Sun May 31 08:55:21 2020] usb usb2: Manufacturer: Linux 5.7.0-rc7-6-amd64-clang xhci-hcd
[Sun May 31 08:55:21 2020] usb usb2: SerialNumber: 0000:03:00.0
[Sun May 31 08:55:21 2020] hub 2-0:1.0: USB hub found
[Sun May 31 08:55:21 2020] hub 2-0:1.0: 2 ports detected
[Sun May 31 08:55:21 2020] ehci-pci 0000:00:1d.0: EHCI Host Controller
[Sun May 31 08:55:21 2020] xhci_hcd 0000:03:00.0: xHCI Host Controller
[Sun May 31 08:55:21 2020] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 3
[Sun May 31 08:55:21 2020] xhci_hcd 0000:03:00.0: new USB bus registered, assigned bus number 4
[Sun May 31 08:55:21 2020] ehci-pci 0000:00:1d.0: debug port 2
[Sun May 31 08:55:21 2020] xhci_hcd 0000:03:00.0: Host supports USB 3.0 SuperSpeed
[Sun May 31 08:55:21 2020] usb usb4: We don't know the algorithms for LPM for this host, disabling LPM.
[Sun May 31 08:55:21 2020] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.07
[Sun May 31 08:55:21 2020] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[Sun May 31 08:55:21 2020] usb usb4: Product: xHCI Host Controller
[Sun May 31 08:55:21 2020] usb usb4: Manufacturer: Linux 5.7.0-rc7-6-amd64-clang xhci-hcd
[Sun May 31 08:55:21 2020] usb usb4: SerialNumber: 0000:03:00.0
[Sun May 31 08:55:21 2020] hub 4-0:1.0: USB hub found
[Sun May 31 08:55:21 2020] hub 4-0:1.0: 2 ports detected
[Sun May 31 08:55:21 2020] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported
[Sun May 31 08:55:21 2020] ehci-pci 0000:00:1d.0: irq 23, io mem 0xf0709000
[Sun May 31 08:55:21 2020] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[Sun May 31 08:55:21 2020] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.07
[Sun May 31 08:55:21 2020] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[Sun May 31 08:55:21 2020] usb usb3: Product: EHCI Host Controller
[Sun May 31 08:55:21 2020] usb usb3: Manufacturer: Linux 5.7.0-rc7-6-amd64-clang ehci_hcd
[Sun May 31 08:55:21 2020] usb usb3: SerialNumber: 0000:00:1d.0
[Sun May 31 08:55:21 2020] hub 3-0:1.0: USB hub found
[Sun May 31 08:55:21 2020] hub 3-0:1.0: 2 ports detected
[Sun May 31 08:55:21 2020] usb 1-1: new high-speed USB device number 2 using ehci-pci
[Sun May 31 08:55:21 2020] ata1: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[Sun May 31 08:55:21 2020] ata1.00: ATA-8: Hitachi HTS545050A7E380, GG2OA6C0, max UDMA/133
[Sun May 31 08:55:21 2020] ata1.00: 976773168 sectors, multi 16: LBA48 NCQ (depth 32), AA
[Sun May 31 08:55:21 2020] ata1.00: configured for UDMA/133
[Sun May 31 08:55:21 2020] scsi 0:0:0:0: Direct-Access     ATA      Hitachi HTS54505 A6C0 PQ: 0 ANSI: 5
[Sun May 31 08:55:21 2020] usb 3-1: new high-speed USB device number 2 using ehci-pci
[Sun May 31 08:55:21 2020] usb 4-1: new SuperSpeed Gen 1 USB device number 2 using xhci_hcd
[Sun May 31 08:55:21 2020] usb 1-1: New USB device found, idVendor=8087, idProduct=0024, bcdDevice= 0.00
[Sun May 31 08:55:21 2020] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[Sun May 31 08:55:21 2020] hub 1-1:1.0: USB hub found
[Sun May 31 08:55:21 2020] hub 1-1:1.0: 6 ports detected
[Sun May 31 08:55:21 2020] usb 4-1: New USB device found, idVendor=174c, idProduct=55aa, bcdDevice= 1.00
[Sun May 31 08:55:21 2020] usb 4-1: New USB device strings: Mfr=2, Product=3, SerialNumber=1
[Sun May 31 08:55:21 2020] usb 4-1: Product: MEDION HDDrive-n-GO
[Sun May 31 08:55:21 2020] usb 4-1: Manufacturer: MEDION
[Sun May 31 08:55:21 2020] usb 4-1: SerialNumber: 3180000000000000092C
[Sun May 31 08:55:21 2020] usb-storage 4-1:1.0: USB Mass Storage device detected
[Sun May 31 08:55:21 2020] usb-storage 4-1:1.0: Quirks match for vid 174c pid 55aa: 400000
[Sun May 31 08:55:21 2020] scsi host6: usb-storage 4-1:1.0
[Sun May 31 08:55:21 2020] usbcore: registered new interface driver usb-storage
[Sun May 31 08:55:21 2020] usbcore: registered new interface driver uas
[Sun May 31 08:55:21 2020] usb 3-1: New USB device found, idVendor=8087, idProduct=0024, bcdDevice= 0.00
[Sun May 31 08:55:21 2020] usb 3-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[Sun May 31 08:55:21 2020] hub 3-1:1.0: USB hub found
[Sun May 31 08:55:21 2020] hub 3-1:1.0: 6 ports detected
[Sun May 31 08:55:21 2020] tsc: Refined TSC clocksource calibration: 1596.376 MHz
[Sun May 31 08:55:21 2020] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x1702c578726, max_idle_ns: 440795205522 ns
[Sun May 31 08:55:21 2020] clocksource: Switched to clocksource tsc
[Sun May 31 08:55:21 2020] ata2: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[Sun May 31 08:55:21 2020] ata2.00: ATA-8: SanDisk iSSD P4 16GB, SSD 9.14, max UDMA/133
[Sun May 31 08:55:21 2020] ata2.00: 31277232 sectors, multi 1: LBA48 
[Sun May 31 08:55:21 2020] ata2.00: configured for UDMA/133
[Sun May 31 08:55:21 2020] scsi 1:0:0:0: Direct-Access     ATA      SanDisk iSSD P4  9.14 PQ: 0 ANSI: 5
[Sun May 31 08:55:22 2020] usb 1-1.2: new low-speed USB device number 3 using ehci-pci
[Sun May 31 08:55:22 2020] psmouse serio1: elantech: assuming hardware version 3 (with firmware version 0x450f00)
[Sun May 31 08:55:22 2020] psmouse serio1: elantech: Synaptics capabilities query result 0x08, 0x17, 0x0c.
[Sun May 31 08:55:22 2020] random: fast init done
[Sun May 31 08:55:22 2020] usb 1-1.2: New USB device found, idVendor=046d, idProduct=c00e, bcdDevice=11.10
[Sun May 31 08:55:22 2020] usb 1-1.2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[Sun May 31 08:55:22 2020] usb 1-1.2: Product: USB-PS/2 Optical Mouse
[Sun May 31 08:55:22 2020] usb 1-1.2: Manufacturer: Logitech
[Sun May 31 08:55:22 2020] psmouse serio1: elantech: Elan sample query result 03, 3f, 86
[Sun May 31 08:55:22 2020] hid: raw HID events driver (C) Jiri Kosina
[Sun May 31 08:55:22 2020] usbcore: registered new interface driver usbhid
[Sun May 31 08:55:22 2020] usbhid: USB HID core driver
[Sun May 31 08:55:22 2020] usb 3-1.5: new full-speed USB device number 3 using ehci-pci
[Sun May 31 08:55:22 2020] input: Logitech USB-PS/2 Optical Mouse as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.2/1-1.2:1.0/0003:046D:C00E.0001/input/input4
[Sun May 31 08:55:22 2020] hid-generic 0003:046D:C00E.0001: input,hidraw0: USB HID v1.10 Mouse [Logitech USB-PS/2 Optical Mouse] on usb-0000:00:1a.0-1.2/input0
[Sun May 31 08:55:22 2020] input: ETPS/2 Elantech Touchpad as /devices/platform/i8042/serio1/input/input3
[Sun May 31 08:55:22 2020] usb 1-1.4: new high-speed USB device number 4 using ehci-pci
[Sun May 31 08:55:22 2020] ata4: SATA link down (SStatus 0 SControl 300)
[Sun May 31 08:55:22 2020] usb 3-1.5: New USB device found, idVendor=8086, idProduct=0189, bcdDevice=69.19
[Sun May 31 08:55:22 2020] usb 3-1.5: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[Sun May 31 08:55:22 2020] usb 1-1.4: New USB device found, idVendor=2232, idProduct=1018, bcdDevice= 0.01
[Sun May 31 08:55:22 2020] usb 1-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[Sun May 31 08:55:22 2020] usb 1-1.4: Product: WebCam SC-13HDL11431N
[Sun May 31 08:55:22 2020] usb 1-1.4: Manufacturer: 123
[Sun May 31 08:55:22 2020] ata5: SATA link down (SStatus 0 SControl 300)
[Sun May 31 08:55:22 2020] sd 0:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/466 GiB)
[Sun May 31 08:55:22 2020] sd 1:0:0:0: [sdb] 31277232 512-byte logical blocks: (16.0 GB/14.9 GiB)
[Sun May 31 08:55:22 2020] sd 0:0:0:0: [sda] 4096-byte physical blocks
[Sun May 31 08:55:22 2020] sd 1:0:0:0: [sdb] Write Protect is off
[Sun May 31 08:55:22 2020] sd 0:0:0:0: [sda] Write Protect is off
[Sun May 31 08:55:22 2020] sd 1:0:0:0: [sdb] Mode Sense: 00 3a 00 00
[Sun May 31 08:55:22 2020] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
[Sun May 31 08:55:22 2020] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[Sun May 31 08:55:22 2020] sd 1:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[Sun May 31 08:55:22 2020]  sdb: sdb1
[Sun May 31 08:55:22 2020] sd 1:0:0:0: [sdb] Attached SCSI disk
[Sun May 31 08:55:22 2020]  sda: sda1 sda2 sda3
[Sun May 31 08:55:22 2020] sd 0:0:0:0: [sda] Attached SCSI disk
[Sun May 31 08:55:22 2020] scsi 6:0:0:0: Direct-Access     ASMT     2105             0    PQ: 0 ANSI: 6
[Sun May 31 08:55:22 2020] sd 6:0:0:0: [sdc] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB)
[Sun May 31 08:55:22 2020] sd 6:0:0:0: [sdc] 4096-byte physical blocks
[Sun May 31 08:55:22 2020] sd 6:0:0:0: [sdc] Write Protect is off
[Sun May 31 08:55:22 2020] sd 6:0:0:0: [sdc] Mode Sense: 43 00 00 00
[Sun May 31 08:55:22 2020] sd 6:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[Sun May 31 08:55:23 2020]  sdc: sdc1 sdc2 sdc3 sdc4 < sdc5 >
[Sun May 31 08:55:23 2020] sd 6:0:0:0: [sdc] Attached SCSI disk
[Sun May 31 08:55:23 2020] process '/usr/bin/fstype' started with executable stack
[Sun May 31 08:55:24 2020] EXT4-fs (sdc2): mounted filesystem with ordered data mode. Opts: (null)
[Sun May 31 08:55:24 2020] Not activating Mandatory Access Control as /sbin/tomoyo-init does not exist.
[Sun May 31 08:55:25 2020] random: crng init done
[Sun May 31 08:55:26 2020] systemd[1]: Inserted module 'autofs4'
[Sun May 31 08:55:26 2020] systemd[1]: systemd 245.5-3 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid)
[Sun May 31 08:55:26 2020] systemd[1]: Detected architecture x86-64.
[Sun May 31 08:55:26 2020] systemd[1]: Set hostname to <iniza>.
[Sun May 31 08:55:28 2020] systemd[1]: /lib/systemd/system/dbus.socket:5: ListenStream= references a path below legacy directory /var/run/, updating /var/run/dbus/system_bus_socket \xe2\x86\x92 /run/dbus/system_bus_socket; please update the unit file accordingly.
[Sun May 31 08:55:29 2020] systemd[1]: Created slice system-getty.slice.
[Sun May 31 08:55:29 2020] systemd[1]: Created slice system-modprobe.slice.
[Sun May 31 08:55:29 2020] systemd[1]: Created slice User and Session Slice.
[Sun May 31 08:55:29 2020] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[Sun May 31 08:55:29 2020] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[Sun May 31 08:55:29 2020] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[Sun May 31 08:55:29 2020] systemd[1]: Reached target Local Encrypted Volumes.
[Sun May 31 08:55:29 2020] systemd[1]: Reached target User and Group Name Lookups.
[Sun May 31 08:55:29 2020] systemd[1]: Reached target Remote File Systems.
[Sun May 31 08:55:29 2020] systemd[1]: Reached target Slices.
[Sun May 31 08:55:29 2020] systemd[1]: Reached target Swap.
[Sun May 31 08:55:29 2020] systemd[1]: Listening on Syslog Socket.
[Sun May 31 08:55:29 2020] systemd[1]: Listening on fsck to fsckd communication Socket.
[Sun May 31 08:55:29 2020] systemd[1]: Listening on initctl Compatibility Named Pipe.
[Sun May 31 08:55:29 2020] systemd[1]: Listening on Journal Audit Socket.
[Sun May 31 08:55:29 2020] systemd[1]: Listening on Journal Socket (/dev/log).
[Sun May 31 08:55:29 2020] systemd[1]: Listening on Journal Socket.
[Sun May 31 08:55:29 2020] systemd[1]: Listening on udev Control Socket.
[Sun May 31 08:55:29 2020] systemd[1]: Listening on udev Kernel Socket.
[Sun May 31 08:55:29 2020] systemd[1]: Mounting Huge Pages File System...
[Sun May 31 08:55:29 2020] systemd[1]: Mounting POSIX Message Queue File System...
[Sun May 31 08:55:29 2020] systemd[1]: Mounting Kernel Debug File System...
[Sun May 31 08:55:29 2020] systemd[1]: Mounting Kernel Trace File System...
[Sun May 31 08:55:29 2020] systemd[1]: Starting Wait for network to be configured by ifupdown...
[Sun May 31 08:55:29 2020] systemd[1]: Starting Set the console keyboard layout...
[Sun May 31 08:55:29 2020] systemd[1]: Starting Create list of static device nodes for the current kernel...
[Sun May 31 08:55:29 2020] systemd[1]: Starting Load Kernel Module drm...
[Sun May 31 08:55:29 2020] systemd[1]: Condition check resulted in Set Up Additional Binary Formats being skipped.
[Sun May 31 08:55:29 2020] systemd[1]: Condition check resulted in File System Check on Root Device being skipped.
[Sun May 31 08:55:29 2020] systemd[1]: Starting Journal Service...
[Sun May 31 08:55:29 2020] systemd[1]: Starting Load Kernel Modules...
[Sun May 31 08:55:29 2020] systemd[1]: Starting Remount Root and Kernel File Systems...
[Sun May 31 08:55:29 2020] systemd[1]: Starting udev Coldplug all Devices...
[Sun May 31 08:55:29 2020] systemd[1]: Finished Create list of static device nodes for the current kernel.
[Sun May 31 08:55:29 2020] systemd[1]: Mounted POSIX Message Queue File System.
[Sun May 31 08:55:29 2020] systemd[1]: Mounted Kernel Debug File System.
[Sun May 31 08:55:29 2020] systemd[1]: Mounted Kernel Trace File System.
[Sun May 31 08:55:29 2020] systemd[1]: Mounted Huge Pages File System.
[Sun May 31 08:55:29 2020] EXT4-fs (sdc2): re-mounted. Opts: errors=remount-ro
[Sun May 31 08:55:29 2020] systemd[1]: Finished Remount Root and Kernel File Systems.
[Sun May 31 08:55:30 2020] systemd[1]: Condition check resulted in Rebuild Hardware Database being skipped.
[Sun May 31 08:55:30 2020] systemd[1]: Condition check resulted in Platform Persistent Storage Archival being skipped.
[Sun May 31 08:55:30 2020] systemd[1]: Starting Load/Save Random Seed...
[Sun May 31 08:55:30 2020] systemd[1]: Starting Create System Users...
[Sun May 31 08:55:30 2020] systemd[1]: Finished Wait for network to be configured by ifupdown.
[Sun May 31 08:55:30 2020] systemd[1]: Finished udev Coldplug all Devices.
[Sun May 31 08:55:30 2020] systemd[1]: Starting Helper to synchronize boot up for ifupdown...
[Sun May 31 08:55:30 2020] systemd[1]: Finished Helper to synchronize boot up for ifupdown.
[Sun May 31 08:55:30 2020] systemd[1]: [email protected]: Succeeded.
[Sun May 31 08:55:30 2020] systemd[1]: Finished Load Kernel Module drm.
[Sun May 31 08:55:30 2020] systemd[1]: Started Journal Service.
[Sun May 31 08:55:30 2020] systemd-journald[246]: Received client request to flush runtime journal.
[Sun May 31 08:55:30 2020] lp: driver loaded but no devices found
[Sun May 31 08:55:30 2020] ppdev: user-space parallel port driver
[Sun May 31 08:55:34 2020] audit: type=1400 audit(1590908134.821:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="libreoffice-xpdfimport" pid=292 comm="apparmor_parser"
[Sun May 31 08:55:34 2020] audit: type=1400 audit(1590908134.901:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lsb_release" pid=294 comm="apparmor_parser"
[Sun May 31 08:55:34 2020] audit: type=1400 audit(1590908134.921:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="libreoffice-senddoc" pid=297 comm="apparmor_parser"
[Sun May 31 08:55:34 2020] audit: type=1400 audit(1590908134.941:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/haveged" pid=298 comm="apparmor_parser"
[Sun May 31 08:55:34 2020] audit: type=1400 audit(1590908135.033:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="libreoffice-oopslash" pid=299 comm="apparmor_parser"
[Sun May 31 08:55:34 2020] audit: type=1400 audit(1590908135.101:7): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/cups-browsed" pid=300 comm="apparmor_parser"
[Sun May 31 08:55:34 2020] audit: type=1400 audit(1590908135.125:8): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/cups/backend/cups-pdf" pid=293 comm="apparmor_parser"
[Sun May 31 08:55:34 2020] audit: type=1400 audit(1590908135.125:9): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/cupsd" pid=293 comm="apparmor_parser"
[Sun May 31 08:55:34 2020] audit: type=1400 audit(1590908135.125:10): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/cupsd//third_party" pid=293 comm="apparmor_parser"
[Sun May 31 08:55:34 2020] audit: type=1400 audit(1590908135.253:11): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/man" pid=302 comm="apparmor_parser"
[Sun May 31 08:55:36 2020] ACPI: AC Adapter [ADP1] (on-line)
[Sun May 31 08:55:36 2020] input: Lid Switch as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0D:00/input/input5
[Sun May 31 08:55:36 2020] ACPI: Lid Switch [LID0]
[Sun May 31 08:55:36 2020] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input6
[Sun May 31 08:55:36 2020] ACPI: Power Button [PWRB]
[Sun May 31 08:55:36 2020] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input7
[Sun May 31 08:55:36 2020] ACPI: Power Button [PWRF]
[Sun May 31 08:55:37 2020] input: PC Speaker as /devices/platform/pcspkr/input/input8
[Sun May 31 08:55:38 2020] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
[Sun May 31 08:55:38 2020] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
[Sun May 31 08:55:38 2020] RAPL PMU: hw unit of domain package 2^-16 Joules
[Sun May 31 08:55:38 2020] RAPL PMU: hw unit of domain pp1-gpu 2^-16 Joules
[Sun May 31 08:55:39 2020] sd 0:0:0:0: Attached scsi generic sg0 type 0
[Sun May 31 08:55:39 2020] sd 1:0:0:0: Attached scsi generic sg1 type 0
[Sun May 31 08:55:39 2020] sd 6:0:0:0: Attached scsi generic sg2 type 0
[Sun May 31 08:55:40 2020] iTCO_vendor_support: vendor-support=0
[Sun May 31 08:55:41 2020] samsung_laptop: detected SABI interface: SwSmi@
[Sun May 31 08:55:41 2020] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[Sun May 31 08:55:41 2020] iTCO_wdt: Found a Cougar Point TCO device (Version=2, TCOBASE=0x0460)
[Sun May 31 08:55:41 2020] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0)
[Sun May 31 08:55:42 2020] cfg80211: Loading compiled-in X.509 certificates for regulatory database
[Sun May 31 08:55:42 2020] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'
[Sun May 31 08:55:42 2020] Error: Driver 'pcspkr' is already registered, aborting...
[Sun May 31 08:55:42 2020] usb 3-1.5: USB disconnect, device number 3
[Sun May 31 08:55:43 2020] cryptd: max_cpu_qlen set to 1000
[Sun May 31 08:55:44 2020] cfg80211: loaded regulatory.db is malformed or signature is missing/invalid
[Sun May 31 08:55:44 2020] AVX version of gcm_enc/dec engaged.
[Sun May 31 08:55:44 2020] AES CTR mode by8 optimization enabled
[Sun May 31 08:55:45 2020] alg: No test for fips(ansi_cprng) (fips_ansi_cprng)
[Sun May 31 08:55:45 2020] Intel(R) Wireless WiFi driver for Linux
[Sun May 31 08:55:45 2020] Copyright(c) 2003- 2015 Intel Corporation
[Sun May 31 08:55:45 2020] iwlwifi 0000:01:00.0: can't disable ASPM; OS doesn't have ASPM control
[Sun May 31 08:55:46 2020] iwlwifi 0000:01:00.0: loaded firmware version 18.168.6.1 6000g2b-6.ucode op_mode iwldvm
[Sun May 31 08:55:46 2020] iwlwifi 0000:01:00.0: Direct firmware load for iwl-debug-yoyo.bin failed with error -2
[Sun May 31 08:55:46 2020] mc: Linux media interface: v0.10
[Sun May 31 08:55:47 2020] i915 0000:00:02.0: vgaarb: deactivate vga console
[Sun May 31 08:55:47 2020] Console: switching to colour dummy device 80x25
[Sun May 31 08:55:47 2020] [drm] Supports vblank timestamp caching Rev 2 (21.10.2013).
[Sun May 31 08:55:47 2020] i915 0000:00:02.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=io+mem
[Sun May 31 08:55:47 2020] [drm] Initialized i915 1.6.0 20200313 for 0000:00:02.0 on minor 0
[Sun May 31 08:55:47 2020] ACPI: Video Device [GFX0] (multi-head: yes  rom: no  post: no)
[Sun May 31 08:55:47 2020] input: Video Bus as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/LNXVIDEO:00/input/input9
[Sun May 31 08:55:47 2020] snd_hda_intel 0000:00:1b.0: bound 0000:00:02.0 (ops i915_audio_component_bind_ops [i915])
[Sun May 31 08:55:47 2020] fbcon: i915drmfb (fb0) is primary device
[Sun May 31 08:55:47 2020] videodev: Linux video capture interface: v2.00
[Sun May 31 08:55:47 2020] Bluetooth: Core ver 2.22
[Sun May 31 08:55:47 2020] NET: Registered protocol family 31
[Sun May 31 08:55:47 2020] Bluetooth: HCI device and connection manager initialized
[Sun May 31 08:55:47 2020] Bluetooth: HCI socket layer initialized
[Sun May 31 08:55:47 2020] Bluetooth: L2CAP socket layer initialized
[Sun May 31 08:55:47 2020] Bluetooth: SCO socket layer initialized
[Sun May 31 08:55:48 2020] Console: switching to colour frame buffer device 170x48
[Sun May 31 08:55:48 2020] i915 0000:00:02.0: fb0: i915drmfb frame buffer device
[Sun May 31 08:55:48 2020] iwlwifi 0000:01:00.0: CONFIG_IWLWIFI_DEBUG disabled
[Sun May 31 08:55:48 2020] iwlwifi 0000:01:00.0: CONFIG_IWLWIFI_DEBUGFS disabled
[Sun May 31 08:55:48 2020] iwlwifi 0000:01:00.0: CONFIG_IWLWIFI_DEVICE_TRACING disabled
[Sun May 31 08:55:48 2020] iwlwifi 0000:01:00.0: Detected Intel(R) Centrino(R) Advanced-N 6230 AGN, REV=0xB0
[Sun May 31 08:55:48 2020] ieee80211 phy0: Selected rate control algorithm 'iwl-agn-rs'
[Sun May 31 08:55:48 2020] zram: Added device: zram0
[Sun May 31 08:55:48 2020] zram0: detected capacity change from 0 to 1647824896
[Sun May 31 08:55:48 2020] uvcvideo: Found UVC 1.00 device WebCam SC-13HDL11431N (2232:1018)
[Sun May 31 08:55:48 2020] uvcvideo 1-1.4:1.0: Entity type for entity Extension 3 was not initialized!
[Sun May 31 08:55:48 2020] uvcvideo 1-1.4:1.0: Entity type for entity Processing 2 was not initialized!
[Sun May 31 08:55:48 2020] uvcvideo 1-1.4:1.0: Entity type for entity Camera 1 was not initialized!
[Sun May 31 08:55:48 2020] input: WebCam SC-13HDL11431N: WebCam S as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.4/1-1.4:1.0/input/input10
[Sun May 31 08:55:48 2020] usbcore: registered new interface driver uvcvideo
[Sun May 31 08:55:48 2020] USB Video Class driver (1.1.1)
[Sun May 31 08:55:49 2020] iwlwifi 0000:01:00.0 wlp1s0: renamed from wlan0
[Sun May 31 08:55:49 2020] usbcore: registered new interface driver btusb
[Sun May 31 08:55:50 2020] snd_hda_codec_realtek hdaudioC0D0: autoconfig for ALC269VC: line_outs=1 (0x14/0x0/0x0/0x0/0x0) type:speaker
[Sun May 31 08:55:50 2020] snd_hda_codec_realtek hdaudioC0D0:    speaker_outs=0 (0x0/0x0/0x0/0x0/0x0)
[Sun May 31 08:55:50 2020] snd_hda_codec_realtek hdaudioC0D0:    hp_outs=1 (0x15/0x0/0x0/0x0/0x0)
[Sun May 31 08:55:50 2020] snd_hda_codec_realtek hdaudioC0D0:    mono: mono_out=0x0
[Sun May 31 08:55:50 2020] snd_hda_codec_realtek hdaudioC0D0:    inputs:
[Sun May 31 08:55:50 2020] snd_hda_codec_realtek hdaudioC0D0:      Internal Mic=0x19
[Sun May 31 08:55:50 2020] snd_hda_codec_realtek hdaudioC0D0:      Mic=0x18
[Sun May 31 08:55:50 2020] Adding 1609200k swap on /dev/zram0.  Priority:100 extents:1 across:1609200k SSFS
[Sun May 31 08:55:50 2020] input: HDA Intel PCH Mic as /devices/pci0000:00/0000:00:1b.0/sound/card0/input11
[Sun May 31 08:55:50 2020] input: HDA Intel PCH Headphone as /devices/pci0000:00/0000:00:1b.0/sound/card0/input12
[Sun May 31 08:55:50 2020] input: HDA Intel PCH HDMI/DP,pcm=3 as /devices/pci0000:00/0000:00:1b.0/sound/card0/input13
[Sun May 31 08:55:51 2020] intel_rapl_common: Found RAPL domain package
[Sun May 31 08:55:51 2020] intel_rapl_common: Found RAPL domain core
[Sun May 31 08:55:51 2020] intel_rapl_common: Found RAPL domain uncore
[Sun May 31 08:55:51 2020] intel_rapl_common: RAPL package-0 domain package locked by BIOS
[Sun May 31 08:55:57 2020] kauditd_printk_skb: 14 callbacks suppressed
[Sun May 31 08:55:57 2020] audit: type=1400 audit(1590908158.101:26): apparmor="DENIED" operation="capable" profile="/usr/sbin/cups-browsed" pid=803 comm="cups-browsed" capability=23  capname="sys_nice"
[Sun May 31 08:55:59 2020] RTL8211E Gigabit Ethernet r8169-200:00: attached PHY driver [RTL8211E Gigabit Ethernet] (mii_bus:phy_addr=r8169-200:00, irq=IGNORE)
[Sun May 31 08:55:59 2020] r8169 0000:02:00.0 enp2s0: Link is Down
[Sun May 31 08:55:59 2020] iwlwifi 0000:01:00.0: Radio type=0x1-0x2-0x0
[Sun May 31 08:55:59 2020] iwlwifi 0000:01:00.0: Radio type=0x1-0x2-0x0
[Sun May 31 08:55:59 2020] iwlwifi 0000:01:00.0: Radio type=0x1-0x2-0x0
[Sun May 31 08:56:00 2020] iwlwifi 0000:01:00.0: Radio type=0x1-0x2-0x0
[Sun May 31 08:56:15 2020] fuse: init (API version 7.31)
[Sun May 31 08:56:26 2020] Bluetooth: BNEP (Ethernet Emulation) ver 1.3
[Sun May 31 08:56:26 2020] Bluetooth: BNEP filters: protocol multicast
[Sun May 31 08:56:26 2020] Bluetooth: BNEP socket layer initialized
[Sun May 31 08:56:41 2020] iwlwifi 0000:01:00.0: Radio type=0x1-0x2-0x0
[Sun May 31 08:56:42 2020] iwlwifi 0000:01:00.0: Radio type=0x1-0x2-0x0
[Sun May 31 08:56:42 2020] iwlwifi 0000:01:00.0: Radio type=0x1-0x2-0x0
[Sun May 31 08:56:42 2020] iwlwifi 0000:01:00.0: Radio type=0x1-0x2-0x0
[Sun May 31 08:57:37 2020] iwlwifi 0000:01:00.0: Radio type=0x1-0x2-0x0
[Sun May 31 08:57:38 2020] iwlwifi 0000:01:00.0: Radio type=0x1-0x2-0x0
[Sun May 31 08:57:41 2020] wlp1s0: authenticate with f6:f5:24:2e:54:f5
[Sun May 31 08:57:41 2020] wlp1s0: send auth to f6:f5:24:2e:54:f5 (try 1/3)
[Sun May 31 08:57:41 2020] wlp1s0: authenticated
[Sun May 31 08:57:41 2020] wlp1s0: associate with f6:f5:24:2e:54:f5 (try 1/3)
[Sun May 31 08:57:41 2020] wlp1s0: RX AssocResp from f6:f5:24:2e:54:f5 (capab=0x431 status=0 aid=1)
[Sun May 31 08:57:41 2020] wlp1s0: associated
[Sun May 31 08:57:41 2020] IPv6: ADDRCONF(NETDEV_CHANGE): wlp1s0: link becomes ready
#37 lore raw
Quoted 121 lines · Sedat Dilek
Quoted 16 lines · Jens Axboe
Quoted 5 lines · Sedat Dilek

Here are the numbers with your patchset:

# cat systemd-analyze-time_5.7.0-rc7-4-amd64-clang_2nd-try.txt
Startup finished in 7.229s (kernel) + 1min 18.304s (userspace) = 1min 25.534s
graphical.target reached after 1min 18.286s in userspace

Can you see if this makes a difference?

include/linux/blk_types.h +0 -0
index c296463c15eb..ccb895f911b1 100644

include/linux/blk_types.h enum req_flag_bits { · line 380

Quoted 9 lines
include/linux/blk_types.h +1 -2
@@ -374,8 +374,7 @@ enum req_flag_bits {
 #define REQ_INTEGRITY          (1ULL << __REQ_INTEGRITY)
 #define REQ_FUA                        (1ULL << __REQ_FUA)
 #define REQ_PREFLUSH           (1ULL << __REQ_PREFLUSH)
-#define REQ_RAHEAD             \
-       ((1ULL << __REQ_RAHEAD) | (1ULL << __REQ_NOWAIT))
+#define REQ_RAHEAD             (1ULL << __REQ_RAHEAD)
 #define REQ_BACKGROUND         (1ULL << __REQ_BACKGROUND)
 #define REQ_NOWAIT             (1ULL << __REQ_NOWAIT)
 #define REQ_CGROUP_PUNT                (1ULL << __REQ_CGROUP_PUNT)

Looks good!

With your patch I now get...

# cat systemd-analyze-time_5.7.0-rc7-6-amd64-clang.txt
Startup finished in 6.199s (kernel) + 45.143s (userspace) = 51.343s
graphical.target reached after 45.123s in userspace
# cat systemd-analyze-blame_5.7.0-rc7-6-amd64-clang.txt
25.029s udisks2.service
24.582s accounts-daemon.service
19.257s dev-sdc2.device
18.016s polkit.service
17.857s avahi-daemon.service
17.730s NetworkManager.service
17.433s rtkit-daemon.service
16.558s switcheroo-control.service
16.547s wpa_supplicant.service
16.538s systemd-logind.service
16.078s smartmontools.service
14.982s fwupd-refresh.service
14.580s NetworkManager-wait-online.service
13.630s zramswap.service
11.286s fwupd.service
 8.153s rsyslog.service
 6.858s gpm.service
 6.835s e2scrub_reap.service
 6.449s ModemManager.service
 6.439s networking.service
 5.881s packagekit.service
 3.696s systemd-udevd.service
 3.322s apparmor.service
 3.277s exim4.service
 2.910s alsa-restore.service
 1.611s systemd-tmpfiles-setup.service
 1.540s bluetooth.service
 1.448s systemd-journal-flush.service
 1.353s keyboard-setup.service
 1.322s atd.service
 1.239s systemd-modules-load.service
 1.216s binfmt-support.service
 1.060s [email protected]
  994ms systemd-journald.service
  983ms upower.service
  937ms systemd-sysusers.service
  914ms ifupdown-wait-online.service
  904ms pppd-dns.service
  710ms systemd-udev-trigger.service
  666ms dev-hugepages.mount
  650ms dev-mqueue.mount
  649ms sys-kernel-debug.mount
  647ms sys-kernel-tracing.mount
  607ms console-setup.service
  590ms systemd-tmpfiles-setup-dev.service
  570ms systemd-timesyncd.service
  508ms systemd-random-seed.service
  461ms systemd-backlight@backlight:intel_backlight.service
  433ms [email protected]
  422ms systemd-remount-fs.service
  365ms systemd-sysctl.service
  279ms kmod-static-nodes.service
  246ms proc-sys-fs-binfmt_misc.mount
  202ms systemd-rfkill.service
  130ms systemd-user-sessions.service
  104ms systemd-update-utmp.service
   25ms [email protected]
   14ms systemd-update-utmp-runlevel.service
    6ms sys-fs-fuse-connections.mount
    4ms ifupdown-pre.service
# cat systemd-analyze-critical-chain_5.7.0-rc7-6-amd64-clang.txt
The time when unit became active or started is printed after the "@" character.
The time the unit took to start is printed after the "+" character.

graphical.target @45.123s

└─multi-user.target @45.122s
  └─exim4.service @41.842s +3.277s
    └─network-online.target @41.840s
      └─NetworkManager-wait-online.service @27.259s +14.580s
        └─NetworkManager.service @9.522s +17.730s
          └─dbus.service @9.514s
            └─basic.target @9.328s
              └─sockets.target @9.327s
                └─dbus.socket @9.327s
                  └─sysinit.target @9.202s
└─systemd-backlight@backlight:intel_backlight.service @21.927s +461ms
                      └─system-systemd\x2dbacklight.slice @21.925s
                        └─system.slice @2.529s
                          └─-.slice @2.529s

Will you send a separate patch on this?

Quoted 8 lines

Feel free to add:

My kernel-config and dmesg-output are attached.

Thanks Jens!

2nd-try (reboot into system with activated WLAN before startup)...

# systemd-analyze --no-pager time
Startup finished in 6.044s (kernel) + 41.370s (userspace) = 47.414s
graphical.target reached after 40.431s in userspace
# systemd-analyze --no-pager blame | head -20
24.674s udisks2.service
24.348s accounts-daemon.service
19.504s dev-sdc2.device
18.677s polkit.service
18.283s avahi-daemon.service
18.231s NetworkManager.service
17.918s rtkit-daemon.service
16.948s switcheroo-control.service
16.932s wpa_supplicant.service
16.928s systemd-logind.service
15.335s smartmontools.service
14.063s zramswap.service
11.507s NetworkManager-wait-online.service
11.279s rsyslog.service
 7.490s gpm.service
 6.556s packagekit.service
 6.506s networking.service
 6.446s e2scrub_reap.service
 5.404s ModemManager.service
 3.329s systemd-udevd.service
# systemd-analyze critical-chain
The time when unit became active or started is printed after the "@" character.
The time the unit took to start is printed after the "+" character.

graphical.target @40.431s

└─multi-user.target @40.431s
  └─exim4.service @38.726s +1.701s
    └─network-online.target @38.723s
      └─NetworkManager-wait-online.service @27.215s +11.507s
        └─NetworkManager.service @8.978s +18.231s
          └─dbus.service @8.971s
            └─basic.target @8.862s
              └─sockets.target @8.861s
                └─dbus.socket @8.861s
                  └─sysinit.target @8.723s
└─systemd-backlight@backlight:intel_backlight.service @20.555s +812ms
                      └─system-systemd\x2dbacklight.slice @19.665s
                        └─system.slice @2.473s
                          └─-.slice @2.473s

Nice!

- Sedat -

#38 lore raw

Hi Jens,

with Linux v5.7 final I switched to linux-block.git/for-next and reverted...

"block: read-ahead submission should imply no-wait as well"

...and see no boot-slowdowns.

Regards,
- Sedat -

author maintainer
#39 lore raw
Quoted 7 lines · Sedat Dilek

Hi Jens,

with Linux v5.7 final I switched to linux-block.git/for-next and reverted...

"block: read-ahead submission should imply no-wait as well"

...and see no boot-slowdowns.

Can you try with these patches applied instead? Or pull my async-readahead branch from the same location.

Signature · 1 line
Jens Axboe

From 297f4d794780f7f55180fb0de6692bd1a1d81c58 Mon Sep 17 00:00:00 2001
From: Jens Axboe <[email protected]>
Date: Sun, 31 May 2020 21:31:08 -0600
Subject: [PATCH 6/6] Revert "block: read-ahead submission should imply no-wait
as well"

This reverts commit 381000ebbf4fed96c206571a04511c0667e38e18.

---
 include/linux/blk_types.h | 3 +--
 1 file changed, 1 insertion(+), 2 deletions(-)
include/linux/blk_types.h +1 -2
index c296463c15eb..ccb895f911b1 100644
@@ -374,8 +374,7 @@ enum req_flag_bits {
 #define REQ_INTEGRITY		(1ULL << __REQ_INTEGRITY)
 #define REQ_FUA			(1ULL << __REQ_FUA)
 #define REQ_PREFLUSH		(1ULL << __REQ_PREFLUSH)
-#define REQ_RAHEAD		\
-	((1ULL << __REQ_RAHEAD) | (1ULL << __REQ_NOWAIT))
+#define REQ_RAHEAD		(1ULL << __REQ_RAHEAD)
 #define REQ_BACKGROUND		(1ULL << __REQ_BACKGROUND)
 #define REQ_NOWAIT		(1ULL << __REQ_NOWAIT)
 #define REQ_CGROUP_PUNT		(1ULL << __REQ_CGROUP_PUNT)
Signature · 1 line
2.26.2

From ffbf3c623a4835c388296d52d82ee7abe75535cf Mon Sep 17 00:00:00 2001
From: Jens Axboe <[email protected]>
Date: Sun, 31 May 2020 20:53:26 -0600
Subject: [PATCH 5/6] fs: make mpage_readpages() take a struct kiocb argument

The callers already have it, so just pass it in. Have mpage_readpages() set REQ_NOWAIT, if IOCB_NOWAIT is set in the iocb.

---
 fs/block_dev.c        |  2 +-
 fs/exfat/inode.c      |  2 +-
 fs/ext2/inode.c       |  2 +-
 fs/fat/inode.c        |  2 +-
 fs/gfs2/aops.c        |  2 +-
 fs/hpfs/file.c        |  2 +-
 fs/isofs/inode.c      |  2 +-
 fs/jfs/inode.c        |  2 +-
 fs/mpage.c            | 17 +++++++++++++----
 fs/nilfs2/inode.c     |  2 +-
 fs/ocfs2/aops.c       |  2 +-
 fs/omfs/file.c        |  2 +-
 fs/qnx6/inode.c       |  2 +-
 fs/reiserfs/inode.c   |  2 +-
 fs/udf/inode.c        |  2 +-
 include/linux/mpage.h |  5 +++--
 16 files changed, 30 insertions(+), 20 deletions(-)
fs/block_dev.c +1 -1
index 87a540b42fa7..bbc1bd8078d6 100644
@@ -617,7 +617,7 @@ static int blkdev_readpage(struct file * file, struct page * page)
 static int blkdev_readpages(struct kiocb *kiocb, struct address_space *mapping,
 			struct list_head *pages, unsigned nr_pages)
 {
-	return mpage_readpages(mapping, pages, nr_pages, blkdev_get_block);
+	return mpage_readpages(mapping, kiocb, pages, nr_pages, blkdev_get_block);
 }
 
 static int blkdev_write_begin(struct file *file, struct address_space *mapping,
fs/exfat/inode.c +1 -1
index 9905307dfba2..a7757edf5534 100644
@@ -375,7 +375,7 @@ static int exfat_readpage(struct file *file, struct page *page)
 static int exfat_readpages(struct kiocb *kiocb, struct address_space *mapping,
 		struct list_head *pages, unsigned int nr_pages)
 {
-	return mpage_readpages(mapping, pages, nr_pages, exfat_get_block);
+	return mpage_readpages(mapping, kiocb, pages, nr_pages, exfat_get_block);
 }
 
 static int exfat_writepage(struct page *page, struct writeback_control *wbc)
fs/ext2/inode.c +1 -1
index 3843900d6251..706fc2628a3a 100644
@@ -881,7 +881,7 @@ static int
 ext2_readpages(struct kiocb *kiocb, struct address_space *mapping,
 		struct list_head *pages, unsigned nr_pages)
 {
-	return mpage_readpages(mapping, pages, nr_pages, ext2_get_block);
+	return mpage_readpages(mapping, kiocb, pages, nr_pages, ext2_get_block);
 }
 
 static int
fs/fat/inode.c +1 -1
index ab9dfcbf1bd3..3c47485d7f83 100644
@@ -213,7 +213,7 @@ static int fat_readpage(struct file *file, struct page *page)
 static int fat_readpages(struct kiocb *kiocb, struct address_space *mapping,
 			 struct list_head *pages, unsigned nr_pages)
 {
-	return mpage_readpages(mapping, pages, nr_pages, fat_get_block);
+	return mpage_readpages(mapping, kiocb, pages, nr_pages, fat_get_block);
 }
 
 static void fat_write_failed(struct address_space *mapping, loff_t to)
fs/gfs2/aops.c +1 -1
index 37d18f82e5a1..3e26ca463ca3 100644
@@ -608,7 +608,7 @@ static int gfs2_readpages(struct kiocb *kiocb, struct address_space *mapping,
 	if (unlikely(ret))
 		goto out_uninit;
 	if (!gfs2_is_stuffed(ip))
-		ret = mpage_readpages(mapping, pages, nr_pages, gfs2_block_map);
+		ret = mpage_readpages(mapping, kiocb, pages, nr_pages, gfs2_block_map);
 	gfs2_glock_dq(&gh);
 out_uninit:
 	gfs2_holder_uninit(&gh);
fs/hpfs/file.c +1 -1
index 5b9c537d011c..21df02964219 100644
@@ -128,7 +128,7 @@ static int hpfs_writepage(struct page *page, struct writeback_control *wbc)
 static int hpfs_readpages(struct kiocb *kiocb, struct address_space *mapping,
 			  struct list_head *pages, unsigned nr_pages)
 {
-	return mpage_readpages(mapping, pages, nr_pages, hpfs_get_block);
+	return mpage_readpages(mapping, kiocb, pages, nr_pages, hpfs_get_block);
 }
 
 static int hpfs_writepages(struct address_space *mapping,
fs/isofs/inode.c +1 -1
index 071da59b7266..060e8dfbe1a2 100644
@@ -1186,7 +1186,7 @@ static int isofs_readpage(struct file *file, struct page *page)
 static int isofs_readpages(struct kiocb *kiocb, struct address_space *mapping,
 			struct list_head *pages, unsigned nr_pages)
 {
-	return mpage_readpages(mapping, pages, nr_pages, isofs_get_block);
+	return mpage_readpages(mapping, kiocb, pages, nr_pages, isofs_get_block);
 }
 
 static sector_t _isofs_bmap(struct address_space *mapping, sector_t block)
fs/jfs/inode.c +1 -1
index 503e2e5cb79d..569e4f4123dd 100644
@@ -299,7 +299,7 @@ static int jfs_readpage(struct file *file, struct page *page)
 static int jfs_readpages(struct kiocb *kiocb, struct address_space *mapping,
 		struct list_head *pages, unsigned nr_pages)
 {
-	return mpage_readpages(mapping, pages, nr_pages, jfs_get_block);
+	return mpage_readpages(mapping, kiocb, pages, nr_pages, jfs_get_block);
 }
 
 static void jfs_write_failed(struct address_space *mapping, loff_t to)
fs/mpage.c +13 -4
index ccba3c4c4479..9148d1eae8ff 100644
@@ -138,6 +138,7 @@ struct mpage_readpage_args {
 	struct page *page;
 	unsigned int nr_pages;
 	bool is_readahead;
+	bool nowait;
 	sector_t last_block_in_bio;
 	struct buffer_head map_bh;
 	unsigned long first_logical_block;
@@ -182,6 +183,8 @@ static struct bio *do_mpage_readpage(struct mpage_readpage_args *args)
 		op_flags = 0;
 		gfp = mapping_gfp_constraint(page->mapping, GFP_KERNEL);
 	}
+	if (args->nowait)
+		op_flags |= REQ_NOWAIT;
 
 	if (page_has_buffers(page))
 		goto confused;
@@ -382,12 +385,14 @@ static struct bio *do_mpage_readpage(struct mpage_readpage_args *args)
  * This all causes the disk requests to be issued in the correct order.
  */
 int
-mpage_readpages(struct address_space *mapping, struct list_head *pages,
-				unsigned nr_pages, get_block_t get_block)
+mpage_readpages(struct address_space *mapping, struct kiocb *kiocb,
+		struct list_head *pages, unsigned nr_pages,
+		get_block_t get_block)
 {
 	struct mpage_readpage_args args = {
 		.get_block = get_block,
 		.is_readahead = true,
+		.nowait = kiocb->ki_flags & IOCB_NOWAIT,
 	};
 	unsigned page_idx;
 
@@ -406,8 +411,12 @@ mpage_readpages(struct address_space *mapping, struct list_head *pages,
 		put_page(page);
 	}
 	BUG_ON(!list_empty(pages));
-	if (args.bio)
-		mpage_bio_submit(REQ_OP_READ, REQ_RAHEAD, args.bio);
+	if (args.bio) {
+		int op = REQ_RAHEAD;
+		if (args.nowait)
+			op |= REQ_NOWAIT;
+		mpage_bio_submit(REQ_OP_READ, op, args.bio);
+	}
 	return 0;
 }
 EXPORT_SYMBOL(mpage_readpages);
fs/nilfs2/inode.c +1 -1
index a981c9404fbc..3cbc8b7284a4 100644
@@ -156,7 +156,7 @@ static int nilfs_readpage(struct file *file, struct page *page)
 static int nilfs_readpages(struct kiocb *kiocb, struct address_space *mapping,
 			   struct list_head *pages, unsigned int nr_pages)
 {
-	return mpage_readpages(mapping, pages, nr_pages, nilfs_get_block);
+	return mpage_readpages(mapping, kiocb, pages, nr_pages, nilfs_get_block);
 }
 
 static int nilfs_writepages(struct address_space *mapping,
fs/ocfs2/aops.c +1 -1
index aa54b0d0d4a1..50ed84f53b20 100644
@@ -388,7 +388,7 @@ static int ocfs2_readpages(struct kiocb *kiocb, struct address_space *mapping,
 	if (start >= i_size_read(inode))
 		goto out_unlock;
 
-	err = mpage_readpages(mapping, pages, nr_pages, ocfs2_get_block);
+	err = mpage_readpages(mapping, kiocb, pages, nr_pages, ocfs2_get_block);
 
 out_unlock:
 	up_read(&oi->ip_alloc_sem);
fs/omfs/file.c +1 -1
index 195bb390ba24..384e8c99fc4f 100644
@@ -292,7 +292,7 @@ static int omfs_readpage(struct file *file, struct page *page)
 static int omfs_readpages(struct kiocb *kiocb, struct address_space *mapping,
 		struct list_head *pages, unsigned nr_pages)
 {
-	return mpage_readpages(mapping, pages, nr_pages, omfs_get_block);
+	return mpage_readpages(mapping, kiocb, pages, nr_pages, omfs_get_block);
 }
 
 static int omfs_writepage(struct page *page, struct writeback_control *wbc)
fs/qnx6/inode.c +1 -1
index c964fd63d4a5..ef603636ca2d 100644
@@ -102,7 +102,7 @@ static int qnx6_readpage(struct file *file, struct page *page)
 static int qnx6_readpages(struct kiocb *kiocb, struct address_space *mapping,
 		   struct list_head *pages, unsigned nr_pages)
 {
-	return mpage_readpages(mapping, pages, nr_pages, qnx6_get_block);
+	return mpage_readpages(mapping, kiocb, pages, nr_pages, qnx6_get_block);
 }
 
 /*
fs/reiserfs/inode.c +1 -1
index 01d5ccdaa5b4..50c93c526557 100644
@@ -1164,7 +1164,7 @@ static int
 reiserfs_readpages(struct kiocb *kiocb, struct address_space *mapping,
 		   struct list_head *pages, unsigned nr_pages)
 {
-	return mpage_readpages(mapping, pages, nr_pages, reiserfs_get_block);
+	return mpage_readpages(mapping, kiocb, pages, nr_pages, reiserfs_get_block);
 }
 
 /*
fs/udf/inode.c +1 -1
index c541ca95f851..c45d4da5e707 100644
@@ -198,7 +198,7 @@ static int udf_readpage(struct file *file, struct page *page)
 static int udf_readpages(struct kiocb *kiocb, struct address_space *mapping,
 			struct list_head *pages, unsigned nr_pages)
 {
-	return mpage_readpages(mapping, pages, nr_pages, udf_get_block);
+	return mpage_readpages(mapping, kiocb, pages, nr_pages, udf_get_block);
 }
 
 static int udf_write_begin(struct file *file, struct address_space *mapping,
include/linux/mpage.h +3 -2
index 001f1fcf9836..f708c7a442ae 100644
@@ -14,8 +14,9 @@
 
 struct writeback_control;
 
-int mpage_readpages(struct address_space *mapping, struct list_head *pages,
-				unsigned nr_pages, get_block_t get_block);
+int mpage_readpages(struct address_space *mapping, struct kiocb *kiocb,
+			struct list_head *pages, unsigned nr_pages,
+			get_block_t get_block);
 int mpage_readpage(struct page *page, get_block_t get_block);
 int mpage_writepages(struct address_space *mapping,
 		struct writeback_control *wbc, get_block_t get_block);
Signature · 1 line
2.26.2

From d17311d78f5d5ffa73cbdd5cbf925d0a4188807d Mon Sep 17 00:00:00 2001
From: Jens Axboe <[email protected]>
Date: Sun, 31 May 2020 20:44:18 -0600
Subject: [PATCH 4/6] iomap: set REQ_NOWAIT on bio if IOCB_NOWAIT is set in
kiocb

---
 fs/iomap/buffered-io.c | 9 +++++++--
 fs/xfs/xfs_aops.c      | 3 ++-
 fs/zonefs/super.c      | 5 +++--
 include/linux/iomap.h  | 5 +++--
 4 files changed, 15 insertions(+), 7 deletions(-)
fs/iomap/buffered-io.c +7 -2
index 89e21961d1ad..4558b455182f 100644
@@ -215,6 +215,7 @@ struct iomap_readpage_ctx {
 	struct page		*cur_page;
 	bool			cur_page_in_bio;
 	bool			is_readahead;
+	bool			nowait;
 	struct bio		*bio;
 	struct list_head	*pages;
 };
@@ -321,6 +322,8 @@ iomap_readpage_actor(struct inode *inode, loff_t pos, loff_t length, void *data,
 		ctx->bio->bi_opf = REQ_OP_READ;
 		if (ctx->is_readahead)
 			ctx->bio->bi_opf |= REQ_RAHEAD;
+		if (ctx->nowait)
+			ctx->bio->bi_opf |= REQ_NOWAIT;
 		ctx->bio->bi_iter.bi_sector = sector;
 		bio_set_dev(ctx->bio, iomap->bdev);
 		ctx->bio->bi_end_io = iomap_read_end_io;
@@ -432,12 +435,14 @@ iomap_readpages_actor(struct inode *inode, loff_t pos, loff_t length,
 }
 
 int
-iomap_readpages(struct address_space *mapping, struct list_head *pages,
-		unsigned nr_pages, const struct iomap_ops *ops)
+iomap_readpages(struct address_space *mapping, struct kiocb *kiocb,
+		struct list_head *pages, unsigned nr_pages,
+		const struct iomap_ops *ops)
 {
 	struct iomap_readpage_ctx ctx = {
 		.pages		= pages,
 		.is_readahead	= true,
+		.nowait		= kiocb->ki_flags & IOCB_NOWAIT,
 	};
 	loff_t pos = page_offset(list_entry(pages->prev, struct page, lru));
 	loff_t last = page_offset(list_entry(pages->next, struct page, lru));
fs/xfs/xfs_aops.c +2 -1
index bff9a2374ece..bc8ea7cd1441 100644
@@ -628,7 +628,8 @@ xfs_vm_readpages(
 	struct list_head	*pages,
 	unsigned		nr_pages)
 {
-	return iomap_readpages(mapping, pages, nr_pages, &xfs_read_iomap_ops);
+	return iomap_readpages(mapping, kiocb, pages, nr_pages,
+				&xfs_read_iomap_ops);
 }
 
 static int
fs/zonefs/super.c +3 -2
index 11812841a5fa..06b4f621a14a 100644
@@ -79,10 +79,11 @@ static int zonefs_readpage(struct file *unused, struct page *page)
 	return iomap_readpage(page, &zonefs_iomap_ops);
 }
 
-static int zonefs_readpages(struct kiocb *unused, struct address_space *mapping,
+static int zonefs_readpages(struct kiocb *kiocb, struct address_space *mapping,
 			    struct list_head *pages, unsigned int nr_pages)
 {
-	return iomap_readpages(mapping, pages, nr_pages, &zonefs_iomap_ops);
+	return iomap_readpages(mapping, kiocb, pages, nr_pages,
+				&zonefs_iomap_ops);
 }
 
 /*
include/linux/iomap.h +3 -2
index 8b09463dae0d..6b5d802d7227 100644
@@ -155,8 +155,9 @@ loff_t iomap_apply(struct inode *inode, loff_t pos, loff_t length,
 ssize_t iomap_file_buffered_write(struct kiocb *iocb, struct iov_iter *from,
 		const struct iomap_ops *ops);
 int iomap_readpage(struct page *page, const struct iomap_ops *ops);
-int iomap_readpages(struct address_space *mapping, struct list_head *pages,
-		unsigned nr_pages, const struct iomap_ops *ops);
+int iomap_readpages(struct address_space *mapping, struct kiocb *kiocb,
+		struct list_head *pages, unsigned nr_pages,
+		const struct iomap_ops *ops);
 int iomap_set_page_dirty(struct page *page);
 int iomap_is_partially_uptodate(struct page *page, unsigned long from,
 		unsigned long count);
Signature · 1 line
2.26.2

From 3a7284cf4ef7c762ac21ffb9644c04346f0f4a59 Mon Sep 17 00:00:00 2001
From: Jens Axboe <[email protected]>
Date: Sun, 31 May 2020 20:26:34 -0600
Subject: [PATCH 3/6] mm: make generic_file_buffered_read() use iocb read-ahead
helpers

---
 mm/filemap.c | 11 +++++------
 1 file changed, 5 insertions(+), 6 deletions(-)
mm/filemap.c +5 -6
index abdd3f32c932..eea40b5894fb 100644
@@ -2053,17 +2053,16 @@ static ssize_t generic_file_buffered_read(struct kiocb *iocb,
 
 		page = find_get_page(mapping, index);
 		if (!page) {
-			page_cache_sync_readahead(mapping,
-					ra, filp,
-					index, last_index - index);
+			__page_cache_sync_readahead(mapping, ra, iocb, index,
+							last_index - index);
 			page = find_get_page(mapping, index);
 			if (unlikely(page == NULL))
 				goto no_cached_page;
 		}
 		if (PageReadahead(page)) {
-			page_cache_async_readahead(mapping,
-					ra, filp, page,
-					index, last_index - index);
+			__page_cache_async_readahead(mapping, ra, iocb, page,
+							index,
+							last_index - index);
 		}
 		if (!PageUptodate(page)) {
 			/*
Signature · 1 line
2.26.2

From 72dfe63dd44979d182be741d2446d364546c5df5 Mon Sep 17 00:00:00 2001
From: Jens Axboe <[email protected]>
Date: Sun, 31 May 2020 20:25:04 -0600
Subject: [PATCH 2/6] mm: provide read-ahead helpers that take a struct kiocb

---
 mm/internal.h  | 10 +++++++
 mm/readahead.c | 79 +++++++++++++++++++++++++++++++-------------------
 2 files changed, 59 insertions(+), 30 deletions(-)
mm/internal.h +10 -0
index 1d051cbadf1a..c486d675af41 100644
@@ -63,6 +63,16 @@ static inline unsigned long ra_submit(struct file_ra_state *ra,
 					ra->start, ra->size, ra->async_size);
 }
 
+void __page_cache_sync_readahead(struct address_space *mapping,
+				 struct file_ra_state *ra,
+				 struct kiocb *kiocb,  pgoff_t offset,
+				 unsigned long req_size);
+
+void __page_cache_async_readahead(struct address_space *mapping,
+				  struct file_ra_state *ra, struct kiocb *kiocb,
+				  struct page *page, pgoff_t offset,
+				  unsigned long req_size);
+
 /**
  * page_evictable - test whether a page is evictable
  * @page: the page to test
mm/readahead.c +49 -30

107 lines not on this page · raw message

Signature · 1 line
2.26.2

From 707258c22fea35a5915ff0373231fb07a8a1c9eb Mon Sep 17 00:00:00 2001
From: Jens Axboe <[email protected]>
Date: Sun, 31 May 2020 19:35:33 -0600
Subject: [PATCH 1/6] fs: make aops->readpages() take kiocb argument

Instead of passing in a file, pass in the kiocb instead. This still provides access to the file through kiocb->ki_filp, but also provides access to more information related to the IO. We'll be using that to ensure that ->readpages() understands IOCB_NOWAIT.

---
 fs/9p/vfs_addr.c       |  3 ++-
 fs/afs/file.c          |  8 ++++----
 fs/block_dev.c         |  2 +-
 fs/btrfs/inode.c       |  2 +-
 fs/ceph/addr.c         |  3 ++-
 fs/cifs/file.c         |  3 ++-
 fs/erofs/data.c        |  2 +-
 fs/erofs/zdata.c       |  2 +-
 fs/exfat/inode.c       |  2 +-
 fs/ext2/inode.c        |  2 +-
 fs/ext4/inode.c        |  2 +-
 fs/f2fs/data.c         |  2 +-
 fs/fat/inode.c         |  2 +-
 fs/fuse/file.c         |  6 +++---
 fs/gfs2/aops.c         |  2 +-
 fs/hpfs/file.c         |  2 +-
 fs/isofs/inode.c       |  2 +-
 fs/jfs/inode.c         |  2 +-
 fs/nfs/read.c          |  3 ++-
 fs/nilfs2/inode.c      |  2 +-
 fs/ocfs2/aops.c        |  2 +-
 fs/omfs/file.c         |  2 +-
 fs/qnx6/inode.c        |  2 +-
 fs/reiserfs/inode.c    |  2 +-
 fs/udf/inode.c         |  2 +-
 fs/xfs/xfs_aops.c      |  2 +-
 fs/zonefs/super.c      |  2 +-
 include/linux/fs.h     |  2 +-
 include/linux/mm.h     |  6 +++---
 include/linux/nfs_fs.h |  2 +-
 mm/fadvise.c           |  7 +++++--
 mm/filemap.c           |  3 ++-
 mm/internal.h          |  6 +++---
 mm/readahead.c         | 39 ++++++++++++++++++++++-----------------
 34 files changed, 73 insertions(+), 60 deletions(-)
fs/9p/vfs_addr.c +2 -1
index cce9ace651a2..f2980829bb9f 100644
@@ -95,9 +95,10 @@ static int v9fs_vfs_readpage(struct file *filp, struct page *page)
  *
  */
 
-static int v9fs_vfs_readpages(struct file *filp, struct address_space *mapping,
+static int v9fs_vfs_readpages(struct kiocb *kiocb, struct address_space *mapping,
 			     struct list_head *pages, unsigned nr_pages)
 {
+	struct file *filp = kiocb->ki_filp;
 	int ret = 0;
 	struct inode *inode;
 
fs/afs/file.c +4 -4
index 8415733f7bc1..447b6524c2e9 100644
@@ -22,7 +22,7 @@ static void afs_invalidatepage(struct page *page, unsigned int offset,
 			       unsigned int length);
 static int afs_releasepage(struct page *page, gfp_t gfp_flags);
 
-static int afs_readpages(struct file *filp, struct address_space *mapping,
+static int afs_readpages(struct kiocb *kiocb, struct address_space *mapping,
 			 struct list_head *pages, unsigned nr_pages);
 
 const struct file_operations afs_file_operations = {
@@ -538,10 +538,10 @@ static int afs_readpages_one(struct file *file, struct address_space *mapping,
 /*
  * read a set of pages
  */
-static int afs_readpages(struct file *file, struct address_space *mapping,
+static int afs_readpages(struct kiocb *kiocb, struct address_space *mapping,
 			 struct list_head *pages, unsigned nr_pages)
 {
-	struct key *key = afs_file_key(file);
+	struct key *key = afs_file_key(kiocb->ki_filp);
 	struct afs_vnode *vnode;
 	int ret = 0;
 
@@ -589,7 +589,7 @@ static int afs_readpages(struct file *file, struct address_space *mapping,
 	}
 
 	while (!list_empty(pages)) {
-		ret = afs_readpages_one(file, mapping, pages);
+		ret = afs_readpages_one(kiocb->ki_filp, mapping, pages);
 		if (ret < 0)
 			break;
 	}
fs/block_dev.c +1 -1
index 980cfce01c9a..87a540b42fa7 100644
@@ -614,7 +614,7 @@ static int blkdev_readpage(struct file * file, struct page * page)
 	return block_read_full_page(page, blkdev_get_block);
 }
 
-static int blkdev_readpages(struct file *file, struct address_space *mapping,
+static int blkdev_readpages(struct kiocb *kiocb, struct address_space *mapping,
 			struct list_head *pages, unsigned nr_pages)
 {
 	return mpage_readpages(mapping, pages, nr_pages, blkdev_get_block);
fs/btrfs/inode.c +1 -1
index 320d1062068d..1569d29fdfc4 100644
@@ -8294,7 +8294,7 @@ static int btrfs_writepages(struct address_space *mapping,
 }
 
 static int
-btrfs_readpages(struct file *file, struct address_space *mapping,
+btrfs_readpages(struct kiocb *kiocb, struct address_space *mapping,
 		struct list_head *pages, unsigned nr_pages)
 {
 	return extent_readpages(mapping, pages, nr_pages);
fs/ceph/addr.c +2 -1
index 6f4678d98df7..687714a29e89 100644
@@ -477,9 +477,10 @@ static int start_read(struct inode *inode, struct ceph_rw_context *rw_ctx,
  * Read multiple pages.  Leave pages we don't read + unlock in page_list;
  * the caller (VM) cleans them up.
  */
-static int ceph_readpages(struct file *file, struct address_space *mapping,
+static int ceph_readpages(struct kiocb *kiocb, struct address_space *mapping,
 			  struct list_head *page_list, unsigned nr_pages)
 {
+	struct file *file = kiocb->ki_filp;
 	struct inode *inode = file_inode(file);
 	struct ceph_fs_client *fsc = ceph_inode_to_client(inode);
 	struct ceph_file_info *fi = file->private_data;
fs/cifs/file.c +2 -1
index 75ddce8ef456..5eec4f40811c 100644
@@ -4344,11 +4344,12 @@ readpages_get_pages(struct address_space *mapping, struct list_head *page_list,
 	return rc;
 }
 
-static int cifs_readpages(struct file *file, struct address_space *mapping,
+static int cifs_readpages(struct kiocb *kiocb, struct address_space *mapping,
 	struct list_head *page_list, unsigned num_pages)
 {
 	int rc;
 	struct list_head tmplist;
+	struct file *file = kiocb->ki_filp;
 	struct cifsFileInfo *open_file = file->private_data;
 	struct cifs_sb_info *cifs_sb = CIFS_FILE_SB(file);
 	struct TCP_Server_Info *server;
fs/erofs/data.c +1 -1
index fc3a8d8064f8..853b905a15c4 100644
@@ -280,7 +280,7 @@ static int erofs_raw_access_readpage(struct file *file, struct page *page)
 	return 0;
 }
 
-static int erofs_raw_access_readpages(struct file *filp,
+static int erofs_raw_access_readpages(struct kiocb *kiocb,
 				      struct address_space *mapping,
 				      struct list_head *pages,
 				      unsigned int nr_pages)
fs/erofs/zdata.c +1 -1
index c4b6c9aa87ec..bc8c02b088ce 100644
@@ -1305,7 +1305,7 @@ static bool should_decompress_synchronously(struct erofs_sb_info *sbi,
 	return nr <= sbi->max_sync_decompress_pages;
 }
 
-static int z_erofs_readpages(struct file *filp, struct address_space *mapping,
+static int z_erofs_readpages(struct kiocb *kiocb, struct address_space *mapping,
 			     struct list_head *pages, unsigned int nr_pages)
 {
 	struct inode *const inode = mapping->host;
fs/exfat/inode.c +1 -1
index 06887492f54b..9905307dfba2 100644
@@ -372,7 +372,7 @@ static int exfat_readpage(struct file *file, struct page *page)
 	return mpage_readpage(page, exfat_get_block);
 }
 
-static int exfat_readpages(struct file *file, struct address_space *mapping,
+static int exfat_readpages(struct kiocb *kiocb, struct address_space *mapping,
 		struct list_head *pages, unsigned int nr_pages)
 {
 	return mpage_readpages(mapping, pages, nr_pages, exfat_get_block);
fs/ext2/inode.c +1 -1
index c885cf7d724b..3843900d6251 100644
@@ -878,7 +878,7 @@ static int ext2_readpage(struct file *file, struct page *page)
 }
 
 static int
-ext2_readpages(struct file *file, struct address_space *mapping,
+ext2_readpages(struct kiocb *kiocb, struct address_space *mapping,
 		struct list_head *pages, unsigned nr_pages)
 {
 	return mpage_readpages(mapping, pages, nr_pages, ext2_get_block);
fs/ext4/inode.c +1 -1
index 2a4aae6acdcb..6297804d1ac2 100644
@@ -3231,7 +3231,7 @@ static int ext4_readpage(struct file *file, struct page *page)
 }
 
 static int
-ext4_readpages(struct file *file, struct address_space *mapping,
+ext4_readpages(struct kiocb *kiocb, struct address_space *mapping,
 		struct list_head *pages, unsigned nr_pages)
 {
 	struct inode *inode = mapping->host;
fs/f2fs/data.c +1 -1
index cdf2f626bea7..7330aa1e2e39 100644
@@ -2304,7 +2304,7 @@ static int f2fs_read_data_page(struct file *file, struct page *page)
 	return ret;
 }
 
-static int f2fs_read_data_pages(struct file *file,
+static int f2fs_read_data_pages(struct kiocb *kiocb,
 			struct address_space *mapping,
 			struct list_head *pages, unsigned nr_pages)
 {
fs/fat/inode.c +1 -1
index 71946da84388..ab9dfcbf1bd3 100644
@@ -210,7 +210,7 @@ static int fat_readpage(struct file *file, struct page *page)
 	return mpage_readpage(page, fat_get_block);
 }
 
-static int fat_readpages(struct file *file, struct address_space *mapping,
+static int fat_readpages(struct kiocb *kiocb, struct address_space *mapping,
 			 struct list_head *pages, unsigned nr_pages)
 {
 	return mpage_readpages(mapping, pages, nr_pages, fat_get_block);
fs/fuse/file.c +3 -3
index 9d67b830fb7a..ebd40681ee94 100644
@@ -962,7 +962,7 @@ static int fuse_readpages_fill(void *_data, struct page *page)
 	return 0;
 }
 
-static int fuse_readpages(struct file *file, struct address_space *mapping,
+static int fuse_readpages(struct kiocb *kiocb, struct address_space *mapping,
 			  struct list_head *pages, unsigned nr_pages)
 {
 	struct inode *inode = mapping->host;
@@ -974,7 +974,7 @@ static int fuse_readpages(struct file *file, struct address_space *mapping,
 	if (is_bad_inode(inode))
 		goto out;
 
-	data.file = file;
+	data.file = kiocb->ki_filp;
 	data.inode = inode;
 	data.nr_pages = nr_pages;
 	data.max_pages = min_t(unsigned int, nr_pages, fc->max_pages);
@@ -987,7 +987,7 @@ static int fuse_readpages(struct file *file, struct address_space *mapping,
 	err = read_cache_pages(mapping, pages, fuse_readpages_fill, &data);
 	if (!err) {
 		if (data.ia->ap.num_pages)
-			fuse_send_readpages(data.ia, file);
+			fuse_send_readpages(data.ia, kiocb->ki_filp);
 		else
 			fuse_io_free(data.ia);
 	}
fs/gfs2/aops.c +1 -1
index 786c1ce8f030..37d18f82e5a1 100644
@@ -594,7 +594,7 @@ int gfs2_internal_read(struct gfs2_inode *ip, char *buf, loff_t *pos,
  * 4. gfs2_block_map() is relied upon to set BH_Boundary in the right places.
  */
 
-static int gfs2_readpages(struct file *file, struct address_space *mapping,
+static int gfs2_readpages(struct kiocb *kiocb, struct address_space *mapping,
 			  struct list_head *pages, unsigned nr_pages)
 {
 	struct inode *inode = mapping->host;
fs/hpfs/file.c +1 -1
index b36abf9cb345..5b9c537d011c 100644
@@ -125,7 +125,7 @@ static int hpfs_writepage(struct page *page, struct writeback_control *wbc)
 	return block_write_full_page(page, hpfs_get_block, wbc);
 }
 
-static int hpfs_readpages(struct file *file, struct address_space *mapping,
+static int hpfs_readpages(struct kiocb *kiocb, struct address_space *mapping,
 			  struct list_head *pages, unsigned nr_pages)
 {
 	return mpage_readpages(mapping, pages, nr_pages, hpfs_get_block);
fs/isofs/inode.c +1 -1
index 276107cdaaf1..071da59b7266 100644
@@ -1183,7 +1183,7 @@ static int isofs_readpage(struct file *file, struct page *page)
 	return mpage_readpage(page, isofs_get_block);
 }
 
-static int isofs_readpages(struct file *file, struct address_space *mapping,
+static int isofs_readpages(struct kiocb *kiocb, struct address_space *mapping,
 			struct list_head *pages, unsigned nr_pages)
 {
 	return mpage_readpages(mapping, pages, nr_pages, isofs_get_block);
fs/jfs/inode.c +1 -1
index 9486afcdac76..503e2e5cb79d 100644
@@ -296,7 +296,7 @@ static int jfs_readpage(struct file *file, struct page *page)
 	return mpage_readpage(page, jfs_get_block);
 }
 
-static int jfs_readpages(struct file *file, struct address_space *mapping,
+static int jfs_readpages(struct kiocb *kiocb, struct address_space *mapping,
 		struct list_head *pages, unsigned nr_pages)
 {
 	return mpage_readpages(mapping, pages, nr_pages, jfs_get_block);
fs/nfs/read.c +2 -1
index 13b22e898116..4719f6b67b5c 100644
@@ -402,9 +402,10 @@ readpage_async_filler(void *data, struct page *page)
 	return error;
 }
 
-int nfs_readpages(struct file *filp, struct address_space *mapping,
+int nfs_readpages(struct kiocb *kiocb, struct address_space *mapping,
 		struct list_head *pages, unsigned nr_pages)
 {
+	struct file *filp = kiocb->ki_filp;
 	struct nfs_pageio_descriptor pgio;
 	struct nfs_pgio_mirror *pgm;
 	struct nfs_readdesc desc = {
fs/nilfs2/inode.c +1 -1
index 671085512e0f..a981c9404fbc 100644
@@ -153,7 +153,7 @@ static int nilfs_readpage(struct file *file, struct page *page)
  * @pages - the pages to be read
  * @nr_pages - number of pages to be read
  */
-static int nilfs_readpages(struct file *file, struct address_space *mapping,
+static int nilfs_readpages(struct kiocb *kiocb, struct address_space *mapping,
 			   struct list_head *pages, unsigned int nr_pages)
 {
 	return mpage_readpages(mapping, pages, nr_pages, nilfs_get_block);
fs/ocfs2/aops.c +1 -1
index 3a67a6518ddf..aa54b0d0d4a1 100644
@@ -350,7 +350,7 @@ static int ocfs2_readpage(struct file *file, struct page *page)
  * grow out to a tree. If need be, detecting boundary extents could
  * trivially be added in a future version of ocfs2_get_block().
  */
-static int ocfs2_readpages(struct file *filp, struct address_space *mapping,
+static int ocfs2_readpages(struct kiocb *kiocb, struct address_space *mapping,
 			   struct list_head *pages, unsigned nr_pages)
 {
 	int ret, err = -EIO;
fs/omfs/file.c +1 -1
index d640b9388238..195bb390ba24 100644
@@ -289,7 +289,7 @@ static int omfs_readpage(struct file *file, struct page *page)
 	return block_read_full_page(page, omfs_get_block);
 }
 
-static int omfs_readpages(struct file *file, struct address_space *mapping,
+static int omfs_readpages(struct kiocb *kiocb, struct address_space *mapping,
 		struct list_head *pages, unsigned nr_pages)
 {
 	return mpage_readpages(mapping, pages, nr_pages, omfs_get_block);
fs/qnx6/inode.c +1 -1
index 345db56c98fd..c964fd63d4a5 100644
@@ -99,7 +99,7 @@ static int qnx6_readpage(struct file *file, struct page *page)
 	return mpage_readpage(page, qnx6_get_block);
 }
 
-static int qnx6_readpages(struct file *file, struct address_space *mapping,
+static int qnx6_readpages(struct kiocb *kiocb, struct address_space *mapping,
 		   struct list_head *pages, unsigned nr_pages)
 {
 	return mpage_readpages(mapping, pages, nr_pages, qnx6_get_block);
fs/reiserfs/inode.c +1 -1
index 6419e6dacc39..01d5ccdaa5b4 100644
@@ -1161,7 +1161,7 @@ int reiserfs_get_block(struct inode *inode, sector_t block,
 }
 
 static int
-reiserfs_readpages(struct file *file, struct address_space *mapping,
+reiserfs_readpages(struct kiocb *kiocb, struct address_space *mapping,
 		   struct list_head *pages, unsigned nr_pages)
 {
 	return mpage_readpages(mapping, pages, nr_pages, reiserfs_get_block);
fs/udf/inode.c +1 -1
index e875bc5668ee..c541ca95f851 100644
@@ -195,7 +195,7 @@ static int udf_readpage(struct file *file, struct page *page)
 	return mpage_readpage(page, udf_get_block);
 }
 
-static int udf_readpages(struct file *file, struct address_space *mapping,
+static int udf_readpages(struct kiocb *kiocb, struct address_space *mapping,
 			struct list_head *pages, unsigned nr_pages)
 {
 	return mpage_readpages(mapping, pages, nr_pages, udf_get_block);
fs/xfs/xfs_aops.c +1 -1
index 9d9cebf18726..bff9a2374ece 100644
@@ -623,7 +623,7 @@ xfs_vm_readpage(
 
 STATIC int
 xfs_vm_readpages(
-	struct file		*unused,
+	struct kiocb		*kiocb,
 	struct address_space	*mapping,
 	struct list_head	*pages,
 	unsigned		nr_pages)
fs/zonefs/super.c +1 -1
index 25afcf55aa41..11812841a5fa 100644
@@ -79,7 +79,7 @@ static int zonefs_readpage(struct file *unused, struct page *page)
 	return iomap_readpage(page, &zonefs_iomap_ops);
 }
 
-static int zonefs_readpages(struct file *unused, struct address_space *mapping,
+static int zonefs_readpages(struct kiocb *unused, struct address_space *mapping,
 			    struct list_head *pages, unsigned int nr_pages)
 {
 	return iomap_readpages(mapping, pages, nr_pages, &zonefs_iomap_ops);
include/linux/fs.h +1 -1
index 5ffc6d236b01..cb5adf72041b 100644
@@ -381,7 +381,7 @@ struct address_space_operations {
 	 * Reads in the requested pages. Unlike ->readpage(), this is
 	 * PURELY used for read-ahead!.
 	 */
-	int (*readpages)(struct file *filp, struct address_space *mapping,
+	int (*readpages)(struct kiocb *kiocb, struct address_space *mapping,
 			struct list_head *pages, unsigned nr_pages);
 
 	int (*write_begin)(struct file *, struct address_space *mapping,
include/linux/mm.h +3 -3
index 5a323422d783..7c805a32fdc7 100644
@@ -2604,18 +2604,18 @@ void task_dirty_inc(struct task_struct *tsk);
 /* readahead.c */
 #define VM_READAHEAD_PAGES	(SZ_128K / PAGE_SIZE)
 
-int force_page_cache_readahead(struct address_space *mapping, struct file *filp,
+int force_page_cache_readahead(struct address_space *mapping, struct kiocb *kiocb,
 			pgoff_t offset, unsigned long nr_to_read);
 
 void page_cache_sync_readahead(struct address_space *mapping,
 			       struct file_ra_state *ra,
-			       struct file *filp,
+			       struct file *file,
 			       pgoff_t offset,
 			       unsigned long size);
 
 void page_cache_async_readahead(struct address_space *mapping,
 				struct file_ra_state *ra,
-				struct file *filp,
+				struct file *file,
 				struct page *pg,
 				pgoff_t offset,
 				unsigned long size);
include/linux/nfs_fs.h +1 -1
index 73eda45f1cfd..27c62a08f499 100644
@@ -550,7 +550,7 @@ nfs_have_writebacks(struct inode *inode)
  * linux/fs/nfs/read.c
  */
 extern int  nfs_readpage(struct file *, struct page *);
-extern int  nfs_readpages(struct file *, struct address_space *,
+extern int  nfs_readpages(struct kiocb *, struct address_space *,
 		struct list_head *, unsigned);
 extern int  nfs_readpage_async(struct nfs_open_context *, struct inode *,
 			       struct page *);
mm/fadvise.c +5 -2
index 4f17c83db575..58654fd13486 100644
@@ -92,7 +92,9 @@ int generic_fadvise(struct file *file, loff_t offset, loff_t len, int advice)
 		file->f_mode &= ~FMODE_RANDOM;
 		spin_unlock(&file->f_lock);
 		break;
-	case POSIX_FADV_WILLNEED:
+	case POSIX_FADV_WILLNEED: {
+		struct kiocb kiocb = { .ki_filp = file, };
+
 		/* First and last PARTIAL page! */
 		start_index = offset >> PAGE_SHIFT;
 		end_index = endbyte >> PAGE_SHIFT;
@@ -106,8 +108,9 @@ int generic_fadvise(struct file *file, loff_t offset, loff_t len, int advice)
 		 * Ignore return value because fadvise() shall return
 		 * success even if filesystem can't retrieve a hint,
 		 */
-		force_page_cache_readahead(mapping, file, start_index, nrpages);
+		force_page_cache_readahead(mapping, &kiocb, start_index, nrpages);
 		break;
+		}
 	case POSIX_FADV_NOREUSE:
 		break;
 	case POSIX_FADV_DONTNEED:
mm/filemap.c +2 -1
index 18022de7dc33..abdd3f32c932 100644
@@ -2403,6 +2403,7 @@ static struct file *do_sync_mmap_readahead(struct vm_fault *vmf)
 	struct address_space *mapping = file->f_mapping;
 	struct file *fpin = NULL;
 	pgoff_t offset = vmf->pgoff;
+	struct kiocb kiocb = { .ki_filp = file, };
 
 	/* If we don't want any read-ahead, don't bother */
 	if (vmf->vma->vm_flags & VM_RAND_READ)
@@ -2435,7 +2436,7 @@ static struct file *do_sync_mmap_readahead(struct vm_fault *vmf)
 	ra->start = max_t(long, 0, offset - ra->ra_pages / 2);
 	ra->size = ra->ra_pages;
 	ra->async_size = ra->ra_pages / 4;
-	ra_submit(ra, mapping, file);
+	ra_submit(ra, mapping, &kiocb);
 	return fpin;
 }
 
mm/internal.h +3 -3
index b5634e78f01d..1d051cbadf1a 100644
@@ -50,16 +50,16 @@ void unmap_page_range(struct mmu_gather *tlb,
 			     struct zap_details *details);
 
 extern unsigned int __do_page_cache_readahead(struct address_space *mapping,
-		struct file *filp, pgoff_t offset, unsigned long nr_to_read,
+		struct kiocb *kiocb, pgoff_t offset, unsigned long nr_to_read,
 		unsigned long lookahead_size);
 
 /*
  * Submit IO for the read-ahead request in file_ra_state.
  */
 static inline unsigned long ra_submit(struct file_ra_state *ra,
-		struct address_space *mapping, struct file *filp)
+		struct address_space *mapping, struct kiocb *kiocb)
 {
-	return __do_page_cache_readahead(mapping, filp,
+	return __do_page_cache_readahead(mapping, kiocb,
 					ra->start, ra->size, ra->async_size);
 }
 
mm/readahead.c +22 -17
index 2fe72cd29b47..657206f6318d 100644
@@ -113,7 +113,7 @@ int read_cache_pages(struct address_space *mapping, struct list_head *pages,
 
 EXPORT_SYMBOL(read_cache_pages);
 
-static int read_pages(struct address_space *mapping, struct file *filp,
+static int read_pages(struct address_space *mapping, struct kiocb *kiocb,
 		struct list_head *pages, unsigned int nr_pages, gfp_t gfp)
 {
 	struct blk_plug plug;
@@ -123,7 +123,7 @@ static int read_pages(struct address_space *mapping, struct file *filp,
 	blk_start_plug(&plug);
 
 	if (mapping->a_ops->readpages) {
-		ret = mapping->a_ops->readpages(filp, mapping, pages, nr_pages);
+		ret = mapping->a_ops->readpages(kiocb, mapping, pages, nr_pages);
 		/* Clean up the remaining pages */
 		put_pages_list(pages);
 		goto out;
@@ -133,7 +133,7 @@ static int read_pages(struct address_space *mapping, struct file *filp,
 		struct page *page = lru_to_page(pages);
 		list_del(&page->lru);
 		if (!add_to_page_cache_lru(page, mapping, page->index, gfp))
-			mapping->a_ops->readpage(filp, page);
+			mapping->a_ops->readpage(kiocb->ki_filp, page);
 		put_page(page);
 	}
 	ret = 0;
@@ -153,7 +153,7 @@ static int read_pages(struct address_space *mapping, struct file *filp,
  * Returns the number of pages requested, or the maximum amount of I/O allowed.
  */
 unsigned int __do_page_cache_readahead(struct address_space *mapping,
-		struct file *filp, pgoff_t offset, unsigned long nr_to_read,
+		struct kiocb *kiocb, pgoff_t offset, unsigned long nr_to_read,
 		unsigned long lookahead_size)
 {
 	struct inode *inode = mapping->host;
@@ -187,7 +187,7 @@ unsigned int __do_page_cache_readahead(struct address_space *mapping,
 			 * batch.
 			 */
 			if (nr_pages)
-				read_pages(mapping, filp, &page_pool, nr_pages,
+				read_pages(mapping, kiocb, &page_pool, nr_pages,
 						gfp_mask);
 			nr_pages = 0;
 			continue;
@@ -209,7 +209,7 @@ unsigned int __do_page_cache_readahead(struct address_space *mapping,
 	 * will then handle the error.
 	 */
 	if (nr_pages)
-		read_pages(mapping, filp, &page_pool, nr_pages, gfp_mask);
+		read_pages(mapping, kiocb, &page_pool, nr_pages, gfp_mask);
 	BUG_ON(!list_empty(&page_pool));
 out:
 	return nr_pages;
@@ -219,11 +219,12 @@ unsigned int __do_page_cache_readahead(struct address_space *mapping,
  * Chunk the readahead into 2 megabyte units, so that we don't pin too much
  * memory at once.
  */
-int force_page_cache_readahead(struct address_space *mapping, struct file *filp,
-			       pgoff_t offset, unsigned long nr_to_read)
+int force_page_cache_readahead(struct address_space *mapping,
+			       struct kiocb *kiocb, pgoff_t offset,
+			       unsigned long nr_to_read)
 {
 	struct backing_dev_info *bdi = inode_to_bdi(mapping->host);
-	struct file_ra_state *ra = &filp->f_ra;
+	struct file_ra_state *ra = &kiocb->ki_filp->f_ra;
 	unsigned long max_pages;
 
 	if (unlikely(!mapping->a_ops->readpage && !mapping->a_ops->readpages))
@@ -240,7 +241,7 @@ int force_page_cache_readahead(struct address_space *mapping, struct file *filp,
 
 		if (this_chunk > nr_to_read)
 			this_chunk = nr_to_read;
-		__do_page_cache_readahead(mapping, filp, offset, this_chunk, 0);
+		__do_page_cache_readahead(mapping, kiocb, offset, this_chunk, 0);
 
 		offset += this_chunk;
 		nr_to_read -= this_chunk;
@@ -380,7 +381,7 @@ static int try_context_readahead(struct address_space *mapping,
  */
 static unsigned long
 ondemand_readahead(struct address_space *mapping,
-		   struct file_ra_state *ra, struct file *filp,
+		   struct file_ra_state *ra, struct kiocb *kiocb,
 		   bool hit_readahead_marker, pgoff_t offset,
 		   unsigned long req_size)
 {
@@ -464,7 +465,7 @@ ondemand_readahead(struct address_space *mapping,
 	 * standalone, small random read
 	 * Read as is, and do not pollute the readahead state.
 	 */
-	return __do_page_cache_readahead(mapping, filp, offset, req_size, 0);
+	return __do_page_cache_readahead(mapping, kiocb, offset, req_size, 0);
 
 initial_readahead:
 	ra->start = offset;
@@ -489,14 +490,14 @@ ondemand_readahead(struct address_space *mapping,
 		}
 	}
 
-	return ra_submit(ra, mapping, filp);
+	return ra_submit(ra, mapping, kiocb);
 }
 
 /**
  * page_cache_sync_readahead - generic file readahead
  * @mapping: address_space which holds the pagecache and I/O vectors
  * @ra: file_ra_state which holds the readahead state
- * @filp: passed on to ->readpage() and ->readpages()
+ * @kiocb: passed on to ->readpage() and ->readpages()
  * @offset: start offset into @mapping, in pagecache page-sized units
  * @req_size: hint: total size of the read which the caller is performing in
  *            pagecache pages
@@ -510,6 +511,8 @@ void page_cache_sync_readahead(struct address_space *mapping,
 			       struct file_ra_state *ra, struct file *filp,
 			       pgoff_t offset, unsigned long req_size)
 {
+	struct kiocb kiocb = { .ki_filp = filp, };
+
 	/* no read-ahead */
 	if (!ra->ra_pages)
 		return;
@@ -519,12 +522,12 @@ void page_cache_sync_readahead(struct address_space *mapping,
 
 	/* be dumb */
 	if (filp && (filp->f_mode & FMODE_RANDOM)) {
-		force_page_cache_readahead(mapping, filp, offset, req_size);
+		force_page_cache_readahead(mapping, &kiocb, offset, req_size);
 		return;
 	}
 
 	/* do read-ahead */
-	ondemand_readahead(mapping, ra, filp, false, offset, req_size);
+	ondemand_readahead(mapping, ra, &kiocb, false, offset, req_size);
 }
 EXPORT_SYMBOL_GPL(page_cache_sync_readahead);
 
@@ -549,6 +552,8 @@ page_cache_async_readahead(struct address_space *mapping,
 			   struct page *page, pgoff_t offset,
 			   unsigned long req_size)
 {
+	struct kiocb kiocb = { .ki_filp = filp, };
+
 	/* no read-ahead */
 	if (!ra->ra_pages)
 		return;
@@ -571,7 +576,7 @@ page_cache_async_readahead(struct address_space *mapping,
 		return;
 
 	/* do read-ahead */
-	ondemand_readahead(mapping, ra, filp, true, offset, req_size);
+	ondemand_readahead(mapping, ra, &kiocb, true, offset, req_size);
 }
 EXPORT_SYMBOL_GPL(page_cache_async_readahead);
 
Signature · 1 line
2.26.2
#40 lore raw
Quoted 4 lines · Jens Axboe
Quoted 2 lines · Sedat Dilek

Hi Jens,

Quoted 9 lines
Quoted 5 lines

with Linux v5.7 final I switched to linux-block.git/for-next and reverted...

"block: read-ahead submission should imply no-wait as well"

...and see no boot-slowdowns.

Can you try with these patches applied instead? Or pull my async-readahead branch from the same location.

Yes, I can do that.
I pulled from linux-block.git#async-readahead and will report later.

Any specific testing desired by you?

- Sedat -

author maintainer
#41 lore raw
Quoted 11 lines · Sedat Dilek
Quoted 10 lines · Jens Axboe
Quoted 7 lines · Sedat Dilek

Hi Jens,

with Linux v5.7 final I switched to linux-block.git/for-next and reverted...

"block: read-ahead submission should imply no-wait as well"

...and see no boot-slowdowns.

Quoted 8 lines
Quoted 3 lines

Can you try with these patches applied instead? Or pull my async-readahead branch from the same location.

Yes, I can do that.
I pulled from linux-block.git#async-readahead and will report later.

Any specific testing desired by you?

Just do your boot timing test and see if it works, thanks.

Signature · 1 line
Jens Axboe
author maintainer
#42 lore raw
Quoted 16 lines · Jens Axboe
Quoted 15 lines · Sedat Dilek
Quoted 13 lines · Jens Axboe
Quoted 7 lines · Sedat Dilek

Hi Jens,

with Linux v5.7 final I switched to linux-block.git/for-next and reverted...

"block: read-ahead submission should imply no-wait as well"

...and see no boot-slowdowns.

Can you try with these patches applied instead? Or pull my async-readahead branch from the same location.

Quoted 6 lines
Quoted 4 lines

Yes, I can do that.
I pulled from linux-block.git#async-readahead and will report later.

Any specific testing desired by you?

Just do your boot timing test and see if it works, thanks.

Actually, can you just re-test with the current async-buffered.6 branch? I think the major surgery should wait for 5.9, we can do this a bit easier without having to touch everything around us.

Signature · 1 line
Jens Axboe
#43 lore raw
Quoted 21 lines · Jens Axboe
Quoted 19 lines · Jens Axboe
Quoted 18 lines · Sedat Dilek
Quoted 4 lines · Jens Axboe
Quoted 2 lines · Sedat Dilek

Hi Jens,

Quoted 9 lines
Quoted 5 lines

with Linux v5.7 final I switched to linux-block.git/for-next and reverted...

"block: read-ahead submission should imply no-wait as well"

...and see no boot-slowdowns.

Can you try with these patches applied instead? Or pull my async-readahead branch from the same location.

Yes, I can do that.
I pulled from linux-block.git#async-readahead and will report later.

Quoted 8 lines
Quoted 3 lines
Quoted 1 line

Any specific testing desired by you?

Just do your boot timing test and see if it works, thanks.

Actually, can you just re-test with the current async-buffered.6 branch? I think the major surgery should wait for 5.9, we can do this a bit easier without having to touch everything around us.

With linux-block.git#async-readahead:

mycompiler -Wp,-MD,kernel/.sys.o.d -nostdinc -isystem
/home/dileks/src/llvm-toolchain/install/lib/clang/10.0.1rc1/include -I./arch/x86/include -I./arch/x86/include/generated -I./include -I./arch/x86/include/uapi -I./arch/x86/include/generated/uapi -I./include/uapi -I./include/generated/uapi -include ./include/linux/kconfig.h -include ./include/linux/compiler_types.h -D__KERNEL__ -Qunused-arguments -Wall -Wundef -Werror=strict-prototypes -Wno-trigraphs -fno-strict-aliasing -fno-common -fshort-wchar -fno-PIE -Werror=implicit-function-declaration -Werror=implicit-int -Wno-format-security -std=gnu89 -no-integrated-as -Werror=unknown-warning-option -mno-sse -mno-mmx -mno-sse2 -mno-3dnow -mno-avx -m64 -mno-80387 -mstack-alignment=8 -mtune=generic -mno-red-zone -mcmodel=kernel -Wno-sign-compare -fno-asynchronous-unwind-tables -mretpoline-external-thunk -fno-delete-null-pointer-checks -Wno-address-of-packed-member -O2 -Wframe-larger-than=2048 -fstack-protector-strong -Wno-format-invalid-specifier -Wno-gnu -mno-global-merge -Wno-unused-const-variable -g -gz=zlib -pg -mfentry -DCC_USING_FENTRY -Wdeclaration-after-statement -Wvla -Wno-pointer-sign -Wno-array-bounds -fno-strict-overflow -fno-merge-all-constants -fno-stack-check -Werror=date-time -Werror=incompatible-pointer-types -fmacro-prefix-map=./= -fcf-protection=none -Wno-initializer-overrides -Wno-format -Wno-sign-compare -Wno-format-zero-length -Wno-tautological-constant-out-of-range-compare -DKBUILD_MODFILE='"kernel/sys"' -DKBUILD_BASENAME='"sys"' -DKBUILD_MODNAME='"sys"' -c -o kernel/sys.o kernel/sys.c fs/9p/vfs_addr.c:112:4: error: use of undeclared identifier 'filp'

                        filp->private_data);
                        ^

1 error generated.
make[5]: *** [scripts/Makefile.build:267: fs/9p/vfs_addr.o] Error 1 make[4]: *** [scripts/Makefile.build:488: fs/9p] Error 2 make[3]: *** [Makefile:1735: fs] Error 2
make[3]: *** Waiting for unfinished jobs....

I guess block.git#async-buffered.6 needs the same revert of "block:
read-ahead submission should imply no-wait as well".

- Sedat -

author maintainer
#44 lore raw
Quoted 63 lines · Sedat Dilek
Quoted 21 lines · Jens Axboe
Quoted 19 lines · Jens Axboe
Quoted 18 lines · Sedat Dilek
Quoted 4 lines · Jens Axboe
Quoted 2 lines · Sedat Dilek

Hi Jens,

Quoted 9 lines
Quoted 5 lines

with Linux v5.7 final I switched to linux-block.git/for-next and reverted...

"block: read-ahead submission should imply no-wait as well"

...and see no boot-slowdowns.

Can you try with these patches applied instead? Or pull my async-readahead branch from the same location.

Yes, I can do that.
I pulled from linux-block.git#async-readahead and will report later.

Quoted 8 lines
Quoted 3 lines
Quoted 1 line

Any specific testing desired by you?

Just do your boot timing test and see if it works, thanks.

Actually, can you just re-test with the current async-buffered.6 branch? I think the major surgery should wait for 5.9, we can do this a bit easier without having to touch everything around us.

With linux-block.git#async-readahead:

mycompiler -Wp,-MD,kernel/.sys.o.d -nostdinc -isystem
/home/dileks/src/llvm-toolchain/install/lib/clang/10.0.1rc1/include

(quoted diff) +0 -3
-I./arch/x86/include -I./arch/x86/include/generated  -I./include
-I./arch/x86/include/uapi -I./arch/x86/include/generated/uapi
-I./include/uapi -I./include/generated/uapi -include

./include/linux/kconfig.h -include ./include/linux/compiler_types.h

(quoted diff) +0 -21
-D__KERNEL__ -Qunused-arguments -Wall -Wundef
-Werror=strict-prototypes -Wno-trigraphs -fno-strict-aliasing
-fno-common -fshort-wchar -fno-PIE
-Werror=implicit-function-declaration -Werror=implicit-int
-Wno-format-security -std=gnu89 -no-integrated-as
-Werror=unknown-warning-option -mno-sse -mno-mmx -mno-sse2 -mno-3dnow
-mno-avx -m64 -mno-80387 -mstack-alignment=8 -mtune=generic
-mno-red-zone -mcmodel=kernel -Wno-sign-compare
-fno-asynchronous-unwind-tables -mretpoline-external-thunk
-fno-delete-null-pointer-checks -Wno-address-of-packed-member -O2
-Wframe-larger-than=2048 -fstack-protector-strong
-Wno-format-invalid-specifier -Wno-gnu -mno-global-merge
-Wno-unused-const-variable -g -gz=zlib -pg -mfentry -DCC_USING_FENTRY
-Wdeclaration-after-statement -Wvla -Wno-pointer-sign
-Wno-array-bounds -fno-strict-overflow -fno-merge-all-constants
-fno-stack-check -Werror=date-time -Werror=incompatible-pointer-types
-fmacro-prefix-map=./= -fcf-protection=none -Wno-initializer-overrides
-Wno-format -Wno-sign-compare -Wno-format-zero-length
-Wno-tautological-constant-out-of-range-compare
-DKBUILD_MODFILE='"kernel/sys"' -DKBUILD_BASENAME='"sys"'
-DKBUILD_MODNAME='"sys"' -c -o kernel/sys.o kernel/sys.c

fs/9p/vfs_addr.c:112:4: error: use of undeclared identifier 'filp'

                        filp->private_data);
                        ^
Quoted 8 lines

1 error generated.
make[5]: *** [scripts/Makefile.build:267: fs/9p/vfs_addr.o] Error 1 make[4]: *** [scripts/Makefile.build:488: fs/9p] Error 2 make[3]: *** [Makefile:1735: fs] Error 2
make[3]: *** Waiting for unfinished jobs....

I guess block.git#async-buffered.6 needs the same revert of "block:
read-ahead submission should imply no-wait as well".

Sorry, forgot to push out the updated version. But as per previous email, I think that major work should wait. Just try the updated async-buffered.6 branch instead.

Signature · 1 line
Jens Axboe
#45 lore raw
Quoted 71 lines · Jens Axboe
Quoted 69 lines · Sedat Dilek
Quoted 21 lines · Jens Axboe
Quoted 19 lines · Jens Axboe
Quoted 18 lines · Sedat Dilek
Quoted 4 lines · Jens Axboe
Quoted 2 lines · Sedat Dilek

Hi Jens,

Quoted 9 lines
Quoted 5 lines

with Linux v5.7 final I switched to linux-block.git/for-next and reverted...

"block: read-ahead submission should imply no-wait as well"

...and see no boot-slowdowns.

Can you try with these patches applied instead? Or pull my async-readahead branch from the same location.

Yes, I can do that.
I pulled from linux-block.git#async-readahead and will report later.

Quoted 8 lines
Quoted 3 lines
Quoted 1 line

Any specific testing desired by you?

Just do your boot timing test and see if it works, thanks.

Actually, can you just re-test with the current async-buffered.6 branch? I think the major surgery should wait for 5.9, we can do this a bit easier without having to touch everything around us.

With linux-block.git#async-readahead:

mycompiler -Wp,-MD,kernel/.sys.o.d -nostdinc -isystem
/home/dileks/src/llvm-toolchain/install/lib/clang/10.0.1rc1/include

(quoted diff) +0 -3
-I./arch/x86/include -I./arch/x86/include/generated  -I./include
-I./arch/x86/include/uapi -I./arch/x86/include/generated/uapi
-I./include/uapi -I./include/generated/uapi -include

./include/linux/kconfig.h -include ./include/linux/compiler_types.h

(quoted diff) +0 -21
-D__KERNEL__ -Qunused-arguments -Wall -Wundef
-Werror=strict-prototypes -Wno-trigraphs -fno-strict-aliasing
-fno-common -fshort-wchar -fno-PIE
-Werror=implicit-function-declaration -Werror=implicit-int
-Wno-format-security -std=gnu89 -no-integrated-as
-Werror=unknown-warning-option -mno-sse -mno-mmx -mno-sse2 -mno-3dnow
-mno-avx -m64 -mno-80387 -mstack-alignment=8 -mtune=generic
-mno-red-zone -mcmodel=kernel -Wno-sign-compare
-fno-asynchronous-unwind-tables -mretpoline-external-thunk
-fno-delete-null-pointer-checks -Wno-address-of-packed-member -O2
-Wframe-larger-than=2048 -fstack-protector-strong
-Wno-format-invalid-specifier -Wno-gnu -mno-global-merge
-Wno-unused-const-variable -g -gz=zlib -pg -mfentry -DCC_USING_FENTRY
-Wdeclaration-after-statement -Wvla -Wno-pointer-sign
-Wno-array-bounds -fno-strict-overflow -fno-merge-all-constants
-fno-stack-check -Werror=date-time -Werror=incompatible-pointer-types
-fmacro-prefix-map=./= -fcf-protection=none -Wno-initializer-overrides
-Wno-format -Wno-sign-compare -Wno-format-zero-length
-Wno-tautological-constant-out-of-range-compare
-DKBUILD_MODFILE='"kernel/sys"' -DKBUILD_BASENAME='"sys"'
-DKBUILD_MODNAME='"sys"' -c -o kernel/sys.o kernel/sys.c

fs/9p/vfs_addr.c:112:4: error: use of undeclared identifier 'filp'

                        filp->private_data);
                        ^

1 error generated.
make[5]: *** [scripts/Makefile.build:267: fs/9p/vfs_addr.o] Error 1 make[4]: *** [scripts/Makefile.build:488: fs/9p] Error 2 make[3]: *** [Makefile:1735: fs] Error 2
make[3]: *** Waiting for unfinished jobs....

Quoted 7 lines
Quoted 2 lines

I guess block.git#async-buffered.6 needs the same revert of "block:
read-ahead submission should imply no-wait as well".

Sorry, forgot to push out the updated version. But as per previous email, I think that major work should wait. Just try the updated async-buffered.6 branch instead.

Hehe, I was looking at git.k.o URLs.

I just pulled from
<https://git.kernel.dk/cgit/linux-block/log/?h=async-buffered.6>.

- Sedat -

#46 lore raw
In reply to Jens Axboe
Quoted 78 lines · Jens Axboe
Quoted 63 lines · Sedat Dilek
Quoted 21 lines · Jens Axboe
Quoted 19 lines · Jens Axboe
Quoted 18 lines · Sedat Dilek
Quoted 4 lines · Jens Axboe
Quoted 2 lines · Sedat Dilek

Hi Jens,

Quoted 9 lines
Quoted 5 lines

with Linux v5.7 final I switched to linux-block.git/for-next and reverted...

"block: read-ahead submission should imply no-wait as well"

...and see no boot-slowdowns.

Can you try with these patches applied instead? Or pull my async-readahead branch from the same location.

Yes, I can do that.
I pulled from linux-block.git#async-readahead and will report later.

Quoted 8 lines
Quoted 3 lines
Quoted 1 line

Any specific testing desired by you?

Just do your boot timing test and see if it works, thanks.

Actually, can you just re-test with the current async-buffered.6 branch? I think the major surgery should wait for 5.9, we can do this a bit easier without having to touch everything around us.

With linux-block.git#async-readahead:

mycompiler -Wp,-MD,kernel/.sys.o.d -nostdinc -isystem
/home/dileks/src/llvm-toolchain/install/lib/clang/10.0.1rc1/include

(quoted diff) +0 -3
-I./arch/x86/include -I./arch/x86/include/generated  -I./include
-I./arch/x86/include/uapi -I./arch/x86/include/generated/uapi
-I./include/uapi -I./include/generated/uapi -include

./include/linux/kconfig.h -include ./include/linux/compiler_types.h

(quoted diff) +0 -21
-D__KERNEL__ -Qunused-arguments -Wall -Wundef
-Werror=strict-prototypes -Wno-trigraphs -fno-strict-aliasing
-fno-common -fshort-wchar -fno-PIE
-Werror=implicit-function-declaration -Werror=implicit-int
-Wno-format-security -std=gnu89 -no-integrated-as
-Werror=unknown-warning-option -mno-sse -mno-mmx -mno-sse2 -mno-3dnow
-mno-avx -m64 -mno-80387 -mstack-alignment=8 -mtune=generic
-mno-red-zone -mcmodel=kernel -Wno-sign-compare
-fno-asynchronous-unwind-tables -mretpoline-external-thunk
-fno-delete-null-pointer-checks -Wno-address-of-packed-member -O2
-Wframe-larger-than=2048 -fstack-protector-strong
-Wno-format-invalid-specifier -Wno-gnu -mno-global-merge
-Wno-unused-const-variable -g -gz=zlib -pg -mfentry -DCC_USING_FENTRY
-Wdeclaration-after-statement -Wvla -Wno-pointer-sign
-Wno-array-bounds -fno-strict-overflow -fno-merge-all-constants
-fno-stack-check -Werror=date-time -Werror=incompatible-pointer-types
-fmacro-prefix-map=./= -fcf-protection=none -Wno-initializer-overrides
-Wno-format -Wno-sign-compare -Wno-format-zero-length
-Wno-tautological-constant-out-of-range-compare
-DKBUILD_MODFILE='"kernel/sys"' -DKBUILD_BASENAME='"sys"'
-DKBUILD_MODNAME='"sys"' -c -o kernel/sys.o kernel/sys.c

fs/9p/vfs_addr.c:112:4: error: use of undeclared identifier 'filp'

                        filp->private_data);
                        ^
Quoted 8 lines

1 error generated.
make[5]: *** [scripts/Makefile.build:267: fs/9p/vfs_addr.o] Error 1 make[4]: *** [scripts/Makefile.build:488: fs/9p] Error 2 make[3]: *** [Makefile:1735: fs] Error 2
make[3]: *** Waiting for unfinished jobs....

I guess block.git#async-buffered.6 needs the same revert of "block:
read-ahead submission should imply no-wait as well".

Sorry, forgot to push out the updated version. But as per previous email, I think that major work should wait. Just try the updated async-buffered.6 branch instead.

Quoted 3 lines

--
Jens Axboe

Looks good.

$ cat systemd-analyze_time_5.7.0-2-amd64-clang.txt
Startup finished in 6.054s (kernel) + 42.626s (userspace) = 48.680s
graphical.target reached after 42.605s in userspace
$ cat systemd-analyze_blame_5.7.0-2-amd64-clang.txt
25.777s udisks2.service
24.527s accounts-daemon.service
18.228s polkit.service
17.593s avahi-daemon.service
17.554s NetworkManager.service
17.526s rtkit-daemon.service
17.417s dev-sdc2.device
17.200s switcheroo-control.service
17.186s wpa_supplicant.service
17.174s systemd-logind.service
15.714s smartmontools.service
14.255s zramswap.service
13.495s NetworkManager-wait-online.service
11.092s rsyslog.service
 8.900s networking.service
 7.817s gpm.service
 6.571s ModemManager.service
 6.403s packagekit.service
 5.701s e2scrub_reap.service
 3.714s alsa-restore.service
 3.509s systemd-udevd.service
 3.286s apparmor.service
 3.028s atd.service
 2.361s exim4.service
 1.532s systemd-tmpfiles-setup.service
 1.213s systemd-journal-flush.service
 1.163s keyboard-setup.service
 1.011s bluetooth.service
 1.008s binfmt-support.service
  995ms systemd-modules-load.service
  987ms pppd-dns.service
  919ms systemd-journald.service
  875ms upower.service
  856ms systemd-sysusers.service
  750ms systemd-udev-trigger.service
  728ms dev-hugepages.mount
  725ms dev-mqueue.mount
  724ms sys-kernel-debug.mount
  723ms sys-kernel-tracing.mount
  648ms [email protected]
  640ms ifupdown-wait-online.service
  609ms systemd-timesyncd.service
  579ms systemd-tmpfiles-setup-dev.service
  521ms systemd-backlight@backlight:intel_backlight.service
  477ms systemd-remount-fs.service
  454ms systemd-sysctl.service
  441ms systemd-random-seed.service
  389ms console-setup.service
  306ms systemd-rfkill.service
  266ms kmod-static-nodes.service
  244ms [email protected]
  150ms proc-sys-fs-binfmt_misc.mount
  131ms systemd-update-utmp.service
   98ms systemd-user-sessions.service
   26ms [email protected]
   15ms systemd-update-utmp-runlevel.service
    6ms sys-fs-fuse-connections.mount
    3ms ifupdown-pre.service
$ cat systemd-analyze_critical-chain_5.7.0-2-amd64-clang.txt
The time when unit became active or started is printed after the "@" character.
The time the unit took to start is printed after the "+" character.

graphical.target @42.605s

└─multi-user.target @42.604s
  └─exim4.service @40.240s +2.361s
    └─network-online.target @40.237s
      └─NetworkManager-wait-online.service @26.740s +13.495s
        └─NetworkManager.service @9.177s +17.554s
          └─dbus.service @9.170s
            └─basic.target @9.081s
              └─sockets.target @9.080s
                └─dbus.socket @9.080s
                  └─sysinit.target @8.814s
└─systemd-backlight@backlight:intel_backlight.service @23.030s +521ms
                      └─system-systemd\x2dbacklight.slice @22.251s
                        └─system.slice @2.429s
                          └─-.slice @2.429s

Hope this helps you.

- Sedat -

#47 lore raw
In reply to Jens Axboe

Hi,

I was trying to benchmark the benefits of this for the io_uring using postgres I am working on. The initial results where quite promising (reducing cpu usage significantly, to lower than non-uring sync io). But unfortunately trying another workload triggered both panics and before that seemingly returned wrong data.

I first saw that problem with b360d424ce02, which was linux-block/async-buffered.6 at the time. After hitting the issue, I updated to the current linux-block/async-buffered.6, but the problem persists.

The workload that triggers the bug within a few seconds is postgres doing a parallel sequential scan of a large table (and aggregating the data, but that shouldn't matter). In the triggering case that boils down to 9 processes sequentially reading a number of 1GB files (we chunk tables internally into smaller files). Each process will read a 512kB chunk of the file on its own, and then claim the next 512kB from a shared memory location. Most of the IO will be READV requests, reading 16 * 8kB into postgres' buffer pool (which may or may not be neighboring 8kB pages).

The io submissions in this case will all be done to the same io_uring, targeting MAP_HUGETLB | MAP_SHARED | MAP_ANONYMOUS memory. The data is on xfs.

The benchmark starts with dropping caches, which helpfully is visible in dmesg... That takes a few seconds, so the actual buffered io_uring load starts soon after.

[  125.526092] tee (7775): drop_caches: 3
[  146.264327] kill_fasync: bad magic number in fasync_struct!

After this, but before the oops, I see some userspace memory or non-io-uring pipe reads being corrupted.

[  146.264327] kill_fasync: bad magic number in fasync_struct!
[  146.285175] kill_fasync: bad magic number in fasync_struct!
[  146.290793] kill_fasync: bad magic number in fasync_struct!
[  146.285175] kill_fasync: bad magic number in fasync_struct!
[  146.290793] kill_fasync: bad magic number in fasync_struct!
[  157.071979] BUG: kernel NULL pointer dereference, address: 0000000000000020
[  157.078945] #PF: supervisor read access in kernel mode
[  157.084082] #PF: error_code(0x0000) - not-present page
[  157.089225] PGD 0 P4D 0
[  157.091763] Oops: 0000 [#1] SMP NOPTI
[  157.095429] CPU: 3 PID: 7756 Comm: postgres Not tainted 5.7.0-rc7-andres-00133-gc8707bf69395 #41
[  157.104208] Hardware name: Supermicro SYS-7049A-T/X11DAi-N, BIOS 3.2 11/13/2019
[  157.111518] RIP: 0010:xfs_log_commit_cil+0x356/0x7f0
[  157.116478] Code: 00 00 48 89 7e 08 49 89 76 30 48 89 11 48 89 4a 08 8b 4c 24 2c 48 89 85 c0 00 00 00 48 89 85 c8 00 00 00 49 8b 46 20 45 31 c9 <8b> 70 20 85 f6 0f 84 d9 02 00 00 45 31 c0 85 c9 7e 4f 41 8b 46 2c
[  157.135226] RSP: 0018:ffffc90021fefb00 EFLAGS: 00010246
[  157.140452] RAX: 0000000000000000 RBX: ffff8897a9ea80b0 RCX: 0000000000000458
[  157.147582] RDX: ffff8897a9ea80c0 RSI: ffff88afc39a1200 RDI: ffff88afb1ae2c18
[  157.154715] RBP: ffff8897a9ea8000 R08: ffffc90021fefb30 R09: 0000000000000000
[  157.161848] R10: 0000000000000084 R11: 0000000000000012 R12: ffff8897721bd400
[  157.168983] R13: ffff88afb1ae2c00 R14: ffff88afb19860c0 R15: ffff8897a9ea80a0
[  157.176115] FS:  00007ffbbe9a1980(0000) GS:ffff8897e0cc0000(0000) knlGS:0000000000000000
[  157.184199] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  157.189946] CR2: 0000000000000020 CR3: 000000179c0ac005 CR4: 00000000007606e0
[  157.197081] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  157.204212] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  157.211343] PKRU: 55555554
[  157.214048] Call Trace:
[  157.216498]  __xfs_trans_commit+0xa1/0x340
[  157.220596]  xfs_create+0x4cc/0x5e0
[  157.224087]  xfs_generic_create+0x241/0x310
[  157.228274]  path_openat+0xdb7/0x1020
[  157.231940]  do_filp_open+0x91/0x100
[  157.235518]  ? __sys_recvfrom+0xe4/0x170
[  157.239444]  ? _cond_resched+0x19/0x30
[  157.243196]  do_sys_openat2+0x215/0x2d0
[  157.247037]  do_sys_open+0x44/0x80
[  157.250443]  do_syscall_64+0x48/0x130
[  157.254108]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  157.259161] RIP: 0033:0x7ffbc0ded307
[  157.262738] Code: 25 00 00 41 00 3d 00 00 41 00 74 47 64 8b 04 25 18 00 00 00 85 c0 75 6b 44 89 e2 48 89 ee bf 9c ff ff ff b8 01 01 00 00 0f 05 <48> 3d 00 f0 ff ff 0f 87 95 00 00 00 48 8b 4c 24 28 64 48 33 0c 25
[  157.281485] RSP: 002b:00007fff520a4940 EFLAGS: 00000246 ORIG_RAX: 0000000000000101
[  157.289052] RAX: ffffffffffffffda RBX: 00005561dc02eca0 RCX: 00007ffbc0ded307
[  157.296185] RDX: 0000000000000241 RSI: 00005561dc013470 RDI: 00000000ffffff9c
[  157.303317] RBP: 00005561dc013470 R08: 0000000000000004 R09: 0000000000000001
[  157.310447] R10: 00000000000001b6 R11: 0000000000000246 R12: 0000000000000241
[  157.317575] R13: 00005561dc02eca0 R14: 0000000000000001 R15: 0000000000000000
[  157.324705] Modules linked in: isst_if_common squashfs nls_iso8859_1 nls_cp437 snd_hda_codec_realtek vfat snd_hda_codec_generic fat iwlmvm ledtrig_audio snd_hda_codec_hdmi x86_pkg_temp_thermal intel_powerclamp snd_hda_intel snd_intel_dspcfg iwlwifi efi_pstore btusb snd_hda_codec btrtl btbcm efivars snd_hwdep btintel snd_hda_core iTCO_wdt iTCO_vendor_support mei_me mei loop coretemp hid_logitech_hidpp hid_logitech_dj hid_lenovo amdgpu gpu_sched i40e ixgbe ast drm_vram_helper drm_ttm_helper ttm mdio xhci_pci xhci_hcd
[  157.370249] CR2: 0000000000000020

There's a lot more of these later, some interspersed (possibly related to grabbing the output via serial->bmc->network->ipmitool). I've attached the whole dmesg and .config.

What would be helpful for debugging? Should I try the v5 branch instead?

I'll try setting up a VM + passing through NVME to be able to test this without fear... In one instance I did see some minor corruption on another device & fs (ext4 on dm-crypt on nvme). It's all backed up, but...

Greetings,

Andres Freund

[    0.000000] Linux version 5.7.0-rc7-andres-00133-gc8707bf69395 (andres@awork3) (gcc version 9.3.0 (Debian 9.3.0-13), GNU ld (GNU Binutils for Debian) 2.34) #41 SMP Wed Jun 3 16:12:42 PDT 2020
[    0.000000] Command line: BOOT_IMAGE=/vmlinuz-5.7.0-rc7-andres-00133-gc8707bf69395 root=/dev/mapper/awork3--vg-root ro apparmor=0 console=ttyS1,115200 console=tty0 systemd.unified_cgroup_hierarchy intel_iommu=on nvme.poll_queues=2 nvme.write_queues=2 quiet
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x008: 'MPX bounds registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x010: 'MPX CSR'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: xstate_offset[3]:  832, xstate_sizes[3]:   64
[    0.000000] x86/fpu: xstate_offset[4]:  896, xstate_sizes[4]:   64
[    0.000000] x86/fpu: xstate_offset[5]:  960, xstate_sizes[5]:   64
[    0.000000] x86/fpu: xstate_offset[6]: 1024, xstate_sizes[6]:  512
[    0.000000] x86/fpu: xstate_offset[7]: 1536, xstate_sizes[7]: 1024
[    0.000000] x86/fpu: xstate_offset[9]: 2560, xstate_sizes[9]:    8
[    0.000000] x86/fpu: Enabled xstate features 0x2ff, context size is 2568 bytes, using 'compacted' format.
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000003dfff] usable
[    0.000000] BIOS-e820: [mem 0x000000000003e000-0x000000000003ffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000040000-0x000000000009ffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000000a0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000069eb5fff] usable
[    0.000000] BIOS-e820: [mem 0x0000000069eb6000-0x000000006bfb5fff] reserved
[    0.000000] BIOS-e820: [mem 0x000000006bfb6000-0x000000006c4edfff] usable
[    0.000000] BIOS-e820: [mem 0x000000006c4ee000-0x000000006d32ffff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x000000006d330000-0x000000006f966fff] reserved
[    0.000000] BIOS-e820: [mem 0x000000006f967000-0x000000006fb33fff] type 20
[    0.000000] BIOS-e820: [mem 0x000000006fb34000-0x000000006fffffff] usable
[    0.000000] BIOS-e820: [mem 0x0000000070000000-0x000000008fffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fd000000-0x00000000fe7fffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed20000-0x00000000fed44fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000303fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] efi: EFI v2.70 by American Megatrends
[    0.000000] efi:  ACPI 2.0=0x6c4ee000  ACPI=0x6c4ee000  SMBIOS=0x6f5d6000  SMBIOS 3.0=0x6f5d5000  MEMATTR=0x67805018  ESRT=0x64261c98
[    0.000000] SMBIOS 3.2.1 present.
[    0.000000] DMI: Supermicro SYS-7049A-T/X11DAi-N, BIOS 3.2 11/13/2019
[    0.000000] tsc: Detected 2500.000 MHz processor
[    0.000411] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000412] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000418] last_pfn = 0x3040000 max_arch_pfn = 0x400000000
[    0.000420] MTRR default type: uncachable
[    0.000421] MTRR fixed ranges enabled:
[    0.000422]   00000-9FFFF write-back
[    0.000423]   A0000-FFFFF uncachable
[    0.000424] MTRR variable ranges enabled:
[    0.000425]   0 base 000000000000 mask 3FE000000000 write-back
[    0.000426]   1 base 002000000000 mask 3FF000000000 write-back
[    0.000427]   2 base 003000000000 mask 3FFFC0000000 write-back
[    0.000428]   3 base 000080000000 mask 3FFF80000000 uncachable
[    0.000429]   4 base 000070000000 mask 3FFFFC000000 uncachable
[    0.000429]   5 disabled
[    0.000429]   6 disabled
[    0.000430]   7 disabled
[    0.000430]   8 disabled
[    0.000431]   9 disabled
[    0.000763] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT
[    0.000867] e820: update [mem 0x70000000-0x73ffffff] usable ==> reserved
[    0.000868] e820: update [mem 0x80000000-0xffffffff] usable ==> reserved
[    0.000870] x2apic: enabled by BIOS, switching to x2apic ops
[    0.000871] last_pfn = 0x70000 max_arch_pfn = 0x400000000
[    0.000877] esrt: Reserving ESRT space from 0x0000000064261c98 to 0x0000000064261cd0.
[    0.000881] e820: update [mem 0x64261000-0x64261fff] usable ==> reserved
[    0.000895] Using GB pages for direct mapping
[    0.000897] BRK [0x07201000, 0x07201fff] PGTABLE
[    0.000898] BRK [0x07202000, 0x07202fff] PGTABLE
[    0.000899] BRK [0x07203000, 0x07203fff] PGTABLE
[    0.001151] BRK [0x07204000, 0x07204fff] PGTABLE
[    0.001224] BRK [0x07205000, 0x07205fff] PGTABLE
[    0.001280] BRK [0x07206000, 0x07206fff] PGTABLE
[    0.001376] Secure boot could not be determined
[    0.001377] RAMDISK: [mem 0x0e5ab000-0x232ccfff]
[    0.001382] ACPI: Early table checksum verification disabled
[    0.001385] ACPI: RSDP 0x000000006C4EE000 000024 (v02 ALASKA)
[    0.001388] ACPI: XSDT 0x000000006C4EE0D0 000124 (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.001393] ACPI: FACP 0x000000006C68AE70 000114 (v06 ALASKA A M I    01072009 INTL 20091013)
[    0.001397] ACPI: DSDT 0x000000006C4EE290 19CBDA (v02 ALASKA A M I    01072009 INTL 20091013)
[    0.001400] ACPI: FACS 0x000000006D2EC080 000040
[    0.001402] ACPI: FPDT 0x000000006C68AF88 000044 (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.001404] ACPI: FIDT 0x000000006C68AFD0 00009C (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.001406] ACPI: SPMI 0x000000006C68B070 000041 (v05 ALASKA A M I    00000000 AMI. 00000000)
[    0.001408] ACPI: SSDT 0x000000006C68B0B8 00046C (v02 INTEL  ADDRXLAT 00000001 INTL 20140828)
[    0.001411] ACPI: MCFG 0x000000006C68B528 00003C (v01 ALASKA A M I    01072009 MSFT 00000097)
[    0.001413] ACPI: HPET 0x000000006C68B568 000038 (v01 ALASKA A M I    00000001 INTL 20091013)
[    0.001415] ACPI: APIC 0x000000006C68B5A0 000C5E (v03 ALASKA A M I    00000000 INTL 20091013)
[    0.001417] ACPI: MIGT 0x000000006C68C200 000040 (v01 ALASKA A M I    00000000 INTL 20091013)
[    0.001419] ACPI: MSCT 0x000000006C68C240 000064 (v01 ALASKA A M I    00000001 INTL 20091013)
[    0.001422] ACPI: PCAT 0x000000006C68C2A8 000088 (v02 ALASKA A M I    00000002 INTL 20091013)
[    0.001424] ACPI: PCCT 0x000000006C68C330 00006E (v01 ALASKA A M I    00000002 INTL 20091013)
[    0.001426] ACPI: RASF 0x000000006C68C3A0 000030 (v01 ALASKA A M I    00000001 INTL 20091013)
[    0.001428] ACPI: SLIT 0x000000006C68C3D0 00012C (v01 ALASKA A M I    00000001 INTL 20091013)
[    0.001430] ACPI: SRAT 0x000000006C68C500 0016B0 (v03 ALASKA A M I    00000002 INTL 20091013)
[    0.001432] ACPI: SVOS 0x000000006C68DBB0 000032 (v01 ALASKA A M I    00000000 INTL 20091013)
[    0.001434] ACPI: WDDT 0x000000006C68DBE8 000040 (v01 ALASKA A M I    00000000 INTL 20091013)
[    0.001437] ACPI: OEM1 0x000000006C68DC28 015174 (v02 INTEL  CPU EIST 00003000 INTL 20140828)
[    0.001439] ACPI: OEM2 0x000000006C6A2DA0 017554 (v02 INTEL  CPU  HWP 00003000 INTL 20140828)
[    0.001441] ACPI: SSDT 0x000000006C6BA2F8 019D00 (v02 INTEL  SSDT  PM 00004000 INTL 20140828)
[    0.001444] ACPI: OEM3 0x000000006C6D3FF8 013344 (v02 INTEL  CPU  TST 00003000 INTL 20140828)
[    0.001446] ACPI: SSDT 0x000000006C6E7340 00065B (v02 ALASKA A M I    00000000 INTL 20091013)
[    0.001448] ACPI: VFCT 0x000000006C6E79A0 00DE84 (v01 ALASKA A M I    00000001 AMD  31504F47)
[    0.001451] ACPI: SPCR 0x000000006C6F5828 000050 (v02 A M I  APTIO V  01072009 AMI. 0005000E)
[    0.001453] ACPI: UEFI 0x000000006C6F5878 00005C (v01 INTEL  RstUefiV 00000000      00000000)
[    0.001455] ACPI: SSDT 0x000000006C6F58D8 001B4E (v02 INTEL  SpsNm    00000002 INTL 20140828)
[    0.001458] ACPI: DMAR 0x000000006C6F7428 0002D8 (v01 ALASKA A M I    00000001 INTL 20091013)
[    0.001460] ACPI: HEST 0x000000006C6F7700 0000A8 (v01 ALASKA A M I    00000001 INTL 00000001)
[    0.001462] ACPI: BERT 0x000000006C6F77A8 000030 (v01 ALASKA A M I    00000001 INTL 00000001)
[    0.001464] ACPI: ERST 0x000000006C6F77D8 000230 (v01 ALASKA A M I    00000001 INTL 00000001)
[    0.001466] ACPI: EINJ 0x000000006C6F7A08 000150 (v01 ALASKA A M I    00000001 INTL 00000001)
[    0.001469] ACPI: WSMT 0x000000006C6F7B58 000028 (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.001474] ACPI: Local APIC address 0xfee00000
[    0.001475] Setting APIC routing to cluster x2apic.
[    0.001551] SRAT: PXM 0 -> APIC 0x0000 -> Node 0
[    0.001551] SRAT: PXM 0 -> APIC 0x0002 -> Node 0
[    0.001552] SRAT: PXM 0 -> APIC 0x0004 -> Node 0
[    0.001552] SRAT: PXM 0 -> APIC 0x0006 -> Node 0
[    0.001553] SRAT: PXM 0 -> APIC 0x0008 -> Node 0
[    0.001554] SRAT: PXM 0 -> APIC 0x0010 -> Node 0
[    0.001554] SRAT: PXM 0 -> APIC 0x0012 -> Node 0
[    0.001555] SRAT: PXM 0 -> APIC 0x0014 -> Node 0
[    0.001555] SRAT: PXM 0 -> APIC 0x0016 -> Node 0
[    0.001556] SRAT: PXM 0 -> APIC 0x0018 -> Node 0
[    0.001556] SRAT: PXM 1 -> APIC 0x0020 -> Node 1
[    0.001557] SRAT: PXM 1 -> APIC 0x0022 -> Node 1
[    0.001557] SRAT: PXM 1 -> APIC 0x0024 -> Node 1
[    0.001558] SRAT: PXM 1 -> APIC 0x0026 -> Node 1
[    0.001558] SRAT: PXM 1 -> APIC 0x0028 -> Node 1
[    0.001559] SRAT: PXM 1 -> APIC 0x0030 -> Node 1
[    0.001559] SRAT: PXM 1 -> APIC 0x0032 -> Node 1
[    0.001559] SRAT: PXM 1 -> APIC 0x0034 -> Node 1
[    0.001560] SRAT: PXM 1 -> APIC 0x0036 -> Node 1
[    0.001560] SRAT: PXM 1 -> APIC 0x0038 -> Node 1
[    0.001561] SRAT: PXM 0 -> APIC 0x0001 -> Node 0
[    0.001561] SRAT: PXM 0 -> APIC 0x0003 -> Node 0
[    0.001562] SRAT: PXM 0 -> APIC 0x0005 -> Node 0
[    0.001562] SRAT: PXM 0 -> APIC 0x0007 -> Node 0
[    0.001563] SRAT: PXM 0 -> APIC 0x0009 -> Node 0
[    0.001563] SRAT: PXM 0 -> APIC 0x0011 -> Node 0
[    0.001564] SRAT: PXM 0 -> APIC 0x0013 -> Node 0
[    0.001564] SRAT: PXM 0 -> APIC 0x0015 -> Node 0
[    0.001565] SRAT: PXM 0 -> APIC 0x0017 -> Node 0
[    0.001565] SRAT: PXM 0 -> APIC 0x0019 -> Node 0
[    0.001566] SRAT: PXM 1 -> APIC 0x0021 -> Node 1
[    0.001566] SRAT: PXM 1 -> APIC 0x0023 -> Node 1
[    0.001567] SRAT: PXM 1 -> APIC 0x0025 -> Node 1
[    0.001567] SRAT: PXM 1 -> APIC 0x0027 -> Node 1
[    0.001568] SRAT: PXM 1 -> APIC 0x0029 -> Node 1
[    0.001568] SRAT: PXM 1 -> APIC 0x0031 -> Node 1
[    0.001568] SRAT: PXM 1 -> APIC 0x0033 -> Node 1
[    0.001569] SRAT: PXM 1 -> APIC 0x0035 -> Node 1
[    0.001569] SRAT: PXM 1 -> APIC 0x0037 -> Node 1
[    0.001570] SRAT: PXM 1 -> APIC 0x0039 -> Node 1
[    0.001575] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0x7fffffff]
[    0.001575] ACPI: SRAT: Node 0 PXM 0 [mem 0x100000000-0x183fffffff]
[    0.001576] ACPI: SRAT: Node 1 PXM 1 [mem 0x1840000000-0x303fffffff]
[    0.001580] NUMA: Initialized distance table, cnt=2
[    0.001582] NUMA: Node 0 [mem 0x00000000-0x7fffffff] + [mem 0x100000000-0x183fffffff] -> [mem 0x00000000-0x183fffffff]
[    0.001585] NODE_DATA(0) allocated [mem 0x183fffc000-0x183fffffff]
[    0.001589] NODE_DATA(1) allocated [mem 0x303fff9000-0x303fffcfff]
[    0.001747] Zone ranges:
[    0.001747]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.001748]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.001749]   Normal   [mem 0x0000000100000000-0x000000303fffffff]
[    0.001750] Movable zone start for each node
[    0.001751] Early memory node ranges
[    0.001752]   node   0: [mem 0x0000000000001000-0x000000000003dfff]
[    0.001752]   node   0: [mem 0x0000000000040000-0x000000000009ffff]
[    0.001753]   node   0: [mem 0x0000000000100000-0x0000000069eb5fff]
[    0.001754]   node   0: [mem 0x000000006bfb6000-0x000000006c4edfff]
[    0.001754]   node   0: [mem 0x000000006fb34000-0x000000006fffffff]
[    0.001755]   node   0: [mem 0x0000000100000000-0x000000183fffffff]
[    0.001762]   node   1: [mem 0x0000001840000000-0x000000303fffffff]
[    0.001995] Zeroed struct page in unavailable ranges: 22441 pages
[    0.001996] Initmem setup node 0 [mem 0x0000000000001000-0x000000183fffffff]
[    0.001998] On node 0 totalpages: 24815703
[    0.001999]   DMA zone: 64 pages used for memmap
[    0.001999]   DMA zone: 24 pages reserved
[    0.002000]   DMA zone: 3997 pages, LIFO batch:0
[    0.002067]   DMA32 zone: 6755 pages used for memmap
[    0.002068]   DMA32 zone: 432314 pages, LIFO batch:63
[    0.009716]   Normal zone: 380928 pages used for memmap
[    0.009718]   Normal zone: 24379392 pages, LIFO batch:63
[    0.394229] Initmem setup node 1 [mem 0x0000001840000000-0x000000303fffffff]
[    0.394231] On node 1 totalpages: 25165824
[    0.394232]   Normal zone: 393216 pages used for memmap
[    0.394232]   Normal zone: 25165824 pages, LIFO batch:63
[    0.823383] ACPI: PM-Timer IO Port: 0x508
[    0.823385] ACPI: Local APIC address 0xfee00000
[    0.823401] ACPI: X2APIC_NMI (uid[0xffffffff] high level lint[0x1])
[    0.823403] ACPI: LAPIC_NMI (acpi_id[0xff] dfl edge lint[0x1])
[    0.823422] IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
[    0.823426] IOAPIC[1]: apic_id 9, version 32, address 0xfec01000, GSI 24-31
[    0.823430] IOAPIC[2]: apic_id 10, version 32, address 0xfec08000, GSI 32-39
[    0.823433] IOAPIC[3]: apic_id 11, version 32, address 0xfec10000, GSI 40-47
[    0.823437] IOAPIC[4]: apic_id 12, version 32, address 0xfec18000, GSI 48-55
[    0.823441] IOAPIC[5]: apic_id 15, version 32, address 0xfec20000, GSI 72-79
[    0.823445] IOAPIC[6]: apic_id 16, version 32, address 0xfec28000, GSI 80-87
[    0.823449] IOAPIC[7]: apic_id 17, version 32, address 0xfec30000, GSI 88-95
[    0.823453] IOAPIC[8]: apic_id 18, version 32, address 0xfec38000, GSI 96-103
[    0.823457] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.823458] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.823460] ACPI: IRQ0 used by override.
[    0.823461] ACPI: IRQ9 used by override.
[    0.823464] Using ACPI (MADT) for SMP configuration information
[    0.823466] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.823469] ACPI: SPCR: console: uart,io,0x2f8,115200
[    0.823471] smpboot: Allowing 40 CPUs, 0 hotplug CPUs
[    0.823491] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.823493] PM: hibernation: Registered nosave memory: [mem 0x0003e000-0x0003ffff]
[    0.823494] PM: hibernation: Registered nosave memory: [mem 0x000a0000-0x000fffff]
[    0.823496] PM: hibernation: Registered nosave memory: [mem 0x64261000-0x64261fff]
[    0.823498] PM: hibernation: Registered nosave memory: [mem 0x69eb6000-0x6bfb5fff]
[    0.823499] PM: hibernation: Registered nosave memory: [mem 0x6c4ee000-0x6d32ffff]
[    0.823500] PM: hibernation: Registered nosave memory: [mem 0x6d330000-0x6f966fff]
[    0.823500] PM: hibernation: Registered nosave memory: [mem 0x6f967000-0x6fb33fff]
[    0.823501] PM: hibernation: Registered nosave memory: [mem 0x70000000-0x8fffffff]
[    0.823502] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfcffffff]
[    0.823502] PM: hibernation: Registered nosave memory: [mem 0xfd000000-0xfe7fffff]
[    0.823503] PM: hibernation: Registered nosave memory: [mem 0xfe800000-0xfed1ffff]
[    0.823503] PM: hibernation: Registered nosave memory: [mem 0xfed20000-0xfed44fff]
[    0.823504] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff]
[    0.823504] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff]
[    0.823506] [mem 0x90000000-0xfcffffff] available for PCI devices
[    0.823509] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 6370452778343963 ns
[    0.831225] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:40 nr_node_ids:2
[    0.834245] percpu: Embedded 54 pages/cpu s182232 r8192 d30760 u262144
[    0.834254] pcpu-alloc: s182232 r8192 d30760 u262144 alloc=1*2097152
[    0.834255] pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 08 09 20 21 22 23 24 25
[    0.834259] pcpu-alloc: [0] 26 27 28 29 -- -- -- -- [1] 10 11 12 13 14 15 16 17
[    0.834262] pcpu-alloc: [1] 18 19 30 31 32 33 34 35 [1] 36 37 38 39 -- -- -- --
[    0.834290] Built 2 zonelists, mobility grouping on.  Total pages: 49200540
[    0.834290] Policy zone: Normal
[    0.834292] Kernel command line: BOOT_IMAGE=/vmlinuz-5.7.0-rc7-andres-00133-gc8707bf69395 root=/dev/mapper/awork3--vg-root ro apparmor=0 console=ttyS1,115200 console=tty0 systemd.unified_cgroup_hierarchy intel_iommu=on nvme.poll_queues=2 nvme.write_queues=2 quiet
[    0.834447] DMAR: IOMMU enabled
[    0.834488] printk: log_buf_len individual max cpu contribution: 4096 bytes
[    0.834489] printk: log_buf_len total cpu_extra contributions: 159744 bytes
[    0.834489] printk: log_buf_len min size: 131072 bytes
[    0.834637] printk: log_buf_len: 524288 bytes
[    0.834638] printk: early log buf free: 113584(86%)
[    0.834993] mem auto-init: stack:off, heap alloc:off, heap free:off
[    1.273144] Memory: 196262256K/199926108K available (20486K kernel code, 2439K rwdata, 15292K rodata, 1784K init, 2144K bss, 3663852K reserved, 0K cma-reserved)
[    1.273702] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=40, Nodes=2
[    1.273727] ftrace: allocating 57952 entries in 227 pages
[    1.296364] ftrace: allocated 227 pages with 5 groups
[    1.296644] rcu: Hierarchical RCU implementation.
[    1.296645] rcu: 	RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=40.
[    1.296646] rcu: RCU calculated value of scheduler-enlistment delay is 30 jiffies.
[    1.296646] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=40
[    1.300110] NR_IRQS: 33024, nr_irqs: 2104, preallocated irqs: 16
[    1.300438] random: get_random_bytes called from start_kernel+0x5c7/0x790 with crng_init=0
[    1.300525] Console: colour dummy device 80x25
[    1.300533] printk: console [tty0] enabled
[    1.300558] printk: console [ttyS1] enabled
[    1.300635] mempolicy: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    1.300638] ACPI: Core revision 20200326
[    1.302496] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 79635855245 ns
[    1.302538] APIC: Switch to symmetric I/O mode setup
[    1.302540] DMAR: Host address width 46
[    1.302541] DMAR: DRHD base: 0x000000d37fc000 flags: 0x0
[    1.302546] DMAR: dmar0: reg_base_addr d37fc000 ver 1:0 cap 8d2078c106f0466 ecap f020df
[    1.302547] DMAR: DRHD base: 0x000000e0ffc000 flags: 0x0
[    1.302551] DMAR: dmar1: reg_base_addr e0ffc000 ver 1:0 cap 8d2078c106f0466 ecap f020df
[    1.302552] DMAR: DRHD base: 0x000000ee7fc000 flags: 0x0
[    1.302556] DMAR: dmar2: reg_base_addr ee7fc000 ver 1:0 cap 8d2078c106f0466 ecap f020df
[    1.302557] DMAR: DRHD base: 0x000000fbffc000 flags: 0x0
[    1.302560] DMAR: dmar3: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020df
[    1.302560] DMAR: DRHD base: 0x000000aaffc000 flags: 0x0
[    1.302565] DMAR: dmar4: reg_base_addr aaffc000 ver 1:0 cap 8d2078c106f0466 ecap f020df
[    1.302566] DMAR: DRHD base: 0x000000b87fc000 flags: 0x0
[    1.302569] DMAR: dmar5: reg_base_addr b87fc000 ver 1:0 cap 8d2078c106f0466 ecap f020df
[    1.302569] DMAR: DRHD base: 0x000000c5ffc000 flags: 0x0
[    1.302572] DMAR: dmar6: reg_base_addr c5ffc000 ver 1:0 cap 8d2078c106f0466 ecap f020df
[    1.302573] DMAR: DRHD base: 0x0000009d7fc000 flags: 0x1
[    1.302576] DMAR: dmar7: reg_base_addr 9d7fc000 ver 1:0 cap 8d2078c106f0466 ecap f020df
[    1.302577] DMAR: RMRR base: 0x0000006f60e000 end: 0x0000006f61efff
[    1.302578] DMAR: ATSR flags: 0x0
[    1.302579] DMAR: ATSR flags: 0x0
[    1.302580] DMAR: RHSA base: 0x0000009d7fc000 proximity domain: 0x0
[    1.302580] DMAR: RHSA base: 0x000000aaffc000 proximity domain: 0x0
[    1.302581] DMAR: RHSA base: 0x000000b87fc000 proximity domain: 0x0
[    1.302581] DMAR: RHSA base: 0x000000c5ffc000 proximity domain: 0x0
[    1.302582] DMAR: RHSA base: 0x000000d37fc000 proximity domain: 0x1
[    1.302582] DMAR: RHSA base: 0x000000e0ffc000 proximity domain: 0x1
[    1.302582] DMAR: RHSA base: 0x000000ee7fc000 proximity domain: 0x1
[    1.302583] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x1
[    1.302584] DMAR-IR: IOAPIC id 12 under DRHD base  0xc5ffc000 IOMMU 6
[    1.302585] DMAR-IR: IOAPIC id 11 under DRHD base  0xb87fc000 IOMMU 5
[    1.302586] DMAR-IR: IOAPIC id 10 under DRHD base  0xaaffc000 IOMMU 4
[    1.302587] DMAR-IR: IOAPIC id 18 under DRHD base  0xfbffc000 IOMMU 3
[    1.302588] DMAR-IR: IOAPIC id 17 under DRHD base  0xee7fc000 IOMMU 2
[    1.302588] DMAR-IR: IOAPIC id 16 under DRHD base  0xe0ffc000 IOMMU 1
[    1.302589] DMAR-IR: IOAPIC id 15 under DRHD base  0xd37fc000 IOMMU 0
[    1.302590] DMAR-IR: IOAPIC id 8 under DRHD base  0x9d7fc000 IOMMU 7
[    1.302591] DMAR-IR: IOAPIC id 9 under DRHD base  0x9d7fc000 IOMMU 7
[    1.302592] DMAR-IR: HPET id 0 under DRHD base 0x9d7fc000
[    1.302593] DMAR-IR: Queued invalidation will be enabled to support x2apic and Intr-remapping.
[    1.304733] DMAR-IR: Enabled IRQ remapping in x2apic mode
[    1.305807] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    1.319191] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x240939f1bb2, max_idle_ns: 440795263295 ns
[    1.319195] Calibrating delay loop (skipped), value calculated using timer frequency.. 5002.33 BogoMIPS (lpj=8333333)
[    1.319197] pid_max: default: 40960 minimum: 320
[    1.322213] LSM: Security Framework initializing
[    1.343100] Dentry cache hash table entries: 16777216 (order: 15, 134217728 bytes, vmalloc)
[    1.353423] Inode-cache hash table entries: 8388608 (order: 14, 67108864 bytes, vmalloc)
[    1.353768] Mount-cache hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc)
[    1.354078] Mountpoint-cache hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc)
[    1.354539] mce: CPU0: Thermal monitoring enabled (TM1)
[    1.354621] process: using mwait in idle threads
[    1.354624] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8
[    1.354624] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4
[    1.354628] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[    1.354630] Spectre V2 : Mitigation: Enhanced IBRS
[    1.354631] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[    1.354632] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier
[    1.354634] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    1.354634] TAA: Mitigation: TSX disabled
[    1.354926] Freeing SMP alternatives memory: 52K
[    1.355581] smpboot: CPU0: Intel(R) Xeon(R) Gold 5215 CPU @ 2.50GHz (family: 0x6, model: 0x55, stepping: 0x7)
[    1.355735] Performance Events: PEBS fmt3+, Skylake events, 32-deep LBR, full-width counters, Intel PMU driver.
[    1.355741] ... version:                4
[    1.355741] ... bit width:              48
[    1.355742] ... generic registers:      4
[    1.355743] ... value mask:             0000ffffffffffff
[    1.355743] ... max period:             00007fffffffffff
[    1.355744] ... fixed-purpose events:   3
[    1.355744] ... event mask:             000000070000000f
[    1.355813] rcu: Hierarchical SRCU implementation.
[    1.355859] smp: Bringing up secondary CPUs ...
[    1.355859] x86: Booting SMP configuration:
[    1.355859] .... node  #0, CPUs:        #1  #2  #3  #4  #5  #6  #7  #8  #9
[    1.371062] .... node  #1, CPUs:   #10
[    0.002134] smpboot: CPU 10 Converting physical 0 to logical die 1
[    1.459306]  #11 #12 #13 #14 #15 #16 #17 #18 #19
[    1.475963] .... node  #0, CPUs:   #20 #21 #22 #23 #24 #25 #26 #27 #28 #29
[    1.494384] .... node  #1, CPUs:   #30 #31 #32 #33 #34 #35 #36 #37 #38 #39
[    1.514332] smp: Brought up 2 nodes, 40 CPUs
[    1.514332] smpboot: Max logical packages: 2
[    1.514332] smpboot: Total of 40 processors activated (200120.81 BogoMIPS)
[    1.521784] devtmpfs: initialized
[    1.521784] PM: Registering ACPI NVS region [mem 0x6c4ee000-0x6d32ffff] (14950400 bytes)
[    1.522634] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 6370867519511994 ns
[    1.522666] futex hash table entries: 16384 (order: 8, 1048576 bytes, vmalloc)
[    1.522989] xor: automatically using best checksumming function   avx
[    1.523030] pinctrl core: initialized pinctrl subsystem
[    1.523118] *************************************************************
[    1.523118] **     NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE    **
[    1.523119] **                                                         **
[    1.523119] **  IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL  **
[    1.523120] **                                                         **
[    1.523120] ** This means that this kernel is built to expose internal **
[    1.523120] ** IOMMU data structures, which may compromise security on **
[    1.523121] ** your system.                                            **
[    1.523121] **                                                         **
[    1.523122] ** If you see this message and you are not debugging the   **
[    1.523122] ** kernel, report this immediately to your vendor!         **
[    1.523122] **                                                         **
[    1.523123] **     NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE    **
[    1.523123] *************************************************************
[    1.523170] PM: RTC time: 00:16:21, date: 2020-06-04
[    1.523171] thermal_sys: Registered thermal governor 'fair_share'
[    1.523172] thermal_sys: Registered thermal governor 'bang_bang'
[    1.523172] thermal_sys: Registered thermal governor 'step_wise'
[    1.523173] thermal_sys: Registered thermal governor 'user_space'
[    1.523174] thermal_sys: Registered thermal governor 'power_allocator'
[    1.523427] NET: Registered protocol family 16
[    1.523597] audit: initializing netlink subsys (disabled)
[    1.523601] audit: type=2000 audit(1591229781.223:1): state=initialized audit_enabled=0 res=1
[    1.523601] cpuidle: using governor ladder
[    1.523601] cpuidle: using governor menu
[    1.523601] Detected 1 PCC Subspaces
[    1.523601] Registering PCC driver as Mailbox controller
[    1.523601] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    1.523601] ACPI: bus type PCI registered
[    1.523601] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.523601] dca service started, version 1.12.1
[    1.523601] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
[    1.523601] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820
[    1.523601] pmd_set_huge: Cannot satisfy [mem 0x80000000-0x80200000] with a huge-page mapping due to MTRR override.
[    1.523601] PCI: Using configuration type 1 for base access
[    1.526033] ENERGY_PERF_BIAS: Set to 'normal', was 'performance'
[    1.529711] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    1.529711] cryptd: max_cpu_qlen set to 1000
[    1.535986] raid6: skip pq benchmark and using algorithm avx512x4
[    1.535986] raid6: using avx512x2 recovery algorithm
[    1.536093] ACPI: Added _OSI(Module Device)
[    1.536094] ACPI: Added _OSI(Processor Device)
[    1.536095] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.536095] ACPI: Added _OSI(Processor Aggregator Device)
[    1.536096] ACPI: Added _OSI(Linux-Dell-Video)
[    1.536097] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[    1.536099] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
[    1.584999] ACPI: 5 ACPI AML tables successfully acquired and loaded
[    1.588752] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    1.611204] ACPI: Interpreter enabled
[    1.611223] ACPI: (supports S0 S3 S4 S5)
[    1.611224] ACPI: Using IOAPIC for interrupt routing
[    1.612559] HEST: Table parsing has been initialized.
[    1.612559] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    1.615864] ACPI: Enabled 6 GPEs in block 00 to 7F
[    1.642527] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 40/0x7f00 ignored.
[    1.642527] ACPI: Unable to map lapic to logical cpu number
[    1.642540] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 41/0x7f02 ignored.
[    1.642540] ACPI: Unable to map lapic to logical cpu number
[    1.642540] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 42/0x7f04 ignored.
[    1.642540] ACPI: Unable to map lapic to logical cpu number
[    1.642540] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 43/0x7f06 ignored.
[    1.642540] ACPI: Unable to map lapic to logical cpu number
[    1.642624] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 44/0x7f08 ignored.
[    1.642625] ACPI: Unable to map lapic to logical cpu number
[    1.642859] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 45/0x7f10 ignored.
[    1.642860] ACPI: Unable to map lapic to logical cpu number
[    1.643092] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 46/0x7f12 ignored.
[    1.643092] ACPI: Unable to map lapic to logical cpu number
[    1.643326] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 47/0x7f14 ignored.
[    1.643327] ACPI: Unable to map lapic to logical cpu number
[    1.643559] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 48/0x7f16 ignored.
[    1.643559] ACPI: Unable to map lapic to logical cpu number
[    1.643792] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 49/0x7f18 ignored.
[    1.643793] ACPI: Unable to map lapic to logical cpu number
[    1.644024] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 50/0x7f01 ignored.
[    1.644025] ACPI: Unable to map lapic to logical cpu number
[    1.644258] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 51/0x7f03 ignored.
[    1.644259] ACPI: Unable to map lapic to logical cpu number
[    1.644493] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 52/0x7f05 ignored.
[    1.644493] ACPI: Unable to map lapic to logical cpu number
[    1.644724] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 53/0x7f07 ignored.
[    1.644725] ACPI: Unable to map lapic to logical cpu number
[    1.645861] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 54/0x7f09 ignored.
[    1.645861] ACPI: Unable to map lapic to logical cpu number
[    1.645870] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 55/0x7f11 ignored.
[    1.645870] ACPI: Unable to map lapic to logical cpu number
[    1.645871] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 56/0x7f13 ignored.
[    1.645871] ACPI: Unable to map lapic to logical cpu number
[    1.645871] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 57/0x7f15 ignored.
[    1.645871] ACPI: Unable to map lapic to logical cpu number
[    1.645899] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 58/0x7f17 ignored.
[    1.645899] ACPI: Unable to map lapic to logical cpu number
[    1.646133] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 59/0x7f19 ignored.
[    1.646133] ACPI: Unable to map lapic to logical cpu number
[    1.647047] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 60/0x7f20 ignored.
[    1.647048] ACPI: Unable to map lapic to logical cpu number
[    1.647280] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 61/0x7f22 ignored.
[    1.647280] ACPI: Unable to map lapic to logical cpu number
[    1.647514] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 62/0x7f24 ignored.
[    1.647514] ACPI: Unable to map lapic to logical cpu number
[    1.647747] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 63/0x7f26 ignored.
[    1.647747] ACPI: Unable to map lapic to logical cpu number
[    1.647981] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 64/0x7f28 ignored.
[    1.647981] ACPI: Unable to map lapic to logical cpu number
[    1.649193] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 65/0x7f30 ignored.
[    1.649193] ACPI: Unable to map lapic to logical cpu number
[    1.649204] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 66/0x7f32 ignored.
[    1.649204] ACPI: Unable to map lapic to logical cpu number
[    1.649204] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 67/0x7f34 ignored.
[    1.649204] ACPI: Unable to map lapic to logical cpu number
[    1.649204] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 68/0x7f36 ignored.
[    1.649204] ACPI: Unable to map lapic to logical cpu number
[    1.649204] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 69/0x7f38 ignored.
[    1.649204] ACPI: Unable to map lapic to logical cpu number
[    1.649385] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 70/0x7f21 ignored.
[    1.649385] ACPI: Unable to map lapic to logical cpu number
[    1.649618] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 71/0x7f23 ignored.
[    1.649618] ACPI: Unable to map lapic to logical cpu number
[    1.649850] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 72/0x7f25 ignored.
[    1.649850] ACPI: Unable to map lapic to logical cpu number
[    1.650082] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 73/0x7f27 ignored.
[    1.650082] ACPI: Unable to map lapic to logical cpu number
[    1.650314] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 74/0x7f29 ignored.
[    1.650315] ACPI: Unable to map lapic to logical cpu number
[    1.650547] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 75/0x7f31 ignored.
[    1.650547] ACPI: Unable to map lapic to logical cpu number
[    1.650779] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 76/0x7f33 ignored.
[    1.650780] ACPI: Unable to map lapic to logical cpu number
[    1.651011] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 77/0x7f35 ignored.
[    1.651011] ACPI: Unable to map lapic to logical cpu number
[    1.651244] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 78/0x7f37 ignored.
[    1.651244] ACPI: Unable to map lapic to logical cpu number
[    1.651475] APIC: NR_CPUS/possible_cpus limit of 40 reached. Processor 79/0x7f39 ignored.
[    1.651475] ACPI: Unable to map lapic to logical cpu number
[    1.652539] ACPI: PCI Root Bridge [PC00] (domain 0000 [bus 00-16])
[    1.652539] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    1.652539] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR]
[    1.652588] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.652589] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.653026] PCI host bridge to bus 0000:00
[    1.653027] pci_bus 0000:00: root bus resource [io  0x0000-0x03af window]
[    1.653029] pci_bus 0000:00: root bus resource [io  0x03e0-0x0cf7 window]
[    1.653030] pci_bus 0000:00: root bus resource [io  0x03b0-0x03bb window]
[    1.653031] pci_bus 0000:00: root bus resource [io  0x03c0-0x03df window]
[    1.653032] pci_bus 0000:00: root bus resource [io  0x1000-0x3fff window]
[    1.653033] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    1.653034] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window]
[    1.653035] pci_bus 0000:00: root bus resource [mem 0xfe010000-0xfe010fff window]
[    1.653036] pci_bus 0000:00: root bus resource [mem 0x90000000-0x9d7fffff window]
[    1.653037] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x383fffffffff window]
[    1.653038] pci_bus 0000:00: root bus resource [bus 00-16]
[    1.653047] pci 0000:00:00.0: [8086:2020] type 00 class 0x060000
[    1.653228] pci 0000:00:04.0: [8086:2021] type 00 class 0x088000
[    1.653239] pci 0000:00:04.0: reg 0x10: [mem 0x383ffff40000-0x383ffff43fff 64bit]
[    1.653372] pci 0000:00:04.1: [8086:2021] type 00 class 0x088000
[    1.653381] pci 0000:00:04.1: reg 0x10: [mem 0x383ffff3c000-0x383ffff3ffff 64bit]
[    1.653513] pci 0000:00:04.2: [8086:2021] type 00 class 0x088000
[    1.653522] pci 0000:00:04.2: reg 0x10: [mem 0x383ffff38000-0x383ffff3bfff 64bit]
[    1.653653] pci 0000:00:04.3: [8086:2021] type 00 class 0x088000
[    1.653662] pci 0000:00:04.3: reg 0x10: [mem 0x383ffff34000-0x383ffff37fff 64bit]
[    1.653793] pci 0000:00:04.4: [8086:2021] type 00 class 0x088000
[    1.653801] pci 0000:00:04.4: reg 0x10: [mem 0x383ffff30000-0x383ffff33fff 64bit]
[    1.653930] pci 0000:00:04.5: [8086:2021] type 00 class 0x088000
[    1.653939] pci 0000:00:04.5: reg 0x10: [mem 0x383ffff2c000-0x383ffff2ffff 64bit]
[    1.654068] pci 0000:00:04.6: [8086:2021] type 00 class 0x088000
[    1.654077] pci 0000:00:04.6: reg 0x10: [mem 0x383ffff28000-0x383ffff2bfff 64bit]
[    1.654209] pci 0000:00:04.7: [8086:2021] type 00 class 0x088000
[    1.654218] pci 0000:00:04.7: reg 0x10: [mem 0x383ffff24000-0x383ffff27fff 64bit]
[    1.654347] pci 0000:00:05.0: [8086:2024] type 00 class 0x088000
[    1.654467] pci 0000:00:05.1: [8086:2022] type 00 class 0x088000
[    1.655871] pci 0000:00:05.2: [8086:2025] type 00 class 0x088000
[    1.655871] pci 0000:00:05.4: [8086:2026] type 00 class 0x080020
[    1.655871] pci 0000:00:05.4: reg 0x10: [mem 0x9d30a000-0x9d30afff]
[    1.655871] pci 0000:00:05.6: [8086:2027] type 00 class 0x110100
[    1.655873] pci 0000:00:07.0: [8086:2028] type 00 class 0x088000
[    1.655873] pci 0000:00:07.4: [8086:202c] type 00 class 0x088000
[    1.655873] pci 0000:00:07.7: [8086:202d] type 00 class 0x088000
[    1.655873] pci 0000:00:08.0: [8086:2014] type 00 class 0x088000
[    1.655874] pci 0000:00:08.1: [8086:2015] type 00 class 0x110100
[    1.655874] pci 0000:00:08.2: [8086:2016] type 00 class 0x088000
[    1.655874] pci 0000:00:11.0: [8086:a1ec] type 00 class 0xff0000
[    1.655874] pci 0000:00:11.1: [8086:a1ed] type 00 class 0xff0000
[    1.656022] pci 0000:00:11.5: [8086:a1d2] type 00 class 0x010601
[    1.656038] pci 0000:00:11.5: reg 0x10: [mem 0x9d306000-0x9d307fff]
[    1.656044] pci 0000:00:11.5: reg 0x14: [mem 0x9d309000-0x9d3090ff]
[    1.656051] pci 0000:00:11.5: reg 0x18: [io  0x3070-0x3077]
[    1.656057] pci 0000:00:11.5: reg 0x1c: [io  0x3060-0x3063]
[    1.656064] pci 0000:00:11.5: reg 0x20: [io  0x3020-0x303f]
[    1.656070] pci 0000:00:11.5: reg 0x24: [mem 0x9d280000-0x9d2fffff]
[    1.656106] pci 0000:00:11.5: PME# supported from D3hot
[    1.656256] pci 0000:00:14.0: [8086:a1af] type 00 class 0x0c0330
[    1.656276] pci 0000:00:14.0: reg 0x10: [mem 0x383ffff10000-0x383ffff1ffff 64bit]
[    1.656336] pci 0000:00:14.0: PME# supported from D3hot D3cold
[    1.656471] pci 0000:00:14.2: [8086:a1b1] type 00 class 0x118000
[    1.656491] pci 0000:00:14.2: reg 0x10: [mem 0x383ffff47000-0x383ffff47fff 64bit]
[    1.656660] pci 0000:00:16.0: [8086:a1ba] type 00 class 0x078000
[    1.656687] pci 0000:00:16.0: reg 0x10: [mem 0x383ffff46000-0x383ffff46fff 64bit]
[    1.656768] pci 0000:00:16.0: PME# supported from D3hot
[    1.656882] pci 0000:00:16.1: [8086:a1bb] type 00 class 0x078000
[    1.656909] pci 0000:00:16.1: reg 0x10: [mem 0x383ffff45000-0x383ffff45fff 64bit]
[    1.656989] pci 0000:00:16.1: PME# supported from D3hot
[    1.657106] pci 0000:00:16.4: [8086:a1be] type 00 class 0x078000
[    1.657133] pci 0000:00:16.4: reg 0x10: [mem 0x383ffff44000-0x383ffff44fff 64bit]
[    1.657212] pci 0000:00:16.4: PME# supported from D3hot
[    1.657331] pci 0000:00:17.0: [8086:a182] type 00 class 0x010601
[    1.657346] pci 0000:00:17.0: reg 0x10: [mem 0x9d304000-0x9d305fff]
[    1.657353] pci 0000:00:17.0: reg 0x14: [mem 0x9d308000-0x9d3080ff]
[    1.657359] pci 0000:00:17.0: reg 0x18: [io  0x3050-0x3057]
[    1.657366] pci 0000:00:17.0: reg 0x1c: [io  0x3040-0x3043]
[    1.657372] pci 0000:00:17.0: reg 0x20: [io  0x3000-0x301f]
[    1.657378] pci 0000:00:17.0: reg 0x24: [mem 0x9d200000-0x9d27ffff]
[    1.657413] pci 0000:00:17.0: PME# supported from D3hot
[    1.657558] pci 0000:00:1c.0: [8086:a190] type 01 class 0x060400
[    1.657624] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[    1.657791] pci 0000:00:1c.2: [8086:a192] type 01 class 0x060400
[    1.657863] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold
[    1.659205] pci 0000:00:1c.5: [8086:a195] type 01 class 0x060400
[    1.659205] pci 0000:00:1c.5: PME# supported from D0 D3hot D3cold
[    1.659208] pci 0000:00:1f.0: [8086:a1c1] type 00 class 0x060100
[    1.659208] pci 0000:00:1f.2: [8086:a1a1] type 00 class 0x058000
[    1.659208] pci 0000:00:1f.2: reg 0x10: [mem 0x9d300000-0x9d303fff]
[    1.659208] pci 0000:00:1f.3: [8086:a1f0] type 00 class 0x040300
[    1.659208] pci 0000:00:1f.3: reg 0x10: [mem 0x383ffff20000-0x383ffff23fff 64bit]
[    1.659208] pci 0000:00:1f.3: reg 0x20: [mem 0x383ffff00000-0x383ffff0ffff 64bit]
[    1.659208] pci 0000:00:1f.3: PME# supported from D3hot D3cold
[    1.659208] pci 0000:00:1f.4: [8086:a1a3] type 00 class 0x0c0500
[    1.659208] pci 0000:00:1f.4: reg 0x10: [mem 0x00000000-0x000000ff 64bit]
[    1.659208] pci 0000:00:1f.4: reg 0x20: [io  0x0780-0x079f]
[    1.659208] pci 0000:00:1f.5: [8086:a1a4] type 00 class 0x0c8000
[    1.659208] pci 0000:00:1f.5: reg 0x10: [mem 0xfe010000-0xfe010fff]
[    1.659270] pci 0000:00:1c.0: PCI bridge to [bus 01]
[    1.659384] pci 0000:02:00.0: [1b21:2142] type 00 class 0x0c0330
[    1.659411] pci 0000:02:00.0: reg 0x10: [mem 0x9d100000-0x9d107fff 64bit]
[    1.659458] pci 0000:02:00.0: enabling Extended Tags
[    1.659521] pci 0000:02:00.0: PME# supported from D0
[    1.659693] pci 0000:00:1c.2: PCI bridge to [bus 02]
[    1.659697] pci 0000:00:1c.2:   bridge window [mem 0x9d100000-0x9d1fffff]
[    1.659750] pci 0000:03:00.0: [1a03:1150] type 01 class 0x060400
[    1.659806] pci 0000:03:00.0: enabling Extended Tags
[    1.659865] pci 0000:03:00.0: supports D1 D2
[    1.659866] pci 0000:03:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    1.659970] pci 0000:00:1c.5: PCI bridge to [bus 03-04]
[    1.659973] pci 0000:00:1c.5:   bridge window [io  0x2000-0x2fff]
[    1.659975] pci 0000:00:1c.5:   bridge window [mem 0x9c000000-0x9d0fffff]
[    1.660012] pci_bus 0000:04: extended config space not accessible
[    1.660039] pci 0000:04:00.0: [1a03:2000] type 00 class 0x030000
[    1.660059] pci 0000:04:00.0: reg 0x10: [mem 0x9c000000-0x9cffffff]
[    1.660069] pci 0000:04:00.0: reg 0x14: [mem 0x9d000000-0x9d01ffff]
[    1.660080] pci 0000:04:00.0: reg 0x18: [io  0x2000-0x207f]
[    1.660165] pci 0000:04:00.0: supports D1 D2
[    1.660166] pci 0000:04:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    1.660264] pci 0000:03:00.0: PCI bridge to [bus 04]
[    1.660269] pci 0000:03:00.0:   bridge window [io  0x2000-0x2fff]
[    1.660273] pci 0000:03:00.0:   bridge window [mem 0x9c000000-0x9d0fffff]
[    1.660296] pci_bus 0000:00: on NUMA node 0
[    1.660909] ACPI: PCI Root Bridge [PC01] (domain 0000 [bus 17-39])
[    1.660913] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    1.661266] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug AER LTR]
[    1.661466] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.661467] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.661630] PCI host bridge to bus 0000:17
[    1.661632] pci_bus 0000:17: root bus resource [io  0x4000-0x5fff window]
[    1.661633] pci_bus 0000:17: root bus resource [mem 0x9d800000-0xaaffffff window]
[    1.661634] pci_bus 0000:17: root bus resource [mem 0x384000000000-0x387fffffffff window]
[    1.661636] pci_bus 0000:17: root bus resource [bus 17-39]
[    1.661644] pci 0000:17:00.0: [8086:2030] type 01 class 0x060400
[    1.661670] pci 0000:17:00.0: enabling Extended Tags
[    1.661700] pci 0000:17:00.0: PME# supported from D0 D3hot D3cold
[    1.662540] pci 0000:17:05.0: [8086:2034] type 00 class 0x088000
[    1.662567] pci 0000:17:05.2: [8086:2035] type 00 class 0x088000
[    1.662567] pci 0000:17:05.4: [8086:2036] type 00 class 0x080020
[    1.662567] pci 0000:17:05.4: reg 0x10: [mem 0xaaf00000-0xaaf00fff]
[    1.662567] pci 0000:17:05.6: [8086:2037] type 00 class 0x110100
[    1.662567] pci 0000:17:07.0: [8086:2038] type 00 class 0x088000
[    1.662567] pci 0000:17:07.1: [8086:2039] type 00 class 0x088000
[    1.662567] pci 0000:17:07.2: [8086:203a] type 00 class 0x088000
[    1.662567] pci 0000:17:07.3: [8086:203b] type 00 class 0x088000
[    1.662567] pci 0000:17:07.4: [8086:203c] type 00 class 0x088000
[    1.662567] pci 0000:17:07.7: [8086:203d] type 00 class 0x088000
[    1.662606] pci 0000:17:08.0: [8086:208d] type 00 class 0x088000
[    1.662677] pci 0000:17:08.1: [8086:208d] type 00 class 0x088000
[    1.662732] pci 0000:17:08.2: [8086:208d] type 00 class 0x088000
[    1.662786] pci 0000:17:08.3: [8086:208d] type 00 class 0x088000
[    1.662840] pci 0000:17:08.4: [8086:208d] type 00 class 0x088000
[    1.662895] pci 0000:17:08.5: [8086:208d] type 00 class 0x088000
[    1.662950] pci 0000:17:08.6: [8086:208d] type 00 class 0x088000
[    1.663007] pci 0000:17:08.7: [8086:208d] type 00 class 0x088000
[    1.663062] pci 0000:17:09.0: [8086:208d] type 00 class 0x088000
[    1.663128] pci 0000:17:09.1: [8086:208d] type 00 class 0x088000
[    1.663183] pci 0000:17:09.2: [8086:208d] type 00 class 0x088000
[    1.663239] pci 0000:17:09.3: [8086:208d] type 00 class 0x088000
[    1.663294] pci 0000:17:09.4: [8086:208d] type 00 class 0x088000
[    1.663349] pci 0000:17:09.5: [8086:208d] type 00 class 0x088000
[    1.663404] pci 0000:17:09.6: [8086:208d] type 00 class 0x088000
[    1.663459] pci 0000:17:09.7: [8086:208d] type 00 class 0x088000
[    1.663514] pci 0000:17:0a.0: [8086:208d] type 00 class 0x088000
[    1.663579] pci 0000:17:0a.1: [8086:208d] type 00 class 0x088000
[    1.663637] pci 0000:17:0e.0: [8086:208e] type 00 class 0x088000
[    1.663707] pci 0000:17:0e.1: [8086:208e] type 00 class 0x088000
[    1.663762] pci 0000:17:0e.2: [8086:208e] type 00 class 0x088000
[    1.663816] pci 0000:17:0e.3: [8086:208e] type 00 class 0x088000
[    1.663873] pci 0000:17:0e.4: [8086:208e] type 00 class 0x088000
[    1.663927] pci 0000:17:0e.5: [8086:208e] type 00 class 0x088000
[    1.663979] pci 0000:17:0e.6: [8086:208e] type 00 class 0x088000
[    1.664032] pci 0000:17:0e.7: [8086:208e] type 00 class 0x088000
[    1.664087] pci 0000:17:0f.0: [8086:208e] type 00 class 0x088000
[    1.664156] pci 0000:17:0f.1: [8086:208e] type 00 class 0x088000
[    1.664211] pci 0000:17:0f.2: [8086:208e] type 00 class 0x088000
[    1.664266] pci 0000:17:0f.3: [8086:208e] type 00 class 0x088000
[    1.664325] pci 0000:17:0f.4: [8086:208e] type 00 class 0x088000
[    1.664378] pci 0000:17:0f.5: [8086:208e] type 00 class 0x088000
[    1.664430] pci 0000:17:0f.6: [8086:208e] type 00 class 0x088000
[    1.664484] pci 0000:17:0f.7: [8086:208e] type 00 class 0x088000
[    1.664540] pci 0000:17:10.0: [8086:208e] type 00 class 0x088000
[    1.664608] pci 0000:17:10.1: [8086:208e] type 00 class 0x088000
[    1.665863] pci 0000:17:14.0: [8086:208f] type 00 class 0x088000
[    1.665881] pci 0000:17:14.1: [8086:208f] type 00 class 0x088000
[    1.665881] pci 0000:17:14.2: [8086:208f] type 00 class 0x088000
[    1.665881] pci 0000:17:14.3: [8086:208f] type 00 class 0x088000
[    1.665881] pci 0000:17:14.4: [8086:208f] type 00 class 0x088000
[    1.665881] pci 0000:17:14.5: [8086:208f] type 00 class 0x088000
[    1.665881] pci 0000:17:14.6: [8086:208f] type 00 class 0x088000
[    1.665881] pci 0000:17:14.7: [8086:208f] type 00 class 0x088000
[    1.665881] pci 0000:17:15.0: [8086:208f] type 00 class 0x088000
[    1.665881] pci 0000:17:15.1: [8086:208f] type 00 class 0x088000
[    1.665881] pci 0000:17:15.2: [8086:208f] type 00 class 0x088000
[    1.665881] pci 0000:17:15.3: [8086:208f] type 00 class 0x088000
[    1.665881] pci 0000:17:15.4: [8086:208f] type 00 class 0x088000
[    1.665881] pci 0000:17:15.5: [8086:208f] type 00 class 0x088000
[    1.665881] pci 0000:17:15.6: [8086:208f] type 00 class 0x088000
[    1.665881] pci 0000:17:15.7: [8086:208f] type 00 class 0x088000
[    1.665881] pci 0000:17:16.0: [8086:208f] type 00 class 0x088000
[    1.665881] pci 0000:17:16.1: [8086:208f] type 00 class 0x088000
[    1.665881] pci 0000:17:1d.0: [8086:2054] type 00 class 0x088000
[    1.665881] pci 0000:17:1d.1: [8086:2055] type 00 class 0x088000
[    1.665881] pci 0000:17:1d.2: [8086:2056] type 00 class 0x088000
[    1.665881] pci 0000:17:1d.3: [8086:2057] type 00 class 0x088000
[    1.665929] pci 0000:17:1e.0: [8086:2080] type 00 class 0x088000
[    1.665996] pci 0000:17:1e.1: [8086:2081] type 00 class 0x088000
[    1.666053] pci 0000:17:1e.2: [8086:2082] type 00 class 0x088000
[    1.666107] pci 0000:17:1e.3: [8086:2083] type 00 class 0x088000
[    1.666265] pci 0000:17:1e.4: [8086:2084] type 00 class 0x088000
[    1.666321] pci 0000:17:1e.5: [8086:2085] type 00 class 0x088000
[    1.666377] pci 0000:17:1e.6: [8086:2086] type 00 class 0x088000
[    1.666434] pci 0000:17:1f.0: [8086:2078] type 00 class 0x088000
[    1.666507] pci 0000:17:1f.1: [8086:2079] type 00 class 0x088000
[    1.666561] pci 0000:17:1f.2: [8086:207a] type 00 class 0x088000
[    1.666614] pci 0000:17:1f.3: [8086:207b] type 00 class 0x088000
[    1.666668] pci 0000:17:1f.4: [8086:207c] type 00 class 0x088000
[    1.666722] pci 0000:17:1f.5: [8086:207d] type 00 class 0x088000
[    1.666777] pci 0000:17:1f.6: [8086:207e] type 00 class 0x088000
[    1.666831] pci 0000:17:1f.7: [8086:207f] type 00 class 0x088000
[    1.666929] pci 0000:18:00.0: [8086:1528] type 00 class 0x020000
[    1.666948] pci 0000:18:00.0: reg 0x10: [mem 0xaa800000-0xaa9fffff 64bit pref]
[    1.666963] pci 0000:18:00.0: reg 0x20: [mem 0xaaa00000-0xaaa03fff 64bit pref]
[    1.666968] pci 0000:18:00.0: reg 0x30: [mem 0xaac00000-0xaac7ffff pref]
[    1.667020] pci 0000:18:00.0: PME# supported from D0 D3hot
[    1.667042] pci 0000:18:00.0: reg 0x184: [mem 0xaad80000-0xaad83fff 64bit]
[    1.667043] pci 0000:18:00.0: VF(n) BAR0 space: [mem 0xaad80000-0xaae7ffff 64bit] (contains BAR0 for 64 VFs)
[    1.667052] pci 0000:18:00.0: reg 0x190: [mem 0xaac80000-0xaac83fff 64bit]
[    1.667053] pci 0000:18:00.0: VF(n) BAR3 space: [mem 0xaac80000-0xaad7ffff 64bit] (contains BAR3 for 64 VFs)
[    1.667242] pci 0000:17:00.0: PCI bridge to [bus 18]
[    1.667245] pci 0000:17:00.0:   bridge window [mem 0xaac00000-0xaaefffff]
[    1.667247] pci 0000:17:00.0:   bridge window [mem 0xaa800000-0xaaafffff 64bit pref]
[    1.667254] pci_bus 0000:17: on NUMA node 0
[    1.667373] ACPI: PCI Root Bridge [PC02] (domain 0000 [bus 3a-5c])
[    1.667376] acpi PNP0A08:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    1.667724] acpi PNP0A08:02: _OSC: platform does not support [SHPCHotplug AER LTR]
[    1.667909] acpi PNP0A08:02: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.667910] acpi PNP0A08:02: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.668047] PCI host bridge to bus 0000:3a
[    1.668048] pci_bus 0000:3a: root bus resource [io  0x6000-0x7fff window]
[    1.668049] pci_bus 0000:3a: root bus resource [mem 0xab000000-0xb87fffff window]
[    1.668050] pci_bus 0000:3a: root bus resource [mem 0x388000000000-0x38bfffffffff window]
[    1.668051] pci_bus 0000:3a: root bus resource [bus 3a-5c]
[    1.668060] pci 0000:3a:00.0: [8086:2030] type 01 class 0x060400
[    1.668085] pci 0000:3a:00.0: enabling Extended Tags
[    1.668114] pci 0000:3a:00.0: PME# supported from D0 D3hot D3cold
[    1.669204] pci 0000:3a:01.0: [8086:2031] type 01 class 0x060400
[    1.669204] pci 0000:3a:01.0: enabling Extended Tags
[    1.669204] pci 0000:3a:01.0: PME# supported from D0 D3hot D3cold
[    1.669214] pci 0000:3a:02.0: [8086:2032] type 01 class 0x060400
[    1.669214] pci 0000:3a:02.0: enabling Extended Tags
[    1.669214] pci 0000:3a:02.0: PME# supported from D0 D3hot D3cold
[    1.669219] pci 0000:3a:03.0: [8086:2033] type 01 class 0x060400
[    1.669219] pci 0000:3a:03.0: enabling Extended Tags
[    1.669219] pci 0000:3a:03.0: PME# supported from D0 D3hot D3cold
[    1.669219] pci 0000:3a:05.0: [8086:2034] type 00 class 0x088000
[    1.669219] pci 0000:3a:05.2: [8086:2035] type 00 class 0x088000
[    1.669219] pci 0000:3a:05.4: [8086:2036] type 00 class 0x080020
[    1.669219] pci 0000:3a:05.4: reg 0x10: [mem 0xb8700000-0xb8700fff]
[    1.669219] pci 0000:3a:05.6: [8086:2037] type 00 class 0x110100
[    1.669219] pci 0000:3a:07.0: [8086:2038] type 00 class 0x088000
[    1.669219] pci 0000:3a:07.1: [8086:2039] type 00 class 0x088000
[    1.669219] pci 0000:3a:07.2: [8086:203a] type 00 class 0x088000
[    1.669219] pci 0000:3a:07.3: [8086:203b] type 00 class 0x088000
[    1.669219] pci 0000:3a:07.4: [8086:203c] type 00 class 0x088000
[    1.669288] pci 0000:3a:07.7: [8086:203d] type 00 class 0x088000
[    1.669356] pci 0000:3a:08.0: [8086:2066] type 00 class 0x088000
[    1.669432] pci 0000:3a:08.1: [8086:2067] type 00 class 0x088000
[    1.669486] pci 0000:3a:09.0: [8086:2066] type 00 class 0x088000
[    1.669559] pci 0000:3a:09.1: [8086:2067] type 00 class 0x088000
[    1.669612] pci 0000:3a:0a.0: [8086:2040] type 00 class 0x088000
[    1.669683] pci 0000:3a:0a.1: [8086:2041] type 00 class 0x088000
[    1.669743] pci 0000:3a:0a.2: [8086:2042] type 00 class 0x088000
[    1.669802] pci 0000:3a:0a.3: [8086:2043] type 00 class 0x088000
[    1.669863] pci 0000:3a:0a.4: [8086:2044] type 00 class 0x088000
[    1.669922] pci 0000:3a:0a.5: [8086:2045] type 00 class 0x088000
[    1.669983] pci 0000:3a:0a.6: [8086:2046] type 00 class 0x088000
[    1.670043] pci 0000:3a:0a.7: [8086:2047] type 00 class 0x088000
[    1.670103] pci 0000:3a:0b.0: [8086:2048] type 00 class 0x088000
[    1.670175] pci 0000:3a:0b.1: [8086:2049] type 00 class 0x088000
[    1.670234] pci 0000:3a:0b.2: [8086:204a] type 00 class 0x088000
[    1.670294] pci 0000:3a:0b.3: [8086:204b] type 00 class 0x088000
[    1.670355] pci 0000:3a:0c.0: [8086:2040] type 00 class 0x088000
[    1.670428] pci 0000:3a:0c.1: [8086:2041] type 00 class 0x088000
[    1.670490] pci 0000:3a:0c.2: [8086:2042] type 00 class 0x088000
[    1.670557] pci 0000:3a:0c.3: [8086:2043] type 00 class 0x088000
[    1.670618] pci 0000:3a:0c.4: [8086:2044] type 00 class 0x088000
[    1.670679] pci 0000:3a:0c.5: [8086:2045] type 00 class 0x088000
[    1.670738] pci 0000:3a:0c.6: [8086:2046] type 00 class 0x088000
[    1.670797] pci 0000:3a:0c.7: [8086:2047] type 00 class 0x088000
[    1.670861] pci 0000:3a:0d.0: [8086:2048] type 00 class 0x088000
[    1.670937] pci 0000:3a:0d.1: [8086:2049] type 00 class 0x088000
[    1.671000] pci 0000:3a:0d.2: [8086:204a] type 00 class 0x088000
[    1.671065] pci 0000:3a:0d.3: [8086:204b] type 00 class 0x088000
[    1.671170] pci 0000:3a:00.0: PCI bridge to [bus 3b]
[    1.671204] pci 0000:3a:01.0: PCI bridge to [bus 3c]
[    1.671247] pci 0000:3d:00.0: [144d:a808] type 00 class 0x010802
[    1.671267] pci 0000:3d:00.0: reg 0x10: [mem 0xb8600000-0xb8603fff 64bit]
[    1.671427] pci 0000:3a:02.0: PCI bridge to [bus 3d]
[    1.671430] pci 0000:3a:02.0:   bridge window [mem 0xb8600000-0xb86fffff]
[    1.672543] pci 0000:3e:00.0: [144d:a808] type 00 class 0x010802
[    1.672543] pci 0000:3e:00.0: reg 0x10: [mem 0xb8500000-0xb8503fff 64bit]
[    1.672543] pci 0000:3a:03.0: PCI bridge to [bus 3e]
[    1.672543] pci 0000:3a:03.0:   bridge window [mem 0xb8500000-0xb85fffff]
[    1.672543] pci_bus 0000:3a: on NUMA node 0
[    1.672543] ACPI: PCI Root Bridge [PC03] (domain 0000 [bus 5d-7f])
[    1.672543] acpi PNP0A08:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    1.672543] acpi PNP0A08:03: _OSC: platform does not support [SHPCHotplug AER LTR]
[    1.672543] acpi PNP0A08:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.672543] acpi PNP0A08:03: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.672543] PCI host bridge to bus 0000:5d
[    1.672543] pci_bus 0000:5d: root bus resource [io  0x8000-0x9fff window]
[    1.672543] pci_bus 0000:5d: root bus resource [mem 0xb8800000-0xc5ffffff window]
[    1.672543] pci_bus 0000:5d: root bus resource [mem 0x38c000000000-0x38ffffffffff window]
[    1.672543] pci_bus 0000:5d: root bus resource [bus 5d-7f]
[    1.672543] pci 0000:5d:02.0: [8086:2032] type 01 class 0x060400
[    1.672543] pci 0000:5d:02.0: enabling Extended Tags
[    1.672543] pci 0000:5d:02.0: PME# supported from D0 D3hot D3cold
[    1.672616] pci 0000:5d:03.0: [8086:2033] type 01 class 0x060400
[    1.672641] pci 0000:5d:03.0: enabling Extended Tags
[    1.672672] pci 0000:5d:03.0: PME# supported from D0 D3hot D3cold
[    1.672762] pci 0000:5d:05.0: [8086:2034] type 00 class 0x088000
[    1.672835] pci 0000:5d:05.2: [8086:2035] type 00 class 0x088000
[    1.672911] pci 0000:5d:05.4: [8086:2036] type 00 class 0x080020
[    1.672920] pci 0000:5d:05.4: reg 0x10: [mem 0xc4400000-0xc4400fff]
[    1.672997] pci 0000:5d:05.5: [8086:201d] type 00 class 0x010400
[    1.673008] pci 0000:5d:05.5: reg 0x10: [mem 0x38fffc000000-0x38fffdffffff 64bit pref]
[    1.673012] pci 0000:5d:05.5: reg 0x18: [mem 0xc2000000-0xc3ffffff]
[    1.673021] pci 0000:5d:05.5: reg 0x20: [mem 0x38fffff00000-0x38ffffffffff 64bit]
[    1.673076] pci 0000:5d:05.6: [8086:2037] type 00 class 0x110100
[    1.673150] pci 0000:5d:07.0: [8086:2038] type 00 class 0x088000
[    1.673223] pci 0000:5d:07.1: [8086:2039] type 00 class 0x088000
[    1.673293] pci 0000:5d:07.2: [8086:203a] type 00 class 0x088000
[    1.673363] pci 0000:5d:07.3: [8086:203b] type 00 class 0x088000
[    1.673435] pci 0000:5d:07.4: [8086:203c] type 00 class 0x088000
[    1.673510] pci 0000:5d:07.7: [8086:203d] type 00 class 0x088000
[    1.673584] pci 0000:5d:0e.0: [8086:2058] type 00 class 0x110100
[    1.673662] pci 0000:5d:0e.1: [8086:2059] type 00 class 0x088000
[    1.673720] pci 0000:5d:0e.2: [8086:205a] type 00 class 0x088000
[    1.673776] pci 0000:5d:0e.3: [8086:205b] type 00 class 0x088000
[    1.673835] pci 0000:5d:0f.0: [8086:2058] type 00 class 0x110100
[    1.673909] pci 0000:5d:0f.1: [8086:2059] type 00 class 0x088000
[    1.673968] pci 0000:5d:0f.2: [8086:205a] type 00 class 0x088000
[    1.674031] pci 0000:5d:12.0: [8086:204c] type 00 class 0x110100
[    1.674106] pci 0000:5d:12.1: [8086:204d] type 00 class 0x110100
[    1.674153] pci 0000:5d:12.2: [8086:204e] type 00 class 0x088000
[    1.674200] pci 0000:5d:12.3: [8086:204f] type 00 class 0x088000
[    1.674255] pci 0000:5d:15.0: [8086:2018] type 00 class 0x088000
[    1.674318] pci 0000:5d:15.1: [8086:2088] type 00 class 0x110100
[    1.674365] pci 0000:5d:15.3: [8086:2019] type 00 class 0x088000
[    1.674412] pci 0000:5d:16.0: [8086:2018] type 00 class 0x088000
[    1.674473] pci 0000:5d:16.1: [8086:2088] type 00 class 0x110100
[    1.674521] pci 0000:5d:16.3: [8086:2019] type 00 class 0x088000
[    1.674567] pci 0000:5d:16.4: [8086:2018] type 00 class 0x088000
[    1.674615] pci 0000:5d:16.5: [8086:2088] type 00 class 0x110100
[    1.674662] pci 0000:5d:16.7: [8086:2019] type 00 class 0x088000
[    1.675871] pci 0000:5e:00.0: [144d:a808] type 00 class 0x010802
[    1.675871] pci 0000:5e:00.0: reg 0x10: [mem 0xc4300000-0xc4303fff 64bit]
[    1.675875] pci 0000:5d:02.0: PCI bridge to [bus 5e]
[    1.675875] pci 0000:5d:02.0:   bridge window [mem 0xc4300000-0xc43fffff]
[    1.675875] pci 0000:5f:00.0: [8086:37c0] type 01 class 0x060400
[    1.675875] pci 0000:5f:00.0: reg 0x10: [mem 0xc4200000-0xc421ffff 64bit]
[    1.675875] pci 0000:5f:00.0: reg 0x38: [mem 0xc4000000-0xc40fffff pref]
[    1.675875] pci 0000:5f:00.0: PME# supported from D0 D3hot D3cold
[    1.675875] pci 0000:5d:03.0: PCI bridge to [bus 5f-61]
[    1.675875] pci 0000:5d:03.0:   bridge window [mem 0xc4000000-0xc42fffff]
[    1.675875] pci 0000:5d:03.0:   bridge window [mem 0xbf000000-0xc19fffff 64bit pref]
[    1.675875] pci 0000:60:03.0: [8086:37c5] type 01 class 0x060400
[    1.675875] pci 0000:60:03.0: PME# supported from D0 D3hot D3cold
[    1.675875] pci 0000:5f:00.0: PCI bridge to [bus 60-61]
[    1.675875] pci 0000:5f:00.0:   bridge window [mem 0xc4100000-0xc41fffff]
[    1.675875] pci 0000:5f:00.0:   bridge window [mem 0xbf000000-0xc19fffff 64bit pref]
[    1.675875] pci 0000:61:00.0: [8086:37d1] type 00 class 0x020000
[    1.675875] pci 0000:61:00.0: reg 0x10: [mem 0xc0000000-0xc0ffffff 64bit pref]
[    1.675875] pci 0000:61:00.0: reg 0x1c: [mem 0xc1808000-0xc180ffff 64bit pref]
[    1.675875] pci 0000:61:00.0: reg 0x30: [mem 0xc4180000-0xc41fffff pref]
[    1.675875] pci 0000:61:00.0: enabling Extended Tags
[    1.675875] pci 0000:61:00.0: PME# supported from D0 D3hot D3cold
[    1.675875] pci 0000:61:00.0: reg 0x184: [mem 0xc1400000-0xc141ffff 64bit pref]
[    1.675875] pci 0000:61:00.0: VF(n) BAR0 space: [mem 0xc1400000-0xc17fffff 64bit pref] (contains BAR0 for 32 VFs)
[    1.675875] pci 0000:61:00.0: reg 0x190: [mem 0xc1890000-0xc1893fff 64bit pref]
[    1.675875] pci 0000:61:00.0: VF(n) BAR3 space: [mem 0xc1890000-0xc190ffff 64bit pref] (contains BAR3 for 32 VFs)
[    1.675875] pci 0000:61:00.1: [8086:37d1] type 00 class 0x020000
[    1.675875] pci 0000:61:00.1: reg 0x10: [mem 0xbf000000-0xbfffffff 64bit pref]
[    1.675875] pci 0000:61:00.1: reg 0x1c: [mem 0xc1800000-0xc1807fff 64bit pref]
[    1.675875] pci 0000:61:00.1: reg 0x30: [mem 0xc4100000-0xc417ffff pref]
[    1.675875] pci 0000:61:00.1: enabling Extended Tags
[    1.675875] pci 0000:61:00.1: PME# supported from D0 D3hot D3cold
[    1.675875] pci 0000:61:00.1: reg 0x184: [mem 0xc1000000-0xc101ffff 64bit pref]
[    1.675875] pci 0000:61:00.1: VF(n) BAR0 space: [mem 0xc1000000-0xc13fffff 64bit pref] (contains BAR0 for 32 VFs)
[    1.675875] pci 0000:61:00.1: reg 0x190: [mem 0xc1810000-0xc1813fff 64bit pref]
[    1.675875] pci 0000:61:00.1: VF(n) BAR3 space: [mem 0xc1810000-0xc188ffff 64bit pref] (contains BAR3 for 32 VFs)
[    1.675999] pci 0000:60:03.0: PCI bridge to [bus 61]
[    1.676003] pci 0000:60:03.0:   bridge window [mem 0xc4100000-0xc41fffff]
[    1.676007] pci 0000:60:03.0:   bridge window [mem 0xbf000000-0xc19fffff 64bit pref]
[    1.676024] pci_bus 0000:5d: on NUMA node 0
[    1.676175] ACPI: PCI Root Bridge [PC06] (domain 0000 [bus 80-84])
[    1.676178] acpi PNP0A08:06: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    1.676373] acpi PNP0A08:06: _OSC: platform does not support [SHPCHotplug AER LTR]
[    1.676513] acpi PNP0A08:06: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.676514] acpi PNP0A08:06: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.676642] PCI host bridge to bus 0000:80
[    1.676643] pci_bus 0000:80: root bus resource [io  0xa000-0xbfff window]
[    1.676644] pci_bus 0000:80: root bus resource [mem 0xc6000000-0xd37fffff window]
[    1.676646] pci_bus 0000:80: root bus resource [mem 0x390000000000-0x393fffffffff window]
[    1.676647] pci_bus 0000:80: root bus resource [bus 80-84]
[    1.676663] pci 0000:80:00.0: [8086:2030] type 01 class 0x060400
[    1.676690] pci 0000:80:00.0: enabling Extended Tags
[    1.676725] pci 0000:80:00.0: PME# supported from D0 D3hot D3cold
[    1.676823] pci 0000:80:04.0: [8086:2021] type 00 class 0x088000
[    1.676834] pci 0000:80:04.0: reg 0x10: [mem 0x393ffff1c000-0x393ffff1ffff 64bit]
[    1.676923] pci 0000:80:04.1: [8086:2021] type 00 class 0x088000
[    1.676934] pci 0000:80:04.1: reg 0x10: [mem 0x393ffff18000-0x393ffff1bfff 64bit]
[    1.677020] pci 0000:80:04.2: [8086:2021] type 00 class 0x088000
[    1.677030] pci 0000:80:04.2: reg 0x10: [mem 0x393ffff14000-0x393ffff17fff 64bit]
[    1.677120] pci 0000:80:04.3: [8086:2021] type 00 class 0x088000
[    1.677130] pci 0000:80:04.3: reg 0x10: [mem 0x393ffff10000-0x393ffff13fff 64bit]
[    1.677220] pci 0000:80:04.4: [8086:2021] type 00 class 0x088000
[    1.677230] pci 0000:80:04.4: reg 0x10: [mem 0x393ffff0c000-0x393ffff0ffff 64bit]
[    1.677318] pci 0000:80:04.5: [8086:2021] type 00 class 0x088000
[    1.677328] pci 0000:80:04.5: reg 0x10: [mem 0x393ffff08000-0x393ffff0bfff 64bit]
[    1.677415] pci 0000:80:04.6: [8086:2021] type 00 class 0x088000
[    1.677425] pci 0000:80:04.6: reg 0x10: [mem 0x393ffff04000-0x393ffff07fff 64bit]
[    1.677509] pci 0000:80:04.7: [8086:2021] type 00 class 0x088000
[    1.677519] pci 0000:80:04.7: reg 0x10: [mem 0x393ffff00000-0x393ffff03fff 64bit]
[    1.677604] pci 0000:80:05.0: [8086:2024] type 00 class 0x088000
[    1.677679] pci 0000:80:05.1: [8086:2022] type 00 class 0x088000
[    1.677781] pci 0000:80:05.2: [8086:2025] type 00 class 0x088000
[    1.677860] pci 0000:80:05.4: [8086:2026] type 00 class 0x080020
[    1.677869] pci 0000:80:05.4: reg 0x10: [mem 0xd3700000-0xd3700fff]
[    1.677949] pci 0000:80:05.6: [8086:2027] type 00 class 0x110100
[    1.679195] pci 0000:80:07.0: [8086:2028] type 00 class 0x088000
[    1.679205] pci 0000:80:07.4: [8086:202c] type 00 class 0x088000
[    1.679205] pci 0000:80:07.7: [8086:202d] type 00 class 0x088000
[    1.679205] pci 0000:80:08.0: [8086:2014] type 00 class 0x088000
[    1.679205] pci 0000:80:08.1: [8086:2015] type 00 class 0x110100
[    1.679205] pci 0000:80:08.2: [8086:2016] type 00 class 0x088000
[    1.679205] pci 0000:80:00.0: PCI bridge to [bus 81]
[    1.679205] pci_bus 0000:80: on NUMA node 1
[    1.679205] ACPI: PCI Root Bridge [PC07] (domain 0000 [bus 85-ad])
[    1.679205] acpi PNP0A08:07: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    1.679205] acpi PNP0A08:07: _OSC: platform does not support [SHPCHotplug AER LTR]
[    1.679205] acpi PNP0A08:07: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.679205] acpi PNP0A08:07: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.679307] PCI host bridge to bus 0000:85
[    1.679308] pci_bus 0000:85: root bus resource [io  0xc000-0xdfff window]
[    1.679310] pci_bus 0000:85: root bus resource [mem 0xd3800000-0xe0ffffff window]
[    1.679311] pci_bus 0000:85: root bus resource [mem 0x394000000000-0x397fffffffff window]
[    1.679312] pci_bus 0000:85: root bus resource [bus 85-ad]
[    1.679321] pci 0000:85:00.0: [8086:2030] type 01 class 0x060400
[    1.679349] pci 0000:85:00.0: enabling Extended Tags
[    1.679384] pci 0000:85:00.0: PME# supported from D0 D3hot D3cold
[    1.679508] pci 0000:85:02.0: [8086:2032] type 01 class 0x060400
[    1.679536] pci 0000:85:02.0: enabling Extended Tags
[    1.679570] pci 0000:85:02.0: PME# supported from D0 D3hot D3cold
[    1.679684] pci 0000:85:05.0: [8086:2034] type 00 class 0x088000
[    1.679770] pci 0000:85:05.2: [8086:2035] type 00 class 0x088000
[    1.679852] pci 0000:85:05.4: [8086:2036] type 00 class 0x080020
[    1.679860] pci 0000:85:05.4: reg 0x10: [mem 0xe0f00000-0xe0f00fff]
[    1.679945] pci 0000:85:05.6: [8086:2037] type 00 class 0x110100
[    1.680027] pci 0000:85:07.0: [8086:2038] type 00 class 0x088000
[    1.680107] pci 0000:85:07.1: [8086:2039] type 00 class 0x088000
[    1.680188] pci 0000:85:07.2: [8086:203a] type 00 class 0x088000
[    1.680271] pci 0000:85:07.3: [8086:203b] type 00 class 0x088000
[    1.680351] pci 0000:85:07.4: [8086:203c] type 00 class 0x088000
[    1.680432] pci 0000:85:07.7: [8086:203d] type 00 class 0x088000
[    1.680509] pci 0000:85:08.0: [8086:208d] type 00 class 0x088000
[    1.680578] pci 0000:85:08.1: [8086:208d] type 00 class 0x088000
[    1.680634] pci 0000:85:08.2: [8086:208d] type 00 class 0x088000
[    1.680693] pci 0000:85:08.3: [8086:208d] type 00 class 0x088000
[    1.680749] pci 0000:85:08.4: [8086:208d] type 00 class 0x088000
[    1.680805] pci 0000:85:08.5: [8086:208d] type 00 class 0x088000
[    1.680861] pci 0000:85:08.6: [8086:208d] type 00 class 0x088000
[    1.680918] pci 0000:85:08.7: [8086:208d] type 00 class 0x088000
[    1.680974] pci 0000:85:09.0: [8086:208d] type 00 class 0x088000
[    1.681042] pci 0000:85:09.1: [8086:208d] type 00 class 0x088000
[    1.681098] pci 0000:85:09.2: [8086:208d] type 00 class 0x088000
[    1.681154] pci 0000:85:09.3: [8086:208d] type 00 class 0x088000
[    1.681210] pci 0000:85:09.4: [8086:208d] type 00 class 0x088000
[    1.681267] pci 0000:85:09.5: [8086:208d] type 00 class 0x088000
[    1.681323] pci 0000:85:09.6: [8086:208d] type 00 class 0x088000
[    1.682540] pci 0000:85:09.7: [8086:208d] type 00 class 0x088000
[    1.682542] pci 0000:85:0a.0: [8086:208d] type 00 class 0x088000
[    1.682542] pci 0000:85:0a.1: [8086:208d] type 00 class 0x088000
[    1.682542] pci 0000:85:0e.0: [8086:208e] type 00 class 0x088000
[    1.682542] pci 0000:85:0e.1: [8086:208e] type 00 class 0x088000
[    1.682542] pci 0000:85:0e.2: [8086:208e] type 00 class 0x088000
[    1.682542] pci 0000:85:0e.3: [8086:208e] type 00 class 0x088000
[    1.682542] pci 0000:85:0e.4: [8086:208e] type 00 class 0x088000
[    1.682542] pci 0000:85:0e.5: [8086:208e] type 00 class 0x088000
[    1.682542] pci 0000:85:0e.6: [8086:208e] type 00 class 0x088000
[    1.682542] pci 0000:85:0e.7: [8086:208e] type 00 class 0x088000
[    1.682542] pci 0000:85:0f.0: [8086:208e] type 00 class 0x088000
[    1.682542] pci 0000:85:0f.1: [8086:208e] type 00 class 0x088000
[    1.682542] pci 0000:85:0f.2: [8086:208e] type 00 class 0x088000
[    1.682542] pci 0000:85:0f.3: [8086:208e] type 00 class 0x088000
[    1.682542] pci 0000:85:0f.4: [8086:208e] type 00 class 0x088000
[    1.682542] pci 0000:85:0f.5: [8086:208e] type 00 class 0x088000
[    1.682542] pci 0000:85:0f.6: [8086:208e] type 00 class 0x088000
[    1.682542] pci 0000:85:0f.7: [8086:208e] type 00 class 0x088000
[    1.682542] pci 0000:85:10.0: [8086:208e] type 00 class 0x088000
[    1.682553] pci 0000:85:10.1: [8086:208e] type 00 class 0x088000
[    1.682618] pci 0000:85:14.0: [8086:208f] type 00 class 0x088000
[    1.682687] pci 0000:85:14.1: [8086:208f] type 00 class 0x088000
[    1.682743] pci 0000:85:14.2: [8086:208f] type 00 class 0x088000
[    1.682799] pci 0000:85:14.3: [8086:208f] type 00 class 0x088000
[    1.682854] pci 0000:85:14.4: [8086:208f] type 00 class 0x088000
[    1.682909] pci 0000:85:14.5: [8086:208f] type 00 class 0x088000
[    1.682964] pci 0000:85:14.6: [8086:208f] type 00 class 0x088000
[    1.683021] pci 0000:85:14.7: [8086:208f] type 00 class 0x088000
[    1.683077] pci 0000:85:15.0: [8086:208f] type 00 class 0x088000
[    1.683146] pci 0000:85:15.1: [8086:208f] type 00 class 0x088000
[    1.683204] pci 0000:85:15.2: [8086:208f] type 00 class 0x088000
[    1.683259] pci 0000:85:15.3: [8086:208f] type 00 class 0x088000
[    1.683318] pci 0000:85:15.4: [8086:208f] type 00 class 0x088000
[    1.683373] pci 0000:85:15.5: [8086:208f] type 00 class 0x088000
[    1.683429] pci 0000:85:15.6: [8086:208f] type 00 class 0x088000
[    1.683484] pci 0000:85:15.7: [8086:208f] type 00 class 0x088000
[    1.683541] pci 0000:85:16.0: [8086:208f] type 00 class 0x088000
[    1.683610] pci 0000:85:16.1: [8086:208f] type 00 class 0x088000
[    1.683677] pci 0000:85:1d.0: [8086:2054] type 00 class 0x088000
[    1.683745] pci 0000:85:1d.1: [8086:2055] type 00 class 0x088000
[    1.683801] pci 0000:85:1d.2: [8086:2056] type 00 class 0x088000
[    1.683857] pci 0000:85:1d.3: [8086:2057] type 00 class 0x088000
[    1.683916] pci 0000:85:1e.0: [8086:2080] type 00 class 0x088000
[    1.683986] pci 0000:85:1e.1: [8086:2081] type 00 class 0x088000
[    1.684043] pci 0000:85:1e.2: [8086:2082] type 00 class 0x088000
[    1.684100] pci 0000:85:1e.3: [8086:2083] type 00 class 0x088000
[    1.684159] pci 0000:85:1e.4: [8086:2084] type 00 class 0x088000
[    1.684215] pci 0000:85:1e.5: [8086:2085] type 00 class 0x088000
[    1.684271] pci 0000:85:1e.6: [8086:2086] type 00 class 0x088000
[    1.684327] pci 0000:85:1f.0: [8086:2078] type 00 class 0x088000
[    1.684396] pci 0000:85:1f.1: [8086:2079] type 00 class 0x088000
[    1.684454] pci 0000:85:1f.2: [8086:207a] type 00 class 0x088000
[    1.684510] pci 0000:85:1f.3: [8086:207b] type 00 class 0x088000
[    1.684567] pci 0000:85:1f.4: [8086:207c] type 00 class 0x088000
[    1.684627] pci 0000:85:1f.5: [8086:207d] type 00 class 0x088000
[    1.685861] pci 0000:85:1f.6: [8086:207e] type 00 class 0x088000
[    1.685872] pci 0000:85:1f.7: [8086:207f] type 00 class 0x088000
[    1.685877] pci 0000:85:00.0: PCI bridge to [bus 86]
[    1.685877] pci 0000:85:02.0: PCI bridge to [bus 87]
[    1.685877] pci_bus 0000:85: on NUMA node 1
[    1.685877] ACPI: PCI Root Bridge [PC08] (domain 0000 [bus ae-d6])
[    1.685877] acpi PNP0A08:08: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    1.685877] acpi PNP0A08:08: _OSC: platform does not support [SHPCHotplug AER LTR]
[    1.685877] acpi PNP0A08:08: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.685877] acpi PNP0A08:08: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.685877] PCI host bridge to bus 0000:ae
[    1.685877] pci_bus 0000:ae: root bus resource [io  0xe000-0xefff window]
[    1.685877] pci_bus 0000:ae: root bus resource [mem 0xe1000000-0xee7fffff window]
[    1.685877] pci_bus 0000:ae: root bus resource [mem 0x398000000000-0x39bfffffffff window]
[    1.685877] pci_bus 0000:ae: root bus resource [bus ae-d6]
[    1.685877] pci 0000:ae:00.0: [8086:2030] type 01 class 0x060400
[    1.685877] pci 0000:ae:00.0: PME# supported from D0 D3hot D3cold
[    1.685877] pci 0000:ae:05.0: [8086:2034] type 00 class 0x088000
[    1.685948] pci 0000:ae:05.2: [8086:2035] type 00 class 0x088000
[    1.686022] pci 0000:ae:05.4: [8086:2036] type 00 class 0x080020
[    1.686031] pci 0000:ae:05.4: reg 0x10: [mem 0xee700000-0xee700fff]
[    1.686108] pci 0000:ae:05.6: [8086:2037] type 00 class 0x110100
[    1.686183] pci 0000:ae:07.0: [8086:2038] type 00 class 0x088000
[    1.686255] pci 0000:ae:07.1: [8086:2039] type 00 class 0x088000
[    1.686328] pci 0000:ae:07.2: [8086:203a] type 00 class 0x088000
[    1.686399] pci 0000:ae:07.3: [8086:203b] type 00 class 0x088000
[    1.686473] pci 0000:ae:07.4: [8086:203c] type 00 class 0x088000
[    1.686546] pci 0000:ae:07.7: [8086:203d] type 00 class 0x088000
[    1.686618] pci 0000:ae:08.0: [8086:2066] type 00 class 0x088000
[    1.686694] pci 0000:ae:08.1: [8086:2067] type 00 class 0x088000
[    1.686748] pci 0000:ae:09.0: [8086:2066] type 00 class 0x088000
[    1.686820] pci 0000:ae:09.1: [8086:2067] type 00 class 0x088000
[    1.686875] pci 0000:ae:0a.0: [8086:2040] type 00 class 0x088000
[    1.686951] pci 0000:ae:0a.1: [8086:2041] type 00 class 0x088000
[    1.687016] pci 0000:ae:0a.2: [8086:2042] type 00 class 0x088000
[    1.687085] pci 0000:ae:0a.3: [8086:2043] type 00 class 0x088000
[    1.687150] pci 0000:ae:0a.4: [8086:2044] type 00 class 0x088000
[    1.687215] pci 0000:ae:0a.5: [8086:2045] type 00 class 0x088000
[    1.687279] pci 0000:ae:0a.6: [8086:2046] type 00 class 0x088000
[    1.687343] pci 0000:ae:0a.7: [8086:2047] type 00 class 0x088000
[    1.687407] pci 0000:ae:0b.0: [8086:2048] type 00 class 0x088000
[    1.687485] pci 0000:ae:0b.1: [8086:2049] type 00 class 0x088000
[    1.687552] pci 0000:ae:0b.2: [8086:204a] type 00 class 0x088000
[    1.687618] pci 0000:ae:0b.3: [8086:204b] type 00 class 0x088000
[    1.687685] pci 0000:ae:0c.0: [8086:2040] type 00 class 0x088000
[    1.687762] pci 0000:ae:0c.1: [8086:2041] type 00 class 0x088000
[    1.687827] pci 0000:ae:0c.2: [8086:2042] type 00 class 0x088000
[    1.687893] pci 0000:ae:0c.3: [8086:2043] type 00 class 0x088000
[    1.687959] pci 0000:ae:0c.4: [8086:2044] type 00 class 0x088000
[    1.688024] pci 0000:ae:0c.5: [8086:2045] type 00 class 0x088000
[    1.689206] pci 0000:ae:0c.6: [8086:2046] type 00 class 0x088000
[    1.689206] pci 0000:ae:0c.7: [8086:2047] type 00 class 0x088000
[    1.689206] pci 0000:ae:0d.0: [8086:2048] type 00 class 0x088000
[    1.689206] pci 0000:ae:0d.1: [8086:2049] type 00 class 0x088000
[    1.689206] pci 0000:ae:0d.2: [8086:204a] type 00 class 0x088000
[    1.689207] pci 0000:ae:0d.3: [8086:204b] type 00 class 0x088000
[    1.689207] pci 0000:af:00.0: [1002:1478] type 01 class 0x060400
[    1.689207] pci 0000:af:00.0: reg 0x10: [mem 0xee600000-0xee603fff]
[    1.689207] pci 0000:af:00.0: PME# supported from D0 D3hot D3cold
[    1.689207] pci 0000:af:00.0: 63.008 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x8 link at 0000:ae:00.0 (capable of 126.024 Gb/s with 16.0 GT/s PCIe x8 link)
[    1.689212] pci 0000:ae:00.0: PCI bridge to [bus af-b1]
[    1.689212] pci 0000:ae:00.0:   bridge window [io  0xe000-0xefff]
[    1.689212] pci 0000:ae:00.0:   bridge window [mem 0xee500000-0xee6fffff]
[    1.689212] pci 0000:ae:00.0:   bridge window [mem 0x39bfe0000000-0x39bff01fffff 64bit pref]
[    1.689212] pci 0000:b0:00.0: [1002:1479] type 01 class 0x060400
[    1.689212] pci 0000:b0:00.0: PME# supported from D0 D3hot D3cold
[    1.689212] pci 0000:af:00.0: PCI bridge to [bus b0-b1]
[    1.689212] pci 0000:af:00.0:   bridge window [io  0xe000-0xefff]
[    1.689212] pci 0000:af:00.0:   bridge window [mem 0xee500000-0xee5fffff]
[    1.689212] pci 0000:af:00.0:   bridge window [mem 0x39bfe0000000-0x39bff01fffff 64bit pref]
[    1.689212] pci 0000:b1:00.0: [1002:7340] type 00 class 0x030000
[    1.689212] pci 0000:b1:00.0: reg 0x10: [mem 0x39bfe0000000-0x39bfefffffff 64bit pref]
[    1.689212] pci 0000:b1:00.0: reg 0x18: [mem 0x39bff0000000-0x39bff01fffff 64bit pref]
[    1.689212] pci 0000:b1:00.0: reg 0x20: [io  0xe000-0xe0ff]
[    1.689212] pci 0000:b1:00.0: reg 0x24: [mem 0xee500000-0xee57ffff]
[    1.689212] pci 0000:b1:00.0: reg 0x30: [mem 0xee580000-0xee59ffff pref]
[    1.689212] pci 0000:b1:00.0: BAR 0: assigned to efifb
[    1.689259] pci 0000:b1:00.0: PME# supported from D1 D2 D3hot D3cold
[    1.689325] pci 0000:b1:00.0: 63.008 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x8 link at 0000:ae:00.0 (capable of 252.048 Gb/s with 16.0 GT/s PCIe x16 link)
[    1.689368] pci 0000:b1:00.1: [1002:ab38] type 00 class 0x040300
[    1.689384] pci 0000:b1:00.1: reg 0x10: [mem 0xee5a0000-0xee5a3fff]
[    1.689462] pci 0000:b1:00.1: PME# supported from D1 D2 D3hot D3cold
[    1.689562] pci 0000:b0:00.0: PCI bridge to [bus b1]
[    1.689566] pci 0000:b0:00.0:   bridge window [io  0xe000-0xefff]
[    1.689569] pci 0000:b0:00.0:   bridge window [mem 0xee500000-0xee5fffff]
[    1.689573] pci 0000:b0:00.0:   bridge window [mem 0x39bfe0000000-0x39bff01fffff 64bit pref]
[    1.689589] pci_bus 0000:ae: on NUMA node 1
[    1.689686] ACPI: PCI Root Bridge [PC09] (domain 0000 [bus d7-ff])
[    1.689688] acpi PNP0A08:09: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    1.690031] acpi PNP0A08:09: _OSC: platform does not support [SHPCHotplug AER LTR]
[    1.690217] acpi PNP0A08:09: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    1.690217] acpi PNP0A08:09: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.690375] PCI host bridge to bus 0000:d7
[    1.690376] pci_bus 0000:d7: root bus resource [io  0xf000-0xffff window]
[    1.690377] pci_bus 0000:d7: root bus resource [mem 0xee800000-0xfbffffff window]
[    1.690379] pci_bus 0000:d7: root bus resource [mem 0x39c000000000-0x39ffffffffff window]
[    1.690380] pci_bus 0000:d7: root bus resource [bus d7-ff]
[    1.690389] pci 0000:d7:00.0: [8086:2030] type 01 class 0x060400
[    1.690418] pci 0000:d7:00.0: enabling Extended Tags
[    1.690453] pci 0000:d7:00.0: PME# supported from D0 D3hot D3cold
[    1.690567] pci 0000:d7:05.0: [8086:2034] type 00 class 0x088000
[    1.690647] pci 0000:d7:05.2: [8086:2035] type 00 class 0x088000
[    1.690722] pci 0000:d7:05.4: [8086:2036] type 00 class 0x080020
[    1.690731] pci 0000:d7:05.4: reg 0x10: [mem 0xfbf00000-0xfbf00fff]
[    1.690813] pci 0000:d7:05.6: [8086:2037] type 00 class 0x110100
[    1.690889] pci 0000:d7:07.0: [8086:2038] type 00 class 0x088000
[    1.690969] pci 0000:d7:07.1: [8086:2039] type 00 class 0x088000
[    1.691045] pci 0000:d7:07.2: [8086:203a] type 00 class 0x088000
[    1.691120] pci 0000:d7:07.3: [8086:203b] type 00 class 0x088000
[    1.691196] pci 0000:d7:07.4: [8086:203c] type 00 class 0x088000
[    1.691270] pci 0000:d7:07.7: [8086:203d] type 00 class 0x088000
[    1.691347] pci 0000:d7:0e.0: [8086:2058] type 00 class 0x110100
[    1.692539] pci 0000:d7:0e.1: [8086:2059] type 00 class 0x088000
[    1.692539] pci 0000:d7:0e.2: [8086:205a] type 00 class 0x088000
[    1.692539] pci 0000:d7:0e.3: [8086:205b] type 00 class 0x088000
[    1.692539] pci 0000:d7:0f.0: [8086:2058] type 00 class 0x110100
[    1.692539] pci 0000:d7:0f.1: [8086:2059] type 00 class 0x088000
[    1.692546] pci 0000:d7:0f.2: [8086:205a] type 00 class 0x088000
[    1.692546] pci 0000:d7:12.0: [8086:204c] type 00 class 0x110100
[    1.692546] pci 0000:d7:12.1: [8086:204d] type 00 class 0x110100
[    1.692546] pci 0000:d7:12.2: [8086:204e] type 00 class 0x088000
[    1.692546] pci 0000:d7:12.3: [8086:204f] type 00 class 0x088000
[    1.692546] pci 0000:d7:15.0: [8086:2018] type 00 class 0x088000
[    1.692546] pci 0000:d7:15.1: [8086:2088] type 00 class 0x110100
[    1.692546] pci 0000:d7:15.3: [8086:2019] type 00 class 0x088000
[    1.692546] pci 0000:d7:16.0: [8086:2018] type 00 class 0x088000
[    1.692546] pci 0000:d7:16.1: [8086:2088] type 00 class 0x110100
[    1.692546] pci 0000:d7:16.3: [8086:2019] type 00 class 0x088000
[    1.692546] pci 0000:d7:16.4: [8086:2018] type 00 class 0x088000
[    1.692547] pci 0000:d7:16.5: [8086:2088] type 00 class 0x110100
[    1.692547] pci 0000:d7:16.7: [8086:2019] type 00 class 0x088000
[    1.692611] pci 0000:d8:00.0: [8086:24fd] type 00 class 0x028000
[    1.692651] pci 0000:d8:00.0: reg 0x10: [mem 0xfbe00000-0xfbe01fff 64bit]
[    1.692804] pci 0000:d8:00.0: PME# supported from D0 D3hot D3cold
[    1.692962] pci 0000:d7:00.0: PCI bridge to [bus d8]
[    1.692965] pci 0000:d7:00.0:   bridge window [mem 0xfbe00000-0xfbefffff]
[    1.692974] pci_bus 0000:d7: on NUMA node 1
[    1.693333] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 10 *11 12 14 15)
[    1.693379] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 *10 11 12 14 15)
[    1.693424] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 10 *11 12 14 15)
[    1.693468] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15)
[    1.693511] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 10 *11 12 14 15)
[    1.693555] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 10 *11 12 14 15)
[    1.693599] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 10 *11 12 14 15)
[    1.693643] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 10 *11 12 14 15)
[    1.694022] iommu: Default domain type: Translated
[    1.694035] pci 0000:04:00.0: vgaarb: setting as boot VGA device
[    1.694035] pci 0000:04:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    1.694035] pci 0000:b1:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none
[    1.694035] pci 0000:04:00.0: vgaarb: bridge control possible
[    1.694035] pci 0000:b1:00.0: vgaarb: bridge control possible
[    1.694035] pci 0000:b1:00.0: vgaarb: overriding boot device
[    1.694035] vgaarb: loaded
[    1.694035] SCSI subsystem initialized
[    1.694035] libata version 3.00 loaded.
[    1.694035] ACPI: bus type USB registered
[    1.694035] usbcore: registered new interface driver usbfs
[    1.694035] usbcore: registered new interface driver hub
[    1.694035] usbcore: registered new device driver usb
[    1.694035] mc: Linux media interface: v0.10
[    1.694035] videodev: Linux video capture interface: v2.00
[    1.694035] pps_core: LinuxPPS API ver. 1 registered
[    1.694035] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <[email protected]>
[    1.694035] PTP clock support registered
[    1.695861] EDAC MC: Ver: 3.0.0
[    1.695932] Registered efivars operations
[    1.695975] Advanced Linux Sound Architecture Driver Initialized.
[    1.695975] PCI: Using ACPI for IRQ routing
[    1.699145] PCI: pci_cache_line_size set to 64 bytes
[    1.699583] e820: reserve RAM buffer [mem 0x0003e000-0x0003ffff]
[    1.699585] e820: reserve RAM buffer [mem 0x64261000-0x67ffffff]
[    1.699586] e820: reserve RAM buffer [mem 0x69eb6000-0x6bffffff]
[    1.699586] e820: reserve RAM buffer [mem 0x6c4ee000-0x6fffffff]
[    1.699715] Bluetooth: Core ver 2.22
[    1.699721] NET: Registered protocol family 31
[    1.699721] Bluetooth: HCI device and connection manager initialized
[    1.699722] Bluetooth: HCI socket layer initialized
[    1.699723] Bluetooth: L2CAP socket layer initialized
[    1.699725] Bluetooth: SCO socket layer initialized
[    1.699733] NetLabel: Initializing
[    1.699733] NetLabel:  domain hash size = 128
[    1.699734] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[    1.699746] NetLabel:  unlabeled traffic allowed by default
[    1.699946] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    1.699949] hpet0: 8 comparators, 64-bit 24.000000 MHz counter
[    1.702610] clocksource: Switched to clocksource tsc-early
[    1.735473] VFS: Disk quotas dquot_6.6.0
[    1.735531] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    1.735590] FS-Cache: Loaded
[    1.735720] CacheFiles: Loaded
[    1.735748] pnp: PnP ACPI init
[    1.739086] pnp 00:00: Plug and Play ACPI device, IDs PNP0b00 (active)
[    1.739455] system 00:01: [io  0x0500-0x05fe] has been reserved
[    1.739456] system 00:01: [io  0x0400-0x047f] has been reserved
[    1.739457] system 00:01: [io  0x0600-0x061f] has been reserved
[    1.739459] system 00:01: [io  0x0880-0x0883] has been reserved
[    1.739460] system 00:01: [io  0x0800-0x081f] has been reserved
[    1.739464] system 00:01: [mem 0xfed1c000-0xfed3ffff] could not be reserved
[    1.739465] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved
[    1.739466] system 00:01: [mem 0xff000000-0xffffffff] has been reserved
[    1.739467] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved
[    1.739468] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved
[    1.739469] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved
[    1.739470] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved
[    1.739476] system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active)
[    1.740000] system 00:02: [io  0x0a00-0x0a0f] has been reserved
[    1.740001] system 00:02: [io  0x0a10-0x0a1f] has been reserved
[    1.740002] system 00:02: [io  0x0a20-0x0a2f] has been reserved
[    1.740003] system 00:02: [io  0x0a30-0x0a3f] has been reserved
[    1.740004] system 00:02: [io  0x0a40-0x0a4f] has been reserved
[    1.740011] system 00:02: Plug and Play ACPI device, IDs PNP0c02 (active)
[    1.740257] pnp 00:03: [dma 0 disabled]
[    1.740293] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active)
[    1.740563] system 00:04: [mem 0xfd000000-0xfdabffff] has been reserved
[    1.740566] system 00:04: [mem 0xfdad0000-0xfdadffff] has been reserved
[    1.740567] system 00:04: [mem 0xfdb00000-0xfdffffff] has been reserved
[    1.740568] system 00:04: [mem 0xfe000000-0xfe00ffff] has been reserved
[    1.740569] system 00:04: [mem 0xfe011000-0xfe01ffff] has been reserved
[    1.740570] system 00:04: [mem 0xfe036000-0xfe03bfff] has been reserved
[    1.740571] system 00:04: [mem 0xfe03d000-0xfe3fffff] has been reserved
[    1.740573] system 00:04: [mem 0xfe410000-0xfe7fffff] has been reserved
[    1.740578] system 00:04: Plug and Play ACPI device, IDs PNP0c02 (active)
[    1.740931] system 00:05: [io  0x0f00-0x0ffe] has been reserved
[    1.740937] system 00:05: Plug and Play ACPI device, IDs PNP0c02 (active)
[    1.741668] pnp: PnP ACPI: found 6 devices
[    1.747788] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    1.747861] pci 0000:00:1f.4: BAR 0: assigned [mem 0x380000000000-0x3800000000ff 64bit]
[    1.747871] pci 0000:00:1c.0: PCI bridge to [bus 01]
[    1.747879] pci 0000:00:1c.2: PCI bridge to [bus 02]
[    1.747883] pci 0000:00:1c.2:   bridge window [mem 0x9d100000-0x9d1fffff]
[    1.747889] pci 0000:03:00.0: PCI bridge to [bus 04]
[    1.747891] pci 0000:03:00.0:   bridge window [io  0x2000-0x2fff]
[    1.747896] pci 0000:03:00.0:   bridge window [mem 0x9c000000-0x9d0fffff]
[    1.747904] pci 0000:00:1c.5: PCI bridge to [bus 03-04]
[    1.747906] pci 0000:00:1c.5:   bridge window [io  0x2000-0x2fff]
[    1.747909] pci 0000:00:1c.5:   bridge window [mem 0x9c000000-0x9d0fffff]
[    1.747915] pci_bus 0000:00: resource 4 [io  0x0000-0x03af window]
[    1.747916] pci_bus 0000:00: resource 5 [io  0x03e0-0x0cf7 window]
[    1.747917] pci_bus 0000:00: resource 6 [io  0x03b0-0x03bb window]
[    1.747918] pci_bus 0000:00: resource 7 [io  0x03c0-0x03df window]
[    1.747919] pci_bus 0000:00: resource 8 [io  0x1000-0x3fff window]
[    1.747920] pci_bus 0000:00: resource 9 [mem 0x000a0000-0x000bffff window]
[    1.747921] pci_bus 0000:00: resource 10 [mem 0x000c4000-0x000c7fff window]
[    1.747922] pci_bus 0000:00: resource 11 [mem 0xfe010000-0xfe010fff window]
[    1.747922] pci_bus 0000:00: resource 12 [mem 0x90000000-0x9d7fffff window]
[    1.747923] pci_bus 0000:00: resource 13 [mem 0x380000000000-0x383fffffffff window]
[    1.747925] pci_bus 0000:02: resource 1 [mem 0x9d100000-0x9d1fffff]
[    1.747926] pci_bus 0000:03: resource 0 [io  0x2000-0x2fff]
[    1.747927] pci_bus 0000:03: resource 1 [mem 0x9c000000-0x9d0fffff]
[    1.747928] pci_bus 0000:04: resource 0 [io  0x2000-0x2fff]
[    1.747929] pci_bus 0000:04: resource 1 [mem 0x9c000000-0x9d0fffff]
[    1.748021] pci 0000:17:00.0: PCI bridge to [bus 18]
[    1.748024] pci 0000:17:00.0:   bridge window [mem 0xaac00000-0xaaefffff]
[    1.748026] pci 0000:17:00.0:   bridge window [mem 0xaa800000-0xaaafffff 64bit pref]
[    1.748031] pci_bus 0000:17: resource 4 [io  0x4000-0x5fff window]
[    1.748032] pci_bus 0000:17: resource 5 [mem 0x9d800000-0xaaffffff window]
[    1.748033] pci_bus 0000:17: resource 6 [mem 0x384000000000-0x387fffffffff window]
[    1.748034] pci_bus 0000:18: resource 1 [mem 0xaac00000-0xaaefffff]
[    1.748035] pci_bus 0000:18: resource 2 [mem 0xaa800000-0xaaafffff 64bit pref]
[    1.748056] pci 0000:3a:00.0: PCI bridge to [bus 3b]
[    1.748062] pci 0000:3a:01.0: PCI bridge to [bus 3c]
[    1.748067] pci 0000:3a:02.0: PCI bridge to [bus 3d]
[    1.748070] pci 0000:3a:02.0:   bridge window [mem 0xb8600000-0xb86fffff]
[    1.748074] pci 0000:3a:03.0: PCI bridge to [bus 3e]
[    1.748076] pci 0000:3a:03.0:   bridge window [mem 0xb8500000-0xb85fffff]
[    1.748081] pci_bus 0000:3a: resource 4 [io  0x6000-0x7fff window]
[    1.748082] pci_bus 0000:3a: resource 5 [mem 0xab000000-0xb87fffff window]
[    1.748083] pci_bus 0000:3a: resource 6 [mem 0x388000000000-0x38bfffffffff window]
[    1.748084] pci_bus 0000:3d: resource 1 [mem 0xb8600000-0xb86fffff]
[    1.748085] pci_bus 0000:3e: resource 1 [mem 0xb8500000-0xb85fffff]
[    1.748102] pci 0000:5d:02.0: PCI bridge to [bus 5e]
[    1.748105] pci 0000:5d:02.0:   bridge window [mem 0xc4300000-0xc43fffff]
[    1.748110] pci 0000:60:03.0: PCI bridge to [bus 61]
[    1.748113] pci 0000:60:03.0:   bridge window [mem 0xc4100000-0xc41fffff]
[    1.748116] pci 0000:60:03.0:   bridge window [mem 0xbf000000-0xc19fffff 64bit pref]
[    1.748121] pci 0000:5f:00.0: PCI bridge to [bus 60-61]
[    1.748124] pci 0000:5f:00.0:   bridge window [mem 0xc4100000-0xc41fffff]
[    1.748126] pci 0000:5f:00.0:   bridge window [mem 0xbf000000-0xc19fffff 64bit pref]
[    1.748130] pci 0000:5d:03.0: PCI bridge to [bus 5f-61]
[    1.748132] pci 0000:5d:03.0:   bridge window [mem 0xc4000000-0xc42fffff]
[    1.748134] pci 0000:5d:03.0:   bridge window [mem 0xbf000000-0xc19fffff 64bit pref]
[    1.748138] pci_bus 0000:5d: resource 4 [io  0x8000-0x9fff window]
[    1.748139] pci_bus 0000:5d: resource 5 [mem 0xb8800000-0xc5ffffff window]
[    1.748140] pci_bus 0000:5d: resource 6 [mem 0x38c000000000-0x38ffffffffff window]
[    1.748141] pci_bus 0000:5e: resource 1 [mem 0xc4300000-0xc43fffff]
[    1.748142] pci_bus 0000:5f: resource 1 [mem 0xc4000000-0xc42fffff]
[    1.748143] pci_bus 0000:5f: resource 2 [mem 0xbf000000-0xc19fffff 64bit pref]
[    1.748144] pci_bus 0000:60: resource 1 [mem 0xc4100000-0xc41fffff]
[    1.748145] pci_bus 0000:60: resource 2 [mem 0xbf000000-0xc19fffff 64bit pref]
[    1.748146] pci_bus 0000:61: resource 1 [mem 0xc4100000-0xc41fffff]
[    1.748147] pci_bus 0000:61: resource 2 [mem 0xbf000000-0xc19fffff 64bit pref]
[    1.748163] pci 0000:80:00.0: PCI bridge to [bus 81]
[    1.748168] pci_bus 0000:80: resource 4 [io  0xa000-0xbfff window]
[    1.748169] pci_bus 0000:80: resource 5 [mem 0xc6000000-0xd37fffff window]
[    1.748170] pci_bus 0000:80: resource 6 [mem 0x390000000000-0x393fffffffff window]
[    1.748186] pci 0000:85:00.0: PCI bridge to [bus 86]
[    1.748191] pci 0000:85:02.0: PCI bridge to [bus 87]
[    1.748198] pci_bus 0000:85: resource 4 [io  0xc000-0xdfff window]
[    1.748199] pci_bus 0000:85: resource 5 [mem 0xd3800000-0xe0ffffff window]
[    1.748200] pci_bus 0000:85: resource 6 [mem 0x394000000000-0x397fffffffff window]
[    1.748221] pci 0000:b0:00.0: PCI bridge to [bus b1]
[    1.748223] pci 0000:b0:00.0:   bridge window [io  0xe000-0xefff]
[    1.748226] pci 0000:b0:00.0:   bridge window [mem 0xee500000-0xee5fffff]
[    1.748228] pci 0000:b0:00.0:   bridge window [mem 0x39bfe0000000-0x39bff01fffff 64bit pref]
[    1.748232] pci 0000:af:00.0: PCI bridge to [bus b0-b1]
[    1.748234] pci 0000:af:00.0:   bridge window [io  0xe000-0xefff]
[    1.748237] pci 0000:af:00.0:   bridge window [mem 0xee500000-0xee5fffff]
[    1.748240] pci 0000:af:00.0:   bridge window [mem 0x39bfe0000000-0x39bff01fffff 64bit pref]
[    1.748244] pci 0000:ae:00.0: PCI bridge to [bus af-b1]
[    1.748245] pci 0000:ae:00.0:   bridge window [io  0xe000-0xefff]
[    1.748248] pci 0000:ae:00.0:   bridge window [mem 0xee500000-0xee6fffff]
[    1.748249] pci 0000:ae:00.0:   bridge window [mem 0x39bfe0000000-0x39bff01fffff 64bit pref]
[    1.748253] pci_bus 0000:ae: resource 4 [io  0xe000-0xefff window]
[    1.748254] pci_bus 0000:ae: resource 5 [mem 0xe1000000-0xee7fffff window]
[    1.748255] pci_bus 0000:ae: resource 6 [mem 0x398000000000-0x39bfffffffff window]
[    1.748256] pci_bus 0000:af: resource 0 [io  0xe000-0xefff]
[    1.748257] pci_bus 0000:af: resource 1 [mem 0xee500000-0xee6fffff]
[    1.748258] pci_bus 0000:af: resource 2 [mem 0x39bfe0000000-0x39bff01fffff 64bit pref]
[    1.748259] pci_bus 0000:b0: resource 0 [io  0xe000-0xefff]
[    1.748259] pci_bus 0000:b0: resource 1 [mem 0xee500000-0xee5fffff]
[    1.748260] pci_bus 0000:b0: resource 2 [mem 0x39bfe0000000-0x39bff01fffff 64bit pref]
[    1.748261] pci_bus 0000:b1: resource 0 [io  0xe000-0xefff]
[    1.748262] pci_bus 0000:b1: resource 1 [mem 0xee500000-0xee5fffff]
[    1.748263] pci_bus 0000:b1: resource 2 [mem 0x39bfe0000000-0x39bff01fffff 64bit pref]
[    1.748278] pci 0000:d7:00.0: PCI bridge to [bus d8]
[    1.748281] pci 0000:d7:00.0:   bridge window [mem 0xfbe00000-0xfbefffff]
[    1.748286] pci_bus 0000:d7: resource 4 [io  0xf000-0xffff window]
[    1.748287] pci_bus 0000:d7: resource 5 [mem 0xee800000-0xfbffffff window]
[    1.748288] pci_bus 0000:d7: resource 6 [mem 0x39c000000000-0x39ffffffffff window]
[    1.748289] pci_bus 0000:d8: resource 1 [mem 0xfbe00000-0xfbefffff]
[    1.748382] NET: Registered protocol family 2
[    1.748873] tcp_listen_portaddr_hash hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc)
[    1.749132] TCP established hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc)
[    1.749716] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc)
[    1.749843] TCP: Hash tables configured (established 524288 bind 65536)
[    1.750161] UDP hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc)
[    1.750488] UDP-Lite hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc)
[    1.750872] NET: Registered protocol family 1
[    1.751001] NET: Registered protocol family 44
[    1.751377] pci 0000:02:00.0: PME# does not work under D0, disabling it
[    1.751525] pci 0000:17:05.0: disabled boot interrupts on device [8086:2034]
[    1.751641] pci 0000:18:00.0: CLS mismatch (64 != 32), using 64 bytes
[    1.751648] pci 0000:3a:05.0: disabled boot interrupts on device [8086:2034]
[    1.751692] pci 0000:5d:05.0: disabled boot interrupts on device [8086:2034]
[    1.751751] pci 0000:85:05.0: disabled boot interrupts on device [8086:2034]
[    1.751835] pci 0000:ae:05.0: disabled boot interrupts on device [8086:2034]
[    1.751876] pci 0000:b1:00.0: disabling ATS
[    1.751937] pci 0000:b1:00.1: D0 power state depends on 0000:b1:00.0
[    1.751943] pci 0000:d7:05.0: disabled boot interrupts on device [8086:2034]
[    1.751998] Unpacking initramfs...
[    7.573187] Freeing initrd memory: 341128K
[    7.574017] DMAR: dmar6: Using Queued invalidation
[    7.574023] DMAR: dmar5: Using Queued invalidation
[    7.574028] DMAR: dmar4: Using Queued invalidation
[    7.574032] DMAR: dmar3: Using Queued invalidation
[    7.574039] DMAR: dmar2: Using Queued invalidation
[    7.574045] DMAR: dmar1: Using Queued invalidation
[    7.574050] DMAR: dmar0: Using Queued invalidation
[    7.574057] DMAR: dmar7: Using Queued invalidation
[    7.575193] pci 0000:00:00.0: Adding to iommu group 0
[    7.576258] pci 0000:00:04.0: Adding to iommu group 1
[    7.576325] pci 0000:00:04.1: Adding to iommu group 1
[    7.576393] pci 0000:00:04.2: Adding to iommu group 1
[    7.576458] pci 0000:00:04.3: Adding to iommu group 1
[    7.576523] pci 0000:00:04.4: Adding to iommu group 1
[    7.576588] pci 0000:00:04.5: Adding to iommu group 1
[    7.576653] pci 0000:00:04.6: Adding to iommu group 1
[    7.576718] pci 0000:00:04.7: Adding to iommu group 1
[    7.577627] pci 0000:00:05.0: Adding to iommu group 2
[    7.577696] pci 0000:00:05.1: Adding to iommu group 2
[    7.577761] pci 0000:00:05.2: Adding to iommu group 2
[    7.577827] pci 0000:00:05.4: Adding to iommu group 2
[    7.577892] pci 0000:00:05.6: Adding to iommu group 2
[    7.578697] pci 0000:00:07.0: Adding to iommu group 3
[    7.578765] pci 0000:00:07.4: Adding to iommu group 3
[    7.578830] pci 0000:00:07.7: Adding to iommu group 3
[    7.579444] pci 0000:00:08.0: Adding to iommu group 4
[    7.579511] pci 0000:00:08.1: Adding to iommu group 4
[    7.579577] pci 0000:00:08.2: Adding to iommu group 4
[    7.580240] pci 0000:00:11.0: Adding to iommu group 5
[    7.580307] pci 0000:00:11.1: Adding to iommu group 5
[    7.580373] pci 0000:00:11.5: Adding to iommu group 5
[    7.581088] pci 0000:00:14.0: Adding to iommu group 6
[    7.581156] pci 0000:00:14.2: Adding to iommu group 6
[    7.581750] pci 0000:00:16.0: Adding to iommu group 7
[    7.581817] pci 0000:00:16.1: Adding to iommu group 7
[    7.581883] pci 0000:00:16.4: Adding to iommu group 7
[    7.582478] pci 0000:00:17.0: Adding to iommu group 8
[    7.582966] pci 0000:00:1c.0: Adding to iommu group 9
[    7.583441] pci 0000:00:1c.2: Adding to iommu group 10
[    7.584056] pci 0000:00:1c.5: Adding to iommu group 11
[    7.585652] pci 0000:00:1f.0: Adding to iommu group 12
[    7.585721] pci 0000:00:1f.2: Adding to iommu group 12
[    7.585791] pci 0000:00:1f.3: Adding to iommu group 12
[    7.585859] pci 0000:00:1f.4: Adding to iommu group 12
[    7.585932] pci 0000:00:1f.5: Adding to iommu group 12
[    7.586541] pci 0000:02:00.0: Adding to iommu group 13
[    7.587118] pci 0000:03:00.0: Adding to iommu group 14
[    7.587126] pci 0000:04:00.0: Adding to iommu group 14
[    7.587527] pci 0000:17:00.0: Adding to iommu group 15
[    7.588302] pci 0000:17:05.0: Adding to iommu group 16
[    7.588375] pci 0000:17:05.2: Adding to iommu group 16
[    7.588444] pci 0000:17:05.4: Adding to iommu group 16
[    7.588513] pci 0000:17:05.6: Adding to iommu group 16
[    7.589461] pci 0000:17:07.0: Adding to iommu group 17
[    7.589533] pci 0000:17:07.1: Adding to iommu group 17
[    7.589602] pci 0000:17:07.2: Adding to iommu group 17
[    7.589674] pci 0000:17:07.3: Adding to iommu group 17
[    7.589744] pci 0000:17:07.4: Adding to iommu group 17
[    7.589813] pci 0000:17:07.7: Adding to iommu group 17
[    7.590726] pci 0000:17:08.0: Adding to iommu group 18
[    7.590798] pci 0000:17:08.1: Adding to iommu group 18
[    7.590869] pci 0000:17:08.2: Adding to iommu group 18
[    7.590939] pci 0000:17:08.3: Adding to iommu group 18
[    7.591009] pci 0000:17:08.4: Adding to iommu group 18
[    7.591078] pci 0000:17:08.5: Adding to iommu group 18
[    7.591148] pci 0000:17:08.6: Adding to iommu group 18
[    7.591218] pci 0000:17:08.7: Adding to iommu group 18
[    7.592270] pci 0000:17:09.0: Adding to iommu group 19
[    7.592343] pci 0000:17:09.1: Adding to iommu group 19
[    7.592414] pci 0000:17:09.2: Adding to iommu group 19
[    7.592484] pci 0000:17:09.3: Adding to iommu group 19
[    7.592556] pci 0000:17:09.4: Adding to iommu group 19
[    7.592626] pci 0000:17:09.5: Adding to iommu group 19
[    7.592699] pci 0000:17:09.6: Adding to iommu group 19
[    7.592769] pci 0000:17:09.7: Adding to iommu group 19
[    7.593496] pci 0000:17:0a.0: Adding to iommu group 20
[    7.593570] pci 0000:17:0a.1: Adding to iommu group 20
[    7.594619] pci 0000:17:0e.0: Adding to iommu group 21
[    7.594694] pci 0000:17:0e.1: Adding to iommu group 21
[    7.594766] pci 0000:17:0e.2: Adding to iommu group 21
[    7.594838] pci 0000:17:0e.3: Adding to iommu group 21
[    7.594909] pci 0000:17:0e.4: Adding to iommu group 21
[    7.594981] pci 0000:17:0e.5: Adding to iommu group 21
[    7.595052] pci 0000:17:0e.6: Adding to iommu group 21
[    7.595126] pci 0000:17:0e.7: Adding to iommu group 21
[    7.596079] pci 0000:17:0f.0: Adding to iommu group 22
[    7.596155] pci 0000:17:0f.1: Adding to iommu group 22
[    7.596228] pci 0000:17:0f.2: Adding to iommu group 22
[    7.596301] pci 0000:17:0f.3: Adding to iommu group 22
[    7.596373] pci 0000:17:0f.4: Adding to iommu group 22
[    7.596447] pci 0000:17:0f.5: Adding to iommu group 22
[    7.596522] pci 0000:17:0f.6: Adding to iommu group 22
[    7.596595] pci 0000:17:0f.7: Adding to iommu group 22
[    7.597282] pci 0000:17:10.0: Adding to iommu group 23
[    7.597359] pci 0000:17:10.1: Adding to iommu group 23
[    7.598432] pci 0000:17:14.0: Adding to iommu group 24
[    7.598509] pci 0000:17:14.1: Adding to iommu group 24
[    7.598584] pci 0000:17:14.2: Adding to iommu group 24
[    7.598659] pci 0000:17:14.3: Adding to iommu group 24
[    7.598733] pci 0000:17:14.4: Adding to iommu group 24
[    7.598807] pci 0000:17:14.5: Adding to iommu group 24
[    7.598883] pci 0000:17:14.6: Adding to iommu group 24
[    7.598957] pci 0000:17:14.7: Adding to iommu group 24
[    7.599884] pci 0000:17:15.0: Adding to iommu group 25
[    7.599962] pci 0000:17:15.1: Adding to iommu group 25
[    7.600037] pci 0000:17:15.2: Adding to iommu group 25
[    7.600113] pci 0000:17:15.3: Adding to iommu group 25
[    7.600193] pci 0000:17:15.4: Adding to iommu group 25
[    7.600268] pci 0000:17:15.5: Adding to iommu group 25
[    7.600343] pci 0000:17:15.6: Adding to iommu group 25
[    7.600418] pci 0000:17:15.7: Adding to iommu group 25
[    7.600976] pci 0000:17:16.0: Adding to iommu group 26
[    7.601058] pci 0000:17:16.1: Adding to iommu group 26
[    7.601896] pci 0000:17:1d.0: Adding to iommu group 27
[    7.601976] pci 0000:17:1d.1: Adding to iommu group 27
[    7.602053] pci 0000:17:1d.2: Adding to iommu group 27
[    7.602129] pci 0000:17:1d.3: Adding to iommu group 27
[    7.603043] pci 0000:17:1e.0: Adding to iommu group 28
[    7.603124] pci 0000:17:1e.1: Adding to iommu group 28
[    7.603201] pci 0000:17:1e.2: Adding to iommu group 28
[    7.603278] pci 0000:17:1e.3: Adding to iommu group 28
[    7.603355] pci 0000:17:1e.4: Adding to iommu group 28
[    7.603431] pci 0000:17:1e.5: Adding to iommu group 28
[    7.603507] pci 0000:17:1e.6: Adding to iommu group 28
[    7.604414] pci 0000:17:1f.0: Adding to iommu group 29
[    7.604495] pci 0000:17:1f.1: Adding to iommu group 29
[    7.604574] pci 0000:17:1f.2: Adding to iommu group 29
[    7.604652] pci 0000:17:1f.3: Adding to iommu group 29
[    7.604730] pci 0000:17:1f.4: Adding to iommu group 29
[    7.604809] pci 0000:17:1f.5: Adding to iommu group 29
[    7.604886] pci 0000:17:1f.6: Adding to iommu group 29
[    7.604964] pci 0000:17:1f.7: Adding to iommu group 29
[    7.605366] pci 0000:18:00.0: Adding to iommu group 30
[    7.605805] pci 0000:3a:00.0: Adding to iommu group 31
[    7.606413] pci 0000:3a:01.0: Adding to iommu group 32
[    7.607034] pci 0000:3a:02.0: Adding to iommu group 33
[    7.607434] pci 0000:3a:03.0: Adding to iommu group 34
[    7.608072] pci 0000:3a:05.0: Adding to iommu group 35
[    7.608157] pci 0000:3a:05.2: Adding to iommu group 35
[    7.608238] pci 0000:3a:05.4: Adding to iommu group 35
[    7.608319] pci 0000:3a:05.6: Adding to iommu group 35
[    7.609124] pci 0000:3a:07.0: Adding to iommu group 36
[    7.609211] pci 0000:3a:07.1: Adding to iommu group 36
[    7.609293] pci 0000:3a:07.2: Adding to iommu group 36
[    7.609375] pci 0000:3a:07.3: Adding to iommu group 36
[    7.609455] pci 0000:3a:07.4: Adding to iommu group 36
[    7.609535] pci 0000:3a:07.7: Adding to iommu group 36
[    7.610033] pci 0000:3a:08.0: Adding to iommu group 37
[    7.610119] pci 0000:3a:08.1: Adding to iommu group 37
[    7.610718] pci 0000:3a:09.0: Adding to iommu group 38
[    7.610803] pci 0000:3a:09.1: Adding to iommu group 38
[    7.611651] pci 0000:3a:0a.0: Adding to iommu group 39
[    7.611737] pci 0000:3a:0a.1: Adding to iommu group 39
[    7.611821] pci 0000:3a:0a.2: Adding to iommu group 39
[    7.611902] pci 0000:3a:0a.3: Adding to iommu group 39
[    7.611985] pci 0000:3a:0a.4: Adding to iommu group 39
[    7.612066] pci 0000:3a:0a.5: Adding to iommu group 39
[    7.612148] pci 0000:3a:0a.6: Adding to iommu group 39
[    7.612230] pci 0000:3a:0a.7: Adding to iommu group 39
[    7.612872] pci 0000:3a:0b.0: Adding to iommu group 40
[    7.612959] pci 0000:3a:0b.1: Adding to iommu group 40
[    7.613043] pci 0000:3a:0b.2: Adding to iommu group 40
[    7.613127] pci 0000:3a:0b.3: Adding to iommu group 40
[    7.614116] pci 0000:3a:0c.0: Adding to iommu group 41
[    7.614206] pci 0000:3a:0c.1: Adding to iommu group 41
[    7.614290] pci 0000:3a:0c.2: Adding to iommu group 41
[    7.614373] pci 0000:3a:0c.3: Adding to iommu group 41
[    7.614457] pci 0000:3a:0c.4: Adding to iommu group 41
[    7.614540] pci 0000:3a:0c.5: Adding to iommu group 41
[    7.614623] pci 0000:3a:0c.6: Adding to iommu group 41
[    7.614706] pci 0000:3a:0c.7: Adding to iommu group 41
[    7.615554] pci 0000:3a:0d.0: Adding to iommu group 42
[    7.615643] pci 0000:3a:0d.1: Adding to iommu group 42
[    7.615729] pci 0000:3a:0d.2: Adding to iommu group 42
[    7.615815] pci 0000:3a:0d.3: Adding to iommu group 42
[    7.616400] pci 0000:3d:00.0: Adding to iommu group 43
[    7.616827] pci 0000:3e:00.0: Adding to iommu group 44
[    7.617236] pci 0000:5d:02.0: Adding to iommu group 45
[    7.617655] pci 0000:5d:03.0: Adding to iommu group 46
[    7.618415] pci 0000:5d:05.0: Adding to iommu group 47
[    7.618505] pci 0000:5d:05.2: Adding to iommu group 47
[    7.618592] pci 0000:5d:05.4: Adding to iommu group 47
[    7.618677] pci 0000:5d:05.5: Adding to iommu group 47
[    7.618762] pci 0000:5d:05.6: Adding to iommu group 47
[    7.619511] pci 0000:5d:07.0: Adding to iommu group 48
[    7.619603] pci 0000:5d:07.1: Adding to iommu group 48
[    7.619689] pci 0000:5d:07.2: Adding to iommu group 48
[    7.619776] pci 0000:5d:07.3: Adding to iommu group 48
[    7.619862] pci 0000:5d:07.4: Adding to iommu group 48
[    7.619949] pci 0000:5d:07.7: Adding to iommu group 48
[    7.620569] pci 0000:5d:0e.0: Adding to iommu group 49
[    7.620661] pci 0000:5d:0e.1: Adding to iommu group 49
[    7.620750] pci 0000:5d:0e.2: Adding to iommu group 49
[    7.620837] pci 0000:5d:0e.3: Adding to iommu group 49
[    7.621497] pci 0000:5d:0f.0: Adding to iommu group 50
[    7.621589] pci 0000:5d:0f.1: Adding to iommu group 50
[    7.621680] pci 0000:5d:0f.2: Adding to iommu group 50
[    7.622492] pci 0000:5d:12.0: Adding to iommu group 51
[    7.622587] pci 0000:5d:12.1: Adding to iommu group 51
[    7.622676] pci 0000:5d:12.2: Adding to iommu group 51
[    7.622764] pci 0000:5d:12.3: Adding to iommu group 51
[    7.623542] pci 0000:5d:15.0: Adding to iommu group 52
[    7.623635] pci 0000:5d:15.1: Adding to iommu group 52
[    7.623725] pci 0000:5d:15.3: Adding to iommu group 52
[    7.624662] pci 0000:5d:16.0: Adding to iommu group 53
[    7.624756] pci 0000:5d:16.1: Adding to iommu group 53
[    7.624848] pci 0000:5d:16.3: Adding to iommu group 53
[    7.624938] pci 0000:5d:16.4: Adding to iommu group 53
[    7.625028] pci 0000:5d:16.5: Adding to iommu group 53
[    7.625118] pci 0000:5d:16.7: Adding to iommu group 53
[    7.625691] pci 0000:5e:00.0: Adding to iommu group 54
[    7.626108] pci 0000:5f:00.0: Adding to iommu group 55
[    7.626547] pci 0000:60:03.0: Adding to iommu group 56
[    7.627186] pci 0000:61:00.0: Adding to iommu group 57
[    7.627771] pci 0000:61:00.1: Adding to iommu group 58
[    7.628193] pci 0000:80:00.0: Adding to iommu group 59
[    7.629105] pci 0000:80:04.0: Adding to iommu group 60
[    7.629204] pci 0000:80:04.1: Adding to iommu group 60
[    7.629297] pci 0000:80:04.2: Adding to iommu group 60
[    7.629389] pci 0000:80:04.3: Adding to iommu group 60
[    7.629482] pci 0000:80:04.4: Adding to iommu group 60
[    7.629574] pci 0000:80:04.5: Adding to iommu group 60
[    7.629666] pci 0000:80:04.6: Adding to iommu group 60
[    7.629758] pci 0000:80:04.7: Adding to iommu group 60
[    7.630477] pci 0000:80:05.0: Adding to iommu group 61
[    7.630578] pci 0000:80:05.1: Adding to iommu group 61
[    7.630676] pci 0000:80:05.2: Adding to iommu group 61
[    7.630770] pci 0000:80:05.4: Adding to iommu group 61
[    7.630862] pci 0000:80:05.6: Adding to iommu group 61
[    7.631439] pci 0000:80:07.0: Adding to iommu group 62
[    7.631537] pci 0000:80:07.4: Adding to iommu group 62
[    7.631632] pci 0000:80:07.7: Adding to iommu group 62
[    7.632273] pci 0000:80:08.0: Adding to iommu group 63
[    7.632370] pci 0000:80:08.1: Adding to iommu group 63
[    7.632466] pci 0000:80:08.2: Adding to iommu group 63
[    7.632981] pci 0000:85:00.0: Adding to iommu group 64
[    7.633381] pci 0000:85:02.0: Adding to iommu group 65
[    7.634029] pci 0000:85:05.0: Adding to iommu group 66
[    7.634129] pci 0000:85:05.2: Adding to iommu group 66
[    7.634225] pci 0000:85:05.4: Adding to iommu group 66
[    7.634323] pci 0000:85:05.6: Adding to iommu group 66
[    7.635056] pci 0000:85:07.0: Adding to iommu group 67
[    7.635156] pci 0000:85:07.1: Adding to iommu group 67
[    7.635254] pci 0000:85:07.2: Adding to iommu group 67
[    7.635351] pci 0000:85:07.3: Adding to iommu group 67
[    7.635447] pci 0000:85:07.4: Adding to iommu group 67
[    7.635544] pci 0000:85:07.7: Adding to iommu group 67
[    7.636456] pci 0000:85:08.0: Adding to iommu group 68
[    7.636556] pci 0000:85:08.1: Adding to iommu group 68
[    7.636654] pci 0000:85:08.2: Adding to iommu group 68
[    7.636751] pci 0000:85:08.3: Adding to iommu group 68
[    7.636848] pci 0000:85:08.4: Adding to iommu group 68
[    7.636947] pci 0000:85:08.5: Adding to iommu group 68
[    7.637046] pci 0000:85:08.6: Adding to iommu group 68
[    7.637143] pci 0000:85:08.7: Adding to iommu group 68
[    7.638192] pci 0000:85:09.0: Adding to iommu group 69
[    7.638292] pci 0000:85:09.1: Adding to iommu group 69
[    7.638393] pci 0000:85:09.2: Adding to iommu group 69
[    7.638492] pci 0000:85:09.3: Adding to iommu group 69
[    7.638591] pci 0000:85:09.4: Adding to iommu group 69
[    7.638692] pci 0000:85:09.5: Adding to iommu group 69
[    7.638790] pci 0000:85:09.6: Adding to iommu group 69
[    7.638889] pci 0000:85:09.7: Adding to iommu group 69
[    7.639622] pci 0000:85:0a.0: Adding to iommu group 70
[    7.639725] pci 0000:85:0a.1: Adding to iommu group 70
[    7.640775] pci 0000:85:0e.0: Adding to iommu group 71
[    7.640878] pci 0000:85:0e.1: Adding to iommu group 71
[    7.640979] pci 0000:85:0e.2: Adding to iommu group 71
[    7.641082] pci 0000:85:0e.3: Adding to iommu group 71
[    7.641183] pci 0000:85:0e.4: Adding to iommu group 71
[    7.641284] pci 0000:85:0e.5: Adding to iommu group 71
[    7.641386] pci 0000:85:0e.6: Adding to iommu group 71
[    7.641486] pci 0000:85:0e.7: Adding to iommu group 71
[    7.642561] pci 0000:85:0f.0: Adding to iommu group 72
[    7.642667] pci 0000:85:0f.1: Adding to iommu group 72
[    7.642770] pci 0000:85:0f.2: Adding to iommu group 72
[    7.642873] pci 0000:85:0f.3: Adding to iommu group 72
[    7.642975] pci 0000:85:0f.4: Adding to iommu group 72
[    7.643077] pci 0000:85:0f.5: Adding to iommu group 72
[    7.643180] pci 0000:85:0f.6: Adding to iommu group 72
[    7.643285] pci 0000:85:0f.7: Adding to iommu group 72
[    7.643996] pci 0000:85:10.0: Adding to iommu group 73
[    7.644101] pci 0000:85:10.1: Adding to iommu group 73
[    7.645166] pci 0000:85:14.0: Adding to iommu group 74
[    7.645272] pci 0000:85:14.1: Adding to iommu group 74
[    7.645379] pci 0000:85:14.2: Adding to iommu group 74
[    7.645484] pci 0000:85:14.3: Adding to iommu group 74
[    7.645590] pci 0000:85:14.4: Adding to iommu group 74
[    7.645694] pci 0000:85:14.5: Adding to iommu group 74
[    7.645798] pci 0000:85:14.6: Adding to iommu group 74
[    7.645906] pci 0000:85:14.7: Adding to iommu group 74
[    7.646956] pci 0000:85:15.0: Adding to iommu group 75
[    7.647063] pci 0000:85:15.1: Adding to iommu group 75
[    7.647170] pci 0000:85:15.2: Adding to iommu group 75
[    7.647275] pci 0000:85:15.3: Adding to iommu group 75
[    7.647381] pci 0000:85:15.4: Adding to iommu group 75
[    7.647486] pci 0000:85:15.5: Adding to iommu group 75
[    7.647594] pci 0000:85:15.6: Adding to iommu group 75
[    7.647699] pci 0000:85:15.7: Adding to iommu group 75
[    7.648420] pci 0000:85:16.0: Adding to iommu group 76
[    7.648527] pci 0000:85:16.1: Adding to iommu group 76
[    7.649374] pci 0000:85:1d.0: Adding to iommu group 77
[    7.649484] pci 0000:85:1d.1: Adding to iommu group 77
[    7.649591] pci 0000:85:1d.2: Adding to iommu group 77
[    7.649699] pci 0000:85:1d.3: Adding to iommu group 77
[    7.650598] pci 0000:85:1e.0: Adding to iommu group 78
[    7.650706] pci 0000:85:1e.1: Adding to iommu group 78
[    7.650815] pci 0000:85:1e.2: Adding to iommu group 78
[    7.650924] pci 0000:85:1e.3: Adding to iommu group 78
[    7.651032] pci 0000:85:1e.4: Adding to iommu group 78
[    7.651140] pci 0000:85:1e.5: Adding to iommu group 78
[    7.651247] pci 0000:85:1e.6: Adding to iommu group 78
[    7.652286] pci 0000:85:1f.0: Adding to iommu group 79
[    7.652399] pci 0000:85:1f.1: Adding to iommu group 79
[    7.652509] pci 0000:85:1f.2: Adding to iommu group 79
[    7.652621] pci 0000:85:1f.3: Adding to iommu group 79
[    7.652730] pci 0000:85:1f.4: Adding to iommu group 79
[    7.652839] pci 0000:85:1f.5: Adding to iommu group 79
[    7.652948] pci 0000:85:1f.6: Adding to iommu group 79
[    7.653057] pci 0000:85:1f.7: Adding to iommu group 79
[    7.653517] pci 0000:ae:00.0: Adding to iommu group 80
[    7.654168] pci 0000:ae:05.0: Adding to iommu group 81
[    7.654279] pci 0000:ae:05.2: Adding to iommu group 81
[    7.654390] pci 0000:ae:05.4: Adding to iommu group 81
[    7.654502] pci 0000:ae:05.6: Adding to iommu group 81
[    7.655244] pci 0000:ae:07.0: Adding to iommu group 82
[    7.655356] pci 0000:ae:07.1: Adding to iommu group 82
[    7.655468] pci 0000:ae:07.2: Adding to iommu group 82
[    7.655579] pci 0000:ae:07.3: Adding to iommu group 82
[    7.655690] pci 0000:ae:07.4: Adding to iommu group 82
[    7.655802] pci 0000:ae:07.7: Adding to iommu group 82
[    7.656390] pci 0000:ae:08.0: Adding to iommu group 83
[    7.656503] pci 0000:ae:08.1: Adding to iommu group 83
[    7.657014] pci 0000:ae:09.0: Adding to iommu group 84
[    7.657126] pci 0000:ae:09.1: Adding to iommu group 84
[    7.658122] pci 0000:ae:0a.0: Adding to iommu group 85
[    7.658235] pci 0000:ae:0a.1: Adding to iommu group 85
[    7.658348] pci 0000:ae:0a.2: Adding to iommu group 85
[    7.658461] pci 0000:ae:0a.3: Adding to iommu group 85
[    7.658574] pci 0000:ae:0a.4: Adding to iommu group 85
[    7.658691] pci 0000:ae:0a.5: Adding to iommu group 85
[    7.658804] pci 0000:ae:0a.6: Adding to iommu group 85
[    7.658917] pci 0000:ae:0a.7: Adding to iommu group 85
[    7.659662] pci 0000:ae:0b.0: Adding to iommu group 86
[    7.659778] pci 0000:ae:0b.1: Adding to iommu group 86
[    7.659894] pci 0000:ae:0b.2: Adding to iommu group 86
[    7.660009] pci 0000:ae:0b.3: Adding to iommu group 86
[    7.660889] pci 0000:ae:0c.0: Adding to iommu group 87
[    7.661005] pci 0000:ae:0c.1: Adding to iommu group 87
[    7.661119] pci 0000:ae:0c.2: Adding to iommu group 87
[    7.661234] pci 0000:ae:0c.3: Adding to iommu group 87
[    7.661349] pci 0000:ae:0c.4: Adding to iommu group 87
[    7.661466] pci 0000:ae:0c.5: Adding to iommu group 87
[    7.661581] pci 0000:ae:0c.6: Adding to iommu group 87
[    7.661696] pci 0000:ae:0c.7: Adding to iommu group 87
[    7.662464] pci 0000:ae:0d.0: Adding to iommu group 88
[    7.662582] pci 0000:ae:0d.1: Adding to iommu group 88
[    7.662700] pci 0000:ae:0d.2: Adding to iommu group 88
[    7.662817] pci 0000:ae:0d.3: Adding to iommu group 88
[    7.663420] pci 0000:af:00.0: Adding to iommu group 89
[    7.664066] pci 0000:b0:00.0: Adding to iommu group 90
[    7.664494] pci 0000:b1:00.0: Adding to iommu group 91
[    7.665121] pci 0000:b1:00.1: Adding to iommu group 92
[    7.665528] pci 0000:d7:00.0: Adding to iommu group 93
[    7.666181] pci 0000:d7:05.0: Adding to iommu group 94
[    7.666301] pci 0000:d7:05.2: Adding to iommu group 94
[    7.666418] pci 0000:d7:05.4: Adding to iommu group 94
[    7.666537] pci 0000:d7:05.6: Adding to iommu group 94
[    7.667279] pci 0000:d7:07.0: Adding to iommu group 95
[    7.667398] pci 0000:d7:07.1: Adding to iommu group 95
[    7.667516] pci 0000:d7:07.2: Adding to iommu group 95
[    7.667636] pci 0000:d7:07.3: Adding to iommu group 95
[    7.667754] pci 0000:d7:07.4: Adding to iommu group 95
[    7.667872] pci 0000:d7:07.7: Adding to iommu group 95
[    7.668519] pci 0000:d7:0e.0: Adding to iommu group 96
[    7.668638] pci 0000:d7:0e.1: Adding to iommu group 96
[    7.668759] pci 0000:d7:0e.2: Adding to iommu group 96
[    7.668878] pci 0000:d7:0e.3: Adding to iommu group 96
[    7.669450] pci 0000:d7:0f.0: Adding to iommu group 97
[    7.669570] pci 0000:d7:0f.1: Adding to iommu group 97
[    7.669691] pci 0000:d7:0f.2: Adding to iommu group 97
[    7.670362] pci 0000:d7:12.0: Adding to iommu group 98
[    7.670483] pci 0000:d7:12.1: Adding to iommu group 98
[    7.670604] pci 0000:d7:12.2: Adding to iommu group 98
[    7.670725] pci 0000:d7:12.3: Adding to iommu group 98
[    7.671364] pci 0000:d7:15.0: Adding to iommu group 99
[    7.671486] pci 0000:d7:15.1: Adding to iommu group 99
[    7.671608] pci 0000:d7:15.3: Adding to iommu group 99
[    7.672477] pci 0000:d7:16.0: Adding to iommu group 100
[    7.672602] pci 0000:d7:16.1: Adding to iommu group 100
[    7.672722] pci 0000:d7:16.3: Adding to iommu group 100
[    7.672843] pci 0000:d7:16.4: Adding to iommu group 100
[    7.672966] pci 0000:d7:16.5: Adding to iommu group 100
[    7.673087] pci 0000:d7:16.7: Adding to iommu group 100
[    7.673690] pci 0000:d8:00.0: Adding to iommu group 101
[    7.673704] DMAR: Intel(R) Virtualization Technology for Directed I/O
[    7.676749] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer
[    7.676750] RAPL PMU: hw unit of domain package 2^-14 Joules
[    7.676751] RAPL PMU: hw unit of domain dram 2^-16 Joules
[    7.800195] Initialise system trusted keyrings
[    7.800205] Key type blacklist registered
[    7.800254] workingset: timestamp_bits=56 max_order=26 bucket_order=0
[    7.801853] fuse: init (API version 7.31)
[    7.801987] SGI XFS with ACLs, security attributes, realtime, scrub, quota, no debug enabled
[    7.808038] NET: Registered protocol family 38
[    7.809184] async_tx: api initialized (async)
[    7.809186] Key type asymmetric registered
[    7.809186] Asymmetric key parser 'x509' registered
[    7.809187] Asymmetric key parser 'pkcs8' registered
[    7.809196] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 244)
[    7.809197] io scheduler mq-deadline registered
[    7.810644] pcieport 0000:00:1c.0: PME: Signaling with IRQ 24
[    7.810793] pcieport 0000:00:1c.2: PME: Signaling with IRQ 25
[    7.810989] pcieport 0000:00:1c.5: PME: Signaling with IRQ 26
[    7.811271] pcieport 0000:17:00.0: PME: Signaling with IRQ 28
[    7.811510] pcieport 0000:3a:00.0: PME: Signaling with IRQ 30
[    7.811715] pcieport 0000:3a:01.0: PME: Signaling with IRQ 31
[    7.811917] pcieport 0000:3a:02.0: PME: Signaling with IRQ 32
[    7.812126] pcieport 0000:3a:03.0: PME: Signaling with IRQ 33
[    7.812383] pcieport 0000:5d:02.0: PME: Signaling with IRQ 35
[    7.812606] pcieport 0000:5d:03.0: PME: Signaling with IRQ 36
[    7.813204] pcieport 0000:80:00.0: PME: Signaling with IRQ 40
[    7.813572] pcieport 0000:85:00.0: PME: Signaling with IRQ 42
[    7.813884] pcieport 0000:85:02.0: PME: Signaling with IRQ 43
[    7.814216] pcieport 0000:ae:00.0: PME: Signaling with IRQ 45
[    7.814824] pcieport 0000:d7:00.0: PME: Signaling with IRQ 49
[    7.815344] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    7.816299] vmd 0000:5d:05.5: PCI host bridge to bus 10000:00
[    7.816302] pci_bus 10000:00: root bus resource [bus 00-1f]
[    7.816303] pci_bus 10000:00: root bus resource [mem 0xc2000000-0xc3ffffff]
[    7.816304] pci_bus 10000:00: root bus resource [mem 0x38fffff02000-0x38ffffffffff 64bit]
[    7.816312] pci 10000:00:00.0: [8086:2030] type 01 class 0x060400
[    7.816339] pci 10000:00:00.0: enabling Extended Tags
[    7.816369] pci 10000:00:00.0: PME# supported from D0 D3hot D3cold
[    7.816439] pci 10000:00:00.0: Adding to iommu group 47
[    7.816451] pci 10000:00:01.0: [8086:2031] type 01 class 0x060400
[    7.816477] pci 10000:00:01.0: enabling Extended Tags
[    7.816504] pci 10000:00:01.0: PME# supported from D0 D3hot D3cold
[    7.816558] pci 10000:00:01.0: Adding to iommu group 47
[    7.816592] pci 10000:00:00.0: PCI bridge to [bus 01]
[    7.816594] pci 10000:00:00.0:   bridge window [io  0x0000-0x8fff]
[    7.816617] pci 10000:00:01.0: PCI bridge to [bus 02]
[    7.816618] pci 10000:00:01.0:   bridge window [io  0x0000-0x9fff]
[    7.816630] pci 10000:00:00.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 01] add_size 200000 add_align 100000
[    7.816631] pci 10000:00:00.0: bridge window [mem 0x00100000-0x000fffff] to [bus 01] add_size 200000 add_align 100000
[    7.816633] pci 10000:00:01.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 02] add_size 200000 add_align 100000
[    7.816634] pci 10000:00:01.0: bridge window [mem 0x00100000-0x000fffff] to [bus 02] add_size 200000 add_align 100000
[    7.816638] pci 10000:00:00.0: BAR 14: assigned [mem 0xc2000000-0xc21fffff]
[    7.816641] pci 10000:00:00.0: BAR 15: assigned [mem 0xc2200000-0xc23fffff 64bit pref]
[    7.816642] pci 10000:00:01.0: BAR 14: assigned [mem 0xc2400000-0xc25fffff]
[    7.816643] pci 10000:00:01.0: BAR 15: assigned [mem 0xc2600000-0xc27fffff 64bit pref]
[    7.816645] pci 10000:00:00.0: BAR 13: no space for [io  size 0x9000]
[    7.816646] pci 10000:00:00.0: BAR 13: failed to assign [io  size 0x9000]
[    7.816647] pci 10000:00:01.0: BAR 13: no space for [io  size 0xa000]
[    7.816647] pci 10000:00:01.0: BAR 13: failed to assign [io  size 0xa000]
[    7.816650] pci 10000:00:00.0: BAR 13: no space for [io  size 0x9000]
[    7.816650] pci 10000:00:00.0: BAR 13: failed to assign [io  size 0x9000]
[    7.816651] pci 10000:00:01.0: BAR 13: no space for [io  size 0xa000]
[    7.816652] pci 10000:00:01.0: BAR 13: failed to assign [io  size 0xa000]
[    7.816654] pci 10000:00:00.0: PCI bridge to [bus 01]
[    7.816657] pci 10000:00:00.0:   bridge window [mem 0xc2000000-0xc21fffff]
[    7.816659] pci 10000:00:00.0:   bridge window [mem 0xc2200000-0xc23fffff 64bit pref]
[    7.816663] pci 10000:00:01.0: PCI bridge to [bus 02]
[    7.816665] pci 10000:00:01.0:   bridge window [mem 0xc2400000-0xc25fffff]
[    7.816667] pci 10000:00:01.0:   bridge window [mem 0xc2600000-0xc27fffff 64bit pref]
[    7.816709] pcieport 10000:00:00.0: can't derive routing for PCI INT A
[    7.816710] pcieport 10000:00:00.0: PCI INT A: no GSI
[    7.816760] pcieport 10000:00:00.0: PME: Signaling with IRQ 83
[    7.816809] pcieport 10000:00:00.0: AER: enabled with IRQ 83
[    7.816833] pcieport 10000:00:00.0: pciehp: Slot #89 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+ Interlock- NoCompl- IbPresDis- LLActRep+ (with Cmd Compl erratum)
[    7.816947] pcieport 10000:00:01.0: can't derive routing for PCI INT A
[    7.816948] pcieport 10000:00:01.0: PCI INT A: no GSI
[    7.816994] pcieport 10000:00:01.0: PME: Signaling with IRQ 84
[    7.817041] pcieport 10000:00:01.0: AER: enabled with IRQ 84
[    7.817058] pcieport 10000:00:01.0: pciehp: Slot #90 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+ Interlock- NoCompl- IbPresDis- LLActRep+ (with Cmd Compl erratum)
[    7.817158] vmd 0000:5d:05.5: Bound to PCI domain 10000
[    7.817286] intel_idle: MWAIT substates: 0x2020
[    7.817287] intel_idle: ACPI _CST not found or not usable
[    7.817288] intel_idle: v0.5.1 model 0x55
[    7.819352] intel_idle: Local APIC timer is reliable in all C-states
[    7.819354] IPMI message handler: version 39.2
[    7.819380] ipmi device interface
[    7.819406] ipmi_si: IPMI System Interface driver
[    7.819422] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS
[    7.819426] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[    7.819429] ipmi_si: Adding SMBIOS-specified kcs state machine
[    7.819515] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI
[    7.819621] ipmi_si IPI0001:00: ipmi_platform: [io  0x0ca2] regsize 1 spacing 1 irq 0
[    7.819623] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI
[    7.819624] ipmi_si: Adding ACPI-specified kcs state machine
[    7.819683] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[    8.072629] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed.
[    8.137626] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x097a, dev_id: 0x20)
[    8.176268] ipmi_si IPI0001:00: IPMI kcs interface initialized
[    8.176271] ipmi_ssif: IPMI SSIF Interface driver
[    8.182598] IPMI Watchdog: driver initialized
[    8.182600] IPMI poweroff: Copyright (C) 2004 MontaVista Software - IPMI Powerdown via sys_reboot
[    8.189200] IPMI poweroff: ATCA Detect mfg 0x2A7C prod 0x97A
[    8.189202] IPMI poweroff: Found a chassis style poweroff function
[    8.189554] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    8.189595] ACPI: Power Button [PWRF]
[    8.190548] ERST: Error Record Serialization Table (ERST) support is initialized.
[    8.190549] pstore: Registered erst as persistent store backend
[    8.191158] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    8.191359] ioatdma: Intel(R) QuickData Technology Driver 5.00
[    8.191380] ioatdma 0000:00:04.0: enabling device (0004 -> 0006)
[    8.200624] ioatdma 0000:00:04.1: enabling device (0004 -> 0006)
[    8.207642] ioatdma 0000:00:04.2: enabling device (0004 -> 0006)
[    8.214612] ioatdma 0000:00:04.3: enabling device (0004 -> 0006)
[    8.221522] ioatdma 0000:00:04.4: enabling device (0004 -> 0006)
[    8.228421] ioatdma 0000:00:04.5: enabling device (0004 -> 0006)
[    8.235306] ioatdma 0000:00:04.6: enabling device (0004 -> 0006)
[    8.242186] ioatdma 0000:00:04.7: enabling device (0004 -> 0006)
[    8.249187] ioatdma 0000:80:04.0: enabling device (0004 -> 0006)
[    8.258746] ioatdma 0000:80:04.1: enabling device (0004 -> 0006)
[    8.266162] ioatdma 0000:80:04.2: enabling device (0004 -> 0006)
[    8.273383] ioatdma 0000:80:04.3: enabling device (0004 -> 0006)
[    8.280442] ioatdma 0000:80:04.4: enabling device (0004 -> 0006)
[    8.287480] ioatdma 0000:80:04.5: enabling device (0004 -> 0006)
[    8.294437] ioatdma 0000:80:04.6: enabling device (0004 -> 0006)
[    8.301291] ioatdma 0000:80:04.7: enabling device (0004 -> 0006)
[    8.308371] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    8.308658] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[    8.311943] Non-volatile memory driver v1.3
[    8.311945] Hangcheck: starting hangcheck timer 0.9.1 (tick is 180 seconds, margin is 60 seconds).
[    8.311946] AMD-Vi: AMD IOMMUv2 driver by Joerg Roedel <[email protected]>
[    8.311947] AMD-Vi: AMD IOMMUv2 functionality not available on this system
[    8.312064] [drm] Initialized vgem 1.0.0 20120112 for vgem on minor 0
[    8.312073] usbcore: registered new interface driver udl
[    8.315453] lpc_ich 0000:00:1f.0: I/O space for ACPI uninitialized
[    8.315456] lpc_ich 0000:00:1f.0: No MFD cells added
[    8.316008] nvme nvme0: pci function 0000:3d:00.0
[    8.316070] nvme nvme1: pci function 0000:3e:00.0
[    8.316138] nvme nvme2: pci function 0000:5e:00.0
[    8.316199] ahci 0000:00:11.5: version 3.0
[    8.322904] nvme nvme2: missing or invalid SUBNQN field.
[    8.322925] nvme nvme2: Shutdown timeout set to 8 seconds
[    8.322942] nvme nvme1: missing or invalid SUBNQN field.
[    8.322963] nvme nvme1: Shutdown timeout set to 8 seconds
[    8.326438] ahci 0000:00:11.5: AHCI 0001.0301 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[    8.326441] ahci 0000:00:11.5: flags: 64bit ncq sntf pm led clo only pio slum part ems deso sadm sds apst
[    8.329739] nvme nvme0: missing or invalid SUBNQN field.
[    8.329760] nvme nvme0: Shutdown timeout set to 8 seconds
[    8.350408] nvme nvme2: 2/28/2 default/read/poll queues
[    8.350429] nvme nvme1: 2/28/2 default/read/poll queues
[    8.356418]  nvme2n1: p1 p2 p3
[    8.358208] nvme nvme0: 2/28/2 default/read/poll queues
[    8.379940] scsi host0: ahci
[    8.380099] scsi host1: ahci
[    8.380180] scsi host2: ahci
[    8.380256] scsi host3: ahci
[    8.380389] scsi host4: ahci
[    8.380469] scsi host5: ahci
[    8.380507] ata1: SATA max UDMA/133 abar m524288@0x9d280000 port 0x9d280100 irq 119
[    8.380508] ata2: SATA max UDMA/133 abar m524288@0x9d280000 port 0x9d280180 irq 119
[    8.380510] ata3: SATA max UDMA/133 abar m524288@0x9d280000 port 0x9d280200 irq 119
[    8.380512] ata4: SATA max UDMA/133 abar m524288@0x9d280000 port 0x9d280280 irq 119
[    8.380513] ata5: SATA max UDMA/133 abar m524288@0x9d280000 port 0x9d280300 irq 119
[    8.380515] ata6: SATA max UDMA/133 abar m524288@0x9d280000 port 0x9d280380 irq 119
[    8.390927] ahci 0000:00:17.0: AHCI 0001.0301 32 slots 8 ports 6 Gbps 0xff impl SATA mode
[    8.390929] ahci 0000:00:17.0: flags: 64bit ncq sntf pm led clo only pio slum part ems deso sadm sds apst
[    8.460033] scsi host6: ahci
[    8.460124] scsi host7: ahci
[    8.460204] scsi host8: ahci
[    8.460283] scsi host9: ahci
[    8.460443] scsi host10: ahci
[    8.460536] scsi host11: ahci
[    8.460628] scsi host12: ahci
[    8.460717] scsi host13: ahci
[    8.460755] ata7: SATA max UDMA/133 abar m524288@0x9d200000 port 0x9d200100 irq 210
[    8.460757] ata8: SATA max UDMA/133 abar m524288@0x9d200000 port 0x9d200180 irq 210
[    8.460758] ata9: SATA max UDMA/133 abar m524288@0x9d200000 port 0x9d200200 irq 210
[    8.460760] ata10: SATA max UDMA/133 abar m524288@0x9d200000 port 0x9d200280 irq 210
[    8.460761] ata11: SATA max UDMA/133 abar m524288@0x9d200000 port 0x9d200300 irq 210
[    8.460763] ata12: SATA max UDMA/133 abar m524288@0x9d200000 port 0x9d200380 irq 210
[    8.460764] ata13: SATA max UDMA/133 abar m524288@0x9d200000 port 0x9d200400 irq 210
[    8.460765] ata14: SATA max UDMA/133 abar m524288@0x9d200000 port 0x9d200480 irq 210
[    8.461273] tun: Universal TUN/TAP device driver, 1.6
[    8.461391] usbcore: registered new interface driver usb-storage
[    8.461415] i8042: PNP: No PS/2 controller found.
[    8.461467] mousedev: PS/2 mouse device common for all mice
[    8.461520] usbcore: registered new interface driver synaptics_usb
[    8.461591] input: PC Speaker as /devices/platform/pcspkr/input/input1
[    8.461736] rtc_cmos 00:00: RTC can wake from S4
[    8.462034] rtc_cmos 00:00: registered as rtc0
[    8.462093] rtc_cmos 00:00: setting system clock to 2020-06-04T00:16:28 UTC (1591229788)
[    8.462108] rtc_cmos 00:00: alarms up to one month, 114 bytes nvram, hpet irqs
[    8.462121] i2c /dev entries driver
[    8.462156] i801_smbus 0000:00:1f.4: enabling device (0001 -> 0003)
[    8.462231] i801_smbus 0000:00:1f.4: SPD Write Disable is set
[    8.462248] i801_smbus 0000:00:1f.4: SMBus using PCI interrupt
[    8.682555] tsc: Refined TSC clocksource calibration: 2499.999 MHz
[    8.682589] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x240938fe3e8, max_idle_ns: 440795307177 ns
[    8.682687] clocksource: Switched to clocksource tsc
[    8.693464] ata3: SATA link down (SStatus 0 SControl 300)
[    8.693486] ata6: SATA link down (SStatus 0 SControl 300)
[    8.693508] ata4: SATA link down (SStatus 0 SControl 300)
[    8.693532] ata1: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[    8.693557] ata2: SATA link down (SStatus 0 SControl 300)
[    8.693581] ata5: SATA link down (SStatus 0 SControl 300)
[    8.693771] ata1.00: ATAPI: ATAPI   iHAS324   A, BL1P, max UDMA/100
[    8.694430] ata1.00: configured for UDMA/100
[    8.696098] scsi 0:0:0:0: CD-ROM            ATAPI    iHAS324   A      BL1P PQ: 0 ANSI: 5
[    8.768811] sr 0:0:0:0: [sr0] scsi3-mmc drive: 48x/48x writer dvd-ram cd/rw xa/form2 cdda tray
[    8.768813] cdrom: Uniform CD-ROM driver Revision: 3.20
[    8.769366] sr 0:0:0:0: Attached scsi CD-ROM sr0
[    8.769460] sr 0:0:0:0: Attached scsi generic sg0 type 5
[    8.773277] ata9: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    8.773302] ata11: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    8.773327] ata8: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    8.773353] ata7: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    8.773378] ata14: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    8.773404] ata12: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    8.773429] ata10: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    8.773449] ata13: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    8.773663] ata7.00: supports DRM functions and may not be fully accessible
[    8.774541] ata7.00: ATA-11: Samsung SSD 860 PRO 4TB, RVM01B6Q, max UDMA/133
[    8.774545] ata7.00: 8001573552 sectors, multi 1: LBA48 NCQ (depth 32), AA
[    8.774875] ata11.00: ATA-8: HGST HDS724040ALE640, MJAOA580, max UDMA/133
[    8.774877] ata11.00: 7814037168 sectors, multi 16: LBA48 NCQ (depth 32), AA
[    8.774987] ata12.00: ATA-8: HGST HDS724040ALE640, MJAOA580, max UDMA/133
[    8.774989] ata12.00: 7814037168 sectors, multi 16: LBA48 NCQ (depth 32), AA
[    8.774997] ata10.00: ATA-8: HGST HDS724040ALE640, MJAOA580, max UDMA/133
[    8.774998] ata10.00: 7814037168 sectors, multi 16: LBA48 NCQ (depth 32), AA
[    8.775222] ata9.00: supports DRM functions and may not be fully accessible
[    8.775268] ata8.00: supports DRM functions and may not be fully accessible
[    8.776500] ata11.00: configured for UDMA/133
[    8.776641] ata10.00: configured for UDMA/133
[    8.776665] ata12.00: configured for UDMA/133
[    8.776971] ata7.00: supports DRM functions and may not be fully accessible
[    8.779789] ata14.00: ATA-9: HGST HUS726T4TALA6L4, VLGNW460, max UDMA/133
[    8.779793] ata14.00: 7814037168 sectors, multi 16: LBA48 NCQ (depth 32), AA
[    8.779846] ata7.00: configured for UDMA/133
[    8.779903] ata13.00: ATA-9: HGST HUS726T4TALA6L4, VLGNW460, max UDMA/133
[    8.779904] ata13.00: 7814037168 sectors, multi 16: LBA48 NCQ (depth 32), AA
[    8.779931] scsi 6:0:0:0: Direct-Access     ATA      Samsung SSD 860  1B6Q PQ: 0 ANSI: 5
[    8.779932] ata9.00: disabling queued TRIM support
[    8.779934] ata9.00: ATA-9: Samsung SSD 850 PRO 1TB, EXM04B6Q, max UDMA/133
[    8.779935] ata9.00: 2000409264 sectors, multi 1: LBA48 NCQ (depth 32), AA
[    8.779991] random: fast init done
[    8.780013] ata8.00: disabling queued TRIM support
[    8.780015] ata8.00: ATA-9: Samsung SSD 850 PRO 1TB, EXM04B6Q, max UDMA/133
[    8.780016] ata8.00: 2000409264 sectors, multi 1: LBA48 NCQ (depth 32), AA
[    8.780039] sd 6:0:0:0: Attached scsi generic sg1 type 0
[    8.780079] ata7.00: Enabling discard_zeroes_data
[    8.780106] sd 6:0:0:0: [sda] 8001573552 512-byte logical blocks: (4.10 TB/3.73 TiB)
[    8.780111] sd 6:0:0:0: [sda] Write Protect is off
[    8.780112] sd 6:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    8.780119] sd 6:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    8.780262] ata7.00: Enabling discard_zeroes_data
[    8.780849] ata7.00: Enabling discard_zeroes_data
[    8.782123] sd 6:0:0:0: [sda] supports TCG Opal
[    8.782126] sd 6:0:0:0: [sda] Attached SCSI disk
[    8.784989] ata9.00: supports DRM functions and may not be fully accessible
[    8.785023] ata8.00: supports DRM functions and may not be fully accessible
[    8.789292] ata14.00: configured for UDMA/133
[    8.789320] ata13.00: configured for UDMA/133
[    8.789758] ata9.00: disabling queued TRIM support
[    8.789784] ata8.00: disabling queued TRIM support
[    8.794627] ata9.00: configured for UDMA/133
[    8.794675] ata8.00: configured for UDMA/133
[    8.794797] scsi 7:0:0:0: Direct-Access     ATA      Samsung SSD 850  4B6Q PQ: 0 ANSI: 5
[    8.794905] sd 7:0:0:0: Attached scsi generic sg2 type 0
[    8.794973] sd 7:0:0:0: [sdb] 2000409264 512-byte logical blocks: (1.02 TB/954 GiB)
[    8.794978] sd 7:0:0:0: [sdb] Write Protect is off
[    8.794979] sd 7:0:0:0: [sdb] Mode Sense: 00 3a 00 00
[    8.794989] sd 7:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    8.795000] scsi 8:0:0:0: Direct-Access     ATA      Samsung SSD 850  4B6Q PQ: 0 ANSI: 5
[    8.795130] sd 8:0:0:0: Attached scsi generic sg3 type 0
[    8.795148] sd 8:0:0:0: [sdc] 2000409264 512-byte logical blocks: (1.02 TB/954 GiB)
[    8.795153] sd 8:0:0:0: [sdc] Write Protect is off
[    8.795155] sd 8:0:0:0: [sdc] Mode Sense: 00 3a 00 00
[    8.795162] sd 8:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    8.795249] scsi 9:0:0:0: Direct-Access     ATA      HGST HDS724040AL A580 PQ: 0 ANSI: 5
[    8.795400] sd 9:0:0:0: Attached scsi generic sg4 type 0
[    8.795420] sd 9:0:0:0: [sdd] 7814037168 512-byte logical blocks: (4.00 TB/3.64 TiB)
[    8.795422] sd 9:0:0:0: [sdd] 4096-byte physical blocks
[    8.795429] sd 9:0:0:0: [sdd] Write Protect is off
[    8.795431] sd 9:0:0:0: [sdd] Mode Sense: 00 3a 00 00
[    8.795442] sd 9:0:0:0: [sdd] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    8.795499] scsi 10:0:0:0: Direct-Access     ATA      HGST HDS724040AL A580 PQ: 0 ANSI: 5
[    8.795651] sd 10:0:0:0: Attached scsi generic sg5 type 0
[    8.795666] sd 10:0:0:0: [sde] 7814037168 512-byte logical blocks: (4.00 TB/3.64 TiB)
[    8.795668] sd 10:0:0:0: [sde] 4096-byte physical blocks
[    8.795673] sd 10:0:0:0: [sde] Write Protect is off
[    8.795674] sd 10:0:0:0: [sde] Mode Sense: 00 3a 00 00
[    8.795681] sd 10:0:0:0: [sde] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    8.795754] scsi 11:0:0:0: Direct-Access     ATA      HGST HDS724040AL A580 PQ: 0 ANSI: 5
[    8.795874] sd 11:0:0:0: Attached scsi generic sg6 type 0
[    8.795897] sd 11:0:0:0: [sdf] 7814037168 512-byte logical blocks: (4.00 TB/3.64 TiB)
[    8.795899] sd 11:0:0:0: [sdf] 4096-byte physical blocks
[    8.795905] sd 11:0:0:0: [sdf] Write Protect is off
[    8.795906] sd 11:0:0:0: [sdf] Mode Sense: 00 3a 00 00
[    8.795910] sd 7:0:0:0: [sdb] supports TCG Opal
[    8.795912] sd 7:0:0:0: [sdb] Attached SCSI disk
[    8.795917] sd 11:0:0:0: [sdf] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    8.795968] scsi 12:0:0:0: Direct-Access     ATA      HGST HUS726T4TAL W460 PQ: 0 ANSI: 5
[    8.796105] sd 12:0:0:0: [sdg] 7814037168 512-byte logical blocks: (4.00 TB/3.64 TiB)
[    8.796109] sd 12:0:0:0: [sdg] Write Protect is off
[    8.796110] sd 12:0:0:0: Attached scsi generic sg7 type 0
[    8.796112] sd 12:0:0:0: [sdg] Mode Sense: 00 3a 00 00
[    8.796122] sd 12:0:0:0: [sdg] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    8.796179] sd 8:0:0:0: [sdc] supports TCG Opal
[    8.796180] sd 8:0:0:0: [sdc] Attached SCSI disk
[    8.796209] scsi 13:0:0:0: Direct-Access     ATA      HGST HUS726T4TAL W460 PQ: 0 ANSI: 5
[    8.796312] sd 13:0:0:0: Attached scsi generic sg8 type 0
[    8.796325] sd 13:0:0:0: [sdh] 7814037168 512-byte logical blocks: (4.00 TB/3.64 TiB)
[    8.796330] sd 13:0:0:0: [sdh] Write Protect is off
[    8.796331] sd 13:0:0:0: [sdh] Mode Sense: 00 3a 00 00
[    8.796338] sd 13:0:0:0: [sdh] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    8.805763] sd 11:0:0:0: [sdf] Attached SCSI disk
[    8.811116] sd 10:0:0:0: [sde] Attached SCSI disk
[    8.813032] sd 9:0:0:0: [sdd] Attached SCSI disk
[    8.837312]  sdg: sdg1
[    8.837767] sd 12:0:0:0: [sdg] Attached SCSI disk
[    8.839171]  sdh: sdh1
[    8.839710] sd 13:0:0:0: [sdh] Attached SCSI disk
[    9.529353] power_meter ACPI000D:00: Found ACPI power meter.
[    9.529396] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info().
[    9.529631] device-mapper: uevent: version 1.0.3
[    9.529720] device-mapper: ioctl: 4.42.0-ioctl (2020-02-27) initialised: [email protected]
[    9.530776] EDAC MC0: Giving out device to module skx_edac controller Skylake Socket#0 IMC#0: DEV 0000:3a:0a.0 (INTERRUPT)
[    9.530819] EDAC MC1: Giving out device to module skx_edac controller Skylake Socket#0 IMC#1: DEV 0000:3a:0c.0 (INTERRUPT)
[    9.530866] EDAC MC2: Giving out device to module skx_edac controller Skylake Socket#1 IMC#0: DEV 0000:ae:0a.0 (INTERRUPT)
[    9.530909] EDAC MC3: Giving out device to module skx_edac controller Skylake Socket#1 IMC#1: DEV 0000:ae:0c.0 (INTERRUPT)
[    9.530913] intel_pstate: Intel P-state driver initializing
[    9.533994] intel_pstate: HWP enabled
[    9.536046] ledtrig-cpu: registered to indicate activity on CPUs
[    9.536366] hid: raw HID events driver (C) Jiri Kosina
[    9.536401] usbcore: registered new interface driver usbhid
[    9.536401] usbhid: USB HID core driver
[    9.536858] intel_rapl_common: Found RAPL domain package
[    9.536865] intel_rapl_common: Found RAPL domain dram
[    9.536867] intel_rapl_common: DRAM domain energy unit 15300pj
[    9.537403] intel_rapl_common: Found RAPL domain package
[    9.537409] intel_rapl_common: Found RAPL domain dram
[    9.537412] intel_rapl_common: DRAM domain energy unit 15300pj
[    9.539344] GACT probability on
[    9.539347] Mirror/redirect action on
[    9.539357] Simple TC action Loaded
[    9.539564] netem: version 1.3
[    9.539581] u32 classifier
[    9.539582]     Performance counters on
[    9.539583]     input device check on
[    9.539584]     Actions configured
[    9.540092] xt_time: kernel timezone is -0000
[    9.540158] ipip: IPv4 and MPLS over IPv4 tunneling driver
[    9.540274] IPv4 over IPsec tunneling driver
[    9.540988] ipt_CLUSTERIP: ClusterIP Version 0.8 loaded successfully
[    9.541125] Initializing XFRM netlink socket
[    9.541283] NET: Registered protocol family 10
[    9.554994] Segment Routing with IPv6
[    9.555051] mip6: Mobile IPv6
[    9.556145] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver
[    9.557350] bpfilter: Loaded bpfilter_umh pid 3727
[    9.557515] NET: Registered protocol family 17
[    9.557525] NET: Registered protocol family 15
[    9.557552] Bridge firewalling registered
[    9.557820] Bluetooth: RFCOMM TTY layer initialized
[    9.557823] Bluetooth: RFCOMM socket layer initialized
[    9.557832] Bluetooth: RFCOMM ver 1.11
[    9.557836] Bluetooth: BNEP (Ethernet Emulation) ver 1.3
[    9.557837] Bluetooth: BNEP filters: protocol multicast
[    9.557840] Bluetooth: BNEP socket layer initialized
[    9.557841] Bluetooth: HIDP (Human Interface Emulation) ver 1.2
[    9.557843] Bluetooth: HIDP socket layer initialized
[    9.557881] 8021q: 802.1Q VLAN Support v1.8
[    9.557913] sctp: Hash tables configured (bind 4096/4096)
[    9.558068] Key type dns_resolver registered
[    9.558147] NET: Registered protocol family 40
[    9.563092] microcode: sig=0x50657, pf=0x80, revision=0x500002c
[    9.564722] microcode: Microcode Update Driver: v2.2.
[    9.566885] resctrl: MB allocation detected
[    9.566886] resctrl: L3 monitoring detected
[    9.566891] IPI shorthand broadcast: enabled
[    9.566899] AVX2 version of gcm_enc/dec engaged.
[    9.566900] AES CTR mode by8 optimization enabled
[    9.595782] sched_clock: Marking stable (9596966834, -1198551)->(9637764416, -41996133)
[    9.596237] registered taskstats version 1
[    9.596252] Loading compiled-in X.509 certificates
[    9.596430] Key type ._fscrypt registered
[    9.596432] Key type .fscrypt registered
[    9.596434] Key type fscrypt-provisioning registered
[    9.596902] Btrfs loaded, crc32c=crc32c-intel
[    9.596943] pstore: Using crash dump compression: lz4hc
[    9.604857] Key type big_key registered
[    9.607980] PM:   Magic number: 8:16:253
[    9.608329] acpi device:92: hash matches
[    9.608435] printk: console [netcon0] enabled
[    9.608436] netconsole: network logging started
[    9.610969] cfg80211: Loading compiled-in X.509 certificates for regulatory database
[    9.613123] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'
[    9.613191] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[    9.613194] cfg80211: failed to load regulatory.db
[    9.613233] ALSA device list:
[    9.613236]   No soundcards found.
[    9.616373] Freeing unused kernel image (initmem) memory: 1784K
[    9.639277] Write protecting the kernel read-only data: 38912k
[    9.640329] Freeing unused kernel image (text/rodata gap) memory: 2040K
[    9.640841] Freeing unused kernel image (rodata/data gap) memory: 1092K
[    9.663206] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    9.663208] Run /init as init process
[    9.663209]   with arguments:
[    9.663210]     /init
[    9.663210]   with environment:
[    9.663211]     HOME=/
[    9.663211]     TERM=linux
[    9.663212]     BOOT_IMAGE=/vmlinuz-5.7.0-rc7-andres-00133-gc8707bf69395
[    9.663212]     apparmor=0
[    9.663213]     intel_iommu=on
[    9.901534] xhci_hcd 0000:00:14.0: xHCI Host Controller
[    9.901948] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 1
[    9.903066] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810
[    9.903071] xhci_hcd 0000:00:14.0: cache line size of 64 is not supported
[    9.903449] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.07
[    9.903450] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    9.903452] usb usb1: Product: xHCI Host Controller
[    9.903453] usb usb1: Manufacturer: Linux 5.7.0-rc7-andres-00133-gc8707bf69395 xhci-hcd
[    9.903454] usb usb1: SerialNumber: 0000:00:14.0
[    9.905105] hub 1-0:1.0: USB hub found
[    9.905124] hub 1-0:1.0: 16 ports detected
[    9.908810] xhci_hcd 0000:00:14.0: xHCI Host Controller
[    9.908840] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2
[    9.908843] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed
[    9.908866] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.07
[    9.908867] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    9.908868] usb usb2: Product: xHCI Host Controller
[    9.908868] usb usb2: Manufacturer: Linux 5.7.0-rc7-andres-00133-gc8707bf69395 xhci-hcd
[    9.908869] usb usb2: SerialNumber: 0000:00:14.0
[    9.908949] hub 2-0:1.0: USB hub found
[    9.908963] hub 2-0:1.0: 10 ports detected
[    9.909417] usb: port power management may be unreliable
[    9.909656] xhci_hcd 0000:02:00.0: xHCI Host Controller
[    9.909811] xhci_hcd 0000:02:00.0: new USB bus registered, assigned bus number 3
[    9.920547] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.1.0-k
[    9.920549] ixgbe: Copyright (c) 1999-2016 Intel Corporation.
[    9.928630] i40e: Intel(R) Ethernet Connection XL710 Network Driver - version 2.8.20-k
[    9.928631] i40e: Copyright (c) 2013 - 2019 Intel Corporation.
[    9.964732] xhci_hcd 0000:02:00.0: hcc params 0x0200ef81 hci version 0x110 quirks 0x0000000000000010
[    9.964985] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.07
[    9.964986] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    9.964987] usb usb3: Product: xHCI Host Controller
[    9.964988] usb usb3: Manufacturer: Linux 5.7.0-rc7-andres-00133-gc8707bf69395 xhci-hcd
[    9.964989] usb usb3: SerialNumber: 0000:02:00.0
[    9.965159] [drm] P2A bridge disabled, using default configuration
[    9.965159] [drm] AST 2500 detected
[    9.965165] [drm] Analog VGA only
[    9.965172] [drm] dram MCLK=800 Mhz type=1 bus_width=16 size=01000000
[    9.965183] ixgbe 0000:18:00.0: enabling device (0140 -> 0142)
[    9.968972] md127: detected capacity change from 0 to 12001954234368
[    9.972839] [TTM] Zone  kernel: Available graphics memory: 98372568 KiB
[    9.972840] [TTM] Zone   dma32: Available graphics memory: 2097152 KiB
[    9.972841] [TTM] Initializing pool allocator
[    9.972844] [TTM] Initializing DMA pool allocator
[    9.989284] i40e 0000:61:00.0: fw 3.1.55727 api 1.5 nvm 3.31 0x80000cd9 1.1747.0 [8086:37d1] [15d9:37d1]
[    9.993028] i40e 0000:61:00.0: MAC address: 00:25:90:be:7e:20
[    9.993179] i40e 0000:61:00.0: FW LLDP is enabled
[    9.998026] hub 3-0:1.0: USB hub found
[    9.998033] hub 3-0:1.0: 2 ports detected
[    9.998242] xhci_hcd 0000:02:00.0: xHCI Host Controller
[   10.001306] Console: switching to colour frame buffer device 128x48
[   10.002432] ast 0000:04:00.0: fb0: astdrmfb frame buffer device
[   10.002441] xhci_hcd 0000:02:00.0: new USB bus registered, assigned bus number 4
[   10.002444] xhci_hcd 0000:02:00.0: Host supports USB 3.1 Enhanced SuperSpeed
[   10.002470] usb usb4: We don't know the algorithms for LPM for this host, disabling LPM.
[   10.002483] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.07
[   10.002484] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[   10.002485] usb usb4: Product: xHCI Host Controller
[   10.002486] usb usb4: Manufacturer: Linux 5.7.0-rc7-andres-00133-gc8707bf69395 xhci-hcd
[   10.002487] usb usb4: SerialNumber: 0000:02:00.0
[   10.004077] hub 4-0:1.0: USB hub found
[   10.004082] hub 4-0:1.0: 2 ports detected
[   10.005083] i40e 0000:61:00.0 eth0: NIC Link is Up, 1000 Mbps Full Duplex, Flow Control: None
[   10.014982] i40e 0000:61:00.0: Added LAN device PF0 bus=0x61 dev=0x00 func=0x00
[   10.015506] i40e 0000:61:00.0: Features: PF-id[0] VFs: 32 VSIs: 34 QP: 40 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA
[   10.030218] i40e 0000:61:00.1: fw 3.1.55727 api 1.5 nvm 3.31 0x80000cd9 1.1747.0 [8086:37d1] [15d9:37d1]
[   10.033533] i40e 0000:61:00.1: MAC address: 00:25:90:be:7e:21
[   10.033686] i40e 0000:61:00.1: FW LLDP is enabled
[   10.040600] [drm] amdgpu kernel modesetting enabled.
[   10.040788] CRAT table not found
[   10.040789] Virtual CRAT table created for CPU
[   10.040790] Parsing CRAT table with 2 nodes
[   10.040791] Creating topology SYSFS entries
[   10.040802] Topology: Add CPU node
[   10.040802] Finished initializing topology
[   10.041146] amdgpu 0000:b1:00.0: vgaarb: deactivate vga console
[   10.041169] amdgpu 0000:b1:00.0: enabling device (0146 -> 0147)
[   10.041304] [drm] initializing kernel modesetting (NAVI14 0x1002:0x7340 0x1DA2:0xE421 0xC5).
[   10.041337] [drm] register mmio base: 0xEE500000
[   10.041338] [drm] register mmio size: 524288
[   10.042740] i40e 0000:61:00.1: Added LAN device PF1 bus=0x61 dev=0x00 func=0x01
[   10.043264] i40e 0000:61:00.1: Features: PF-id[1] VFs: 32 VSIs: 34 QP: 40 RSS FD_ATR FD_SB NTUPLE DCB VxLAN Geneve PTP VEPA
[   10.045852] random: crng init done
[   10.056621] [drm] add ip block number 0 <nv_common>
[   10.056623] [drm] add ip block number 1 <gmc_v10_0>
[   10.056624] [drm] add ip block number 2 <navi10_ih>
[   10.056625] [drm] add ip block number 3 <psp>
[   10.056626] [drm] add ip block number 4 <smu>
[   10.056627] [drm] add ip block number 5 <dm>
[   10.056628] [drm] add ip block number 6 <gfx_v10_0>
[   10.056629] [drm] add ip block number 7 <sdma_v5_0>
[   10.056630] [drm] add ip block number 8 <vcn_v2_0>
[   10.056631] [drm] add ip block number 9 <jpeg_v2_0>
[   10.056833] ATOM BIOS: 113-E4210SM-U03
[   10.056848] [drm] VCN decode is enabled in VM mode
[   10.056849] [drm] VCN encode is enabled in VM mode
[   10.056850] [drm] JPEG decode is enabled in VM mode
[   10.056906] [drm] vm size is 262144 GB, 4 levels, block size is 9-bit, fragment size is 9-bit
[   10.056913] amdgpu 0000:b1:00.0: VRAM: 8176M 0x0000008000000000 - 0x00000081FEFFFFFF (8176M used)
[   10.056916] amdgpu 0000:b1:00.0: GART: 512M 0x0000000000000000 - 0x000000001FFFFFFF
[   10.056928] [drm] Detected VRAM RAM=8176M, BAR=256M
[   10.056930] [drm] RAM width 128bits GDDR6
[   10.057430] [drm] amdgpu: 8176M of VRAM memory ready
[   10.057439] [drm] amdgpu: 8176M of GTT memory ready.
[   10.057452] [drm] GART: num cpu pages 131072, num gpu pages 131072
[   10.057545] [drm] PCIE GART of 512M enabled (table at 0x0000008000300000).
[   10.057895] amdgpu 0000:b1:00.0: Direct firmware load for amdgpu/navi14_ta.bin failed with error -2
[   10.057898] amdgpu 0000:b1:00.0: psp v11.0: Failed to load firmware "amdgpu/navi14_ta.bin"
[   10.058795] i40e 0000:61:00.1 eno2: renamed from eth1
[   10.059942] [drm] use_doorbell being set to: [true]
[   10.060001] [drm] use_doorbell being set to: [true]
[   10.060201] [drm] Found VCN firmware Version ENC: 1.7 DEC: 4 VEP: 0 Revision: 13
[   10.060205] [drm] PSP loading VCN firmware
[   10.073035] md0: detected capacity change from 0 to 8001299677184
[   10.242608] ixgbe 0000:18:00.0: Multiqueue Enabled: Rx Queue count = 40, Tx Queue count = 40 XDP Queue count = 0
[   10.249264] usb 1-4: new high-speed USB device number 2 using xhci_hcd
[   10.324743] ixgbe 0000:18:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link)
[   10.396044] usb 1-4: New USB device found, idVendor=0424, idProduct=2514, bcdDevice= b.b3
[   10.396048] usb 1-4: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[   10.396678] hub 1-4:1.0: USB hub found
[   10.396703] hub 1-4:1.0: 4 ports detected
[   10.398137] power_meter ACPI000D:00: Found ACPI power meter.
[   10.398187] power_meter ACPI000D:00: Ignoring unsafe software power cap!
[   10.418055] ixgbe 0000:18:00.0: MAC: 3, PHY: 0, PBA No: G54042-008
[   10.418058] ixgbe 0000:18:00.0: 00:1b:21:e2:59:80
[   10.439424] [drm] Initialized ast 0.1.0 20120228 for 0000:04:00.0 on minor 1
[   10.505971] [drm] reserve 0x900000 from 0x81fe400000 for PSP TMR
[   10.506425] i40e 0000:61:00.0 eno1: renamed from eth0
[   10.519223] usb 1-7: new high-speed USB device number 3 using xhci_hcd
[   10.591901] ixgbe 0000:18:00.0: Intel(R) 10 Gigabit Network Connection
[   10.598123] libphy: ixgbe-mdio: probed
[   10.613730] ixgbe 0000:18:00.0 eth10gbe: renamed from eth0
[   10.666552] usb 1-7: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00
[   10.666556] usb 1-7: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[   10.667345] hub 1-7:1.0: USB hub found
[   10.667535] hub 1-7:1.0: 4 ports detected
[   10.702663] use vbios provided pptable
[   10.702787] smu driver if version = 0x00000036, smu fw if version = 0x00000034, smu fw version = 0x00351600 (53.22.0)
[   10.702787] SMU driver if version not matched
[   10.739262] usb 1-4.2: new low-speed USB device number 4 using xhci_hcd
[   10.740666] SMU is initialized successfully!
[   10.741006] [drm] Display Core initialized with v3.2.76!
[   10.839466] usb 1-4.2: New USB device found, idVendor=17ef, idProduct=6009, bcdDevice= 1.27
[   10.839470] usb 1-4.2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[   10.839473] usb 1-4.2: Product: ThinkPad USB Keyboard with TrackPoint
[   10.839475] usb 1-4.2: Manufacturer: Lite-On Technology Corp.
[   10.859253] input: Lite-On Technology Corp. ThinkPad USB Keyboard with TrackPoint as /devices/pci0000:00/0000:00:14.0/usb1/1-4/1-4.2/1-4.2:1.0/0003:17EF:6009.0001/input/input2
[   10.916212] lenovo 0003:17EF:6009.0001: input,hidraw0: USB HID v1.10 Keyboard [Lite-On Technology Corp. ThinkPad USB Keyboard with TrackPoint] on usb-0000:00:14.0-4.2/input0
[   10.916966] input: Lite-On Technology Corp. ThinkPad USB Keyboard with TrackPoint as /devices/pci0000:00/0000:00:14.0/usb1/1-4/1-4.2/1-4.2:1.1/0003:17EF:6009.0002/input/input3
[   10.942597] usb 1-4.3: new full-speed USB device number 5 using xhci_hcd
[   10.976275] lenovo 0003:17EF:6009.0002: input,hiddev0,hidraw1: USB HID v1.10 Mouse [Lite-On Technology Corp. ThinkPad USB Keyboard with TrackPoint] on usb-0000:00:14.0-4.2/input1
[   11.068853] usb 1-4.3: New USB device found, idVendor=0a12, idProduct=0001, bcdDevice=88.91
[   11.068857] usb 1-4.3: New USB device strings: Mfr=0, Product=2, SerialNumber=0
[   11.068859] usb 1-4.3: Product: CSR8510 A10
[   11.070959] [drm] Supports vblank timestamp caching Rev 2 (21.10.2013).
[   11.071820] [drm] kiq ring mec 2 pipe 1 q 0
[   11.079799] [drm] VCN decode and encode initialized successfully(under DPG Mode).
[   11.079849] [drm] JPEG decode initialized successfully.
[   11.081599] kfd kfd: Allocated 3969056 bytes on gart
[   11.082463] Virtual CRAT table created for GPU
[   11.082464] Parsing CRAT table with 1 nodes
[   11.082471] Creating topology SYSFS entries
[   11.082607] Topology: Add dGPU node [0x7340:0x1002]
[   11.082611] kfd kfd: added device 1002:7340
[   11.086692] [drm] fb mappable at 0x39BFE04C1000
[   11.086694] [drm] vram apper at 0x39BFE0000000
[   11.086695] [drm] size 14745600
[   11.086696] [drm] fb depth is 24
[   11.086697] [drm]    pitch is 10240
[   11.086837] fbcon: amdgpudrmfb (fb1) is primary device
[   11.086839] fbcon: Remapping primary device, fb1, to tty 1-63
[   11.130704] [drm:mod_hdcp_add_display_to_topology [amdgpu]] *ERROR* Failed to add display topology, DTM TA is not initialized.
[   11.130706] [drm] [Link 0] WARNING MOD_HDCP_STATUS_FAILURE IN STATE HDCP_UNINITIALIZED STAY COUNT 0
[   11.159273] usb 1-7.1: new low-speed USB device number 6 using xhci_hcd
[   11.185810] [drm:mod_hdcp_add_display_to_topology [amdgpu]] *ERROR* Failed to add display topology, DTM TA is not initialized.
[   11.185812] [drm] [Link 0] WARNING MOD_HDCP_STATUS_FAILURE IN STATE HDCP_UNINITIALIZED STAY COUNT 0
[   11.242508] [drm:mod_hdcp_add_display_to_topology [amdgpu]] *ERROR* Failed to add display topology, DTM TA is not initialized.
[   11.242511] [drm] [Link 0] WARNING MOD_HDCP_STATUS_FAILURE IN STATE HDCP_UNINITIALIZED STAY COUNT 0
[   11.277455] usb 1-7.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00
[   11.277459] usb 1-7.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[   11.284077] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb1/1-7/1-7.1/1-7.1:1.0/0003:0557:2419.0003/input/input4
[   11.339626] hid-generic 0003:0557:2419.0003: input,hidraw2: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-7.1/input0
[   11.341497] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb1/1-7/1-7.1/1-7.1:1.1/0003:0557:2419.0004/input/input5
[   11.342243] hid-generic 0003:0557:2419.0004: input,hidraw3: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-7.1/input1
[   11.352602] usb 1-4.4: new full-speed USB device number 7 using xhci_hcd
[   11.447182] usb 1-4.4: New USB device found, idVendor=046d, idProduct=c52b, bcdDevice=12.11
[   11.447186] usb 1-4.4: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[   11.447188] usb 1-4.4: Product: USB Receiver
[   11.447190] usb 1-4.4: Manufacturer: Logitech
[   11.457619] input: Logitech USB Receiver as /devices/pci0000:00/0000:00:14.0/usb1/1-4/1-4.4/1-4.4:1.0/0003:046D:C52B.0005/input/input6
[   11.512964] hid-generic 0003:046D:C52B.0005: input,hidraw4: USB HID v1.11 Keyboard [Logitech USB Receiver] on usb-0000:00:14.0-4.4/input0
[   11.516569] input: Logitech USB Receiver Mouse as /devices/pci0000:00/0000:00:14.0/usb1/1-4/1-4.4/1-4.4:1.1/0003:046D:C52B.0006/input/input7
[   11.516791] input: Logitech USB Receiver Consumer Control as /devices/pci0000:00/0000:00:14.0/usb1/1-4/1-4.4/1-4.4:1.1/0003:046D:C52B.0006/input/input8
[   11.572802] input: Logitech USB Receiver System Control as /devices/pci0000:00/0000:00:14.0/usb1/1-4/1-4.4/1-4.4:1.1/0003:046D:C52B.0006/input/input9
[   11.572942] hid-generic 0003:046D:C52B.0006: input,hiddev1,hidraw5: USB HID v1.11 Mouse [Logitech USB Receiver] on usb-0000:00:14.0-4.4/input1
[   11.575514] hid-generic 0003:046D:C52B.0007: hiddev2,hidraw6: USB HID v1.11 Device [Logitech USB Receiver] on usb-0000:00:14.0-4.4/input2
[   11.916817] logitech-djreceiver 0003:046D:C52B.0007: hiddev1,hidraw4: USB HID v1.11 Device [Logitech USB Receiver] on usb-0000:00:14.0-4.4/input2
[   12.032183] input: Logitech Unifying Device. Wireless PID:4069 Keyboard as /devices/pci0000:00/0000:00:14.0/usb1/1-4/1-4.4/1-4.4:1.2/0003:046D:C52B.0007/0003:046D:4069.0008/input/input11
[   12.032934] input: Logitech Unifying Device. Wireless PID:4069 Mouse as /devices/pci0000:00/0000:00:14.0/usb1/1-4/1-4.4/1-4.4:1.2/0003:046D:C52B.0007/0003:046D:4069.0008/input/input12
[   12.033079] input: Logitech Unifying Device. Wireless PID:4069 Consumer Control as /devices/pci0000:00/0000:00:14.0/usb1/1-4/1-4.4/1-4.4:1.2/0003:046D:C52B.0007/0003:046D:4069.0008/input/input13
[   12.033427] input: Logitech Unifying Device. Wireless PID:4069 System Control as /devices/pci0000:00/0000:00:14.0/usb1/1-4/1-4.4/1-4.4:1.2/0003:046D:C52B.0007/0003:046D:4069.0008/input/input14
[   12.033764] hid-generic 0003:046D:4069.0008: input,hidraw5: USB HID v1.11 Keyboard [Logitech Unifying Device. Wireless PID:4069] on usb-0000:00:14.0-4.4/input2:1
[   12.373268] input: Logitech MX Master 2S as /devices/pci0000:00/0000:00:14.0/usb1/1-4/1-4.4/1-4.4:1.2/0003:046D:C52B.0007/0003:046D:4069.0008/input/input18
[   12.373575] logitech-hidpp-device 0003:046D:4069.0008: input,hidraw5: USB HID v1.11 Keyboard [Logitech MX Master 2S] on usb-0000:00:14.0-4.4/input2:1
[   12.932048] amdgpu 0000:b1:00.0: fb1: amdgpudrmfb frame buffer device
[   12.932126] amdgpu 0000:b1:00.0: ring gfx_0.0.0 uses VM inv eng 0 on hub 0
[   12.932127] amdgpu 0000:b1:00.0: ring comp_1.0.0 uses VM inv eng 1 on hub 0
[   12.932128] amdgpu 0000:b1:00.0: ring comp_1.1.0 uses VM inv eng 4 on hub 0
[   12.932129] amdgpu 0000:b1:00.0: ring comp_1.2.0 uses VM inv eng 5 on hub 0
[   12.932130] amdgpu 0000:b1:00.0: ring comp_1.3.0 uses VM inv eng 6 on hub 0
[   12.932131] amdgpu 0000:b1:00.0: ring comp_1.0.1 uses VM inv eng 7 on hub 0
[   12.932131] amdgpu 0000:b1:00.0: ring comp_1.1.1 uses VM inv eng 8 on hub 0
[   12.932132] amdgpu 0000:b1:00.0: ring comp_1.2.1 uses VM inv eng 9 on hub 0
[   12.932133] amdgpu 0000:b1:00.0: ring comp_1.3.1 uses VM inv eng 10 on hub 0
[   12.932133] amdgpu 0000:b1:00.0: ring kiq_2.1.0 uses VM inv eng 11 on hub 0
[   12.932134] amdgpu 0000:b1:00.0: ring sdma0 uses VM inv eng 12 on hub 0
[   12.932135] amdgpu 0000:b1:00.0: ring sdma1 uses VM inv eng 13 on hub 0
[   12.932136] amdgpu 0000:b1:00.0: ring vcn_dec uses VM inv eng 0 on hub 1
[   12.932137] amdgpu 0000:b1:00.0: ring vcn_enc0 uses VM inv eng 1 on hub 1
[   12.932137] amdgpu 0000:b1:00.0: ring vcn_enc1 uses VM inv eng 4 on hub 1
[   12.932138] amdgpu 0000:b1:00.0: ring jpeg_dec uses VM inv eng 5 on hub 1
[   12.932677] [drm] Initialized amdgpu 3.37.0 20150101 for 0000:b1:00.0 on minor 2
[   13.040037] process '/usr/bin/ipconfig' started with executable stack
[   13.126514] 8021q: adding VLAN 0 to HW filter on device eno2
[   13.336369] pps pps0: new PPS source ptp2
[   13.336428] ixgbe 0000:18:00.0: registered PHC device on eth10gbe
[   13.472425] 8021q: adding VLAN 0 to HW filter on device eth10gbe
[   13.538113] 8021q: adding VLAN 0 to HW filter on device eno1
[   13.538151] IPv6: ADDRCONF(NETDEV_CHANGE): eno1: link becomes ready
[   18.630132] ixgbe 0000:18:00.0 eth10gbe: NIC Link is Up 10 Gbps, Flow Control: None
[   18.630303] IPv6: ADDRCONF(NETDEV_CHANGE): eth10gbe: link becomes ready
[   20.815167] PM: Image not found (code -22)
[   20.875759] EXT4-fs (dm-2): mounted filesystem with ordered data mode. Opts: (null)
[   21.038733] ixgbe 0000:18:00.0: removed PHC on eth10gbe
[   21.618382] systemd[1]: systemd 245.5-3 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid)
[   21.632754] systemd[1]: Detected architecture x86-64.
[   21.632995] systemd[1]: Set hostname to <awork3>.
[   21.894279] systemd[1]: Created slice Virtual Machine and Container Slice.
[   21.894468] systemd[1]: Created slice system-getty.slice.
[   21.894558] systemd[1]: Created slice system-modprobe.slice.
[   21.894643] systemd[1]: Created slice system-postfix.slice.
[   21.894734] systemd[1]: Created slice system-serial\x2dgetty.slice.
[   21.894819] systemd[1]: Created slice Cryptsetup Units Slice.
[   21.894905] systemd[1]: Created slice system-systemd\x2dfsck.slice.
[   21.894976] systemd[1]: Created slice User and Session Slice.
[   21.895025] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[   21.895174] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[   21.895243] systemd[1]: Reached target User and Group Name Lookups.
[   21.895254] systemd[1]: Reached target Remote File Systems.
[   21.895264] systemd[1]: Reached target Slices.
[   21.895283] systemd[1]: Reached target Libvirt guests shutdown.
[   21.895335] systemd[1]: Listening on Device-mapper event daemon FIFOs.
[   21.895409] systemd[1]: Listening on LVM2 poll daemon socket.
[   21.895468] systemd[1]: Listening on Syslog Socket.
[   21.895524] systemd[1]: Listening on fsck to fsckd communication Socket.
[   21.895555] systemd[1]: Listening on initctl Compatibility Named Pipe.
[   21.896083] systemd[1]: Listening on Journal Audit Socket.
[   21.896126] systemd[1]: Listening on Journal Socket (/dev/log).
[   21.896185] systemd[1]: Listening on Journal Socket.
[   21.896237] systemd[1]: Listening on udev Control Socket.
[   21.896266] systemd[1]: Listening on udev Kernel Socket.
[   21.896764] systemd[1]: Mounting Huge Pages File System...
[   21.897295] systemd[1]: Mounting POSIX Message Queue File System...
[   21.897942] systemd[1]: Mounting Kernel Debug File System...
[   21.898553] systemd[1]: Mounting Kernel Trace File System...
[   21.899183] systemd[1]: Starting Availability of block devices...
[   21.899797] systemd[1]: Starting Set the console keyboard layout...
[   21.902701] systemd[1]: Starting Create list of static device nodes for the current kernel...
[   21.903740] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling...
[   21.903810] systemd[1]: Condition check resulted in Load Kernel Module drm being skipped.
[   21.904871] systemd[1]: Started Nameserver information manager.
[   21.905151] systemd[1]: Reached target Network (Pre).
[   21.905701] systemd[1]: Condition check resulted in Set Up Additional Binary Formats being skipped.
[   21.905777] systemd[1]: Condition check resulted in File System Check on Root Device being skipped.
[   21.908066] systemd[1]: Starting Journal Service...
[   21.909661] systemd[1]: Starting Load Kernel Modules...
[   21.910664] systemd[1]: Starting Remount Root and Kernel File Systems...
[   21.911804] systemd[1]: Starting udev Coldplug all Devices...
[   21.914372] systemd[1]: Mounted Huge Pages File System.
[   21.914581] systemd[1]: Mounted POSIX Message Queue File System.
[   21.914762] systemd[1]: Mounted Kernel Debug File System.
[   21.914934] systemd[1]: Mounted Kernel Trace File System.
[   21.915292] systemd[1]: Finished Availability of block devices.
[   21.915725] systemd[1]: Finished Set the console keyboard layout.
[   21.916020] systemd[1]: Finished Create list of static device nodes for the current kernel.
[   21.932416] EXT4-fs (dm-2): re-mounted. Opts: errors=remount-ro
[   21.933894] systemd[1]: Finished Remount Root and Kernel File Systems.
[   21.934335] systemd[1]: Finished Load Kernel Modules.
[   21.935336] systemd[1]: Mounting FUSE Control File System...
[   21.936279] systemd[1]: Mounting Kernel Configuration File System...
[   21.937139] systemd[1]: Condition check resulted in Rebuild Hardware Database being skipped.
[   21.937208] systemd[1]: Condition check resulted in Platform Persistent Storage Archival being skipped.
[   21.938142] systemd[1]: Starting Load/Save Random Seed...
[   21.939110] systemd[1]: Starting Apply Kernel Variables...
[   21.940143] systemd[1]: Starting Create System Users...
[   21.942401] systemd[1]: Mounted FUSE Control File System.
[   21.942671] systemd[1]: Mounted Kernel Configuration File System.
[   21.954418] systemd[1]: Finished Load/Save Random Seed.
[   21.957451] systemd[1]: Finished Apply Kernel Variables.
[   21.960015] systemd[1]: Finished Create System Users.
[   21.961071] systemd[1]: Starting Create Static Device Nodes in /dev...
[   21.975201] systemd[1]: Finished Create Static Device Nodes in /dev.
[   21.976655] systemd[1]: Starting udev Kernel Device Manager...
[   22.017901] systemd[1]: Finished Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling.
[   22.018154] systemd[1]: Reached target Local File Systems (Pre).
[   22.019395] systemd[1]: Mounting Mount unit for chromium, revision 1143...
[   22.020624] systemd[1]: Mounting Mount unit for chromium, revision 1165...
[   22.022025] systemd[1]: Mounting Mount unit for core18, revision 1705...
[   22.023302] systemd[1]: Mounting Mount unit for core18, revision 1754...
[   22.024577] systemd[1]: Mounting Mount unit for gtk-common-themes, revision 1502...
[   22.025744] systemd[1]: Mounting Mount unit for gtk-common-themes, revision 1506...
[   22.026945] systemd[1]: Mounting Mount unit for kde-frameworks-5-qt-5-14-core18, revision 4...
[   22.028488] systemd[1]: Mounting Mount unit for kdenlive, revision 24...
[   22.029788] systemd[1]: Mounting Mount unit for snapd, revision 7264...
[   22.031095] systemd[1]: Mounting Mount unit for snapd, revision 7777...
[   22.032226] systemd[1]: Mounting Mount unit for zoom-client, revision 83...
[   22.033309] systemd[1]: Mounting Mount unit for zoom-client, revision 84...
[   22.033384] systemd[1]: Condition check resulted in Virtual Machine and Container Storage (Compatibility) being skipped.
[   22.033434] systemd[1]: Reached target Containers.
[   22.052754] systemd[1]: Finished udev Coldplug all Devices.
[   22.054052] systemd[1]: Starting Helper to synchronize boot up for ifupdown...
[   22.056979] systemd[1]: Started udev Kernel Device Manager.
[   22.058030] systemd[1]: Starting Show Plymouth Boot Screen...
[   22.080367] systemd[1]: Started Show Plymouth Boot Screen.
[   22.080540] systemd[1]: Condition check resulted in Dispatch Password Requests to Console Directory Watch being skipped.
[   22.080640] systemd[1]: Started Forward Password Requests to Plymouth Directory Watch.
[   22.215803] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[   22.233260] iTCO_vendor_support: vendor-support=0
[   22.237024] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[   22.237209] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS
[   22.273687] systemd[1]: Found device Samsung_SSD_860_PRO_4TB awork3-boring-crypt.
[   22.276579] systemd[1]: Starting Cryptography Setup for awork3-boring_crypt...
[   22.303532] systemd[1]: Found device SAMSUNG MZVLB1T0HBLR-000L7.
[   22.326468] systemd[1]: Found device Samsung SSD 970 PRO 1TB.
[   22.333198] systemd[1]: Found device Samsung SSD 970 PRO 1TB awork3-root-crypt.
[   22.334191] systemd[1]: Condition check resulted in Dispatch Password Requests to Console Directory Watch being skipped.
[   22.336288] systemd[1]: Started Forward Password Requests to Plymouth.
[   22.336522] systemd[1]: Condition check resulted in Set Up Additional Binary Formats being skipped.
[   22.338624] systemd[1]: Starting Cryptography Setup for nvme0n1p3_crypt...
[   22.338657] systemd[1]: Condition check resulted in File System Check on Root Device being skipped.
[   22.341285] systemd[1]: Starting File System Check on /dev/disk/by-uuid/0d38984e-69ab-485a-9bf8-f8ef937eb986...
[   22.345223] systemd[1]: Starting File System Check on /dev/disk/by-uuid/61565612-356a-4e94-9485-4fe5993532ed...
[   22.345291] systemd[1]: Condition check resulted in Rebuild Hardware Database being skipped.
[   22.345478] systemd[1]: Condition check resulted in Platform Persistent Storage Archival being skipped.
[   22.352815] systemd[1]: Finished Cryptography Setup for nvme0n1p3_crypt.
[   22.356865] systemd[1]: Found device Samsung SSD 970 PRO 1TB 1.
[   22.357788] EFI Variables Facility v0.08 2004-May-17
[   22.365604] systemd[1]: Found device Samsung SSD 970 PRO 1TB boot.
[   22.370601] systemd[1]: Found device /dev/ttyS1.
[   22.373784] systemd[1]: Finished File System Check on /dev/disk/by-uuid/0d38984e-69ab-485a-9bf8-f8ef937eb986.
[   22.374818] systemd[1]: Finished File System Check on /dev/disk/by-uuid/61565612-356a-4e94-9485-4fe5993532ed.
[   22.375840] usbcore: registered new interface driver btusb
[   22.378136] Intel(R) Wireless WiFi driver for Linux
[   22.378137] Copyright(c) 2003- 2015 Intel Corporation
[   22.378590] systemd[1]: Reached target Block Device Preparation for /dev/mapper/nvme0n1p3_crypt.
[   22.378788] iwlwifi 0000:d8:00.0: enabling device (0140 -> 0142)
[   22.379761] snd_hda_intel 0000:00:1f.3: enabling device (0140 -> 0142)
[   22.379923] systemd[1]: Mounting /home/andres/other...
[   22.380311] snd_hda_intel 0000:b1:00.1: enabling device (0140 -> 0142)
[   22.380564] snd_hda_intel 0000:b1:00.1: Force to non-snoop mode
[   22.380729] systemd[1]: Mounting /srv/dev...
[   22.381609] systemd[1]: Starting File System Check on /dev/disk/by-uuid/626c74ab-3a73-4c1f-84bd-5f35703272a3...
[   22.381962] XFS (nvme0n1): Mounting V5 Filesystem
[   22.382627] systemd[1]: Starting File System Check on /dev/disk/by-uuid/8450-27D6...
[   22.383149] XFS (nvme1n1): Mounting V5 Filesystem
[   22.383292] systemd[1]: Started File System Check Daemon to report status.
[   22.385088] systemd[1]: Found device Ethernet Controller 10-Gigabit X540-AT2 (Ethernet Converged Network Adapter X540-T1).
[   22.385717] iwlwifi 0000:d8:00.0: loaded firmware version 36.8fd77bb3.0 8265-36.ucode op_mode iwlmvm
[   22.385742] iwlwifi 0000:d8:00.0: Direct firmware load for iwl-debug-yoyo.bin failed with error -2
[   22.390830] XFS (nvme0n1): Ending clean mount
[   22.392132] snd_hda_intel 0000:b1:00.1: bound 0000:b1:00.0 (ops amdgpu_dm_audio_component_bind_ops [amdgpu])
[   22.392259] xfs filesystem being mounted at /home/andres/other supports timestamps until 2038 (0x7fffffff)
[   22.392777] XFS (nvme1n1): Ending clean mount
[   22.393353] systemd[1]: Mounted /home/andres/other.
[   22.393425] input: HDA ATI HDMI HDMI/DP,pcm=3 as /devices/pci0000:ae/0000:ae:00.0/0000:af:00.0/0000:b0:00.0/0000:b1:00.1/sound/card1/input19
[   22.393622] input: HDA ATI HDMI HDMI/DP,pcm=7 as /devices/pci0000:ae/0000:ae:00.0/0000:af:00.0/0000:b0:00.0/0000:b1:00.1/sound/card1/input20
[   22.393803] input: HDA ATI HDMI HDMI/DP,pcm=8 as /devices/pci0000:ae/0000:ae:00.0/0000:af:00.0/0000:b0:00.0/0000:b1:00.1/sound/card1/input21
[   22.393994] input: HDA ATI HDMI HDMI/DP,pcm=9 as /devices/pci0000:ae/0000:ae:00.0/0000:af:00.0/0000:b0:00.0/0000:b1:00.1/sound/card1/input22
[   22.394025] input: HDA ATI HDMI HDMI/DP,pcm=10 as /devices/pci0000:ae/0000:ae:00.0/0000:af:00.0/0000:b0:00.0/0000:b1:00.1/sound/card1/input23
[   22.394199] input: HDA ATI HDMI HDMI/DP,pcm=11 as /devices/pci0000:ae/0000:ae:00.0/0000:af:00.0/0000:b0:00.0/0000:b1:00.1/sound/card1/input24
[   22.394585] xfs filesystem being mounted at /srv/dev supports timestamps until 2038 (0x7fffffff)
[   22.396384] systemd[1]: Mounted /srv/dev.
[   22.397457] systemd[1]: Found device Ethernet Connection X722 for 1GbE.
[   22.398345] systemd[1]: Found device Ethernet Connection X722 for 1GbE.
[   22.409528] systemd[1]: Finished File System Check on /dev/disk/by-uuid/626c74ab-3a73-4c1f-84bd-5f35703272a3.
[   22.410567] systemd[1]: Mounting /boot...
[   22.411431] systemd[1]: Finished File System Check on /dev/disk/by-uuid/8450-27D6.
[   22.415824] EXT4-fs (nvme2n1p2): mounted filesystem with ordered data mode. Opts: (null)
[   22.418119] systemd[1]: Mounted /boot.
[   22.419573] systemd[1]: Mounting /boot/efi...
[   22.499115] systemd[1]: Started Journal Service.
[   22.517094] systemd-journald[4352]: Received client request to flush runtime journal.
[   22.550161] loop: module loaded
[   22.577849] iwlwifi 0000:d8:00.0: Detected Intel(R) Dual Band Wireless AC 8265, REV=0x230
[   22.582595] snd_hda_codec_realtek hdaudioC0D0: autoconfig for ALC888-VD: line_outs=3 (0x14/0x15/0x16/0x0/0x0) type:line
[   22.582599] snd_hda_codec_realtek hdaudioC0D0:    speaker_outs=0 (0x0/0x0/0x0/0x0/0x0)
[   22.582602] snd_hda_codec_realtek hdaudioC0D0:    hp_outs=1 (0x1b/0x0/0x0/0x0/0x0)
[   22.582603] snd_hda_codec_realtek hdaudioC0D0:    mono: mono_out=0x0
[   22.582605] snd_hda_codec_realtek hdaudioC0D0:    dig-out=0x11/0x1e
[   22.582607] snd_hda_codec_realtek hdaudioC0D0:    inputs:
[   22.582610] snd_hda_codec_realtek hdaudioC0D0:      Front Mic=0x19
[   22.582612] snd_hda_codec_realtek hdaudioC0D0:      Rear Mic=0x18
[   22.582614] snd_hda_codec_realtek hdaudioC0D0:      Line=0x1a
[   22.582615] snd_hda_codec_realtek hdaudioC0D0:    dig-in=0x1f
[   22.593364] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[   22.635873] iwlwifi 0000:d8:00.0: base HW address: a0:a4:c5:6a:5c:c0
[   22.647306] input: HDA Intel PCH Front Mic as /devices/pci0000:00/0000:00:1f.3/sound/card0/input25
[   22.647399] input: HDA Intel PCH Rear Mic as /devices/pci0000:00/0000:00:1f.3/sound/card0/input26
[   22.647473] input: HDA Intel PCH Line as /devices/pci0000:00/0000:00:1f.3/sound/card0/input27
[   22.647545] input: HDA Intel PCH Line Out Front as /devices/pci0000:00/0000:00:1f.3/sound/card0/input28
[   22.647617] input: HDA Intel PCH Line Out Surround as /devices/pci0000:00/0000:00:1f.3/sound/card0/input29
[   22.647686] input: HDA Intel PCH Line Out CLFE as /devices/pci0000:00/0000:00:1f.3/sound/card0/input30
[   22.647761] input: HDA Intel PCH Front Headphone as /devices/pci0000:00/0000:00:1f.3/sound/card0/input31
[   22.710906] ieee80211 phy0: Selected rate control algorithm 'iwl-mvm-rs'
[   22.711577] thermal thermal_zone2: failed to read out thermal zone (-61)
[   24.426735] ata7.00: Enabling discard_zeroes_data
[   25.795938] Adding 62496764k swap on /dev/mapper/awork3--vg-swap.  Priority:-2 extents:1 across:62496764k SSFS
[   25.946209] iwlwifi 0000:d8:00.0 wifi0: renamed from wlan0
[   25.962177] EXT4-fs (md0): mounted filesystem with ordered data mode. Opts: (null)
[   26.325767] EXT4-fs (dm-5): mounted filesystem with ordered data mode. Opts: errors=remount-ro
[   26.406771] irq 347: Affinity broken due to vector space exhaustion.
[   26.406790] irq 348: Affinity broken due to vector space exhaustion.
[   26.406807] irq 349: Affinity broken due to vector space exhaustion.
[   26.406823] irq 350: Affinity broken due to vector space exhaustion.
[   26.406839] irq 351: Affinity broken due to vector space exhaustion.
[   26.406855] irq 352: Affinity broken due to vector space exhaustion.
[   26.406872] irq 353: Affinity broken due to vector space exhaustion.
[   26.406888] irq 354: Affinity broken due to vector space exhaustion.
[   26.406904] irq 355: Affinity broken due to vector space exhaustion.
[   26.406920] irq 356: Affinity broken due to vector space exhaustion.
[   26.407064] irq 367: Affinity broken due to vector space exhaustion.
[   26.407090] irq 368: Affinity broken due to vector space exhaustion.
[   26.407106] irq 369: Affinity broken due to vector space exhaustion.
[   26.407122] irq 370: Affinity broken due to vector space exhaustion.
[   26.407138] irq 371: Affinity broken due to vector space exhaustion.
[   26.407153] irq 372: Affinity broken due to vector space exhaustion.
[   26.407171] irq 373: Affinity broken due to vector space exhaustion.
[   26.407187] irq 374: Affinity broken due to vector space exhaustion.
[   26.407203] irq 375: Affinity broken due to vector space exhaustion.
[   26.407219] irq 376: Affinity broken due to vector space exhaustion.
[   26.407829] 8021q: adding VLAN 0 to HW filter on device eno2
[   26.419529] irq 232: Affinity broken due to vector space exhaustion.
[   26.419545] irq 233: Affinity broken due to vector space exhaustion.
[   26.419561] irq 234: Affinity broken due to vector space exhaustion.
[   26.419576] irq 235: Affinity broken due to vector space exhaustion.
[   26.419591] irq 236: Affinity broken due to vector space exhaustion.
[   26.419606] irq 237: Affinity broken due to vector space exhaustion.
[   26.419622] irq 238: Affinity broken due to vector space exhaustion.
[   26.419637] irq 239: Affinity broken due to vector space exhaustion.
[   26.419653] irq 240: Affinity broken due to vector space exhaustion.
[   26.419668] irq 241: Affinity broken due to vector space exhaustion.
[   26.419805] irq 252: Affinity broken due to vector space exhaustion.
[   26.419820] irq 253: Affinity broken due to vector space exhaustion.
[   26.419835] irq 254: Affinity broken due to vector space exhaustion.
[   26.419850] irq 255: Affinity broken due to vector space exhaustion.
[   26.419866] irq 256: Affinity broken due to vector space exhaustion.
[   26.419881] irq 257: Affinity broken due to vector space exhaustion.
[   26.419897] irq 258: Affinity broken due to vector space exhaustion.
[   26.419912] irq 259: Affinity broken due to vector space exhaustion.
[   26.419927] irq 260: Affinity broken due to vector space exhaustion.
[   26.419942] irq 261: Affinity broken due to vector space exhaustion.
[   26.420612] 8021q: adding VLAN 0 to HW filter on device eno1
[   26.585107] irq 472: Affinity broken due to vector space exhaustion.
[   26.585123] irq 473: Affinity broken due to vector space exhaustion.
[   26.585137] irq 474: Affinity broken due to vector space exhaustion.
[   26.585150] irq 475: Affinity broken due to vector space exhaustion.
[   26.585164] irq 476: Affinity broken due to vector space exhaustion.
[   26.585179] irq 477: Affinity broken due to vector space exhaustion.
[   26.585193] irq 478: Affinity broken due to vector space exhaustion.
[   26.585206] irq 479: Affinity broken due to vector space exhaustion.
[   26.585220] irq 480: Affinity broken due to vector space exhaustion.
[   26.585234] irq 481: Affinity broken due to vector space exhaustion.
[   26.585248] irq 482: Affinity broken due to vector space exhaustion.
[   26.585262] irq 483: Affinity broken due to vector space exhaustion.
[   26.585276] irq 484: Affinity broken due to vector space exhaustion.
[   26.585289] irq 485: Affinity broken due to vector space exhaustion.
[   26.585303] irq 486: Affinity broken due to vector space exhaustion.
[   26.585316] irq 487: Affinity broken due to vector space exhaustion.
[   26.585329] irq 488: Affinity broken due to vector space exhaustion.
[   26.585342] irq 489: Affinity broken due to vector space exhaustion.
[   26.585355] irq 490: Affinity broken due to vector space exhaustion.
[   26.585369] irq 491: Affinity broken due to vector space exhaustion.
[   26.585530] pps pps0: new PPS source ptp2
[   26.585589] ixgbe 0000:18:00.0: registered PHC device on eth10gbe
[   26.708082] 8021q: adding VLAN 0 to HW filter on device eth10gbe
[   26.708279] IPv6: ADDRCONF(NETDEV_CHANGE): eno1: link becomes ready
[   31.633829] ixgbe 0000:18:00.0 eth10gbe: NIC Link is Up 10 Gbps, Flow Control: None
[   31.634015] IPv6: ADDRCONF(NETDEV_CHANGE): eth10gbe: link becomes ready
[   31.638410] ixgbe 0000:18:00.0 eth10gbe: NIC Link is Down
[   32.946004] ixgbe 0000:18:00.0 eth10gbe: NIC Link is Up 10 Gbps, Flow Control: None
[   33.342040] wifi0: authenticate with 16:91:82:b8:29:61
[   33.347275] wifi0: send auth to 16:91:82:b8:29:61 (try 1/3)
[   33.352345] wifi0: authenticated
[   33.355925] wifi0: associate with 16:91:82:b8:29:61 (try 1/3)
[   33.385075] wifi0: RX AssocResp from 16:91:82:b8:29:61 (capab=0x11 status=0 aid=2)
[   33.387318] wifi0: associated
[   33.419695] IPv6: ADDRCONF(NETDEV_CHANGE): wifi0: link becomes ready
[   39.800564] rfkill: input handler disabled
[  125.526092] tee (7775): drop_caches: 3
[  146.264327] kill_fasync: bad magic number in fasync_struct!
[  146.264327] kill_fasync: bad magic number in fasync_struct!
[  146.285175] kill_fasync: bad magic number in fasync_struct!
[  146.290793] kill_fasync: bad magic number in fasync_struct!
[  146.285175] kill_fasync: bad magic number in fasync_struct!
[  146.290793] kill_fasync: bad magic number in fasync_struct!
[  157.071979] BUG: kernel NULL pointer dereference, address: 0000000000000020
[  157.078945] #PF: supervisor read access in kernel mode
[  157.084082] #PF: error_code(0x0000) - not-present page
[  157.089225] PGD 0 P4D 0
[  157.091763] Oops: 0000 [#1] SMP NOPTI
[  157.095429] CPU: 3 PID: 7756 Comm: postgres Not tainted 5.7.0-rc7-andres-00133-gc8707bf69395 #41
[  157.104208] Hardware name: Supermicro SYS-7049A-T/X11DAi-N, BIOS 3.2 11/13/2019
[  157.111518] RIP: 0010:xfs_log_commit_cil+0x356/0x7f0
[  157.116478] Code: 00 00 48 89 7e 08 49 89 76 30 48 89 11 48 89 4a 08 8b 4c 24 2c 48 89 85 c0 00 00 00 48 89 85 c8 00 00 00 49 8b 46 20 45 31 c9 <8b> 70 20 85 f6 0f 84 d9 02 00 00 45 31 c0 85 c9 7e 4f 41 8b 46 2c
[  157.135226] RSP: 0018:ffffc90021fefb00 EFLAGS: 00010246
[  157.140452] RAX: 0000000000000000 RBX: ffff8897a9ea80b0 RCX: 0000000000000458
[  157.147582] RDX: ffff8897a9ea80c0 RSI: ffff88afc39a1200 RDI: ffff88afb1ae2c18
[  157.154715] RBP: ffff8897a9ea8000 R08: ffffc90021fefb30 R09: 0000000000000000
[  157.161848] R10: 0000000000000084 R11: 0000000000000012 R12: ffff8897721bd400
[  157.168983] R13: ffff88afb1ae2c00 R14: ffff88afb19860c0 R15: ffff8897a9ea80a0
[  157.176115] FS:  00007ffbbe9a1980(0000) GS:ffff8897e0cc0000(0000) knlGS:0000000000000000
[  157.184199] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  157.189946] CR2: 0000000000000020 CR3: 000000179c0ac005 CR4: 00000000007606e0
[  157.197081] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  157.204212] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  157.211343] PKRU: 55555554
[  157.214048] Call Trace:
[  157.216498]  __xfs_trans_commit+0xa1/0x340
[  157.220596]  xfs_create+0x4cc/0x5e0
[  157.224087]  xfs_generic_create+0x241/0x310
[  157.228274]  path_openat+0xdb7/0x1020
[  157.231940]  do_filp_open+0x91/0x100
[  157.235518]  ? __sys_recvfrom+0xe4/0x170
[  157.239444]  ? _cond_resched+0x19/0x30
[  157.243196]  do_sys_openat2+0x215/0x2d0
[  157.247037]  do_sys_open+0x44/0x80
[  157.250443]  do_syscall_64+0x48/0x130
[  157.254108]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  157.259161] RIP: 0033:0x7ffbc0ded307
[  157.262738] Code: 25 00 00 41 00 3d 00 00 41 00 74 47 64 8b 04 25 18 00 00 00 85 c0 75 6b 44 89 e2 48 89 ee bf 9c ff ff ff b8 01 01 00 00 0f 05 <48> 3d 00 f0 ff ff 0f 87 95 00 00 00 48 8b 4c 24 28 64 48 33 0c 25
[  157.281485] RSP: 002b:00007fff520a4940 EFLAGS: 00000246 ORIG_RAX: 0000000000000101
[  157.289052] RAX: ffffffffffffffda RBX: 00005561dc02eca0 RCX: 00007ffbc0ded307
[  157.296185] RDX: 0000000000000241 RSI: 00005561dc013470 RDI: 00000000ffffff9c
[  157.303317] RBP: 00005561dc013470 R08: 0000000000000004 R09: 0000000000000001
[  157.310447] R10: 00000000000001b6 R11: 0000000000000246 R12: 0000000000000241
[  157.317575] R13: 00005561dc02eca0 R14: 0000000000000001 R15: 0000000000000000
[  157.324705] Modules linked in: isst_if_common squashfs nls_iso8859_1 nls_cp437 snd_hda_codec_realtek vfat snd_hda_codec_generic fat iwlmvm ledtrig_audio snd_hda_codec_hdmi x86_pkg_temp_thermal intel_powerclamp snd_hda_intel snd_intel_dspcfg iwlwifi efi_pstore btusb snd_hda_codec btrtl btbcm efivars snd_hwdep btintel snd_hda_core iTCO_wdt iTCO_vendor_support mei_me mei loop coretemp hid_logitech_hidpp hid_logitech_dj hid_lenovo amdgpu gpu_sched i40e ixgbe ast drm_vram_helper drm_ttm_helper ttm mdio xhci_pci xhci_hcd
[  157.370249] CR2: 0000000000000020
[  157.373569] ---[ end trace 563634e2f1b39798 ]---
[  158.079256] RIP: 0010:xfs_log_commit_cil+0x356/0x7f0
[  158.084219] Code: 00 00 48 89 7e 08 49 89 76 30 48 89 11 48 89 4a 08 8b 4c 24 2c 48 89 85 c0 00 00 00 48 89 85 c8 00 00 00 49 8b 46 20 45 31 c9 <8b> 70 20 85 f6 0f 84 d9 02 00 00 45 31 c0 85 c9 7e 4f 41 8b 46 2c
[  158.102964] RSP: 0018:ffffc90021fefb00 EFLAGS: 00010246
[  158.108192] RAX: 0000000000000000 RBX: ffff8897a9ea80b0 RCX: 0000000000000458
[  158.115322] RDX: ffff8897a9ea80c0 RSI: ffff88afc39a1200 RDI: ffff88afb1ae2c18
[  158.122455] RBP: ffff8897a9ea8000 R08: ffffc90021fefb30 R09: 0000000000000000
[  158.129590] R10: 0000000000000084 R11: 0000000000000012 R12: ffff8897721bd400
[  158.136722] R13: ffff88afb1ae2c00 R14: ffff88afb19860c0 R15: ffff8897a9ea80a0
[  158.143855] FS:  00007ffbbe9a1980(0000) GS:ffff8897e0cc0000(0000) knlGS:0000000000000000
[  158.151939] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  158.157685] CR2: 0000000000000020 CR3: 000000179c0ac005 CR4: 00000000007606e0
[  158.164810] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  158.171942] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  158.179074] PKRU: 55555554
[  157.071979] BUG: kernel NULL pointer dereference, address: 0000000000000020
[  157.078945] #PF: supervisor read access in kernel mode
[  157.084082] #PF: error_code(0x0000) - not-present page
[  157.089225] PGD 0 P4D 0
[  157.091763] Oops: 0000 [#1] SMP NOPTI
[  157.095429] CPU: 3 PID: 7756 Comm: postgres Not tainted 5.7.0-rc7-andres-00133-gc8707bf69395 #41
[  157.104208] Hardware name: Supermicro SYS-7049A-T/X11DAi-N, BIOS 3.2 11/13/2019
[  157.111518] RIP: 0010:xfs_log_commit_cil+0x356/0x7f0
[  157.116478] Code: 00 00 48 89 7e 08 49 89 76 30 48 89 11 48 89 4a 08 8b 4c 24 2c 48 89 85 c0 00 00 00 48 89 85[  158.235406] BUG: unable to handle page fault for address: 0000000000843f70
 c8[ 00 00 00 49   158.242834] #PF: supervisor write access in kernel mode
[  158.249442] #PF: error_code(0x0002) - not-present page
8b 46 20 45 31 c[  158.254582] PGD 0 P4D 0
[  158.258500] Oops: 0002 [#2] SMP NOPTI
9 <[8b> 70 20 85   158.262167] CPU: 21 PID: 7839 Comm: postgres Tainted: G      D           5.7.0-rc7-andres-00133-gc8707bf69395 #41
[  158.273804] Hardware name: Supermicro SYS-7049A-T/X11DAi-N, BIOS 3.2 11/13/2019
f6 0f 84 d9 02 0[  158.281116] RIP: 0010:queued_spin_lock_slowpath+0x16c/0x1a0
[  158.288064] Code: 8b 02 48 85 c0 74 f6 48 89 c6 eb e5 c1 ee 12 83 e0 03 83 ee 01 48 c1 e0 04 48 63 f6 48 05 c0 c1 02 00 48 03 04 f5 c0 86 fc 82 <48> 89 10 8b 42 08 85 c0 75 09 f3 90 8b 42 08 85 c0 74 f7 48 8b 02
0 0[0 45 31 c0 85  158.306810] RSP: 0018:ffffc9002116fe20 EFLAGS: 00010002
[  158.313421] RAX: 0000000000843f70 RBX: ffff8897d87924e0 RCX: 0000000000580000
 c[9 7e 4f 41 8b   158.320555] RDX: ffff8897e0eec1c0 RSI: 0000000000001201 RDI: ffff88afd7957a60
[  158.329073] RBP: ffff88afd7957a60 R08: 0000000000580000 R09: 0000000000000000
46[ 2c
[  157.13  158.336207] R10: ffff88afd70bfce0 R11: 0000000000000000 R12: 0000000000000286
[  158.344724] R13: dead000000000122 R14: dead000000000100 R15: ffff88afd639e000
522[6] RSP: 0018:  158.351860] FS:  00007ffbbe9a1980(0000) GS:ffff8897e0ec0000(0000) knlGS:0000000000000000
[  158.361331] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
ff[ffc90021fefb00  158.367078] CR2: 0000000000843f70 CR3: 0000002fd67a2004 CR4: 00000000007606e0
[  158.375598] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
 E[FLAGS: 0001024  158.382737] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  158.391256] PKRU: 55555554
6[
[  157.140452  158.393968] Call Trace:
] R[AX: 000000000  158.397813]  _raw_spin_lock_irqsave+0x25/0x30
00[00000 RBX: fff  158.403559]  remove_wait_queue+0x12/0x50
f8[897a9ea80b0 RC  158.408873]  ep_unregister_pollwait.isra.0+0x5e/0x80
X:[ 0000000000000  158.415235]  ep_free+0x4e/0xd0
[  158.419684]  ep_eventpoll_release+0x16/0x20
458
[  157.1475[  158.423874]  __fput+0xda/0x240
82[] RDX: ffff889  158.428312]  task_work_run+0x5f/0x90
7a[9ea80c0 RSI: f  158.433285]  exit_to_usermode_loop+0xbd/0xe0
ff[f88afc39a1200   158.438944]  do_syscall_64+0xf2/0x130
RD[I: ffff88afb1a  158.443998]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  158.450437] RIP: 0033:0x7ffbc1aa0f13
e2c[18
[  157.15  158.454012] Code: 00 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb bb 0f 1f 80 00 00 00 00 64 8b 04 25 18 00 00 00 85 c0 75 14 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 45 c3 0f 1f 40 00 48 83 ec 18 89 7c 24 0c e8
[  158.474138] RSP: 002b:00007fff520a4a48 EFLAGS: 00000246 ORIG_RAX: 0000000000000003
471[5] RBP: ffff8  158.481705] RAX: 0000000000000000 RBX: 0000000000000002 RCX: 00007ffbc1aa0f13
[  158.490222] RDX: 0000000000000002 RSI: 00005561dc0333c0 RDI: 0000000000000005
897[a9ea8000 R08:  158.497354] RBP: 00007fff520a4ab0 R08: 0000000005000007 R09: 0000000000000003
[  158.505867] R10: 00000000ffffffff R11: 0000000000000246 R12: 00005561dc033348
 ff[ffc90021fefb3  158.513000] R13: 0000000000000002 R14: ffffffffffffffff R15: 00005561da52b2c8
0 R09: 000000000[  158.521520] Modules linked in: isst_if_common squashfs nls_iso8859_1 nls_cp437 snd_hda_codec_realtek vfat snd_hda_codec_generic fat iwlmvm ledtrig_audio snd_hda_codec_hdmi x86_pkg_temp_thermal intel_powerclamp snd_hda_intel snd_intel_dspcfg iwlwifi efi_pstore btusb snd_hda_codec btrtl btbcm efivars snd_hwdep btintel snd_hda_core iTCO_wdt iTCO_vendor_support mei_me mei loop coretemp hid_logitech_hidpp hid_logitech_dj hid_lenovo amdgpu gpu_sched i40e ixgbe ast drm_vram_helper drm_ttm_helper ttm mdio xhci_pci xhci_hcd
[  158.568431] CR2: 0000000000843f70
0000000
[  157.[  158.571751] ---[ end trace 563634e2f1b39799 ]---
161848] R10: 0000000000000084 R11: 0000000000000012 R12: ffff8897721bd400
[  157.168983] R13: ffff88afb1ae2c00 R14: ffff88afb19[  158.639843] RIP: 0010:xfs_log_commit_cil+0x356/0x7f0
[  158.646009] Code: 00 00 48 89 7e 08 49 89 76 30 48 89 11 48 89 4a 08 8b 4c 24 2c 48 89 85 c0 00 00 00 48 89 85 c8 00 00 00 49 8b 46 20 45 31 c9 <8b> 70 20 85 f6 0f 84 d9 02 00 00 45 31 c0 85 c9 7e 4f 41 8b 46 2c
860c0 R15: ffff8[  158.664754] RSP: 0018:ffffc90021fefb00 EFLAGS: 00010246
[  158.671356] RAX: 0000000000000000 RBX: ffff8897a9ea80b0 RCX: 0000000000000458
897a9ea80a0
[  [  158.678488] RDX: ffff8897a9ea80c0 RSI: ffff88afc39a1200 RDI: ffff88afb1ae2c18
[  158.686999] RBP: ffff8897a9ea8000 R08: ffffc90021fefb30 R09: 0000000000000000
157.176115] FS: [  158.694132] R10: 0000000000000084 R11: 0000000000000012 R12: ffff8897721bd400
[  158.702643] R13: ffff88afb1ae2c00 R14: ffff88afb19860c0 R15: ffff8897a9ea80a0
 00007ffbbe9a198[  158.709776] FS:  00007ffbbe9a1980(0000) GS:ffff8897e0ec0000(0000) knlGS:0000000000000000
[  158.719241] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
0(0000) GS:ffff8[  158.724985] CR2: 0000000000843f70 CR3: 0000002fd67a2004 CR4: 00000000007606e0
[  158.733498] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
897e0cc0000(0000[  158.740631] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  158.749142] PKRU: 55555554
) knlGS:00000000[  158.752176] BUG: unable to handle page fault for address: 00007ffb48196038
[  158.760116] #PF: supervisor read access in kernel mode
00[000000
[  157  158.765254] #PF: error_code(0x0000) - not-present page
[  158.771778] PGD 0 P4D 0
.1[84199] CS:  00  158.774319] Oops: 0000 [#3] SMP NOPTI
[  158.779373] CPU: 21 PID: 7839 Comm: postgres Tainted: G      D           5.7.0-rc7-andres-00133-gc8707bf69395 #41
10[ DS: 0000 ES:   158.789623] Hardware name: Supermicro SYS-7049A-T/X11DAi-N, BIOS 3.2 11/13/2019
[  158.798320] RIP: 0010:__mutex_lock.isra.0+0x16f/0x4d0
00[00 CR0: 000000  158.803368] Code: 41 c6 45 08 00 31 c0 48 8b 7c 24 68 65 48 33 3c 25 28 00 00 00 0f 85 66 03 00 00 48 8d 65 d8 5b 41 5c 41 5d 41 5e 41 5f 5d c3 <8b> 50 38 85 d2 74 08 8b 40 3c e9 fe fe ff ff 65 48 8b 04 25 80 7d
[  158.823502] RSP: 0018:ffffc9002116fdb0 EFLAGS: 00010206
00[80050033
[  1  158.828728] RAX: 00007ffb48196000 RBX: ffff8897ad21f200 RCX: 0000000000000001
[  158.837248] RDX: 00007ffb48196000 RSI: ffff88afb7b98000 RDI: ffff88afd7957a40
57[.189946] CR2:   158.844381] RBP: ffffc9002116fe50 R08: 0000000000000000 R09: 0000000000000000
[  158.852900] R10: ffff88afbab4d0f0 R11: 0000000000000018 R12: ffff88afbab4d0f0
00[00000000000020  158.860030] R13: ffff88afd7957a40 R14: ffff88afd7908160 R15: ffff88afc8508300
[  158.868552] FS:  00007ffbbe9a1980(0000) GS:ffff8897e0ec0000(0000) knlGS:0000000000000000
 C[R3: 000000179c  158.876638] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  158.883771] CR2: 00007ffb48196038 CR3: 000000000660a005 CR4: 00000000007606e0
0a[c005 CR4: 0000  158.890902] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  158.899421] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
00[00007606e0
[   158.906553] PKRU: 55555554
[  158.910654] Call Trace:
 15[7.197081] DR0  158.913110]  ? __schedule+0x29f/0x700
[  158.918162]  pipe_release+0x1e/0xd0
: [00000000000000  158.921655]  __fput+0xda/0x240
[  158.926102]  task_work_run+0x5f/0x90
00[ DR1: 00000000  158.929681]  do_exit+0x34f/0xa60
[  158.934300]  ? exit_to_usermode_loop+0xbd/0xe0
000[00000 DR2: 00  158.938744]  rewind_stack_do_exit+0x17/0x20
[  158.944309] RIP: 0033:0x7ffbc1aa0f13
000[00000000000
  158.947890] Code: Bad RIP value.
[  158.952505] RSP: 002b:00007fff520a4a48 EFLAGS: 00000246 ORIG_RAX: 0000000000000003
[ [ 157.204212] D  158.960070] RAX: 0000000000000000 RBX: 0000000000000002 RCX: 00007ffbc1aa0f13
[  158.968592] RDX: 0000000000000002 RSI: 00005561dc0333c0 RDI: 0000000000000005
R3[: 000000000000  158.975725] RBP: 00007fff520a4ab0 R08: 0000000005000007 R09: 0000000000000003
[  158.984243] R10: 00000000ffffffff R11: 0000000000000246 R12: 00005561dc033348
00[00 DR6: 000000  158.991378] R13: 0000000000000002 R14: ffffffffffffffff R15: 00005561da52b2c8
00fffe0ff0 DR7: [  158.999899] Modules linked in: isst_if_common squashfs nls_iso8859_1 nls_cp437 snd_hda_codec_realtek vfat snd_hda_codec_generic fat iwlmvm ledtrig_audio snd_hda_codec_hdmi x86_pkg_temp_thermal intel_powerclamp snd_hda_intel snd_intel_dspcfg iwlwifi efi_pstore btusb snd_hda_codec btrtl btbcm efivars snd_hwdep btintel snd_hda_core iTCO_wdt iTCO_vendor_support mei_me mei loop coretemp hid_logitech_hidpp hid_logitech_dj hid_lenovo amdgpu gpu_sched i40e ixgbe ast drm_vram_helper drm_ttm_helper ttm mdio xhci_pci xhci_hcd
[  159.046811] CR2: 00007ffb48196038

0000000000000400[ 159.050131] ---[ end trace 563634e2f1b3979a ]---

[  157.211343] PKRU: 55555554
[  157.214048] Call Trace:
[  157.216498]  __xfs_trans_commit+0xa1/0x340
[  157.220596]  xfs_[  159.119169] RIP: 0010:xfs_log_commit_cil+0x356/0x7f0
create+0x4cc/0x5[  159.124205] Code: 00 00 48 89 7e 08 49 89 76 30 48 89 11 48 89 4a 08 8b 4c 24 2c 48 89 85 c0 00 00 00 48 89 85 c8 00 00 00 49 8b 46 20 45 31 c9 <8b> 70 20 85 f6 0f 84 d9 02 00 00 45 31 c0 85 c9 7e 4f 41 8b 46 2c
[  159.144326] RSP: 0018:ffffc90021fefb00 EFLAGS: 00010246
e0
[  157.22408[  159.149553] RAX: 0000000000000000 RBX: ffff8897a9ea80b0 RCX: 0000000000000458
[  159.158066] RDX: ffff8897a9ea80c0 RSI: ffff88afc39a1200 RDI: ffff88afb1ae2c18
7]  xfs_generic_[  159.165197] RBP: ffff8897a9ea8000 R08: ffffc90021fefb30 R09: 0000000000000000
[  159.173707] R10: 0000000000000084 R11: 0000000000000012 R12: ffff8897721bd400
create+0x241/0x3[  159.180839] R13: ffff88afb1ae2c00 R14: ffff88afb19860c0 R15: ffff8897a9ea80a0
[  159.189353] FS:  00007ffbbe9a1980(0000) GS:ffff8897e0ec0000(0000) knlGS:0000000000000000
10
[  157.22827[  159.197436] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  159.204562] CR2: 00007ffbc1aa0ee9 CR3: 000000000660a005 CR4: 00000000007606e0
4]  path_openat+[  159.211695] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  159.220203] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
0xdb7/0x1020
[ [  159.227339] PKRU: 55555554
[  159.231430] Fixing recursive fault but reboot is needed!
 157.231940]  do_filp_open+0x91/0x100
[  157.235518]  ? __sys_recvfrom+0xe4/0x170
[  157.239444]  ? _cond_resched+0x19/0x30
[  157.243196]  do_sys_openat2+0x215/0x2d0
[  157.247037]  do_sys_open+0x44/0x80
[  157.250443]  do_syscall_64+0x48/0x130
[  157.254108]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  157.259161] RIP: 0033:0x7ffbc0ded307
[  157.262738] Code: 25 00 00 41 00 3d 00 00 41 00 74 47 64 8b 04 25 18 00 00 00 85 c0 75 6b 44 89 e2 48 89 ee bf 9c ff ff ff b8 01 01 00 00 0f 05 <48> 3d 00 f0 ff ff 0f 87 95 00 00 00 48 8b 4c 24 28 64 48 33 0c 25
[  157.281485] RSP: 002b:00007fff520a4940 EFLAGS: 00000246 ORIG_RAX: 0000000000000101
[  157.289052] RAX: ffffffffffffffda RBX: 00005561dc02eca0 RCX: 00007ffbc0ded307
[  157.296185] RDX: 0000000000000241 RSI: 00005561dc013470 RDI: 00000000ffffff9c
[  157.303317] RBP: 00005561dc013470 R08: 0000000000000004 R09: 0000000000000001
[  157.310447] R10: 00000000000001b6 R11: 0000000000000246 R12: 0000000000000241
[  157.317575] R13: 00005561dc02eca0 R14: 0000000000000001 R15: 0000000000000000
[  157.324705] Modules linked in: isst_if_common squashfs nls_iso8859_1 nls_cp437 snd_hda_codec_realtek vfat snd_hda_codec_generic fat iwlmvm ledtrig_audio snd_hda_codec_hdmi x86_pkg_temp_thermal intel_powerclamp snd_hda_intel snd_intel_dspcfg iwlwifi efi_pstore btusb snd_hda_codec btrtl btbcm efivars snd_hwdep btintel snd_hda_core iTCO_wdt iTCO_vendor_support mei_me mei loop coretemp hid_logitech_hidpp hid_logitech_dj hid_lenovo amdgpu gpu_sched i40e ixgbe ast drm_vram_helper drm_ttm_helper ttm mdio xhci_pci xhci_hcd
[  157.370249] CR2: 0000000000000020
[  157.373569] ---[ end trace 563634e2f1b39798 ]---
[  158.079256] RIP: 0010:xfs_log_commit_cil+0x356/0x7f0
[  158.084219] Code: 00 00 48 89 7e 08 49 89 76 30 48 89 11 48 89 4a 08 8b 4c 24 2c 48 89 85 c0 00 00 00 48 89 85 c8 00 00 00 49 8b 46 20 45 31 c9 <8b> 70 20 85 f6 0f 84 d9 02 00 00 45 31 c0 85 c9 7e 4f 41 8b 46 2c
[  158.102964] RSP: 0018:ffffc90021fefb00 EFLAGS: 00010246
[  158.108192] RAX: 0000000000000000 RBX: ffff8897a9ea80b0 RCX: 0000000000000458
[  158.115322] RDX: ffff8897a9ea80c0 RSI: ffff88afc39a1200 RDI: ffff88afb1ae2c18
[  158.122455] RBP: ffff8897a9ea8000 R08: ffffc90021fefb30 R09: 0000000000000000
[  158.129590] R10: 0000000000000084 R11: 0000000000000012 R12: ffff8897721bd400
[  158.136722] R13: ffff88afb1ae2c00 R14: ffff88afb19860c0 R15: ffff8897a9ea80a0
[  158.143855] FS:  00007ffbbe9a1980(0000) GS:ffff8897e0cc0000(0000) knlGS:0000000000000000
[  158.151939] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  158.157685] CR2: 0000000000000020 CR3: 000000179c0ac005 CR4: 00000000007606e0
[  158.164810] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  158.171942] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  158.179074] PKRU: 55555554
[  158.235406] BUG: unable to handle page fault for address: 0000000000843f70
[  158.242834] #PF: supervisor write access in kernel mode
[  158.249442] #PF: error_code(0x0002) - not-present page
[  158.254582] PGD 0 P4D 0
[  158.258500] Oops: 0002 [#2] SMP NOPTI
[  158.262167] CPU: 21 PID: 7839 Comm: postgres Tainted: G      D           5.7.0-rc7-andres-00133-gc8707bf69395 #41
[  158.273804] Hardware name: Supermicro SYS-7049A-T/X11DAi-N, BIOS 3.2 11/13/2019
[  158.281116] RIP: 0010:queued_spin_lock_slowpath+0x16c/0x1a0
[  158.288064] Code: 8b 02 48 85 c0 74 f6 48 89 c6 eb e5 c1 ee 12 83 e0 03 83 ee 01 48 c1 e0 04 48 63 f6 48 05 c0 c1 02 00 48 03 04 f5 c0 86 fc 82 <48> 89 10 8b 42 08 85 c0 75 09 f3 90 8b 42 08 85 c0 74 f7 48 8b 02
[  158.306810] RSP: 0018:ffffc9002116fe20 EFLAGS: 00010002
[  158.313421] RAX: 0000000000843f70 RBX: ffff8897d87924e0 RCX: 0000000000580000
[  158.320555] RDX: ffff8897e0eec1c0 RSI: 0000000000001201 RDI: ffff88afd7957a60
[  158.329073] RBP: ffff88afd7957a60 R08: 0000000000580000 R09: 0000000000000000
[  158.336207] R10: ffff88afd70bfce0 R11: 0000000000000000 R12: 0000000000000286
[  158.344724] R13: dead000000000122 R14: dead000000000100 R15: ffff88afd639e000
[  158.351860] FS:  00007ffbbe9a1980(0000) GS:ffff8897e0ec0000(0000) knlGS:0000000000000000
[  158.361331] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  158.367078] CR2: 0000000000843f70 CR3: 0000002fd67a2004 CR4: 00000000007606e0
[  158.375598] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  158.382737] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  158.391256] PKRU: 55555554
[  158.393968] Call Trace:
[  158.397813]  _raw_spin_lock_irqsave+0x25/0x30
[  158.403559]  remove_wait_queue+0x12/0x50
[  158.408873]  ep_unregister_pollwait.isra.0+0x5e/0x80
[  158.415235]  ep_free+0x4e/0xd0
[  158.419684]  ep_eventpoll_release+0x16/0x20
[  158.423874]  __fput+0xda/0x240
[  158.428312]  task_work_run+0x5f/0x90
[  158.433285]  exit_to_usermode_loop+0xbd/0xe0
[  158.438944]  do_syscall_64+0xf2/0x130
[  158.443998]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  158.450437] RIP: 0033:0x7ffbc1aa0f13
[  158.454012] Code: 00 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb bb 0f 1f 80 00 00 00 00 64 8b 04 25 18 00 00 00 85 c0 75 14 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 45 c3 0f 1f 40 00 48 83 ec 18 89 7c 24 0c e8
[  158.474138] RSP: 002b:00007fff520a4a48 EFLAGS: 00000246 ORIG_RAX: 0000000000000003
[  158.481705] RAX: 0000000000000000 RBX: 0000000000000002 RCX: 00007ffbc1aa0f13
[  158.490222] RDX: 0000000000000002 RSI: 00005561dc0333c0 RDI: 0000000000000005
[  158.497354] RBP: 00007fff520a4ab0 R08: 0000000005000007 R09: 0000000000000003
[  158.505867] R10: 00000000ffffffff R11: 0000000000000246 R12: 00005561dc033348
[  158.513000] R13: 0000000000000002 R14: ffffffffffffffff R15: 00005561da52b2c8
[  158.521520] Modules linked in: isst_if_common squashfs nls_iso8859_1 nls_cp437 snd_hda_codec_realtek vfat snd_hda_codec_generic fat iwlmvm ledtrig_audio snd_hda_codec_hdmi x86_pkg_temp_thermal intel_powerclamp snd_hda_intel snd_intel_dspcfg iwlwifi efi_pstore btusb snd_hda_codec btrtl btbcm efivars snd_hwdep btintel snd_hda_core iTCO_wdt iTCO_vendor_support mei_me mei loop coretemp hid_logitech_hidpp hid_logitech_dj hid_lenovo amdgpu gpu_sched i40e ixgbe ast drm_vram_helper drm_ttm_helper ttm mdio xhci_pci xhci_hcd
[  158.568431] CR2: 0000000000843f70
[  158.571751] ---[ end trace 563634e2f1b39799 ]---
[  158.639843] RIP: 0010:xfs_log_commit_cil+0x356/0x7f0
[  158.646009] Code: 00 00 48 89 7e 08 49 89 76 30 48 89 11 48 89 4a 08 8b 4c 24 2c 48 89 85 c0 00 00 00 48 89 85 c8 00 00 00 49 8b 46 20 45 31 c9 <8b> 70 20 85 [  159.807838] general protection fault, probably for non-canonical address 0x16152f0de31ca0e2: 0000 [#4] SMP NOPTI
f6 [0f 84 d9 02 0  159.818219] CPU: 37 PID: 6847 Comm: gnome-shell Tainted: G      D           5.7.0-rc7-andres-00133-gc8707bf69395 #41
0 [00 45 31 c0 85  159.830115] Hardware name: Supermicro SYS-7049A-T/X11DAi-N, BIOS 3.2 11/13/2019
 c9[ 7e 4f 41 8b   159.838822] RIP: 0010:kmem_cache_alloc_trace+0x78/0x1c0
[  159.845430] Code: 00 00 4c 8b 45 00 65 49 8b 50 08 65 4c 03 05 37 9c c9 7e 4d 8b 38 4d 85 ff 0f 84 2d 01 00 00 8b 45 20 48 8d 4a 01 48 8b 7d 00 <49> 8b 1c 07 4c 89 f8 65 48 0f c7 0f 0f 94 c0 84 c0 74 c5 8b 45 20
46 [2c
[  158.66  159.864174] RSP: 0018:ffffc9000eb9bc98 EFLAGS: 00010202
[  159.870785] RAX: 0000000000000080 RBX: 0000000000000001 RCX: 00000000000006a2
47[54] RSP: 0018:  159.877919] RDX: 00000000000006a1 RSI: 0000000000000dc0 RDI: 000000000002e900
[  159.886439] RBP: ffff8897e0803700 R08: ffff88afdfc6e900 R09: ffff8897d51a7560
ff[ffc90021fefb00  159.893571] R10: 0000000000000000 R11: ffff88afbc711840 R12: 0000000000000dc0
[  159.902088] R13: 00000000000000d0 R14: ffffffffa0265697 R15: 16152f0de31ca062
 E[FLAGS: 0001024  159.909223] FS:  00007f58af13fcc0(0000) GS:ffff88afdfc40000(0000) knlGS:0000000000000000
[  159.918696] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
6[
[  158.671356  159.924441] CR2: 0000558a26e64ab8 CR3: 00000017a49ba001 CR4: 00000000007606e0
[  159.932959] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
] [RAX: 000000000  159.940092] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  159.948614] PKRU: 55555554
00[00000 RBX: fff  159.951328] Call Trace:
f8897a9ea80b0 RC[  159.955238]  amdgpu_display_user_framebuffer_create+0x67/0xc0 [amdgpu]
X:[ 0000000000000  159.963085]  drm_internal_framebuffer_create+0x37c/0x4c0
45[8
[  158.6784  159.969793]  drm_mode_addfb2+0x2b/0xb0
[  159.974937]  ? drm_mode_addfb_ioctl+0x10/0x10
88] RDX: ffff889[  159.979297]  drm_ioctl_kernel+0xab/0xf0
[  159.984514]  drm_ioctl+0x1e1/0x362
7a9[ea80c0 RSI: f  159.987919]  ? drm_mode_addfb_ioctl+0x10/0x10
fff88afc39a1200 [  159.993728]  amdgpu_drm_ioctl+0x49/0x80 [amdgpu]
RD[I: ffff88afb1a  159.999673]  ksys_ioctl+0x82/0xc0
e2[c18
[  158.68  160.004379]  __x64_sys_ioctl+0x16/0x20
[  160.009528]  do_syscall_64+0x48/0x130
6999] RBP: ffff8[  160.013202]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  160.019630] RIP: 0033:0x7f58b5152427
897[a9ea8000 R08:  160.023210] Code: 00 00 90 48 8b 05 69 7a 0c 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 39 7a 0c 00 f7 d8 64 89 01 48
[  160.043342] RSP: 002b:00007ffd208c6708 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
 f[fffc90021fefb3  160.050906] RAX: ffffffffffffffda RBX: 00007ffd208c6740 RCX: 00007f58b5152427
[  160.059427] RDX: 00007ffd208c6740 RSI: 00000000c06864b8 RDI: 000000000000000a
0 [R09: 000000000  160.066559] RBP: 00000000c06864b8 R08: 00007ffd208c688c R09: 00007ffd208c68ac
[  160.075077] R10: 000000000000000a R11: 0000000000000246 R12: 00000000000005a0

00[00000
[ 158. 160.082212] R13: 000000000000000a R14: 00007ffd208c682c R15: 0000000000000000
694132] R10: 000[ 160.090734] Modules linked in: isst_if_common squashfs nls_iso8859_1 nls_cp437 snd_hda_codec_realtek vfat snd_hda_codec_generic fat iwlmvm ledtrig_audio snd_hda_codec_hdmi x86_pkg_temp_thermal intel_powerclamp snd_hda_intel snd_intel_dspcfg iwlwifi efi_pstore btusb snd_hda_codec btrtl btbcm efivars snd_hwdep btintel snd_hda_core iTCO_wdt iTCO_vendor_support mei_me mei loop coretemp hid_logitech_hidpp hid_logitech_dj hid_lenovo amdgpu gpu_sched i40e ixgbe ast drm_vram_helper drm_ttm_helper ttm mdio xhci_pci xhci_hcd 0000000000084 R1[ 160.137675] ---[ end trace 563634e2f1b3979b ]---
1: 0000000000000012 R12: ffff8897721bd400

[  158.702643] R13: ffff88afb1ae2c00 R14: ffff88afb19860c0 R15: ffff8897a9ea80a0
[  158.709776] FS: [  160.211222] RIP: 0010:xfs_log_commit_cil+0x356/0x7f0
 00007ffbbe9a198[  160.217572] Code: 00 00 48 89 7e 08 49 89 76 30 48 89 11 48 89 4a 08 8b 4c 24 2c 48 89 85 c0 00 00 00 48 89 85 c8 00 00 00 49 8b 46 20 45 31 c9 <8b> 70 20 85 f6 0f 84 d9 02 00 00 45 31 c0 85 c9 7e 4f 41 8b 46 2c
0(0000) GS:ffff8[  160.237717] RSP: 0018:ffffc90021fefb00 EFLAGS: 00010246
897e0ec0000(0000[  160.244322] RAX: 0000000000000000 RBX: ffff8897a9ea80b0 RCX: 0000000000000458
) knlGS:00000000[  160.252842] RDX: ffff8897a9ea80c0 RSI: ffff88afc39a1200 RDI: ffff88afb1ae2c18
00000000
[  158[  160.261365] RBP: ffff8897a9ea8000 R08: ffffc90021fefb30 R09: 0000000000000000
.719241] CS:  00[  160.269881] R10: 0000000000000084 R11: 0000000000000012 R12: ffff8897721bd400
10 DS: 0000 ES: [  160.278399] R13: ffff88afb1ae2c00 R14: ffff88afb19860c0 R15: ffff8897a9ea80a0
0000 CR0: 000000[  160.286921] FS:  00007f58af13fcc0(0000) GS:ffff88afdfc40000(0000) knlGS:0000000000000000
0080050033
[  1[  160.296388] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
58.724985] CR2: [  160.303523] CR2: 0000558a26e64ab8 CR3: 00000017a49ba001 CR4: 00000000007606e0
0000000000843f70[  160.312045] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
 CR3: 0000002fd6[  160.320560] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
7a2004 CR4: 0000[  160.329078] PKRU: 55555554
0000007606e0
[  158.733498] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  158.740631] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  158.749142] PKRU: 55555554
[  158.752176] BUG: unable to handle page fault for address: 00007ffb48196038
[  158.760116] #PF: supervisor read access in kernel mode
[  158.765254] #PF: error_code(0x0000) - not-present page
[  158.771778] PGD 0 P4D 0
[  158.774319] Oops: 0000 [#3] SMP NOPTI
[  158.779373] CPU: 21 PID: 7839 Comm: postgres Tainted: G      D           5.7.0-rc7-andres-00133-gc8707bf69395 #41
[  158.789623] Hardware name: Supermicro SYS-7049A-T/X11DAi-N, BIOS 3.2 11/13/2019
[  158.798320] RIP: 0010:__mutex_lock.isra.0+0x16f/0x4d0
[  158.803368] Code: 41 c6 45 08 00 31 c0 48 8b 7c 24 68 65 48 33 3c 25 28 00 00 00 0f 85 66 03 00 00 48 8d 65 d8 5b 41 5c 41 5d 41 5e 41 5f 5d c3 <8b> 50 38 85 d2 74 08 8b 40 3c e9 fe fe ff ff 65 48 8b 04 25 80 7d
[  158.823502] RSP: 0018:ffffc9002116fdb0 EFLAGS: 00010206
[  158.828728] RAX: 00007ffb48196000 RBX: ffff8897ad21f200 RCX: 0000000000000001
[  158.837248] RDX: 00007ffb48196000 RSI: ffff88afb7b98000 RDI: ffff88afd7957a40
[  158.844381] RBP: ffffc9002116fe50 R08: 0000000000000000 R09: 0000000000000000
[  158.852900] R10: ffff88afbab4d0f0 R11: 0000000000000018 R12: ffff88afbab4d0f0
[  158.860030] R13: ffff88afd7957a40 R14: ffff88afd7908160 R15: ffff88afc8508300
[  158.868552] FS:  00007ffbbe9a1980(0000) GS:ffff8897e0ec0000(0000) knlGS:0000000000000000
[  158.876638] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  158.883771] CR2: 00007ffb48196038 CR3: 000000000660a005 CR4: 00000000007606e0
[  158.890902] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  158.899421] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  158.906553] PKRU: 55555554
[  158.910654] Call Trace:
[  158.913110]  ? __schedule+0x29f/0x700
[  158.918162]  pipe_release+0x1e/0xd0
[  158.921655]  __fput+0xda/0x240
[  158.926102]  task_work_run+0x5f/0x90
[  158.929681]  do_exit+0x34f/0xa60
[  158.934300]  ? exit_to_usermode_loop+0xbd/0xe0
[  158.938744]  rewind_stack_do_exit+0x17/0x20
[  158.944309] RIP: 0033:0x7ffbc1aa0f13
[  158.947890] Code: Bad RIP value.
[  158.952505] RSP: 002b:00007fff520a4a48 EFLAGS: 00000246 ORIG_RAX: 0000000000000003
[  158.960070] RAX: 0000000000000000 RBX: 0000000000000002 RCX: 00007ffbc1aa0f13
[  158.968592] RDX: 0000000000000002 RSI: 00005561dc0333c0 RDI: 0000000000000005
[  158.975725] RBP: 00007fff520a4ab0 R08: 0000000005000007 R09: 0000000000000003
[  158.984243] R10: 00000000ffffffff R11: 0000000000000246 R12: 00005561dc033348
[  158.991378] R13: 0000000000000002 R14: ffffffffffffffff R15: 00005561da52b2c8
[  158.999899] Modules linked in: isst_if_common squashfs nls_iso8859_1 nls_cp437 snd_hda_codec_realtek vfat snd_hda_codec_generic fat iwlmvm ledtrig_audio snd_hda_codec_hdmi x86_pkg_temp_thermal intel_powerclamp snd_hda_intel snd_intel_dspcfg iwlwifi efi_pstore btusb snd_hda_codec btrtl btbcm efivars snd_hwdep btintel snd_hda_core iTCO_wdt iTCO_vendor_support mei_me mei loop coretemp hid_logitech_hidpp hid_logitech_dj hid_lenovo amdgpu gpu_sched i40e ixgbe ast drm_vram_helper drm_ttm_helper ttm mdio xhci_pci xhci_hcd
[  159.046811] CR2: 00007ffb48196038
[  159.050131] ---[ end trace 563634e2f1b3979a ]---
[  159.119169] RIP: 0010:xfs_log_commit_cil+0x356/0x7f0
[  159.124205] Code: 00 00 48 89 7e 08 49 89 76 30 48 89 11 48 89 4a 08 8b 4c 24 2c 48 89 85 c0 00 00 00 48 89 85 c8 00 00 00 49 8b 46 20 45 31 c9 <8b> 70 20 85 f6 0f 84 d9 02 00 00 45 31 c0 85 c9 7e 4f 41 8b 46 2c
[  159.144326] RSP: 0018:ffffc90021fefb00 EFLAGS: 00010246
[  159.149553] RAX: 0000000000000000 RBX: ffff8897a9ea80b0 RCX: 0000000000000458
[  159.158066] RDX: ffff8897a9ea80c0 RSI: ffff88afc39a1200 RDI: ffff88afb1ae2c18
[  159.165197] RBP: ffff8897a9ea8000 R08: ffffc90021fefb30 R09: 0000000000000000
[  159.173707] R10: 0000000000000084 R11: 0000000000000012 R12: ffff8897721bd400
[  159.180839] R13: ffff88afb1ae2c00 R14: ffff88afb19860c0 R15: ffff8897a9ea80a0
[  159.189353] FS:  00007ffbbe9a1980(0000) GS:ffff8897e0ec0000(0000) knlGS:0000000000000000
[  159.197436] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  159.204562] CR2: 00007ffbc1aa0ee9 CR3: 000000000660a005 CR4: 00000000007606e0
[  159.211695] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  159.220203] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  159.227339] PKRU: 55555554
[  159.231430] Fixing recursive fault but reboot is needed!
[  159.807838] general protection fault, probably for non-canonical address 0x16152f0de31ca0e2: 0000 [#4] SMP NOPTI
[  159.818219] CPU: 37 PID: 6847 Comm: gnome-shell Tainted: G      D           5.7.0-rc7-andres-00133-gc8707bf69395 #41
[  159.830115] Hardware name: Supermicro SYS-7049A-T/X11DAi-N, BIOS 3.2 11/13/2019
[  159.838822] RIP: 0010:kmem_cache_alloc_trace+0x78/0x1c0
[  159.845430] Code: 00 00 4c 8b 45 00 65 49 8b 50 08 65 4c 03 05 37 9c c9 7e 4d 8b 38 4d 85 ff 0f 84 2d 01 00 00 8b 45 20 48 8d 4a 01 48 8b 7d 00 <49> 8b 1c 07 4c 89 f8 65 48 0f c7 0f 0f 94 c0 84 c0 74 c5 8b 45 20
[  159.864174] RSP: 0018:ffffc9000eb9bc98 EFLAGS: 00010202
[  159.870785] RAX: 0000000000000080 RBX: 0000000000000001 RCX: 00000000000006a2
[  159.877919] RDX: 00000000000006a1 RSI: 0000000000000dc0 RDI: 000000000002e900
[  159.886439] RBP: ffff8897e0803700 R08: ffff88afdfc6e900 R09: ffff8897d51a7560
[  159.893571] R10: 0000000000000000 R11: ffff88afbc711840 R12: 0000000000000dc0
[  159.902088] R13: 00000000000000d0 R14: ffffffffa0265697 R15: 16152f0de31ca062
[  159.909223] FS:  00007f58af13fcc0(0000) GS:ffff88afdfc40000(0000) knlGS:0000000000000000
[  159.918696] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  159.924441] CR2: 0000558a26e64ab8 CR3: 00000017a49ba001 CR4: 00000000007606e0
[  159.932959] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  159.940092] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  159.948614] PKRU: 55555554
[  159.951328] Call Trace:
[  159.955238]  amdgpu_display_user_framebuffer_create+0x67/0xc0 [amdgpu]
[  159.963085]  drm_internal_framebuffer_create+0x37c/0x4c0
[  159.969793]  drm_mode_addfb2+0x2b/0xb0
[  159.974937]  ? drm_mode_addfb_ioctl+0x10/0x10
[  159.979297]  drm_ioctl_kernel+0xab/0xf0
[  159.984514]  drm_ioctl+0x1e1/0x362
[  159.987919]  ? drm_mode_addfb_ioctl+0x10/0x10
[  159.993728]  amdgpu_drm_ioctl+0x49/0x80 [amdgpu]
[  159.999673]  ksys_ioctl+0x82/0xc0
[  160.004379]  __x64_sys_ioctl+0x16/0x20
[  160.009528]  do_syscall_64+0x48/0x130
[  160.013202]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  160.019630] RIP: 0033:0x7f58b5152427
[  160.023210] Code: 00 00 90 48 8b 05 69 7a 0c 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 39 7a 0c 00 f7 d8 64 89 01 48
[  160.043342] RSP: 002b:00007ffd208c6708 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[  160.050906] RAX: ffffffffffffffda RBX: 00007ffd208c6740 RCX: 00007f58b5152427
[  160.059427] RDX: 00007ffd208c6740 RSI: 00000000c06864b8 RDI: 000000000000000a
[  160.066559] RBP: 00000000c06864b8 R08: 00007ffd208c688c R09: 00007ffd208c68ac
[  160.075077] R10: 000000000000000a R11: 0000000000000246 R12: 00000000000005a0
[  160.082212] R13: 000000000000000a R14: 00007ffd208c682c R15: 0000000000000000
[  160.090734] Modules linked in: isst_if_common squashfs nls_iso8859_1 nls_cp437 snd_hda_codec_realtek vfat snd_hda_codec_generic fat iwlmvm ledtrig_audio snd_hda_codec_hdmi x86_pkg_temp_thermal intel_powerclamp snd_hda_intel snd_intel_dspcfg iwlwifi efi_pstore btusb snd_hda_codec btrtl btbcm efivars snd_hwdep btintel snd_hda_core iTCO_wdt iTCO_vendor_support mei_me mei loop coretemp hid_logitech_hidpp hid_logitech_dj hid_lenovo amdgpu gpu_sched i40e ixgbe ast drm_vram_helper drm_ttm_helper ttm mdio xhci_pci xhci_hcd
[  160.137675] ---[ end trace 563634e2f1b3979b ]---
[  160.211222] RIP: 0010:xfs_log_commit_cil+0x356/0x7f0
[  160.217572] Code: 00 00 48 89 7e 08 49 89 76[  161.041289] BUG: unable to handle page fault for address: 0000000000002000
[  161.048635] #PF: supervisor instruction fetch in kernel mode
 3[0 48 89 11 48   161.054292] #PF: error_code(0x0010) - not-present page
[  161.060818] PGD 0 P4D 0
89[ 4a 08 8b 4c 2  161.063357] Oops: 0010 [#5] SMP NOPTI
[  161.068412] CPU: 22 PID: 0 Comm: swapper/22 Tainted: G      D           5.7.0-rc7-andres-00133-gc8707bf69395 #41
4 [2c 48 89 85 c0  161.078577] Hardware name: Supermicro SYS-7049A-T/X11DAi-N, BIOS 3.2 11/13/2019
[  161.087278] RIP: 0010:0x2000
 0[0 00 00 48 89   161.090164] Code: Bad RIP value.
[  161.094784] RSP: 0018:ffffc9000ccd0f20 EFLAGS: 00010006
85[ c8 00 00 00 4  161.100009] RAX: 0000000000000000 RBX: ffff8897b1dfee00 RCX: 0000000000000000
[  161.108527] RDX: 0000000000000000 RSI: 0000000000000006 RDI: ffff8897b1dfee00
9 [8b 46 20 45 31  161.115661] RBP: ffff8897e0f1f1c0 R08: ffff8897e0f1f680 R09: 7fffffffffffffff
[  161.124179] R10: 0000002588b04191 R11: 0000000000000df5 R12: 0000000000002000
 c[9 <8b> 70 20 8  161.131323] R13: ffff8897e0f1f180 R14: ffff8897e0f1f140 R15: ffff8897e0f1f278
[  161.139840] FS:  0000000000000000(0000) GS:ffff8897e0f00000(0000) knlGS:0000000000000000
5 [f6 0f 84 d9 02  161.147927] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  161.155058] CR2: 0000000000001fd6 CR3: 0000002fb7802004 CR4: 00000000007606e0
 0[0 00 45 31 c0   161.162192] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  161.170712] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
85[ c9 7e 4f 41 8  161.177843] PKRU: 55555554
[  161.181944] Call Trace:
b [46 2c
[  160.  161.184397]  <IRQ>
23[7717] RSP: 001  161.187809]  ? __hrtimer_run_queues+0xf2/0x270
[  161.193647]  ? hrtimer_interrupt+0x106/0x220
8:f[fffc90021fefb  161.197920]  ? smp_apic_timer_interrupt+0x6c/0x130
[  161.204097]  ? apic_timer_interrupt+0xf/0x20
00[ EFLAGS: 00010  161.208369]  </IRQ>
[  161.211866]  ? cpuidle_enter_state+0xae/0x380
24[6
[  160.2443  161.216221]  ? cpuidle_enter+0x29/0x40
[  161.221361]  ? do_idle+0x1cc/0x240
22[] RAX: 0000000  161.224768]  ? cpu_startup_entry+0x19/0x20
[  161.230254]  ? start_secondary+0x15c/0x1b0
000[000000 RBX: f  161.234355]  ? secondary_startup_64+0xa4/0xb0
fff8897a9ea80b0 [  161.240098] Modules linked in: isst_if_common squashfs nls_iso8859_1 nls_cp437 snd_hda_codec_realtek vfat snd_hda_codec_generic fat iwlmvm ledtrig_audio snd_hda_codec_hdmi x86_pkg_temp_thermal intel_powerclamp snd_hda_intel snd_intel_dspcfg iwlwifi efi_pstore btusb snd_hda_codec btrtl btbcm efivars snd_hwdep btintel snd_hda_core iTCO_wdt iTCO_vendor_support mei_me mei loop coretemp hid_logitech_hidpp hid_logitech_dj hid_lenovo amdgpu gpu_sched i40e ixgbe ast drm_vram_helper drm_ttm_helper ttm mdio xhci_pci xhci_hcd
[  161.287011] CR2: 0000000000002000
RCX: 00000000000[  161.290342] ---[ end trace 563634e2f1b3979c ]---
[  161.294667] BUG: unable to handle page fault for address: 0000000000850b48
00[458
[  160.25  161.294672] ------------[ cut here ]------------
[  161.294683] WARNING: CPU: 21 PID: 7852 at kernel/workqueue.c:951 worker_thread+0x38f/0x3c0
28[42] RDX: ffff8  161.294685] Modules linked in: isst_if_common squashfs nls_iso8859_1 nls_cp437 snd_hda_codec_realtek vfat snd_hda_codec_generic fat iwlmvm ledtrig_audio snd_hda_codec_hdmi x86_pkg_temp_thermal intel_powerclamp snd_hda_intel snd_intel_dspcfg iwlwifi efi_pstore btusb snd_hda_codec btrtl btbcm efivars snd_hwdep btintel snd_hda_core iTCO_wdt iTCO_vendor_support mei_me mei loop coretemp hid_logitech_hidpp hid_logitech_dj hid_lenovo amdgpu gpu_sched i40e ixgbe ast drm_vram_helper drm_ttm_helper ttm mdio xhci_pci xhci_hcd
[  161.294724] CPU: 21 PID: 7852 Comm: kworker/21:2 Tainted: G      D           5.7.0-rc7-andres-00133-gc8707bf69395 #41
89[7a9ea80c0 RSI:  161.294727] Hardware name: Supermicro SYS-7049A-T/X11DAi-N, BIOS 3.2 11/13/2019
[  161.294738] Workqueue:  0x0 (mm_percpu_wq)
 f[fff88afc39a120  161.294746] RIP: 0010:worker_thread+0x38f/0x3c0
[  161.294750] Code: ff ff e9 33 fd ff ff 0f 0b e9 99 fd ff ff 0f 0b 48 8b 4c 24 08 49 39 4f 38 41 8b 47 60 0f 84 d2 fd ff ff 0f 0b e9 cb fd ff ff <0f> 0b e9 e8 fc ff ff 0f 0b e9 4f fd ff ff 8b 73 34 85 f6 0f 84 06
0 [RDI: ffff88afb  161.294752] RSP: 0018:ffffc900211ebec0 EFLAGS: 00010087
[  161.294757] RAX: ffff8897a4334a00 RBX: ffff8897e0eeaf00 RCX: ffff8897e0eeff60
1ae[2c18
[  160.  161.294759] RDX: ffff8897e0eeff60 RSI: 0000000000000000 RDI: ffff8897e0eeff00
[  161.294761] RBP: ffff8897e0eeaf00 R08: ffff8897e0ee8f08 R09: ffff8897e0ee8f20
26[1365] RBP: fff  161.294763] R10: 0000000000000000 R11: 0000000000000018 R12: ffff8897d8f919a8
[  161.294765] R13: ffff8897e0eeaf20 R14: ffff8897d8f91980 R15: ffff8897d8f91980
f8[897a9ea8000 R0  161.294768] FS:  0000000000000000(0000) GS:ffff8897e0ec0000(0000) knlGS:0000000000000000
[  161.294771] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
8:[ ffffc90021fef  161.294773] CR2: 00000000000000b0 CR3: 0000002fb7a70003 CR4: 00000000007606e0
[  161.294775] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
b3[0 R09: 0000000  161.294777] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  161.294778] PKRU: 55555554
00[0000000
[  16  161.294780] Call Trace:
[  161.294788]  kthread+0xfb/0x130
[  161.294794]  ? process_one_work+0x3a0/0x3a0
[  161.294798]  ? kthread_park+0x90/0x90
[  161.294805]  ret_from_fork+0x1f/0x40
[  161.294810] ---[ end trace 563634e2f1b3979d ]---
[  161.348061] RIP: 0010:xfs_log_commit_cil+0x356/0x7f0
[  161.349898] #PF: supervisor write access in kernel mode
[  161.355907] Code: 00 00 48 89 7e 08 49 89 76 30 48 89 11 48 89 4a 08 8b 4c 24 2c 48 89 85 c0 00 00 00 48 89 85 c8 00 00 00 49 8b 46 20 45 31 c9 <8b> 70 20 85 f6 0f 84 d9 02 00 00 45 31 c0 85 c9 7e 4f 41 8b 46 2c
[  161.364162] #PF: error_code(0x0002) - not-present page
[  161.364164] PGD 0 P4D 0
[  161.411076] RSP: 0018:ffffc90021fefb00 EFLAGS: 00010246
[  161.421679] Oops: 0002 [#6] SMP NOPTI
[  161.430369] RAX: 0000000000000000 RBX: ffff8897a9ea80b0 RCX: 0000000000000458
[  161.430372] RDX: ffff8897a9ea80c0 RSI: ffff88afc39a1200 RDI: ffff88afb1ae2c18
[  161.434470] CPU: 12 PID: 7750 Comm: postgres Tainted: G      D W         5.7.0-rc7-andres-00133-gc8707bf69395 #41
[  161.440390] RBP: ffff8897a9ea8000 R08: ffffc90021fefb30 R09: 0000000000000000
[  161.459134] Hardware name: Supermicro SYS-7049A-T/X11DAi-N, BIOS 3.2 11/13/2019
[  161.459142] RIP: 0010:queued_spin_lock_slowpath+0x16c/0x1a0
[  161.465746] R10: 0000000000000084 R11: 0000000000000012 R12: ffff8897721bd400
[  161.465748] R13: ffff88afb1ae2c00 R14: ffff88afb19860c0 R15: ffff8897a9ea80a0
[  161.472879] Code: 8b 02 48 85 c0 74 f6 48 89 c6 eb e5 c1 ee 12 83 e0 03 83 ee 01 48 c1 e0 04 48 63 f6 48 05 c0 c1 02 00 48 03 04 f5 c0 86 fc 82 <48> 89 10 8b 42 08 85 c0 75 09 f3 90 8b 42 08 85 c0 74 f7 48 8b 02
[  161.472881] RSP: 0018:ffffc9000cac8bb8 EFLAGS: 00010006
[  161.481392] FS:  0000000000000000(0000) GS:ffff8897e0f00000(0000) knlGS:0000000000000000
[  161.481394] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  161.488522] RAX: 0000000000850b48 RBX: ffff8897d8f919b8 RCX: 0000000000340000
[  161.488524] RDX: ffff88afdf8ac1c0 RSI: 000000000000290b RDI: ffff8897d8f919b8
[  161.497043] CR2: 0000000000001fd6 CR3: 0000002fb7802004 CR4: 00000000007606e0
[  161.497045] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  161.504175] RBP: ffff8897d5a18100 R08: 0000000000340000 R09: ffffc9000cac8ce0
[  161.504177] R10: 0100000000000000 R11: 00000000c827dcec R12: 0000000000000046
[  161.513647] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  161.513649] PKRU: 55555554
[  161.519394] R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000003
[  161.519397] FS:  00007ffbbe9a1980(0000) GS:ffff88afdf880000(0000) knlGS:0000000000000000
[  161.527913] Kernel panic - not syncing: Fatal exception in interrupt
[  161.535045] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  161.535047] CR2: 0000000000850b48 CR3: 000000179c01e005 CR4: 00000000007606e0
[  161.798465] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  161.805597] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  161.812729] PKRU: 55555554
[  161.815440] Call Trace:
[  161.817897]  <IRQ>
[  161.819915]  _raw_spin_lock_irqsave+0x25/0x30
[  161.824275]  __wake_up_common_lock+0x62/0xc0
[  161.828548]  ep_poll_callback+0x111/0x2b0
[  161.832557]  __wake_up_common+0x7a/0x140
[  161.836486]  __wake_up_common_lock+0x7c/0xc0
[  161.840760]  sock_def_readable+0x37/0x60
[  161.844685]  __udp_enqueue_schedule_skb+0x159/0x250
[  161.849568]  udpv6_queue_rcv_one_skb+0x284/0x3c0
[  161.854183]  udp6_unicast_rcv_skb.isra.0+0x44/0xa0
[  161.858976]  ip6_protocol_deliver_rcu+0x235/0x4b0
[  161.863682]  ip6_input_finish+0x11/0x20
[  161.867520]  ip6_input+0xa2/0xb0
[  161.870752]  ? ip6_protocol_deliver_rcu+0x4b0/0x4b0
[  161.875631]  ipv6_rcv+0xc0/0xd0
[  161.878780]  ? ip6_rcv_finish_core.isra.0+0xd0/0xd0
[  161.883659]  __netif_receive_skb_one_core+0x63/0xa0
[  161.888538]  process_backlog+0x98/0x130
[  161.892377]  net_rx_action+0x13a/0x370
[  161.896132]  __do_softirq+0xe0/0x2ca
[  161.899710]  do_softirq_own_stack+0x2a/0x40
[  161.903896]  </IRQ>
[  161.906001]  do_softirq.part.0+0x2b/0x30
[  161.909926]  __local_bh_enable_ip+0x4b/0x50
[  161.914116]  ip6_finish_output2+0x264/0x5b0
[  161.918299]  ip6_output+0x73/0x120
[  161.921705]  ? __ip6_finish_output+0x110/0x110
[  161.926152]  ip6_send_skb+0x1e/0x60
[  161.929646]  udp_v6_send_skb.isra.0+0x197/0x460
[  161.934177]  udpv6_sendmsg+0xb4f/0xdb0
[  161.937931]  ? ip_reply_glue_bits+0x40/0x40
[  161.942118]  ? touch_atime+0x33/0xd0
[  161.945695]  ? __sys_sendto+0x108/0x190
[  161.949533]  __sys_sendto+0x108/0x190
[  161.953203]  ? __fput+0x1a5/0x240
[  161.956519]  ? _cond_resched+0x19/0x30
[  161.960271]  ? task_work_run+0x64/0x90
[  161.964026]  __x64_sys_sendto+0x25/0x30
[  161.967865]  do_syscall_64+0x48/0x130
[  161.971529]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  161.976584] RIP: 0033:0x7ffbc1aa126c
[  161.980161] Code: c0 ff ff ff ff eb b9 0f 1f 80 00 00 00 00 41 89 ca 64 8b 04 25 18 00 00 00 85 c0 75 19 45 31 c9 45 31 c0 b8 2c 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 64 c3 0f 1f 00 55 48 83 ec 20 48 89 54 24 10
[  161.998907] RSP: 002b:00007fff520a50c8 EFLAGS: 00000246 ORIG_RAX: 000000000000002c
[  162.006475] RAX: ffffffffffffffda RBX: 00000000000000c0 RCX: 00007ffbc1aa126c
[  162.013608] RDX: 0000000000000020 RSI: 00007fff520a50f0 RDI: 0000000000000009
[  162.020741] RBP: 00007fff520a5140 R08: 0000000000000000 R09: 0000000000000000
[  162.027873] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000001
[  162.035005] R13: 00007fff520a50f0 R14: 0000000000000000 R15: 00007fff520a50e8
[  162.042140] Modules linked in: isst_if_common squashfs nls_iso8859_1 nls_cp437 snd_hda_codec_realtek vfat snd_hda_codec_generic fat iwlmvm ledtrig_audio snd_hda_codec_hdmi x86_pkg_temp_thermal intel_powerclamp snd_hda_intel snd_intel_dspcfg iwlwifi efi_pstore btusb snd_hda_codec btrtl btbcm efivars snd_hwdep btintel snd_hda_core iTCO_wdt iTCO_vendor_support mei_me mei loop coretemp hid_logitech_hidpp hid_logitech_dj hid_lenovo amdgpu gpu_sched i40e ixgbe ast drm_vram_helper drm_ttm_helper ttm mdio xhci_pci xhci_hcd
[  162.087682] CR2: 0000000000850b48
[  162.091002] ---[ end trace 563634e2f1b3979e ]---
[  162.101634] RIP: 0010:xfs_log_commit_cil+0x356/0x7f0
[  162.106602] Code: 00 00 48 89 7e 08 49 89 76 30 48 89 11 48 89 4a 08 8b 4c 24 2c 48 89 85 c0 00 00 00 48 89 85 c8 00 00 00 49 8b 46 20 45 31 c9 <8b> 70 20 85 f6 0f 84 d9 02 00 00 45 31 c0 85 c9 7e 4f 41 8b 46 2c
[  162.125348] RSP: 0018:ffffc90021fefb00 EFLAGS: 00010246
[  162.130572] RAX: 0000000000000000 RBX: ffff8897a9ea80b0 RCX: 0000000000000458
[  162.137705] RDX: ffff8897a9ea80c0 RSI: ffff88afc39a1200 RDI: ffff88afb1ae2c18
[  162.144838] RBP: ffff8897a9ea8000 R08: ffffc90021fefb30 R09: 0000000000000000
[  162.151971] R10: 0000000000000084 R11: 0000000000000012 R12: ffff8897721bd400
[  162.159103] R13: ffff88afb1ae2c00 R14: ffff88afb19860c0 R15: ffff8897a9ea80a0
[  162.166235] FS:  00007ffbbe9a1980(0000) GS:ffff88afdf880000(0000) knlGS:0000000000000000
[  162.174322] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  162.180068] CR2: 0000000000850b48 CR3: 000000179c01e005 CR4: 00000000007606e0
[  162.187200] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  162.194326] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  162.201458] PKRU: 55555554
[  162.567356] Shutting down cpus with NMI
[  162.571201] Kernel Offset: disabled
[  162.580776] ---[ end Kernel panic - not syncing: Fatal exception in interrupt ]---

#
# Automatically generated file; DO NOT EDIT.
# Linux/x86 5.7.0-rc7 Kernel Configuration
#

#
# Compiler: gcc (Debian 9.3.0-13) 9.3.0
#
CONFIG_CC_IS_GCC=y
CONFIG_GCC_VERSION=90300
CONFIG_LD_VERSION=234000000
CONFIG_CLANG_VERSION=0
CONFIG_CC_CAN_LINK=y
CONFIG_CC_HAS_ASM_GOTO=y
CONFIG_CC_HAS_ASM_INLINE=y
CONFIG_IRQ_WORK=y
CONFIG_BUILDTIME_TABLE_SORT=y
CONFIG_THREAD_INFO_IN_TASK=y

#
# General setup
#
CONFIG_INIT_ENV_ARG_LIMIT=32
# CONFIG_COMPILE_TEST is not set
# CONFIG_UAPI_HEADER_TEST is not set
CONFIG_LOCALVERSION="-andres"
CONFIG_LOCALVERSION_AUTO=y
CONFIG_BUILD_SALT=""
CONFIG_HAVE_KERNEL_GZIP=y
CONFIG_HAVE_KERNEL_BZIP2=y
CONFIG_HAVE_KERNEL_LZMA=y
CONFIG_HAVE_KERNEL_XZ=y
CONFIG_HAVE_KERNEL_LZO=y
CONFIG_HAVE_KERNEL_LZ4=y
# CONFIG_KERNEL_GZIP is not set
# CONFIG_KERNEL_BZIP2 is not set
# CONFIG_KERNEL_LZMA is not set
CONFIG_KERNEL_XZ=y
# CONFIG_KERNEL_LZO is not set
# CONFIG_KERNEL_LZ4 is not set
CONFIG_DEFAULT_HOSTNAME="(none)"
CONFIG_SWAP=y
CONFIG_SYSVIPC=y
CONFIG_SYSVIPC_SYSCTL=y
CONFIG_POSIX_MQUEUE=y
CONFIG_POSIX_MQUEUE_SYSCTL=y
CONFIG_CROSS_MEMORY_ATTACH=y
# CONFIG_USELIB is not set
CONFIG_AUDIT=y
CONFIG_HAVE_ARCH_AUDITSYSCALL=y
CONFIG_AUDITSYSCALL=y

#
# IRQ subsystem
#
CONFIG_GENERIC_IRQ_PROBE=y
CONFIG_GENERIC_IRQ_SHOW=y
CONFIG_GENERIC_IRQ_EFFECTIVE_AFF_MASK=y
CONFIG_GENERIC_PENDING_IRQ=y
CONFIG_GENERIC_IRQ_MIGRATION=y
CONFIG_HARDIRQS_SW_RESEND=y
CONFIG_GENERIC_IRQ_CHIP=y
CONFIG_IRQ_DOMAIN=y
CONFIG_IRQ_DOMAIN_HIERARCHY=y
CONFIG_GENERIC_MSI_IRQ=y
CONFIG_GENERIC_MSI_IRQ_DOMAIN=y
CONFIG_IRQ_MSI_IOMMU=y
CONFIG_GENERIC_IRQ_MATRIX_ALLOCATOR=y
CONFIG_GENERIC_IRQ_RESERVATION_MODE=y
CONFIG_IRQ_FORCED_THREADING=y
CONFIG_SPARSE_IRQ=y
# CONFIG_GENERIC_IRQ_DEBUGFS is not set

# end of IRQ subsystem

CONFIG_CLOCKSOURCE_WATCHDOG=y
CONFIG_ARCH_CLOCKSOURCE_INIT=y
CONFIG_CLOCKSOURCE_VALIDATE_LAST_CYCLE=y
CONFIG_GENERIC_TIME_VSYSCALL=y
CONFIG_GENERIC_CLOCKEVENTS=y
CONFIG_GENERIC_CLOCKEVENTS_BROADCAST=y
CONFIG_GENERIC_CLOCKEVENTS_MIN_ADJUST=y
CONFIG_GENERIC_CMOS_UPDATE=y

#
# Timers subsystem
#
CONFIG_TICK_ONESHOT=y
CONFIG_NO_HZ_COMMON=y
# CONFIG_HZ_PERIODIC is not set
CONFIG_NO_HZ_IDLE=y
# CONFIG_NO_HZ_FULL is not set
# CONFIG_NO_HZ is not set
CONFIG_HIGH_RES_TIMERS=y

# end of Timers subsystem

# CONFIG_PREEMPT_NONE is not set
CONFIG_PREEMPT_VOLUNTARY=y
# CONFIG_PREEMPT is not set

#
# CPU/Task time and stats accounting
#
CONFIG_TICK_CPU_ACCOUNTING=y
# CONFIG_VIRT_CPU_ACCOUNTING_GEN is not set
# CONFIG_IRQ_TIME_ACCOUNTING is not set
# CONFIG_SCHED_THERMAL_PRESSURE is not set
CONFIG_BSD_PROCESS_ACCT=y
CONFIG_BSD_PROCESS_ACCT_V3=y
CONFIG_TASKSTATS=y
CONFIG_TASK_DELAY_ACCT=y
CONFIG_TASK_XACCT=y
CONFIG_TASK_IO_ACCOUNTING=y
CONFIG_PSI=y
CONFIG_PSI_DEFAULT_DISABLED=y

# end of CPU/Task time and stats accounting

CONFIG_CPU_ISOLATION=y

#
# RCU Subsystem
#
CONFIG_TREE_RCU=y
# CONFIG_RCU_EXPERT is not set
CONFIG_SRCU=y
CONFIG_TREE_SRCU=y
CONFIG_RCU_STALL_COMMON=y
CONFIG_RCU_NEED_SEGCBLIST=y

# end of RCU Subsystem

CONFIG_BUILD_BIN2C=y
CONFIG_IKCONFIG=y
CONFIG_IKCONFIG_PROC=y
CONFIG_IKHEADERS=y
CONFIG_LOG_BUF_SHIFT=17
CONFIG_LOG_CPU_MAX_BUF_SHIFT=12
CONFIG_PRINTK_SAFE_LOG_BUF_SHIFT=13
CONFIG_HAVE_UNSTABLE_SCHED_CLOCK=y

#
# Scheduler features
#
# CONFIG_UCLAMP_TASK is not set

# end of Scheduler features

CONFIG_ARCH_SUPPORTS_NUMA_BALANCING=y
CONFIG_ARCH_WANT_BATCHED_UNMAP_TLB_FLUSH=y
CONFIG_CC_HAS_INT128=y
CONFIG_ARCH_SUPPORTS_INT128=y
CONFIG_NUMA_BALANCING=y
CONFIG_NUMA_BALANCING_DEFAULT_ENABLED=y
CONFIG_CGROUPS=y
# CONFIG_MEMCG is not set
# CONFIG_BLK_CGROUP is not set
CONFIG_CGROUP_SCHED=y
CONFIG_FAIR_GROUP_SCHED=y
CONFIG_CFS_BANDWIDTH=y
CONFIG_RT_GROUP_SCHED=y
CONFIG_CGROUP_PIDS=y
# CONFIG_CGROUP_RDMA is not set
CONFIG_CGROUP_FREEZER=y
# CONFIG_CGROUP_HUGETLB is not set
# CONFIG_CPUSETS is not set
CONFIG_CGROUP_DEVICE=y
CONFIG_CGROUP_CPUACCT=y
# CONFIG_CGROUP_PERF is not set
CONFIG_CGROUP_BPF=y
# CONFIG_CGROUP_DEBUG is not set
CONFIG_SOCK_CGROUP_DATA=y
CONFIG_NAMESPACES=y
CONFIG_UTS_NS=y
CONFIG_TIME_NS=y
CONFIG_IPC_NS=y
CONFIG_USER_NS=y
CONFIG_PID_NS=y
CONFIG_NET_NS=y
# CONFIG_CHECKPOINT_RESTORE is not set
CONFIG_SCHED_AUTOGROUP=y
# CONFIG_SYSFS_DEPRECATED is not set
CONFIG_RELAY=y
CONFIG_BLK_DEV_INITRD=y
CONFIG_INITRAMFS_SOURCE=""
CONFIG_RD_GZIP=y
CONFIG_RD_BZIP2=y
CONFIG_RD_LZMA=y
CONFIG_RD_XZ=y
CONFIG_RD_LZO=y
CONFIG_RD_LZ4=y
CONFIG_BOOT_CONFIG=y
CONFIG_CC_OPTIMIZE_FOR_PERFORMANCE=y
# CONFIG_CC_OPTIMIZE_FOR_SIZE is not set
CONFIG_SYSCTL=y
CONFIG_HAVE_UID16=y
CONFIG_SYSCTL_EXCEPTION_TRACE=y
CONFIG_HAVE_PCSPKR_PLATFORM=y
CONFIG_BPF=y
# CONFIG_EXPERT is not set
CONFIG_UID16=y
CONFIG_MULTIUSER=y
CONFIG_SGETMASK_SYSCALL=y
CONFIG_SYSFS_SYSCALL=y
CONFIG_FHANDLE=y
CONFIG_POSIX_TIMERS=y
CONFIG_PRINTK=y
CONFIG_PRINTK_NMI=y
CONFIG_BUG=y
CONFIG_ELF_CORE=y
CONFIG_PCSPKR_PLATFORM=y
CONFIG_BASE_FULL=y
CONFIG_FUTEX=y
CONFIG_FUTEX_PI=y
CONFIG_EPOLL=y
CONFIG_SIGNALFD=y
CONFIG_TIMERFD=y
CONFIG_EVENTFD=y
CONFIG_SHMEM=y
CONFIG_AIO=y
CONFIG_IO_URING=y
CONFIG_ADVISE_SYSCALLS=y
CONFIG_HAVE_ARCH_USERFAULTFD_WP=y
CONFIG_MEMBARRIER=y
CONFIG_KALLSYMS=y
CONFIG_KALLSYMS_ALL=y
CONFIG_KALLSYMS_ABSOLUTE_PERCPU=y
CONFIG_KALLSYMS_BASE_RELATIVE=y
# CONFIG_BPF_LSM is not set
CONFIG_BPF_SYSCALL=y
CONFIG_ARCH_WANT_DEFAULT_BPF_JIT=y
# CONFIG_BPF_JIT_ALWAYS_ON is not set
CONFIG_BPF_JIT_DEFAULT_ON=y
CONFIG_USERFAULTFD=y
CONFIG_ARCH_HAS_MEMBARRIER_SYNC_CORE=y
CONFIG_RSEQ=y
# CONFIG_EMBEDDED is not set
CONFIG_HAVE_PERF_EVENTS=y

#
# Kernel Performance Events And Counters
#
CONFIG_PERF_EVENTS=y
# CONFIG_DEBUG_PERF_USE_VMALLOC is not set

# end of Kernel Performance Events And Counters

CONFIG_VM_EVENT_COUNTERS=y
CONFIG_SLUB_DEBUG=y
# CONFIG_COMPAT_BRK is not set
# CONFIG_SLAB is not set
CONFIG_SLUB=y
CONFIG_SLAB_MERGE_DEFAULT=y
# CONFIG_SLAB_FREELIST_RANDOM is not set
# CONFIG_SLAB_FREELIST_HARDENED is not set
# CONFIG_SHUFFLE_PAGE_ALLOCATOR is not set
CONFIG_SLUB_CPU_PARTIAL=y
CONFIG_SYSTEM_DATA_VERIFICATION=y
CONFIG_PROFILING=y
CONFIG_TRACEPOINTS=y

# end of General setup

CONFIG_64BIT=y
CONFIG_X86_64=y
CONFIG_X86=y
CONFIG_INSTRUCTION_DECODER=y
CONFIG_OUTPUT_FORMAT="elf64-x86-64"
CONFIG_LOCKDEP_SUPPORT=y
CONFIG_STACKTRACE_SUPPORT=y
CONFIG_MMU=y
CONFIG_ARCH_MMAP_RND_BITS_MIN=28
CONFIG_ARCH_MMAP_RND_BITS_MAX=32
CONFIG_ARCH_MMAP_RND_COMPAT_BITS_MIN=8
CONFIG_ARCH_MMAP_RND_COMPAT_BITS_MAX=16
CONFIG_GENERIC_ISA_DMA=y
CONFIG_GENERIC_BUG=y
CONFIG_GENERIC_BUG_RELATIVE_POINTERS=y
CONFIG_ARCH_MAY_HAVE_PC_FDC=y
CONFIG_GENERIC_CALIBRATE_DELAY=y
CONFIG_ARCH_HAS_CPU_RELAX=y
CONFIG_ARCH_HAS_CACHE_LINE_SIZE=y
CONFIG_ARCH_HAS_FILTER_PGPROT=y
CONFIG_HAVE_SETUP_PER_CPU_AREA=y
CONFIG_NEED_PER_CPU_EMBED_FIRST_CHUNK=y
CONFIG_NEED_PER_CPU_PAGE_FIRST_CHUNK=y
CONFIG_ARCH_HIBERNATION_POSSIBLE=y
CONFIG_ARCH_SUSPEND_POSSIBLE=y
CONFIG_ARCH_WANT_GENERAL_HUGETLB=y
CONFIG_ZONE_DMA32=y
CONFIG_AUDIT_ARCH=y
CONFIG_ARCH_SUPPORTS_DEBUG_PAGEALLOC=y
CONFIG_HAVE_INTEL_TXT=y
CONFIG_X86_64_SMP=y
CONFIG_ARCH_SUPPORTS_UPROBES=y
CONFIG_FIX_EARLYCON_MEM=y
CONFIG_PGTABLE_LEVELS=4
CONFIG_CC_HAS_SANE_STACKPROTECTOR=y

#
# Processor type and features
#
CONFIG_ZONE_DMA=y
CONFIG_SMP=y
CONFIG_X86_FEATURE_NAMES=y
CONFIG_X86_X2APIC=y
# CONFIG_X86_MPPARSE is not set
# CONFIG_GOLDFISH is not set
CONFIG_RETPOLINE=y
CONFIG_X86_CPU_RESCTRL=y
# CONFIG_X86_EXTENDED_PLATFORM is not set
CONFIG_X86_INTEL_LPSS=y
# CONFIG_X86_AMD_PLATFORM_DEVICE is not set
CONFIG_IOSF_MBI=y
# CONFIG_IOSF_MBI_DEBUG is not set
CONFIG_X86_SUPPORTS_MEMORY_FAILURE=y
# CONFIG_SCHED_OMIT_FRAME_POINTER is not set
# CONFIG_HYPERVISOR_GUEST is not set
# CONFIG_MK8 is not set
# CONFIG_MPSC is not set
CONFIG_MCORE2=y
# CONFIG_MATOM is not set
# CONFIG_GENERIC_CPU is not set
CONFIG_X86_INTERNODE_CACHE_SHIFT=6
CONFIG_X86_L1_CACHE_SHIFT=6
CONFIG_X86_INTEL_USERCOPY=y
CONFIG_X86_USE_PPRO_CHECKSUM=y
CONFIG_X86_P6_NOP=y
CONFIG_X86_TSC=y
CONFIG_X86_CMPXCHG64=y
CONFIG_X86_CMOV=y
CONFIG_X86_MINIMUM_CPU_FAMILY=64
CONFIG_X86_DEBUGCTLMSR=y
CONFIG_IA32_FEAT_CTL=y
CONFIG_X86_VMX_FEATURE_NAMES=y
CONFIG_CPU_SUP_INTEL=y
CONFIG_CPU_SUP_AMD=y
CONFIG_CPU_SUP_HYGON=y
CONFIG_CPU_SUP_CENTAUR=y
CONFIG_CPU_SUP_ZHAOXIN=y
CONFIG_HPET_TIMER=y
CONFIG_HPET_EMULATE_RTC=y
CONFIG_DMI=y
# CONFIG_GART_IOMMU is not set
# CONFIG_MAXSMP is not set
CONFIG_NR_CPUS_RANGE_BEGIN=2
CONFIG_NR_CPUS_RANGE_END=512
CONFIG_NR_CPUS_DEFAULT=64
CONFIG_NR_CPUS=512
CONFIG_SCHED_SMT=y
CONFIG_SCHED_MC=y
CONFIG_SCHED_MC_PRIO=y
CONFIG_X86_LOCAL_APIC=y
CONFIG_X86_IO_APIC=y
CONFIG_X86_REROUTE_FOR_BROKEN_BOOT_IRQS=y
CONFIG_X86_MCE=y
CONFIG_X86_MCELOG_LEGACY=y
CONFIG_X86_MCE_INTEL=y
# CONFIG_X86_MCE_AMD is not set
CONFIG_X86_MCE_THRESHOLD=y
# CONFIG_X86_MCE_INJECT is not set
CONFIG_X86_THERMAL_VECTOR=y

#
# Performance monitoring
#
CONFIG_PERF_EVENTS_INTEL_UNCORE=y
CONFIG_PERF_EVENTS_INTEL_RAPL=y
CONFIG_PERF_EVENTS_INTEL_CSTATE=y
# CONFIG_PERF_EVENTS_AMD_POWER is not set

# end of Performance monitoring

CONFIG_X86_16BIT=y
CONFIG_X86_ESPFIX64=y
CONFIG_X86_VSYSCALL_EMULATION=y
CONFIG_X86_IOPL_IOPERM=y
# CONFIG_I8K is not set
CONFIG_MICROCODE=y
CONFIG_MICROCODE_INTEL=y
# CONFIG_MICROCODE_AMD is not set
# CONFIG_MICROCODE_OLD_INTERFACE is not set
CONFIG_X86_MSR=y
CONFIG_X86_CPUID=y
# CONFIG_X86_5LEVEL is not set
CONFIG_X86_DIRECT_GBPAGES=y
# CONFIG_X86_CPA_STATISTICS is not set
# CONFIG_AMD_MEM_ENCRYPT is not set
CONFIG_NUMA=y
CONFIG_AMD_NUMA=y
CONFIG_X86_64_ACPI_NUMA=y
CONFIG_NODES_SPAN_OTHER_NODES=y
# CONFIG_NUMA_EMU is not set
CONFIG_NODES_SHIFT=6
CONFIG_ARCH_SPARSEMEM_ENABLE=y
CONFIG_ARCH_SPARSEMEM_DEFAULT=y
CONFIG_ARCH_SELECT_MEMORY_MODEL=y
CONFIG_ARCH_PROC_KCORE_TEXT=y
CONFIG_ILLEGAL_POINTER_VALUE=0xdead000000000000
# CONFIG_X86_PMEM_LEGACY is not set
# CONFIG_X86_CHECK_BIOS_CORRUPTION is not set
CONFIG_X86_RESERVE_LOW=64
CONFIG_MTRR=y
CONFIG_MTRR_SANITIZER=y
CONFIG_MTRR_SANITIZER_ENABLE_DEFAULT=0
CONFIG_MTRR_SANITIZER_SPARE_REG_NR_DEFAULT=1
CONFIG_X86_PAT=y
CONFIG_ARCH_USES_PG_UNCACHED=y
CONFIG_ARCH_RANDOM=y
CONFIG_X86_SMAP=y
CONFIG_X86_UMIP=y
CONFIG_X86_INTEL_MEMORY_PROTECTION_KEYS=y
CONFIG_X86_INTEL_TSX_MODE_OFF=y
# CONFIG_X86_INTEL_TSX_MODE_ON is not set
# CONFIG_X86_INTEL_TSX_MODE_AUTO is not set
CONFIG_EFI=y
CONFIG_EFI_STUB=y
CONFIG_EFI_MIXED=y
CONFIG_SECCOMP=y
# CONFIG_HZ_100 is not set
# CONFIG_HZ_250 is not set
CONFIG_HZ_300=y
# CONFIG_HZ_1000 is not set
CONFIG_HZ=300
CONFIG_SCHED_HRTICK=y
CONFIG_KEXEC=y
CONFIG_KEXEC_FILE=y
CONFIG_ARCH_HAS_KEXEC_PURGATORY=y
# CONFIG_KEXEC_SIG is not set
CONFIG_CRASH_DUMP=y
CONFIG_KEXEC_JUMP=y
CONFIG_PHYSICAL_START=0x200000
CONFIG_RELOCATABLE=y
# CONFIG_RANDOMIZE_BASE is not set
CONFIG_PHYSICAL_ALIGN=0x1000000
CONFIG_HOTPLUG_CPU=y
# CONFIG_BOOTPARAM_HOTPLUG_CPU0 is not set
# CONFIG_DEBUG_HOTPLUG_CPU0 is not set
CONFIG_COMPAT_VDSO=y
# CONFIG_LEGACY_VSYSCALL_EMULATE is not set
# CONFIG_LEGACY_VSYSCALL_XONLY is not set
CONFIG_LEGACY_VSYSCALL_NONE=y
CONFIG_CMDLINE_BOOL=y
CONFIG_CMDLINE=""
CONFIG_MODIFY_LDT_SYSCALL=y
CONFIG_HAVE_LIVEPATCH=y
# CONFIG_LIVEPATCH is not set

# end of Processor type and features

CONFIG_ARCH_HAS_ADD_PAGES=y
CONFIG_ARCH_ENABLE_MEMORY_HOTPLUG=y
CONFIG_USE_PERCPU_NUMA_NODE_ID=y
CONFIG_ARCH_ENABLE_SPLIT_PMD_PTLOCK=y
CONFIG_ARCH_ENABLE_HUGEPAGE_MIGRATION=y
CONFIG_ARCH_ENABLE_THP_MIGRATION=y

#
# Power management and ACPI options
#
CONFIG_ARCH_HIBERNATION_HEADER=y
CONFIG_SUSPEND=y
CONFIG_SUSPEND_FREEZER=y
CONFIG_HIBERNATE_CALLBACKS=y
CONFIG_HIBERNATION=y
CONFIG_PM_STD_PARTITION=""
CONFIG_PM_SLEEP=y
CONFIG_PM_SLEEP_SMP=y
CONFIG_PM_AUTOSLEEP=y
CONFIG_PM_WAKELOCKS=y
CONFIG_PM_WAKELOCKS_LIMIT=100
CONFIG_PM_WAKELOCKS_GC=y
CONFIG_PM=y
CONFIG_PM_DEBUG=y
CONFIG_PM_ADVANCED_DEBUG=y
CONFIG_PM_TEST_SUSPEND=y
CONFIG_PM_SLEEP_DEBUG=y
CONFIG_PM_TRACE=y
CONFIG_PM_TRACE_RTC=y
CONFIG_PM_CLK=y
CONFIG_PM_GENERIC_DOMAINS=y
CONFIG_WQ_POWER_EFFICIENT_DEFAULT=y
CONFIG_PM_GENERIC_DOMAINS_SLEEP=y
CONFIG_ENERGY_MODEL=y
CONFIG_ARCH_SUPPORTS_ACPI=y
CONFIG_ACPI=y
CONFIG_ACPI_LEGACY_TABLES_LOOKUP=y
CONFIG_ARCH_MIGHT_HAVE_ACPI_PDC=y
CONFIG_ACPI_SYSTEM_POWER_STATES_SUPPORT=y
# CONFIG_ACPI_DEBUGGER is not set
CONFIG_ACPI_SPCR_TABLE=y
CONFIG_ACPI_LPIT=y
CONFIG_ACPI_SLEEP=y
# CONFIG_ACPI_PROCFS_POWER is not set
CONFIG_ACPI_REV_OVERRIDE_POSSIBLE=y
# CONFIG_ACPI_EC_DEBUGFS is not set
CONFIG_ACPI_AC=y
CONFIG_ACPI_BATTERY=y
CONFIG_ACPI_BUTTON=y
CONFIG_ACPI_VIDEO=y
CONFIG_ACPI_FAN=y
CONFIG_ACPI_TAD=y
CONFIG_ACPI_DOCK=y
CONFIG_ACPI_CPU_FREQ_PSS=y
CONFIG_ACPI_PROCESSOR_CSTATE=y
CONFIG_ACPI_PROCESSOR_IDLE=y
CONFIG_ACPI_CPPC_LIB=y
CONFIG_ACPI_PROCESSOR=y
CONFIG_ACPI_IPMI=m
CONFIG_ACPI_HOTPLUG_CPU=y
CONFIG_ACPI_PROCESSOR_AGGREGATOR=y
CONFIG_ACPI_THERMAL=y
CONFIG_ACPI_CUSTOM_DSDT_FILE=""
CONFIG_ARCH_HAS_ACPI_TABLE_UPGRADE=y
CONFIG_ACPI_TABLE_UPGRADE=y
# CONFIG_ACPI_DEBUG is not set
CONFIG_ACPI_PCI_SLOT=y
CONFIG_ACPI_CONTAINER=y
CONFIG_ACPI_HOTPLUG_IOAPIC=y
CONFIG_ACPI_SBS=y
CONFIG_ACPI_HED=y
CONFIG_ACPI_CUSTOM_METHOD=m
CONFIG_ACPI_BGRT=y
CONFIG_ACPI_NFIT=y
# CONFIG_NFIT_SECURITY_DEBUG is not set
CONFIG_ACPI_NUMA=y
CONFIG_ACPI_HMAT=y
CONFIG_HAVE_ACPI_APEI=y
CONFIG_HAVE_ACPI_APEI_NMI=y
CONFIG_ACPI_APEI=y
CONFIG_ACPI_APEI_GHES=y
CONFIG_ACPI_APEI_PCIEAER=y
CONFIG_ACPI_APEI_EINJ=m
CONFIG_ACPI_APEI_ERST_DEBUG=m
CONFIG_DPTF_POWER=m
CONFIG_ACPI_WATCHDOG=y
CONFIG_ACPI_EXTLOG=y
CONFIG_ACPI_ADXL=y
CONFIG_PMIC_OPREGION=y
CONFIG_BXT_WC_PMIC_OPREGION=y
CONFIG_CHT_DC_TI_PMIC_OPREGION=y
CONFIG_ACPI_CONFIGFS=y
CONFIG_X86_PM_TIMER=y
CONFIG_SFI=y

#
# CPU Frequency scaling
#
CONFIG_CPU_FREQ=y CONFIG_CPU_FREQ_GOV_ATTR_SET=y CONFIG_CPU_FREQ_GOV_COMMON=y CONFIG_CPU_FREQ_STAT=y
# CONFIG_CPU_FREQ_DEFAULT_GOV_PERFORMANCE is not set # CONFIG_CPU_FREQ_DEFAULT_GOV_POWERSAVE is not set # CONFIG_CPU_FREQ_DEFAULT_GOV_USERSPACE is not set CONFIG_CPU_FREQ_DEFAULT_GOV_ONDEMAND=y
# CONFIG_CPU_FREQ_DEFAULT_GOV_CONSERVATIVE is not set # CONFIG_CPU_FREQ_DEFAULT_GOV_SCHEDUTIL is not set CONFIG_CPU_FREQ_GOV_PERFORMANCE=y CONFIG_CPU_FREQ_GOV_POWERSAVE=y CONFIG_CPU_FREQ_GOV_USERSPACE=y CONFIG_CPU_FREQ_GOV_ONDEMAND=y CONFIG_CPU_FREQ_GOV_CONSERVATIVE=y CONFIG_CPU_FREQ_GOV_SCHEDUTIL=y

#
# CPU frequency scaling drivers
#
CONFIG_X86_INTEL_PSTATE=y
CONFIG_X86_PCC_CPUFREQ=m
CONFIG_X86_ACPI_CPUFREQ=m
CONFIG_X86_ACPI_CPUFREQ_CPB=y
# CONFIG_X86_POWERNOW_K8 is not set
# CONFIG_X86_AMD_FREQ_SENSITIVITY is not set
# CONFIG_X86_SPEEDSTEP_CENTRINO is not set
# CONFIG_X86_P4_CLOCKMOD is not set

#

# shared options
#
# end of CPU Frequency scaling

#
# CPU Idle
#
CONFIG_CPU_IDLE=y
CONFIG_CPU_IDLE_GOV_LADDER=y
CONFIG_CPU_IDLE_GOV_MENU=y
# CONFIG_CPU_IDLE_GOV_TEO is not set

# end of CPU Idle

CONFIG_INTEL_IDLE=y

# end of Power management and ACPI options

#
# Bus options (PCI etc.)
#
CONFIG_PCI_DIRECT=y
CONFIG_PCI_MMCONFIG=y
CONFIG_MMCONF_FAM10H=y
CONFIG_ISA_DMA_API=y
CONFIG_AMD_NB=y
CONFIG_X86_SYSFB=y

# end of Bus options (PCI etc.)

#
# Binary Emulations
#
CONFIG_IA32_EMULATION=y
# CONFIG_X86_X32 is not set
CONFIG_COMPAT_32=y
CONFIG_COMPAT=y
CONFIG_COMPAT_FOR_U64_ALIGNMENT=y
CONFIG_SYSVIPC_COMPAT=y

# end of Binary Emulations

#
# Firmware Drivers
#
CONFIG_EDD=m
# CONFIG_EDD_OFF is not set
CONFIG_FIRMWARE_MEMMAP=y
CONFIG_DMIID=y
CONFIG_DMI_SYSFS=y
CONFIG_DMI_SCAN_MACHINE_NON_EFI_FALLBACK=y
# CONFIG_ISCSI_IBFT is not set
# CONFIG_FW_CFG_SYSFS is not set
# CONFIG_GOOGLE_FIRMWARE is not set

#
# EFI (Extensible Firmware Interface) Support
#
CONFIG_EFI_VARS=m
CONFIG_EFI_ESRT=y
CONFIG_EFI_VARS_PSTORE=m
CONFIG_EFI_VARS_PSTORE_DEFAULT_DISABLE=y
CONFIG_EFI_RUNTIME_MAP=y
# CONFIG_EFI_FAKE_MEMMAP is not set
CONFIG_EFI_SOFT_RESERVE=y
CONFIG_EFI_RUNTIME_WRAPPERS=y
CONFIG_EFI_BOOTLOADER_CONTROL=m
CONFIG_EFI_CAPSULE_LOADER=m
# CONFIG_EFI_TEST is not set
CONFIG_APPLE_PROPERTIES=y
# CONFIG_RESET_ATTACK_MITIGATION is not set
CONFIG_EFI_RCI2_TABLE=y
# CONFIG_EFI_DISABLE_PCI_DMA is not set

# end of EFI (Extensible Firmware Interface) Support

CONFIG_UEFI_CPER=y
CONFIG_UEFI_CPER_X86=y
CONFIG_EFI_DEV_PATH_PARSER=y
CONFIG_EFI_EARLYCON=y

#
# Tegra firmware driver
#

# end of Tegra firmware driver
# end of Firmware Drivers

CONFIG_HAVE_KVM=y
CONFIG_HAVE_KVM_IRQCHIP=y
CONFIG_HAVE_KVM_IRQFD=y
CONFIG_HAVE_KVM_IRQ_ROUTING=y
CONFIG_HAVE_KVM_EVENTFD=y
CONFIG_KVM_MMIO=y
CONFIG_KVM_ASYNC_PF=y
CONFIG_HAVE_KVM_MSI=y
CONFIG_HAVE_KVM_CPU_RELAX_INTERCEPT=y
CONFIG_KVM_VFIO=y
CONFIG_KVM_GENERIC_DIRTYLOG_READ_PROTECT=y
CONFIG_KVM_COMPAT=y
CONFIG_HAVE_KVM_IRQ_BYPASS=y
CONFIG_HAVE_KVM_NO_POLL=y
CONFIG_VIRTUALIZATION=y
CONFIG_KVM=y
CONFIG_KVM_INTEL=y
# CONFIG_KVM_AMD is not set
# CONFIG_KVM_MMU_AUDIT is not set
CONFIG_AS_AVX512=y
CONFIG_AS_SHA1_NI=y
CONFIG_AS_SHA256_NI=y

#
# General architecture-dependent options
#
CONFIG_CRASH_CORE=y
CONFIG_KEXEC_CORE=y
CONFIG_HOTPLUG_SMT=y
# CONFIG_OPROFILE is not set
CONFIG_HAVE_OPROFILE=y
CONFIG_OPROFILE_NMI_TIMER=y
CONFIG_KPROBES=y
CONFIG_JUMP_LABEL=y
# CONFIG_STATIC_KEYS_SELFTEST is not set
CONFIG_OPTPROBES=y
CONFIG_KPROBES_ON_FTRACE=y
CONFIG_UPROBES=y
CONFIG_HAVE_EFFICIENT_UNALIGNED_ACCESS=y
CONFIG_ARCH_USE_BUILTIN_BSWAP=y
CONFIG_KRETPROBES=y
CONFIG_USER_RETURN_NOTIFIER=y
CONFIG_HAVE_IOREMAP_PROT=y
CONFIG_HAVE_KPROBES=y
CONFIG_HAVE_KRETPROBES=y
CONFIG_HAVE_OPTPROBES=y
CONFIG_HAVE_KPROBES_ON_FTRACE=y
CONFIG_HAVE_FUNCTION_ERROR_INJECTION=y
CONFIG_HAVE_NMI=y
CONFIG_HAVE_ARCH_TRACEHOOK=y
CONFIG_HAVE_DMA_CONTIGUOUS=y
CONFIG_GENERIC_SMP_IDLE_THREAD=y
CONFIG_ARCH_HAS_FORTIFY_SOURCE=y
CONFIG_ARCH_HAS_SET_MEMORY=y
CONFIG_ARCH_HAS_SET_DIRECT_MAP=y
CONFIG_HAVE_ARCH_THREAD_STRUCT_WHITELIST=y
CONFIG_ARCH_WANTS_DYNAMIC_TASK_STRUCT=y
CONFIG_HAVE_ASM_MODVERSIONS=y
CONFIG_HAVE_REGS_AND_STACK_ACCESS_API=y
CONFIG_HAVE_RSEQ=y
CONFIG_HAVE_FUNCTION_ARG_ACCESS_API=y
CONFIG_HAVE_CLK=y
CONFIG_HAVE_HW_BREAKPOINT=y
CONFIG_HAVE_MIXED_BREAKPOINTS_REGS=y
CONFIG_HAVE_USER_RETURN_NOTIFIER=y
CONFIG_HAVE_PERF_EVENTS_NMI=y
CONFIG_HAVE_HARDLOCKUP_DETECTOR_PERF=y
CONFIG_HAVE_PERF_REGS=y
CONFIG_HAVE_PERF_USER_STACK_DUMP=y
CONFIG_HAVE_ARCH_JUMP_LABEL=y
CONFIG_HAVE_ARCH_JUMP_LABEL_RELATIVE=y
CONFIG_ARCH_HAVE_NMI_SAFE_CMPXCHG=y
CONFIG_HAVE_ALIGNED_STRUCT_PAGE=y
CONFIG_HAVE_CMPXCHG_LOCAL=y
CONFIG_HAVE_CMPXCHG_DOUBLE=y
CONFIG_ARCH_WANT_COMPAT_IPC_PARSE_VERSION=y
CONFIG_ARCH_WANT_OLD_COMPAT_IPC=y
CONFIG_HAVE_ARCH_SECCOMP_FILTER=y
CONFIG_SECCOMP_FILTER=y
CONFIG_HAVE_ARCH_STACKLEAK=y
CONFIG_HAVE_STACKPROTECTOR=y
CONFIG_CC_HAS_STACKPROTECTOR_NONE=y
CONFIG_STACKPROTECTOR=y
CONFIG_STACKPROTECTOR_STRONG=y
CONFIG_HAVE_ARCH_WITHIN_STACK_FRAMES=y
CONFIG_HAVE_CONTEXT_TRACKING=y
CONFIG_HAVE_VIRT_CPU_ACCOUNTING_GEN=y
CONFIG_HAVE_IRQ_TIME_ACCOUNTING=y
CONFIG_HAVE_MOVE_PMD=y
CONFIG_HAVE_ARCH_TRANSPARENT_HUGEPAGE=y
CONFIG_HAVE_ARCH_TRANSPARENT_HUGEPAGE_PUD=y
CONFIG_HAVE_ARCH_HUGE_VMAP=y
CONFIG_ARCH_WANT_HUGE_PMD_SHARE=y
CONFIG_HAVE_ARCH_SOFT_DIRTY=y
CONFIG_HAVE_MOD_ARCH_SPECIFIC=y
CONFIG_MODULES_USE_ELF_RELA=y
CONFIG_HAVE_IRQ_EXIT_ON_IRQ_STACK=y
CONFIG_ARCH_HAS_ELF_RANDOMIZE=y
CONFIG_HAVE_ARCH_MMAP_RND_BITS=y
CONFIG_HAVE_EXIT_THREAD=y
CONFIG_ARCH_MMAP_RND_BITS=28
CONFIG_HAVE_ARCH_MMAP_RND_COMPAT_BITS=y
CONFIG_ARCH_MMAP_RND_COMPAT_BITS=8
CONFIG_HAVE_ARCH_COMPAT_MMAP_BASES=y
CONFIG_HAVE_COPY_THREAD_TLS=y
CONFIG_HAVE_STACK_VALIDATION=y
CONFIG_HAVE_RELIABLE_STACKTRACE=y
CONFIG_ISA_BUS_API=y
CONFIG_OLD_SIGSUSPEND3=y
CONFIG_COMPAT_OLD_SIGACTION=y
CONFIG_COMPAT_32BIT_TIME=y
CONFIG_HAVE_ARCH_VMAP_STACK=y
CONFIG_VMAP_STACK=y
CONFIG_ARCH_HAS_STRICT_KERNEL_RWX=y
CONFIG_STRICT_KERNEL_RWX=y
CONFIG_ARCH_HAS_STRICT_MODULE_RWX=y
CONFIG_STRICT_MODULE_RWX=y
CONFIG_HAVE_ARCH_PREL32_RELOCATIONS=y
CONFIG_ARCH_USE_MEMREMAP_PROT=y
# CONFIG_LOCK_EVENT_COUNTS is not set
CONFIG_ARCH_HAS_MEM_ENCRYPT=y

#
# GCOV-based kernel profiling
#
# CONFIG_GCOV_KERNEL is not set
CONFIG_ARCH_HAS_GCOV_PROFILE_ALL=y

# end of GCOV-based kernel profiling

CONFIG_HAVE_GCC_PLUGINS=y

# end of General architecture-dependent options

CONFIG_RT_MUTEXES=y
CONFIG_BASE_SMALL=0
CONFIG_MODULES=y
# CONFIG_MODULE_FORCE_LOAD is not set CONFIG_MODULE_UNLOAD=y CONFIG_MODULE_FORCE_UNLOAD=y
CONFIG_MODVERSIONS=y
CONFIG_ASM_MODVERSIONS=y CONFIG_MODULE_SRCVERSION_ALL=y
# CONFIG_MODULE_SIG is not set
# CONFIG_MODULE_COMPRESS is not set
# CONFIG_MODULE_ALLOW_MISSING_NAMESPACE_IMPORTS is not set CONFIG_UNUSED_SYMBOLS=y CONFIG_MODULES_TREE_LOOKUP=y
CONFIG_BLOCK=y
CONFIG_BLK_SCSI_REQUEST=y
CONFIG_BLK_DEV_BSG=y
CONFIG_BLK_DEV_BSGLIB=y CONFIG_BLK_DEV_INTEGRITY=y CONFIG_BLK_DEV_INTEGRITY_T10=y CONFIG_BLK_DEV_ZONED=y CONFIG_BLK_CMDLINE_PARSER=y
CONFIG_BLK_WBT=y
CONFIG_BLK_WBT_MQ=y
CONFIG_BLK_DEBUG_FS=y
CONFIG_BLK_DEBUG_FS_ZONED=y
CONFIG_BLK_SED_OPAL=y
# CONFIG_BLK_INLINE_ENCRYPTION is not set

#
# Partition Types
#
CONFIG_PARTITION_ADVANCED=y
# CONFIG_ACORN_PARTITION is not set
# CONFIG_AIX_PARTITION is not set
# CONFIG_OSF_PARTITION is not set
# CONFIG_AMIGA_PARTITION is not set
# CONFIG_ATARI_PARTITION is not set
CONFIG_MAC_PARTITION=y
CONFIG_MSDOS_PARTITION=y
CONFIG_BSD_DISKLABEL=y
CONFIG_MINIX_SUBPARTITION=y
CONFIG_SOLARIS_X86_PARTITION=y
CONFIG_UNIXWARE_DISKLABEL=y
CONFIG_LDM_PARTITION=y
# CONFIG_LDM_DEBUG is not set
# CONFIG_SGI_PARTITION is not set
# CONFIG_ULTRIX_PARTITION is not set
# CONFIG_SUN_PARTITION is not set
# CONFIG_KARMA_PARTITION is not set
CONFIG_EFI_PARTITION=y
CONFIG_SYSV68_PARTITION=y
# CONFIG_CMDLINE_PARTITION is not set

# end of Partition Types

CONFIG_BLOCK_COMPAT=y
CONFIG_BLK_MQ_PCI=y
CONFIG_BLK_MQ_VIRTIO=y
CONFIG_BLK_PM=y

#
# IO Schedulers
#
CONFIG_MQ_IOSCHED_DEADLINE=y
CONFIG_MQ_IOSCHED_KYBER=m
CONFIG_IOSCHED_BFQ=m

# end of IO Schedulers

CONFIG_PREEMPT_NOTIFIERS=y
CONFIG_PADATA=y
CONFIG_ASN1=y
CONFIG_INLINE_SPIN_UNLOCK_IRQ=y
CONFIG_INLINE_READ_UNLOCK=y
CONFIG_INLINE_READ_UNLOCK_IRQ=y
CONFIG_INLINE_WRITE_UNLOCK=y
CONFIG_INLINE_WRITE_UNLOCK_IRQ=y
CONFIG_ARCH_SUPPORTS_ATOMIC_RMW=y
CONFIG_MUTEX_SPIN_ON_OWNER=y
CONFIG_RWSEM_SPIN_ON_OWNER=y
CONFIG_LOCK_SPIN_ON_OWNER=y
CONFIG_ARCH_USE_QUEUED_SPINLOCKS=y
CONFIG_QUEUED_SPINLOCKS=y
CONFIG_ARCH_USE_QUEUED_RWLOCKS=y
CONFIG_QUEUED_RWLOCKS=y
CONFIG_ARCH_HAS_NON_OVERLAPPING_ADDRESS_SPACE=y
CONFIG_ARCH_HAS_SYNC_CORE_BEFORE_USERMODE=y
CONFIG_ARCH_HAS_SYSCALL_WRAPPER=y
CONFIG_FREEZER=y

#
# Executable file formats
#
CONFIG_BINFMT_ELF=y
CONFIG_COMPAT_BINFMT_ELF=y
CONFIG_ELFCORE=y
CONFIG_CORE_DUMP_DEFAULT_ELF_HEADERS=y
CONFIG_BINFMT_SCRIPT=y
CONFIG_BINFMT_MISC=y
CONFIG_COREDUMP=y

# end of Executable file formats

#
# Memory Management options
#
CONFIG_SELECT_MEMORY_MODEL=y
CONFIG_SPARSEMEM_MANUAL=y
CONFIG_SPARSEMEM=y
CONFIG_NEED_MULTIPLE_NODES=y
CONFIG_HAVE_MEMORY_PRESENT=y
CONFIG_SPARSEMEM_EXTREME=y
CONFIG_SPARSEMEM_VMEMMAP_ENABLE=y
CONFIG_SPARSEMEM_VMEMMAP=y
CONFIG_HAVE_MEMBLOCK_NODE_MAP=y
CONFIG_HAVE_FAST_GUP=y
# CONFIG_MEMORY_HOTPLUG is not set
CONFIG_SPLIT_PTLOCK_CPUS=4
CONFIG_COMPACTION=y
# CONFIG_PAGE_REPORTING is not set
CONFIG_MIGRATION=y
CONFIG_PHYS_ADDR_T_64BIT=y
CONFIG_BOUNCE=y
CONFIG_VIRT_TO_BUS=y
CONFIG_MMU_NOTIFIER=y
CONFIG_KSM=y
CONFIG_DEFAULT_MMAP_MIN_ADDR=4096
CONFIG_ARCH_SUPPORTS_MEMORY_FAILURE=y
# CONFIG_MEMORY_FAILURE is not set
CONFIG_TRANSPARENT_HUGEPAGE=y
CONFIG_TRANSPARENT_HUGEPAGE_ALWAYS=y
# CONFIG_TRANSPARENT_HUGEPAGE_MADVISE is not set
CONFIG_ARCH_WANTS_THP_SWAP=y
CONFIG_THP_SWAP=y
# CONFIG_CLEANCACHE is not set
CONFIG_FRONTSWAP=y
# CONFIG_CMA is not set
# CONFIG_ZSWAP is not set
# CONFIG_ZPOOL is not set
# CONFIG_ZBUD is not set
# CONFIG_ZSMALLOC is not set
CONFIG_GENERIC_EARLY_IOREMAP=y
# CONFIG_DEFERRED_STRUCT_PAGE_INIT is not set
# CONFIG_IDLE_PAGE_TRACKING is not set
CONFIG_ARCH_HAS_PTE_DEVMAP=y
CONFIG_HMM_MIRROR=y
CONFIG_FRAME_VECTOR=y
CONFIG_ARCH_USES_HIGH_VMA_FLAGS=y
CONFIG_ARCH_HAS_PKEYS=y
# CONFIG_PERCPU_STATS is not set
# CONFIG_GUP_BENCHMARK is not set
CONFIG_READ_ONLY_THP_FOR_FS=y
CONFIG_ARCH_HAS_PTE_SPECIAL=y

# end of Memory Management options

CONFIG_NET=y
CONFIG_COMPAT_NETLINK_MESSAGES=y
CONFIG_NET_INGRESS=y
CONFIG_NET_EGRESS=y
CONFIG_NET_REDIRECT=y
CONFIG_SKB_EXTENSIONS=y

#
# Networking options
#
CONFIG_PACKET=y
CONFIG_PACKET_DIAG=y
CONFIG_UNIX=y
CONFIG_UNIX_SCM=y
CONFIG_UNIX_DIAG=y
# CONFIG_TLS is not set
CONFIG_XFRM=y
CONFIG_XFRM_OFFLOAD=y
CONFIG_XFRM_ALGO=y
CONFIG_XFRM_USER=y
# CONFIG_XFRM_INTERFACE is not set
CONFIG_XFRM_SUB_POLICY=y
CONFIG_XFRM_MIGRATE=y
CONFIG_XFRM_STATISTICS=y
CONFIG_XFRM_IPCOMP=y
CONFIG_NET_KEY=y
CONFIG_NET_KEY_MIGRATE=y
CONFIG_XDP_SOCKETS=y
CONFIG_XDP_SOCKETS_DIAG=y
CONFIG_INET=y
CONFIG_IP_MULTICAST=y
CONFIG_IP_ADVANCED_ROUTER=y
CONFIG_IP_FIB_TRIE_STATS=y
CONFIG_IP_MULTIPLE_TABLES=y
CONFIG_IP_ROUTE_MULTIPATH=y
CONFIG_IP_ROUTE_VERBOSE=y
CONFIG_IP_ROUTE_CLASSID=y
CONFIG_IP_PNP=y
CONFIG_IP_PNP_DHCP=y
CONFIG_IP_PNP_BOOTP=y
CONFIG_IP_PNP_RARP=y
CONFIG_NET_IPIP=y
CONFIG_NET_IPGRE_DEMUX=m
CONFIG_NET_IP_TUNNEL=y
CONFIG_NET_IPGRE=m
CONFIG_NET_IPGRE_BROADCAST=y
CONFIG_IP_MROUTE_COMMON=y
CONFIG_IP_MROUTE=y
CONFIG_IP_MROUTE_MULTIPLE_TABLES=y
CONFIG_IP_PIMSM_V1=y
CONFIG_IP_PIMSM_V2=y
CONFIG_SYN_COOKIES=y
CONFIG_NET_IPVTI=y
CONFIG_NET_UDP_TUNNEL=y
CONFIG_NET_FOU=y
CONFIG_NET_FOU_IP_TUNNELS=y
CONFIG_INET_AH=y
CONFIG_INET_ESP=y
CONFIG_INET_ESP_OFFLOAD=y
CONFIG_INET_ESPINTCP=y
CONFIG_INET_IPCOMP=y
CONFIG_INET_XFRM_TUNNEL=y
CONFIG_INET_TUNNEL=y
CONFIG_INET_DIAG=y
CONFIG_INET_TCP_DIAG=y
CONFIG_INET_UDP_DIAG=y
CONFIG_INET_RAW_DIAG=y
CONFIG_INET_DIAG_DESTROY=y
CONFIG_TCP_CONG_ADVANCED=y
CONFIG_TCP_CONG_BIC=y
CONFIG_TCP_CONG_CUBIC=y
CONFIG_TCP_CONG_WESTWOOD=y
CONFIG_TCP_CONG_HTCP=y
CONFIG_TCP_CONG_HSTCP=y
CONFIG_TCP_CONG_HYBLA=y
CONFIG_TCP_CONG_VEGAS=y
CONFIG_TCP_CONG_NV=y
CONFIG_TCP_CONG_SCALABLE=y
CONFIG_TCP_CONG_LP=y
CONFIG_TCP_CONG_VENO=y
CONFIG_TCP_CONG_YEAH=y
CONFIG_TCP_CONG_ILLINOIS=y
CONFIG_TCP_CONG_DCTCP=y
CONFIG_TCP_CONG_CDG=y
CONFIG_TCP_CONG_BBR=y
# CONFIG_DEFAULT_BIC is not set
CONFIG_DEFAULT_CUBIC=y
# CONFIG_DEFAULT_HTCP is not set
# CONFIG_DEFAULT_HYBLA is not set
# CONFIG_DEFAULT_VEGAS is not set
# CONFIG_DEFAULT_VENO is not set
# CONFIG_DEFAULT_WESTWOOD is not set
# CONFIG_DEFAULT_DCTCP is not set
# CONFIG_DEFAULT_CDG is not set
# CONFIG_DEFAULT_BBR is not set
# CONFIG_DEFAULT_RENO is not set
CONFIG_DEFAULT_TCP_CONG="cubic"
CONFIG_TCP_MD5SIG=y
CONFIG_IPV6=y
CONFIG_IPV6_ROUTER_PREF=y
CONFIG_IPV6_ROUTE_INFO=y
CONFIG_IPV6_OPTIMISTIC_DAD=y
CONFIG_INET6_AH=y
CONFIG_INET6_ESP=y
# CONFIG_INET6_ESP_OFFLOAD is not set
CONFIG_INET6_IPCOMP=y
CONFIG_IPV6_MIP6=y
CONFIG_IPV6_ILA=y
CONFIG_INET6_XFRM_TUNNEL=y
CONFIG_INET6_TUNNEL=y
CONFIG_IPV6_VTI=y
CONFIG_IPV6_SIT=y
CONFIG_IPV6_SIT_6RD=y
CONFIG_IPV6_NDISC_NODETYPE=y
CONFIG_IPV6_TUNNEL=y
# CONFIG_IPV6_GRE is not set
CONFIG_IPV6_FOU=y
CONFIG_IPV6_FOU_TUNNEL=y
CONFIG_IPV6_MULTIPLE_TABLES=y
CONFIG_IPV6_SUBTREES=y
CONFIG_IPV6_MROUTE=y
CONFIG_IPV6_MROUTE_MULTIPLE_TABLES=y
CONFIG_IPV6_PIMSM_V2=y
CONFIG_IPV6_SEG6_LWTUNNEL=y
CONFIG_IPV6_SEG6_HMAC=y
CONFIG_IPV6_SEG6_BPF=y
# CONFIG_IPV6_RPL_LWTUNNEL is not set
CONFIG_NETLABEL=y
CONFIG_MPTCP=y
CONFIG_MPTCP_IPV6=y
# CONFIG_MPTCP_HMAC_TEST is not set
CONFIG_NETWORK_SECMARK=y
CONFIG_NET_PTP_CLASSIFY=y
CONFIG_NETWORK_PHY_TIMESTAMPING=y
CONFIG_NETFILTER=y
CONFIG_NETFILTER_ADVANCED=y
CONFIG_BRIDGE_NETFILTER=y

#
# Core Netfilter Configuration
#
CONFIG_NETFILTER_INGRESS=y
CONFIG_NETFILTER_NETLINK=y
CONFIG_NETFILTER_FAMILY_BRIDGE=y
CONFIG_NETFILTER_FAMILY_ARP=y
CONFIG_NETFILTER_NETLINK_ACCT=y
CONFIG_NETFILTER_NETLINK_QUEUE=y
CONFIG_NETFILTER_NETLINK_LOG=y
CONFIG_NETFILTER_NETLINK_OSF=y
CONFIG_NF_CONNTRACK=y
CONFIG_NF_LOG_COMMON=y
# CONFIG_NF_LOG_NETDEV is not set
CONFIG_NETFILTER_CONNCOUNT=y
CONFIG_NF_CONNTRACK_MARK=y
CONFIG_NF_CONNTRACK_SECMARK=y
# CONFIG_NF_CONNTRACK_ZONES is not set
CONFIG_NF_CONNTRACK_PROCFS=y
CONFIG_NF_CONNTRACK_EVENTS=y
CONFIG_NF_CONNTRACK_TIMEOUT=y
CONFIG_NF_CONNTRACK_TIMESTAMP=y
CONFIG_NF_CONNTRACK_LABELS=y
# CONFIG_NF_CT_PROTO_DCCP is not set
CONFIG_NF_CT_PROTO_GRE=y
CONFIG_NF_CT_PROTO_SCTP=y
CONFIG_NF_CT_PROTO_UDPLITE=y
# CONFIG_NF_CONNTRACK_AMANDA is not set
CONFIG_NF_CONNTRACK_FTP=y
# CONFIG_NF_CONNTRACK_H323 is not set
# CONFIG_NF_CONNTRACK_IRC is not set
CONFIG_NF_CONNTRACK_BROADCAST=y
# CONFIG_NF_CONNTRACK_NETBIOS_NS is not set
CONFIG_NF_CONNTRACK_SNMP=y
CONFIG_NF_CONNTRACK_PPTP=y
CONFIG_NF_CONNTRACK_SANE=y
CONFIG_NF_CONNTRACK_SIP=y
CONFIG_NF_CONNTRACK_TFTP=y
CONFIG_NF_CT_NETLINK=y
# CONFIG_NF_CT_NETLINK_TIMEOUT is not set
# CONFIG_NETFILTER_NETLINK_GLUE_CT is not set
CONFIG_NF_NAT=y
CONFIG_NF_NAT_FTP=y
CONFIG_NF_NAT_SIP=y
CONFIG_NF_NAT_TFTP=y
CONFIG_NF_NAT_REDIRECT=y
CONFIG_NF_NAT_MASQUERADE=y
CONFIG_NETFILTER_SYNPROXY=y
CONFIG_NF_TABLES=y
CONFIG_NF_TABLES_INET=y
# CONFIG_NF_TABLES_NETDEV is not set
# CONFIG_NFT_NUMGEN is not set
CONFIG_NFT_CT=y
CONFIG_NFT_COUNTER=y
CONFIG_NFT_CONNLIMIT=y
CONFIG_NFT_LOG=y
CONFIG_NFT_LIMIT=y
# CONFIG_NFT_MASQ is not set
# CONFIG_NFT_REDIR is not set
CONFIG_NFT_NAT=y
# CONFIG_NFT_TUNNEL is not set
# CONFIG_NFT_OBJREF is not set
CONFIG_NFT_QUEUE=y
# CONFIG_NFT_QUOTA is not set
CONFIG_NFT_REJECT=y
CONFIG_NFT_REJECT_INET=y
CONFIG_NFT_COMPAT=y
CONFIG_NFT_HASH=y
CONFIG_NFT_FIB=y
# CONFIG_NFT_FIB_INET is not set
# CONFIG_NFT_XFRM is not set
CONFIG_NFT_SOCKET=y
# CONFIG_NFT_OSF is not set
# CONFIG_NFT_TPROXY is not set
CONFIG_NFT_SYNPROXY=y
# CONFIG_NF_FLOW_TABLE is not set
CONFIG_NETFILTER_XTABLES=y

#
# Xtables combined modules
#
CONFIG_NETFILTER_XT_MARK=y
CONFIG_NETFILTER_XT_CONNMARK=y
CONFIG_NETFILTER_XT_SET=y

#
# Xtables targets
#
CONFIG_NETFILTER_XT_TARGET_AUDIT=y
CONFIG_NETFILTER_XT_TARGET_CHECKSUM=y
CONFIG_NETFILTER_XT_TARGET_CLASSIFY=y
CONFIG_NETFILTER_XT_TARGET_CONNMARK=y
CONFIG_NETFILTER_XT_TARGET_CONNSECMARK=y
CONFIG_NETFILTER_XT_TARGET_CT=y
CONFIG_NETFILTER_XT_TARGET_DSCP=y
CONFIG_NETFILTER_XT_TARGET_HL=y
CONFIG_NETFILTER_XT_TARGET_HMARK=y
CONFIG_NETFILTER_XT_TARGET_IDLETIMER=y
CONFIG_NETFILTER_XT_TARGET_LED=y
CONFIG_NETFILTER_XT_TARGET_LOG=y
CONFIG_NETFILTER_XT_TARGET_MARK=y
CONFIG_NETFILTER_XT_NAT=y
CONFIG_NETFILTER_XT_TARGET_NETMAP=y
CONFIG_NETFILTER_XT_TARGET_NFLOG=y
CONFIG_NETFILTER_XT_TARGET_NFQUEUE=y
# CONFIG_NETFILTER_XT_TARGET_NOTRACK is not set
CONFIG_NETFILTER_XT_TARGET_RATEEST=y
CONFIG_NETFILTER_XT_TARGET_REDIRECT=y
CONFIG_NETFILTER_XT_TARGET_MASQUERADE=y
CONFIG_NETFILTER_XT_TARGET_TEE=y
CONFIG_NETFILTER_XT_TARGET_TPROXY=y
CONFIG_NETFILTER_XT_TARGET_TRACE=y
CONFIG_NETFILTER_XT_TARGET_SECMARK=y
CONFIG_NETFILTER_XT_TARGET_TCPMSS=y
CONFIG_NETFILTER_XT_TARGET_TCPOPTSTRIP=y

#
# Xtables matches
#
CONFIG_NETFILTER_XT_MATCH_ADDRTYPE=y
CONFIG_NETFILTER_XT_MATCH_BPF=y
CONFIG_NETFILTER_XT_MATCH_CGROUP=y
CONFIG_NETFILTER_XT_MATCH_CLUSTER=y
CONFIG_NETFILTER_XT_MATCH_COMMENT=y
CONFIG_NETFILTER_XT_MATCH_CONNBYTES=y
CONFIG_NETFILTER_XT_MATCH_CONNLABEL=y
CONFIG_NETFILTER_XT_MATCH_CONNLIMIT=y
CONFIG_NETFILTER_XT_MATCH_CONNMARK=y
CONFIG_NETFILTER_XT_MATCH_CONNTRACK=y
CONFIG_NETFILTER_XT_MATCH_CPU=y
CONFIG_NETFILTER_XT_MATCH_DCCP=y
CONFIG_NETFILTER_XT_MATCH_DEVGROUP=y
CONFIG_NETFILTER_XT_MATCH_DSCP=y
CONFIG_NETFILTER_XT_MATCH_ECN=y
CONFIG_NETFILTER_XT_MATCH_ESP=y
CONFIG_NETFILTER_XT_MATCH_HASHLIMIT=y
CONFIG_NETFILTER_XT_MATCH_HELPER=y
CONFIG_NETFILTER_XT_MATCH_HL=y
# CONFIG_NETFILTER_XT_MATCH_IPCOMP is not set
CONFIG_NETFILTER_XT_MATCH_IPRANGE=y
CONFIG_NETFILTER_XT_MATCH_L2TP=y
CONFIG_NETFILTER_XT_MATCH_LENGTH=y
CONFIG_NETFILTER_XT_MATCH_LIMIT=y
CONFIG_NETFILTER_XT_MATCH_MAC=y
CONFIG_NETFILTER_XT_MATCH_MARK=y
CONFIG_NETFILTER_XT_MATCH_MULTIPORT=y
CONFIG_NETFILTER_XT_MATCH_NFACCT=y
CONFIG_NETFILTER_XT_MATCH_OSF=y
CONFIG_NETFILTER_XT_MATCH_OWNER=y
CONFIG_NETFILTER_XT_MATCH_POLICY=y
CONFIG_NETFILTER_XT_MATCH_PHYSDEV=y
CONFIG_NETFILTER_XT_MATCH_PKTTYPE=y
CONFIG_NETFILTER_XT_MATCH_QUOTA=y
CONFIG_NETFILTER_XT_MATCH_RATEEST=y
CONFIG_NETFILTER_XT_MATCH_REALM=y
CONFIG_NETFILTER_XT_MATCH_RECENT=y
CONFIG_NETFILTER_XT_MATCH_SCTP=y
CONFIG_NETFILTER_XT_MATCH_SOCKET=y
CONFIG_NETFILTER_XT_MATCH_STATE=y
CONFIG_NETFILTER_XT_MATCH_STATISTIC=y
CONFIG_NETFILTER_XT_MATCH_STRING=y
CONFIG_NETFILTER_XT_MATCH_TCPMSS=y
CONFIG_NETFILTER_XT_MATCH_TIME=y
CONFIG_NETFILTER_XT_MATCH_U32=y

# end of Core Netfilter Configuration

CONFIG_IP_SET=y
CONFIG_IP_SET_MAX=256
CONFIG_IP_SET_BITMAP_IP=y
CONFIG_IP_SET_BITMAP_IPMAC=y
CONFIG_IP_SET_BITMAP_PORT=y
CONFIG_IP_SET_HASH_IP=y
CONFIG_IP_SET_HASH_IPMARK=y
CONFIG_IP_SET_HASH_IPPORT=y
CONFIG_IP_SET_HASH_IPPORTIP=y
CONFIG_IP_SET_HASH_IPPORTNET=y
# CONFIG_IP_SET_HASH_IPMAC is not set
# CONFIG_IP_SET_HASH_MAC is not set
CONFIG_IP_SET_HASH_NETPORTNET=y
CONFIG_IP_SET_HASH_NET=y
CONFIG_IP_SET_HASH_NETNET=y
CONFIG_IP_SET_HASH_NETPORT=y
CONFIG_IP_SET_HASH_NETIFACE=y
CONFIG_IP_SET_LIST_SET=y
# CONFIG_IP_VS is not set

#
# IP: Netfilter Configuration
#
CONFIG_NF_DEFRAG_IPV4=y
CONFIG_NF_SOCKET_IPV4=y
CONFIG_NF_TPROXY_IPV4=y
CONFIG_NF_TABLES_IPV4=y
CONFIG_NFT_REJECT_IPV4=y
CONFIG_NFT_DUP_IPV4=y
CONFIG_NFT_FIB_IPV4=y
CONFIG_NF_TABLES_ARP=y
CONFIG_NF_DUP_IPV4=y
CONFIG_NF_LOG_ARP=y
CONFIG_NF_LOG_IPV4=y
CONFIG_NF_REJECT_IPV4=y
CONFIG_NF_NAT_SNMP_BASIC=y
CONFIG_NF_NAT_PPTP=y
CONFIG_IP_NF_IPTABLES=y
CONFIG_IP_NF_MATCH_AH=y
CONFIG_IP_NF_MATCH_ECN=y
CONFIG_IP_NF_MATCH_RPFILTER=y
CONFIG_IP_NF_MATCH_TTL=y
CONFIG_IP_NF_FILTER=y
CONFIG_IP_NF_TARGET_REJECT=y
CONFIG_IP_NF_TARGET_SYNPROXY=y
CONFIG_IP_NF_NAT=y
CONFIG_IP_NF_TARGET_MASQUERADE=y
CONFIG_IP_NF_TARGET_NETMAP=y
CONFIG_IP_NF_TARGET_REDIRECT=y
CONFIG_IP_NF_MANGLE=y
CONFIG_IP_NF_TARGET_CLUSTERIP=y
CONFIG_IP_NF_TARGET_ECN=y
CONFIG_IP_NF_TARGET_TTL=y
CONFIG_IP_NF_RAW=y
CONFIG_IP_NF_SECURITY=y
CONFIG_IP_NF_ARPTABLES=y
CONFIG_IP_NF_ARPFILTER=y
CONFIG_IP_NF_ARP_MANGLE=y

# end of IP: Netfilter Configuration

#
# IPv6: Netfilter Configuration
#
CONFIG_NF_SOCKET_IPV6=y
CONFIG_NF_TPROXY_IPV6=y
CONFIG_NF_TABLES_IPV6=y
CONFIG_NFT_REJECT_IPV6=y
CONFIG_NFT_DUP_IPV6=y
CONFIG_NFT_FIB_IPV6=y
CONFIG_NF_DUP_IPV6=y
CONFIG_NF_REJECT_IPV6=y
CONFIG_NF_LOG_IPV6=y
CONFIG_IP6_NF_IPTABLES=y
CONFIG_IP6_NF_MATCH_AH=y
CONFIG_IP6_NF_MATCH_EUI64=y
CONFIG_IP6_NF_MATCH_FRAG=y
CONFIG_IP6_NF_MATCH_OPTS=y
CONFIG_IP6_NF_MATCH_HL=y
CONFIG_IP6_NF_MATCH_IPV6HEADER=y
CONFIG_IP6_NF_MATCH_MH=y
CONFIG_IP6_NF_MATCH_RPFILTER=y
CONFIG_IP6_NF_MATCH_RT=y
CONFIG_IP6_NF_MATCH_SRH=y
CONFIG_IP6_NF_TARGET_HL=y
CONFIG_IP6_NF_FILTER=y
CONFIG_IP6_NF_TARGET_REJECT=y
CONFIG_IP6_NF_TARGET_SYNPROXY=y
CONFIG_IP6_NF_MANGLE=y
CONFIG_IP6_NF_RAW=y
CONFIG_IP6_NF_SECURITY=y
CONFIG_IP6_NF_NAT=y
CONFIG_IP6_NF_TARGET_MASQUERADE=y
CONFIG_IP6_NF_TARGET_NPT=y

# end of IPv6: Netfilter Configuration

CONFIG_NF_DEFRAG_IPV6=y
CONFIG_NF_TABLES_BRIDGE=y
CONFIG_NFT_BRIDGE_META=y
CONFIG_NFT_BRIDGE_REJECT=y
CONFIG_NF_LOG_BRIDGE=y
CONFIG_NF_CONNTRACK_BRIDGE=y
CONFIG_BRIDGE_NF_EBTABLES=y
CONFIG_BRIDGE_EBT_BROUTE=y
CONFIG_BRIDGE_EBT_T_FILTER=y
CONFIG_BRIDGE_EBT_T_NAT=y
CONFIG_BRIDGE_EBT_802_3=y
CONFIG_BRIDGE_EBT_AMONG=y
CONFIG_BRIDGE_EBT_ARP=y
CONFIG_BRIDGE_EBT_IP=y
CONFIG_BRIDGE_EBT_IP6=y
CONFIG_BRIDGE_EBT_LIMIT=y
CONFIG_BRIDGE_EBT_MARK=y
CONFIG_BRIDGE_EBT_PKTTYPE=y
CONFIG_BRIDGE_EBT_STP=y
CONFIG_BRIDGE_EBT_VLAN=y
CONFIG_BRIDGE_EBT_ARPREPLY=y
CONFIG_BRIDGE_EBT_DNAT=y
CONFIG_BRIDGE_EBT_MARK_T=y
CONFIG_BRIDGE_EBT_REDIRECT=y
CONFIG_BRIDGE_EBT_SNAT=y
CONFIG_BRIDGE_EBT_LOG=y
CONFIG_BRIDGE_EBT_NFLOG=y
CONFIG_BPFILTER=y
CONFIG_BPFILTER_UMH=y
# CONFIG_IP_DCCP is not set
CONFIG_IP_SCTP=y
# CONFIG_SCTP_DBG_OBJCNT is not set
CONFIG_SCTP_DEFAULT_COOKIE_HMAC_MD5=y
# CONFIG_SCTP_DEFAULT_COOKIE_HMAC_SHA1 is not set
# CONFIG_SCTP_DEFAULT_COOKIE_HMAC_NONE is not set
CONFIG_SCTP_COOKIE_HMAC_MD5=y
CONFIG_SCTP_COOKIE_HMAC_SHA1=y
CONFIG_INET_SCTP_DIAG=y
# CONFIG_RDS is not set
# CONFIG_TIPC is not set
# CONFIG_ATM is not set
# CONFIG_L2TP is not set
CONFIG_STP=y
CONFIG_GARP=y
CONFIG_MRP=y
CONFIG_BRIDGE=y
CONFIG_BRIDGE_IGMP_SNOOPING=y
CONFIG_BRIDGE_VLAN_FILTERING=y
CONFIG_HAVE_NET_DSA=y
# CONFIG_NET_DSA is not set
CONFIG_VLAN_8021Q=y
CONFIG_VLAN_8021Q_GVRP=y
CONFIG_VLAN_8021Q_MVRP=y
# CONFIG_DECNET is not set
CONFIG_LLC=y
# CONFIG_LLC2 is not set
# CONFIG_ATALK is not set
# CONFIG_X25 is not set
# CONFIG_LAPB is not set
# CONFIG_PHONET is not set
# CONFIG_6LOWPAN is not set
# CONFIG_IEEE802154 is not set
CONFIG_NET_SCHED=y

#
# Queueing/Scheduling
#
CONFIG_NET_SCH_CBQ=y
CONFIG_NET_SCH_HTB=y
CONFIG_NET_SCH_HFSC=y
CONFIG_NET_SCH_PRIO=y
CONFIG_NET_SCH_MULTIQ=y
CONFIG_NET_SCH_RED=y
CONFIG_NET_SCH_SFB=y
CONFIG_NET_SCH_SFQ=y
CONFIG_NET_SCH_TEQL=y
CONFIG_NET_SCH_TBF=y
CONFIG_NET_SCH_CBS=y
CONFIG_NET_SCH_ETF=y
CONFIG_NET_SCH_TAPRIO=y
CONFIG_NET_SCH_GRED=y
CONFIG_NET_SCH_DSMARK=y
CONFIG_NET_SCH_NETEM=y
CONFIG_NET_SCH_DRR=y
CONFIG_NET_SCH_MQPRIO=y
CONFIG_NET_SCH_SKBPRIO=y
CONFIG_NET_SCH_CHOKE=y
CONFIG_NET_SCH_QFQ=y
CONFIG_NET_SCH_CODEL=y
CONFIG_NET_SCH_FQ_CODEL=y
CONFIG_NET_SCH_CAKE=y
CONFIG_NET_SCH_FQ=y
CONFIG_NET_SCH_HHF=y
CONFIG_NET_SCH_PIE=y
CONFIG_NET_SCH_FQ_PIE=y
CONFIG_NET_SCH_INGRESS=y
# CONFIG_NET_SCH_PLUG is not set
CONFIG_NET_SCH_ETS=m
# CONFIG_NET_SCH_DEFAULT is not set

#
# Classification
#
CONFIG_NET_CLS=y
CONFIG_NET_CLS_BASIC=y
CONFIG_NET_CLS_TCINDEX=y
CONFIG_NET_CLS_ROUTE4=y
CONFIG_NET_CLS_FW=y
CONFIG_NET_CLS_U32=y
CONFIG_CLS_U32_PERF=y
CONFIG_CLS_U32_MARK=y
CONFIG_NET_CLS_RSVP=y
CONFIG_NET_CLS_RSVP6=y
CONFIG_NET_CLS_FLOW=y
CONFIG_NET_CLS_CGROUP=y
CONFIG_NET_CLS_BPF=y
CONFIG_NET_CLS_FLOWER=y
CONFIG_NET_CLS_MATCHALL=y
CONFIG_NET_EMATCH=y
CONFIG_NET_EMATCH_STACK=32
CONFIG_NET_EMATCH_CMP=y
CONFIG_NET_EMATCH_NBYTE=y
CONFIG_NET_EMATCH_U32=y
CONFIG_NET_EMATCH_META=y
CONFIG_NET_EMATCH_TEXT=y
CONFIG_NET_EMATCH_IPSET=y
CONFIG_NET_EMATCH_IPT=y
CONFIG_NET_CLS_ACT=y
CONFIG_NET_ACT_POLICE=y
CONFIG_NET_ACT_GACT=y
CONFIG_GACT_PROB=y
CONFIG_NET_ACT_MIRRED=y
CONFIG_NET_ACT_SAMPLE=y
CONFIG_NET_ACT_IPT=y
CONFIG_NET_ACT_NAT=y
CONFIG_NET_ACT_PEDIT=y
CONFIG_NET_ACT_SIMP=y
CONFIG_NET_ACT_SKBEDIT=y
CONFIG_NET_ACT_CSUM=y
CONFIG_NET_ACT_MPLS=y
CONFIG_NET_ACT_VLAN=y
CONFIG_NET_ACT_BPF=y
CONFIG_NET_ACT_CONNMARK=y
CONFIG_NET_ACT_CTINFO=y
CONFIG_NET_ACT_SKBMOD=y
CONFIG_NET_ACT_IFE=y
CONFIG_NET_ACT_TUNNEL_KEY=y
CONFIG_NET_IFE_SKBMARK=y
CONFIG_NET_IFE_SKBPRIO=y
CONFIG_NET_IFE_SKBTCINDEX=y
# CONFIG_NET_TC_SKB_EXT is not set
CONFIG_NET_SCH_FIFO=y
CONFIG_DCB=y
CONFIG_DNS_RESOLVER=y
# CONFIG_BATMAN_ADV is not set
# CONFIG_OPENVSWITCH is not set
CONFIG_VSOCKETS=y
CONFIG_VSOCKETS_DIAG=y
CONFIG_VSOCKETS_LOOPBACK=m
CONFIG_VIRTIO_VSOCKETS=y
CONFIG_VIRTIO_VSOCKETS_COMMON=y
CONFIG_NETLINK_DIAG=y
# CONFIG_MPLS is not set
# CONFIG_NET_NSH is not set
# CONFIG_HSR is not set
# CONFIG_NET_SWITCHDEV is not set
CONFIG_NET_L3_MASTER_DEV=y
# CONFIG_NET_NCSI is not set
CONFIG_RPS=y
CONFIG_RFS_ACCEL=y
CONFIG_XPS=y
CONFIG_CGROUP_NET_PRIO=y
CONFIG_CGROUP_NET_CLASSID=y
CONFIG_NET_RX_BUSY_POLL=y
CONFIG_BQL=y
CONFIG_BPF_JIT=y
CONFIG_BPF_STREAM_PARSER=y
CONFIG_NET_FLOW_LIMIT=y

#
# Network testing
#
# CONFIG_NET_PKTGEN is not set
# CONFIG_NET_DROP_MONITOR is not set

# end of Network testing
# end of Networking options

# CONFIG_HAMRADIO is not set
# CONFIG_CAN is not set
CONFIG_BT=y
CONFIG_BT_BREDR=y
CONFIG_BT_RFCOMM=y
CONFIG_BT_RFCOMM_TTY=y
CONFIG_BT_BNEP=y
CONFIG_BT_BNEP_MC_FILTER=y
CONFIG_BT_BNEP_PROTO_FILTER=y
CONFIG_BT_HIDP=y
CONFIG_BT_HS=y
CONFIG_BT_LE=y
CONFIG_BT_LEDS=y
# CONFIG_BT_SELFTEST is not set
CONFIG_BT_DEBUGFS=y

#
# Bluetooth device drivers
#
CONFIG_BT_INTEL=m
CONFIG_BT_BCM=m
CONFIG_BT_RTL=m
CONFIG_BT_QCA=m
CONFIG_BT_HCIBTUSB=m
CONFIG_BT_HCIBTUSB_AUTOSUSPEND=y
CONFIG_BT_HCIBTUSB_BCM=y
CONFIG_BT_HCIBTUSB_MTK=y
CONFIG_BT_HCIBTUSB_RTL=y
CONFIG_BT_HCIBTSDIO=m
CONFIG_BT_HCIUART=m
CONFIG_BT_HCIUART_SERDEV=y
CONFIG_BT_HCIUART_H4=y
CONFIG_BT_HCIUART_NOKIA=m
CONFIG_BT_HCIUART_BCSP=y
CONFIG_BT_HCIUART_ATH3K=y
CONFIG_BT_HCIUART_LL=y
CONFIG_BT_HCIUART_3WIRE=y
CONFIG_BT_HCIUART_INTEL=y
CONFIG_BT_HCIUART_BCM=y
CONFIG_BT_HCIUART_RTL=y
CONFIG_BT_HCIUART_QCA=y
CONFIG_BT_HCIUART_AG6XX=y
CONFIG_BT_HCIUART_MRVL=y
CONFIG_BT_HCIBCM203X=m
CONFIG_BT_HCIBPA10X=m
CONFIG_BT_HCIBFUSB=m
CONFIG_BT_HCIDTL1=m
CONFIG_BT_HCIBT3C=m
CONFIG_BT_HCIBLUECARD=m
CONFIG_BT_HCIVHCI=m
CONFIG_BT_MRVL=m
CONFIG_BT_MRVL_SDIO=m
CONFIG_BT_ATH3K=m
CONFIG_BT_MTKSDIO=m
CONFIG_BT_MTKUART=m

# end of Bluetooth device drivers

# CONFIG_AF_RXRPC is not set
# CONFIG_AF_KCM is not set
CONFIG_STREAM_PARSER=y
CONFIG_FIB_RULES=y
CONFIG_WIRELESS=y
CONFIG_WIRELESS_EXT=y
CONFIG_WEXT_CORE=y
CONFIG_WEXT_PROC=y
CONFIG_WEXT_SPY=y
CONFIG_WEXT_PRIV=y
CONFIG_CFG80211=y
# CONFIG_NL80211_TESTMODE is not set
# CONFIG_CFG80211_DEVELOPER_WARNINGS is not set
CONFIG_CFG80211_REQUIRE_SIGNED_REGDB=y
CONFIG_CFG80211_USE_KERNEL_REGDB_KEYS=y
CONFIG_CFG80211_DEFAULT_PS=y
CONFIG_CFG80211_DEBUGFS=y
CONFIG_CFG80211_CRDA_SUPPORT=y
CONFIG_CFG80211_WEXT=y
CONFIG_CFG80211_WEXT_EXPORT=y
CONFIG_LIB80211=m
CONFIG_LIB80211_CRYPT_WEP=m
CONFIG_LIB80211_CRYPT_CCMP=m
CONFIG_LIB80211_CRYPT_TKIP=m
# CONFIG_LIB80211_DEBUG is not set
CONFIG_MAC80211=y
CONFIG_MAC80211_HAS_RC=y
CONFIG_MAC80211_RC_MINSTREL=y
CONFIG_MAC80211_RC_DEFAULT_MINSTREL=y
CONFIG_MAC80211_RC_DEFAULT="minstrel_ht"
CONFIG_MAC80211_MESH=y
CONFIG_MAC80211_LEDS=y
CONFIG_MAC80211_DEBUGFS=y
# CONFIG_MAC80211_MESSAGE_TRACING is not set
# CONFIG_MAC80211_DEBUG_MENU is not set
CONFIG_MAC80211_STA_HASH_MAX_SIZE=0
# CONFIG_WIMAX is not set
CONFIG_RFKILL=y
CONFIG_RFKILL_LEDS=y
CONFIG_RFKILL_INPUT=y
# CONFIG_RFKILL_GPIO is not set
# CONFIG_NET_9P is not set
# CONFIG_CAIF is not set
# CONFIG_CEPH_LIB is not set
# CONFIG_NFC is not set
CONFIG_PSAMPLE=y
CONFIG_NET_IFE=y
CONFIG_LWTUNNEL=y
CONFIG_LWTUNNEL_BPF=y
CONFIG_DST_CACHE=y
CONFIG_GRO_CELLS=y
CONFIG_NET_SOCK_MSG=y
CONFIG_FAILOVER=y
CONFIG_ETHTOOL_NETLINK=y
CONFIG_HAVE_EBPF_JIT=y

#
# Device Drivers
#
CONFIG_HAVE_EISA=y
# CONFIG_EISA is not set
CONFIG_HAVE_PCI=y
CONFIG_PCI=y
CONFIG_PCI_DOMAINS=y
CONFIG_PCIEPORTBUS=y
CONFIG_HOTPLUG_PCI_PCIE=y
CONFIG_PCIEAER=y
# CONFIG_PCIEAER_INJECT is not set
# CONFIG_PCIE_ECRC is not set
CONFIG_PCIEASPM=y
CONFIG_PCIEASPM_DEFAULT=y
# CONFIG_PCIEASPM_POWERSAVE is not set
# CONFIG_PCIEASPM_POWER_SUPERSAVE is not set
# CONFIG_PCIEASPM_PERFORMANCE is not set
CONFIG_PCIE_PME=y
CONFIG_PCIE_DPC=y
CONFIG_PCIE_PTM=y
CONFIG_PCIE_BW=y
# CONFIG_PCIE_EDR is not set
CONFIG_PCI_MSI=y
CONFIG_PCI_MSI_IRQ_DOMAIN=y
CONFIG_PCI_QUIRKS=y
# CONFIG_PCI_DEBUG is not set
CONFIG_PCI_REALLOC_ENABLE_AUTO=y
# CONFIG_PCI_STUB is not set
# CONFIG_PCI_PF_STUB is not set
CONFIG_PCI_ATS=y
CONFIG_PCI_LOCKLESS_CONFIG=y
CONFIG_PCI_IOV=y
CONFIG_PCI_PRI=y
CONFIG_PCI_PASID=y
CONFIG_PCI_LABEL=y
CONFIG_HOTPLUG_PCI=y
CONFIG_HOTPLUG_PCI_ACPI=y
# CONFIG_HOTPLUG_PCI_ACPI_IBM is not set
CONFIG_HOTPLUG_PCI_CPCI=y
CONFIG_HOTPLUG_PCI_CPCI_ZT5550=m
CONFIG_HOTPLUG_PCI_CPCI_GENERIC=m
CONFIG_HOTPLUG_PCI_SHPC=y

#
# PCI controller drivers
#
CONFIG_VMD=y

#
# DesignWare PCI Core Support
#
CONFIG_PCIE_DW=y
CONFIG_PCIE_DW_HOST=y
CONFIG_PCIE_DW_PLAT=y
CONFIG_PCIE_DW_PLAT_HOST=y
CONFIG_PCI_MESON=y

# end of DesignWare PCI Core Support

#
# Mobiveil PCIe Core Support
#

# end of Mobiveil PCIe Core Support

#
# Cadence PCIe controllers support
#

# end of Cadence PCIe controllers support
# end of PCI controller drivers

#
# PCI Endpoint
#
# CONFIG_PCI_ENDPOINT is not set

# end of PCI Endpoint

#
# PCI switch controller drivers
#
CONFIG_PCI_SW_SWITCHTEC=m

# end of PCI switch controller drivers

CONFIG_PCCARD=m
CONFIG_PCMCIA=m
CONFIG_PCMCIA_LOAD_CIS=y
CONFIG_CARDBUS=y

#
# PC-card bridges
#
CONFIG_YENTA=m
CONFIG_YENTA_O2=y
CONFIG_YENTA_RICOH=y
CONFIG_YENTA_TI=y
CONFIG_YENTA_ENE_TUNE=y
CONFIG_YENTA_TOSHIBA=y
CONFIG_PD6729=m
CONFIG_I82092=m
CONFIG_PCCARD_NONSTATIC=y
# CONFIG_RAPIDIO is not set

#
# Generic Driver Options
#
CONFIG_UEVENT_HELPER=y
CONFIG_UEVENT_HELPER_PATH="/sbin/hotplug"
CONFIG_DEVTMPFS=y
CONFIG_DEVTMPFS_MOUNT=y
# CONFIG_STANDALONE is not set
CONFIG_PREVENT_FIRMWARE_BUILD=y

#
# Firmware loader
#
CONFIG_FW_LOADER=y CONFIG_FW_LOADER_PAGED_BUF=y CONFIG_EXTRA_FIRMWARE="" CONFIG_FW_LOADER_USER_HELPER=y
# CONFIG_FW_LOADER_USER_HELPER_FALLBACK is not set CONFIG_FW_LOADER_COMPRESS=y CONFIG_FW_CACHE=y

# end of Firmware loader

CONFIG_WANT_DEV_COREDUMP=y
CONFIG_ALLOW_DEV_COREDUMP=y
CONFIG_DEV_COREDUMP=y
# CONFIG_DEBUG_DRIVER is not set
# CONFIG_DEBUG_DEVRES is not set
# CONFIG_DEBUG_TEST_DRIVER_REMOVE is not set
CONFIG_HMEM_REPORTING=y
# CONFIG_TEST_ASYNC_DRIVER_PROBE is not set
CONFIG_GENERIC_CPU_AUTOPROBE=y
CONFIG_GENERIC_CPU_VULNERABILITIES=y
CONFIG_REGMAP=y
CONFIG_REGMAP_I2C=m
CONFIG_REGMAP_SPI=m
CONFIG_REGMAP_W1=m
CONFIG_REGMAP_MMIO=y
CONFIG_REGMAP_IRQ=y
CONFIG_DMA_SHARED_BUFFER=y
# CONFIG_DMA_FENCE_TRACE is not set

# end of Generic Driver Options

#
# Bus devices
#
# CONFIG_MHI_BUS is not set

# end of Bus devices

CONFIG_CONNECTOR=m
# CONFIG_GNSS is not set
CONFIG_MTD=m
# CONFIG_MTD_TESTS is not set

#
# Partition parsers
#
# CONFIG_MTD_AR7_PARTS is not set
# CONFIG_MTD_CMDLINE_PARTS is not set
# CONFIG_MTD_REDBOOT_PARTS is not set

# end of Partition parsers

#
# User Modules And Translation Layers
#
CONFIG_MTD_BLKDEVS=m
CONFIG_MTD_BLOCK=m
CONFIG_MTD_BLOCK_RO=m
CONFIG_FTL=m
CONFIG_NFTL=m
CONFIG_NFTL_RW=y
CONFIG_INFTL=m
CONFIG_RFD_FTL=m
# CONFIG_SSFDC is not set
# CONFIG_SM_FTL is not set
CONFIG_MTD_OOPS=m
# CONFIG_MTD_SWAP is not set
# CONFIG_MTD_PARTITIONED_MASTER is not set

#
# RAM/ROM/Flash chip drivers
#
CONFIG_MTD_CFI=m
CONFIG_MTD_JEDECPROBE=m
CONFIG_MTD_GEN_PROBE=m
# CONFIG_MTD_CFI_ADV_OPTIONS is not set
CONFIG_MTD_MAP_BANK_WIDTH_1=y
CONFIG_MTD_MAP_BANK_WIDTH_2=y
CONFIG_MTD_MAP_BANK_WIDTH_4=y
CONFIG_MTD_CFI_I1=y
CONFIG_MTD_CFI_I2=y
CONFIG_MTD_CFI_INTELEXT=m
CONFIG_MTD_CFI_AMDSTD=m
CONFIG_MTD_CFI_STAA=m
CONFIG_MTD_CFI_UTIL=m
CONFIG_MTD_RAM=m
CONFIG_MTD_ROM=m
# CONFIG_MTD_ABSENT is not set

# end of RAM/ROM/Flash chip drivers

#
# Mapping drivers for chip access
#
CONFIG_MTD_COMPLEX_MAPPINGS=y
CONFIG_MTD_PHYSMAP=m
# CONFIG_MTD_PHYSMAP_COMPAT is not set
# CONFIG_MTD_PHYSMAP_GPIO_ADDR is not set
# CONFIG_MTD_SBC_GXX is not set
# CONFIG_MTD_AMD76XROM is not set
# CONFIG_MTD_ICHXROM is not set
# CONFIG_MTD_ESB2ROM is not set
# CONFIG_MTD_CK804XROM is not set
# CONFIG_MTD_SCB2_FLASH is not set
# CONFIG_MTD_NETtel is not set
# CONFIG_MTD_L440GX is not set
CONFIG_MTD_PCI=m
CONFIG_MTD_PCMCIA=m
# CONFIG_MTD_PCMCIA_ANONYMOUS is not set
CONFIG_MTD_INTEL_VR_NOR=m
CONFIG_MTD_PLATRAM=m

# end of Mapping drivers for chip access

#
# Self-contained MTD device drivers
#
# CONFIG_MTD_PMC551 is not set
# CONFIG_MTD_DATAFLASH is not set
# CONFIG_MTD_MCHP23K256 is not set
CONFIG_MTD_SST25L=m
CONFIG_MTD_SLRAM=m
CONFIG_MTD_PHRAM=m
# CONFIG_MTD_MTDRAM is not set
CONFIG_MTD_BLOCK2MTD=m

#
# Disk-On-Chip Device Drivers
#
# CONFIG_MTD_DOCG3 is not set

# end of Self-contained MTD device drivers

CONFIG_MTD_NAND_CORE=m
# CONFIG_MTD_ONENAND is not set
CONFIG_MTD_NAND_ECC_SW_HAMMING=m
# CONFIG_MTD_NAND_ECC_SW_HAMMING_SMC is not set
CONFIG_MTD_RAW_NAND=m
# CONFIG_MTD_NAND_ECC_SW_BCH is not set

#
# Raw/parallel NAND flash controllers
#
# CONFIG_MTD_NAND_DENALI_PCI is not set
# CONFIG_MTD_NAND_CAFE is not set
# CONFIG_MTD_NAND_MXIC is not set
# CONFIG_MTD_NAND_GPIO is not set
# CONFIG_MTD_NAND_PLATFORM is not set

#
# Misc
#
# CONFIG_MTD_NAND_NANDSIM is not set
# CONFIG_MTD_NAND_RICOH is not set
# CONFIG_MTD_NAND_DISKONCHIP is not set
# CONFIG_MTD_SPI_NAND is not set

#
# LPDDR & LPDDR2 PCM memory drivers
#
CONFIG_MTD_LPDDR=m
CONFIG_MTD_QINFO_PROBE=m

# end of LPDDR & LPDDR2 PCM memory drivers

CONFIG_MTD_SPI_NOR=m
CONFIG_MTD_SPI_NOR_USE_4K_SECTORS=y
# CONFIG_SPI_INTEL_SPI_PCI is not set
# CONFIG_SPI_INTEL_SPI_PLATFORM is not set
# CONFIG_MTD_UBI is not set
# CONFIG_MTD_HYPERBUS is not set
# CONFIG_OF is not set
CONFIG_ARCH_MIGHT_HAVE_PC_PARPORT=y
# CONFIG_PARPORT is not set
CONFIG_PNP=y
# CONFIG_PNP_DEBUG_MESSAGES is not set

#
# Protocols
#
CONFIG_PNPACPI=y
CONFIG_BLK_DEV=y
# CONFIG_BLK_DEV_NULL_BLK is not set
# CONFIG_BLK_DEV_FD is not set
CONFIG_CDROM=y
# CONFIG_BLK_DEV_PCIESSD_MTIP32XX is not set
# CONFIG_BLK_DEV_UMEM is not set
CONFIG_BLK_DEV_LOOP=m
CONFIG_BLK_DEV_LOOP_MIN_COUNT=8
CONFIG_BLK_DEV_CRYPTOLOOP=m
# CONFIG_BLK_DEV_DRBD is not set
CONFIG_BLK_DEV_NBD=m
# CONFIG_BLK_DEV_SKD is not set
# CONFIG_BLK_DEV_SX8 is not set
# CONFIG_BLK_DEV_RAM is not set
CONFIG_CDROM_PKTCDVD=m
CONFIG_CDROM_PKTCDVD_BUFFERS=8
# CONFIG_CDROM_PKTCDVD_WCACHE is not set
# CONFIG_ATA_OVER_ETH is not set
CONFIG_VIRTIO_BLK=m
# CONFIG_BLK_DEV_RBD is not set
# CONFIG_BLK_DEV_RSXX is not set

#
# NVME Support
#
CONFIG_NVME_CORE=y
CONFIG_BLK_DEV_NVME=y
CONFIG_NVME_MULTIPATH=y
CONFIG_NVME_HWMON=y
CONFIG_NVME_FABRICS=m
CONFIG_NVME_FC=m
CONFIG_NVME_TCP=m
CONFIG_NVME_TARGET=m
CONFIG_NVME_TARGET_LOOP=m
CONFIG_NVME_TARGET_FC=m
CONFIG_NVME_TARGET_FCLOOP=m
CONFIG_NVME_TARGET_TCP=m

# end of NVME Support

#
# Misc devices
#
# CONFIG_AD525X_DPOT is not set
# CONFIG_DUMMY_IRQ is not set
# CONFIG_IBM_ASM is not set
# CONFIG_PHANTOM is not set
CONFIG_TIFM_CORE=m
CONFIG_TIFM_7XX1=m
# CONFIG_ICS932S401 is not set
CONFIG_ENCLOSURE_SERVICES=m
# CONFIG_HP_ILO is not set
# CONFIG_APDS9802ALS is not set
# CONFIG_ISL29003 is not set
# CONFIG_ISL29020 is not set
# CONFIG_SENSORS_TSL2550 is not set
# CONFIG_SENSORS_BH1770 is not set
# CONFIG_SENSORS_APDS990X is not set
# CONFIG_HMC6352 is not set
# CONFIG_DS1682 is not set
# CONFIG_LATTICE_ECP3_CONFIG is not set
# CONFIG_SRAM is not set
# CONFIG_PCI_ENDPOINT_TEST is not set
# CONFIG_XILINX_SDFEC is not set
CONFIG_MISC_RTSX=m
CONFIG_PVPANIC=m
# CONFIG_C2PORT is not set

#
# EEPROM support
#
CONFIG_EEPROM_AT24=m
CONFIG_EEPROM_AT25=m
# CONFIG_EEPROM_LEGACY is not set
CONFIG_EEPROM_MAX6875=m
CONFIG_EEPROM_93CX6=m
CONFIG_EEPROM_93XX46=m
CONFIG_EEPROM_IDT_89HPESX=m
CONFIG_EEPROM_EE1004=m

# end of EEPROM support

CONFIG_CB710_CORE=m
# CONFIG_CB710_DEBUG is not set
CONFIG_CB710_DEBUG_ASSUMPTIONS=y

#
# Texas Instruments shared transport line discipline #
# CONFIG_TI_ST is not set

# end of Texas Instruments shared transport line discipline

# CONFIG_SENSORS_LIS3_I2C is not set
# CONFIG_ALTERA_STAPL is not set
CONFIG_INTEL_MEI=m
CONFIG_INTEL_MEI_ME=m
CONFIG_INTEL_MEI_TXE=m
CONFIG_INTEL_MEI_HDCP=m
# CONFIG_VMWARE_VMCI is not set

#
# Intel MIC & related support
#
CONFIG_INTEL_MIC_BUS=m
CONFIG_SCIF_BUS=m
CONFIG_VOP_BUS=m
CONFIG_INTEL_MIC_HOST=m
CONFIG_INTEL_MIC_CARD=m
CONFIG_SCIF=m
CONFIG_MIC_COSM=m
CONFIG_VOP=m

# end of Intel MIC & related support

# CONFIG_GENWQE is not set
# CONFIG_ECHO is not set
# CONFIG_MISC_ALCOR_PCI is not set
CONFIG_MISC_RTSX_PCI=m
CONFIG_MISC_RTSX_USB=m
# CONFIG_HABANA_AI is not set
# CONFIG_UACCE is not set

# end of Misc devices

CONFIG_HAVE_IDE=y
# CONFIG_IDE is not set

#
# SCSI device support
#
CONFIG_SCSI_MOD=y
CONFIG_RAID_ATTRS=y
CONFIG_SCSI=y
CONFIG_SCSI_DMA=y
CONFIG_SCSI_NETLINK=y
CONFIG_SCSI_PROC_FS=y

#
# SCSI support type (disk, tape, CD-ROM)
#
CONFIG_BLK_DEV_SD=y
# CONFIG_CHR_DEV_ST is not set
CONFIG_BLK_DEV_SR=y
CONFIG_CHR_DEV_SG=y
CONFIG_CHR_DEV_SCH=m
CONFIG_SCSI_ENCLOSURE=m
CONFIG_SCSI_CONSTANTS=y
CONFIG_SCSI_LOGGING=y
CONFIG_SCSI_SCAN_ASYNC=y

#
# SCSI Transports
#
CONFIG_SCSI_SPI_ATTRS=y
CONFIG_SCSI_FC_ATTRS=m
CONFIG_SCSI_ISCSI_ATTRS=m
CONFIG_SCSI_SAS_ATTRS=m
CONFIG_SCSI_SAS_LIBSAS=m
CONFIG_SCSI_SAS_ATA=y
CONFIG_SCSI_SAS_HOST_SMP=y
CONFIG_SCSI_SRP_ATTRS=m

# end of SCSI Transports

CONFIG_SCSI_LOWLEVEL=y
# CONFIG_ISCSI_TCP is not set
# CONFIG_ISCSI_BOOT_SYSFS is not set
# CONFIG_SCSI_CXGB3_ISCSI is not set
# CONFIG_SCSI_CXGB4_ISCSI is not set
# CONFIG_SCSI_BNX2_ISCSI is not set
# CONFIG_BE2ISCSI is not set
# CONFIG_BLK_DEV_3W_XXXX_RAID is not set
# CONFIG_SCSI_HPSA is not set
# CONFIG_SCSI_3W_9XXX is not set
# CONFIG_SCSI_3W_SAS is not set
# CONFIG_SCSI_ACARD is not set
# CONFIG_SCSI_AACRAID is not set
# CONFIG_SCSI_AIC7XXX is not set
# CONFIG_SCSI_AIC79XX is not set
# CONFIG_SCSI_AIC94XX is not set
# CONFIG_SCSI_MVSAS is not set
# CONFIG_SCSI_MVUMI is not set
# CONFIG_SCSI_DPT_I2O is not set
# CONFIG_SCSI_ADVANSYS is not set
# CONFIG_SCSI_ARCMSR is not set
# CONFIG_SCSI_ESAS2R is not set
# CONFIG_MEGARAID_NEWGEN is not set
# CONFIG_MEGARAID_LEGACY is not set
# CONFIG_MEGARAID_SAS is not set
# CONFIG_SCSI_MPT3SAS is not set
# CONFIG_SCSI_MPT2SAS is not set
# CONFIG_SCSI_SMARTPQI is not set
# CONFIG_SCSI_UFSHCD is not set
# CONFIG_SCSI_HPTIOP is not set
# CONFIG_SCSI_BUSLOGIC is not set
# CONFIG_SCSI_MYRB is not set
# CONFIG_SCSI_MYRS is not set
# CONFIG_VMWARE_PVSCSI is not set
# CONFIG_LIBFC is not set
# CONFIG_SCSI_SNIC is not set
# CONFIG_SCSI_DMX3191D is not set
CONFIG_SCSI_FDOMAIN=m
# CONFIG_SCSI_FDOMAIN_PCI is not set
CONFIG_SCSI_GDTH=m
CONFIG_SCSI_ISCI=m
# CONFIG_SCSI_IPS is not set
# CONFIG_SCSI_INITIO is not set
# CONFIG_SCSI_INIA100 is not set
# CONFIG_SCSI_STEX is not set
# CONFIG_SCSI_SYM53C8XX_2 is not set
# CONFIG_SCSI_IPR is not set
# CONFIG_SCSI_QLOGIC_1280 is not set
# CONFIG_SCSI_QLA_FC is not set
# CONFIG_SCSI_QLA_ISCSI is not set
# CONFIG_SCSI_LPFC is not set
# CONFIG_SCSI_DC395x is not set
# CONFIG_SCSI_AM53C974 is not set
# CONFIG_SCSI_WD719X is not set
# CONFIG_SCSI_DEBUG is not set
# CONFIG_SCSI_PMCRAID is not set
# CONFIG_SCSI_PM8001 is not set
# CONFIG_SCSI_BFA_FC is not set
CONFIG_SCSI_VIRTIO=m
# CONFIG_SCSI_CHELSIO_FCOE is not set
CONFIG_SCSI_LOWLEVEL_PCMCIA=y
CONFIG_PCMCIA_AHA152X=m
CONFIG_PCMCIA_FDOMAIN=m
CONFIG_PCMCIA_QLOGIC=m
CONFIG_PCMCIA_SYM53C500=m
CONFIG_SCSI_DH=y
# CONFIG_SCSI_DH_RDAC is not set
# CONFIG_SCSI_DH_HP_SW is not set
# CONFIG_SCSI_DH_EMC is not set
# CONFIG_SCSI_DH_ALUA is not set

# end of SCSI device support

CONFIG_ATA=y
CONFIG_SATA_HOST=y
CONFIG_PATA_TIMINGS=y
CONFIG_ATA_VERBOSE_ERROR=y
CONFIG_ATA_FORCE=y
CONFIG_ATA_ACPI=y
CONFIG_SATA_ZPODD=y
CONFIG_SATA_PMP=y

#
# Controllers with non-SFF native interface #
CONFIG_SATA_AHCI=y CONFIG_SATA_MOBILE_LPM_POLICY=0
# CONFIG_SATA_AHCI_PLATFORM is not set
# CONFIG_SATA_INIC162X is not set
# CONFIG_SATA_ACARD_AHCI is not set
# CONFIG_SATA_SIL24 is not set
# CONFIG_ATA_SFF is not set
CONFIG_MD=y
CONFIG_BLK_DEV_MD=y
# CONFIG_MD_AUTODETECT is not set CONFIG_MD_LINEAR=y
CONFIG_MD_RAID0=y
CONFIG_MD_RAID1=y
CONFIG_MD_RAID10=y
CONFIG_MD_RAID456=y
CONFIG_MD_MULTIPATH=y
CONFIG_MD_FAULTY=y
CONFIG_BCACHE=m
# CONFIG_BCACHE_DEBUG is not set
# CONFIG_BCACHE_CLOSURES_DEBUG is not set CONFIG_BLK_DEV_DM_BUILTIN=y CONFIG_BLK_DEV_DM=y
# CONFIG_DM_DEBUG is not set CONFIG_DM_BUFIO=m
# CONFIG_DM_DEBUG_BLOCK_MANAGER_LOCKING is not set CONFIG_DM_BIO_PRISON=m CONFIG_DM_PERSISTENT_DATA=m CONFIG_DM_UNSTRIPED=y
CONFIG_DM_CRYPT=y
CONFIG_DM_SNAPSHOT=m CONFIG_DM_THIN_PROVISIONING=m CONFIG_DM_CACHE=m
CONFIG_DM_CACHE_SMQ=m CONFIG_DM_WRITECACHE=m
CONFIG_DM_ERA=m
CONFIG_DM_CLONE=m
CONFIG_DM_MIRROR=m CONFIG_DM_LOG_USERSPACE=m
CONFIG_DM_RAID=m
CONFIG_DM_ZERO=m
CONFIG_DM_MULTIPATH=m CONFIG_DM_MULTIPATH_QL=m CONFIG_DM_MULTIPATH_ST=m
CONFIG_DM_DELAY=m
CONFIG_DM_DUST=m
CONFIG_DM_INIT=y
CONFIG_DM_UEVENT=y
CONFIG_DM_FLAKEY=m
CONFIG_DM_VERITY=m CONFIG_DM_VERITY_VERIFY_ROOTHASH_SIG=y CONFIG_DM_VERITY_FEC=y
CONFIG_DM_SWITCH=m
CONFIG_DM_LOG_WRITES=m CONFIG_DM_INTEGRITY=m
CONFIG_DM_ZONED=m
CONFIG_TARGET_CORE=m
CONFIG_TCM_IBLOCK=m
CONFIG_TCM_FILEIO=m
CONFIG_TCM_PSCSI=m CONFIG_LOOPBACK_TARGET=m CONFIG_ISCSI_TARGET=m
# CONFIG_FUSION is not set

#
# IEEE 1394 (FireWire) support
#
# CONFIG_FIREWIRE is not set
# CONFIG_FIREWIRE_NOSY is not set

# end of IEEE 1394 (FireWire) support

# CONFIG_MACINTOSH_DRIVERS is not set
CONFIG_NETDEVICES=y
CONFIG_MII=m
CONFIG_NET_CORE=y
CONFIG_BONDING=m
CONFIG_DUMMY=m
CONFIG_WIREGUARD=m
# CONFIG_WIREGUARD_DEBUG is not set
# CONFIG_EQUALIZER is not set
# CONFIG_NET_FC is not set
CONFIG_IFB=y
CONFIG_NET_TEAM=m
CONFIG_NET_TEAM_MODE_BROADCAST=m
CONFIG_NET_TEAM_MODE_ROUNDROBIN=m
CONFIG_NET_TEAM_MODE_RANDOM=m
CONFIG_NET_TEAM_MODE_ACTIVEBACKUP=m
CONFIG_NET_TEAM_MODE_LOADBALANCE=m
CONFIG_MACVLAN=y
CONFIG_MACVTAP=y
CONFIG_IPVLAN_L3S=y
CONFIG_IPVLAN=y
CONFIG_IPVTAP=y
# CONFIG_VXLAN is not set
CONFIG_GENEVE=m
# CONFIG_BAREUDP is not set
CONFIG_GTP=m
CONFIG_MACSEC=m
CONFIG_NETCONSOLE=y
CONFIG_NETCONSOLE_DYNAMIC=y
CONFIG_NETPOLL=y
CONFIG_NET_POLL_CONTROLLER=y
CONFIG_TUN=y
CONFIG_TAP=y
# CONFIG_TUN_VNET_CROSS_LE is not set
CONFIG_VETH=y
CONFIG_VIRTIO_NET=y
CONFIG_NLMON=y
# CONFIG_NET_VRF is not set
# CONFIG_VSOCKMON is not set
# CONFIG_ARCNET is not set

#
# Distributed Switch Architecture drivers
#

# end of Distributed Switch Architecture drivers

CONFIG_ETHERNET=y
CONFIG_MDIO=m
# CONFIG_NET_VENDOR_3COM is not set
# CONFIG_NET_VENDOR_ADAPTEC is not set
# CONFIG_NET_VENDOR_AGERE is not set
# CONFIG_NET_VENDOR_ALACRITECH is not set
# CONFIG_NET_VENDOR_ALTEON is not set
# CONFIG_ALTERA_TSE is not set
# CONFIG_NET_VENDOR_AMAZON is not set
# CONFIG_NET_VENDOR_AMD is not set
CONFIG_NET_VENDOR_AQUANTIA=y
CONFIG_AQTION=m
# CONFIG_NET_VENDOR_ARC is not set
# CONFIG_NET_VENDOR_ATHEROS is not set
# CONFIG_NET_VENDOR_AURORA is not set
# CONFIG_NET_VENDOR_BROADCOM is not set
# CONFIG_NET_VENDOR_BROCADE is not set
# CONFIG_NET_VENDOR_CADENCE is not set
# CONFIG_NET_VENDOR_CAVIUM is not set
# CONFIG_NET_VENDOR_CHELSIO is not set
# CONFIG_NET_VENDOR_CISCO is not set
# CONFIG_NET_VENDOR_CORTINA is not set
# CONFIG_CX_ECAT is not set
# CONFIG_DNET is not set
# CONFIG_NET_VENDOR_DEC is not set
# CONFIG_NET_VENDOR_DLINK is not set
# CONFIG_NET_VENDOR_EMULEX is not set
# CONFIG_NET_VENDOR_EZCHIP is not set
# CONFIG_NET_VENDOR_FUJITSU is not set
# CONFIG_NET_VENDOR_GOOGLE is not set
# CONFIG_NET_VENDOR_HUAWEI is not set
CONFIG_NET_VENDOR_I825XX=y
CONFIG_NET_VENDOR_INTEL=y
# CONFIG_E100 is not set
CONFIG_E1000=m
CONFIG_E1000E=m
CONFIG_E1000E_HWTS=y
CONFIG_IGB=m
CONFIG_IGB_HWMON=y
CONFIG_IGB_DCA=y
CONFIG_IGBVF=m
CONFIG_IXGB=m
CONFIG_IXGBE=m
CONFIG_IXGBE_HWMON=y
CONFIG_IXGBE_DCA=y
CONFIG_IXGBE_DCB=y
CONFIG_IXGBE_IPSEC=y
CONFIG_IXGBEVF=m
CONFIG_IXGBEVF_IPSEC=y
CONFIG_I40E=m
CONFIG_I40E_DCB=y
CONFIG_IAVF=m
CONFIG_I40EVF=m
# CONFIG_ICE is not set
# CONFIG_FM10K is not set
# CONFIG_IGC is not set
# CONFIG_JME is not set
# CONFIG_NET_VENDOR_MARVELL is not set
# CONFIG_NET_VENDOR_MELLANOX is not set
# CONFIG_NET_VENDOR_MICREL is not set
# CONFIG_NET_VENDOR_MICROCHIP is not set
# CONFIG_NET_VENDOR_MICROSEMI is not set
# CONFIG_NET_VENDOR_MYRI is not set
# CONFIG_FEALNX is not set
# CONFIG_NET_VENDOR_NATSEMI is not set
# CONFIG_NET_VENDOR_NETERION is not set
# CONFIG_NET_VENDOR_NETRONOME is not set
# CONFIG_NET_VENDOR_NI is not set
# CONFIG_NET_VENDOR_NVIDIA is not set
# CONFIG_NET_VENDOR_OKI is not set
# CONFIG_ETHOC is not set
# CONFIG_NET_VENDOR_PACKET_ENGINES is not set
# CONFIG_NET_VENDOR_PENSANDO is not set
# CONFIG_NET_VENDOR_QLOGIC is not set
# CONFIG_NET_VENDOR_QUALCOMM is not set
# CONFIG_NET_VENDOR_RDC is not set
# CONFIG_NET_VENDOR_REALTEK is not set
# CONFIG_NET_VENDOR_RENESAS is not set
# CONFIG_NET_VENDOR_ROCKER is not set
# CONFIG_NET_VENDOR_SAMSUNG is not set
# CONFIG_NET_VENDOR_SEEQ is not set
# CONFIG_NET_VENDOR_SOLARFLARE is not set
# CONFIG_NET_VENDOR_SILAN is not set
# CONFIG_NET_VENDOR_SIS is not set
# CONFIG_NET_VENDOR_SMSC is not set
# CONFIG_NET_VENDOR_SOCIONEXT is not set
# CONFIG_NET_VENDOR_STMICRO is not set
# CONFIG_NET_VENDOR_SUN is not set
# CONFIG_NET_VENDOR_SYNOPSYS is not set
# CONFIG_NET_VENDOR_TEHUTI is not set
# CONFIG_NET_VENDOR_TI is not set
# CONFIG_NET_VENDOR_VIA is not set
# CONFIG_NET_VENDOR_WIZNET is not set
# CONFIG_NET_VENDOR_XILINX is not set
# CONFIG_NET_VENDOR_XIRCOM is not set
# CONFIG_FDDI is not set
# CONFIG_HIPPI is not set
# CONFIG_NET_SB1000 is not set
CONFIG_MDIO_DEVICE=y
CONFIG_MDIO_BUS=y
# CONFIG_MDIO_BCM_UNIMAC is not set
# CONFIG_MDIO_BITBANG is not set
# CONFIG_MDIO_MSCC_MIIM is not set
# CONFIG_MDIO_MVUSB is not set
# CONFIG_MDIO_THUNDER is not set
# CONFIG_MDIO_XPCS is not set
CONFIG_PHYLIB=y
CONFIG_SWPHY=y
CONFIG_LED_TRIGGER_PHY=y

#
# MII PHY device drivers
#
# CONFIG_ADIN_PHY is not set
# CONFIG_AMD_PHY is not set
# CONFIG_AQUANTIA_PHY is not set
# CONFIG_AX88796B_PHY is not set
# CONFIG_BCM7XXX_PHY is not set
# CONFIG_BCM87XX_PHY is not set
# CONFIG_BROADCOM_PHY is not set
# CONFIG_BCM84881_PHY is not set
# CONFIG_CICADA_PHY is not set
# CONFIG_CORTINA_PHY is not set
# CONFIG_DAVICOM_PHY is not set
# CONFIG_DP83822_PHY is not set
# CONFIG_DP83TC811_PHY is not set
# CONFIG_DP83848_PHY is not set
# CONFIG_DP83867_PHY is not set
# CONFIG_DP83869_PHY is not set
CONFIG_FIXED_PHY=m
# CONFIG_ICPLUS_PHY is not set
# CONFIG_INTEL_XWAY_PHY is not set
# CONFIG_LSI_ET1011C_PHY is not set
# CONFIG_LXT_PHY is not set
# CONFIG_MARVELL_PHY is not set
# CONFIG_MARVELL_10G_PHY is not set
# CONFIG_MICREL_PHY is not set
CONFIG_MICROCHIP_PHY=m
# CONFIG_MICROCHIP_T1_PHY is not set
# CONFIG_MICROSEMI_PHY is not set
# CONFIG_NATIONAL_PHY is not set
# CONFIG_NXP_TJA11XX_PHY is not set
# CONFIG_AT803X_PHY is not set
# CONFIG_QSEMI_PHY is not set
# CONFIG_REALTEK_PHY is not set
# CONFIG_RENESAS_PHY is not set
# CONFIG_ROCKCHIP_PHY is not set
# CONFIG_SMSC_PHY is not set
# CONFIG_STE10XP is not set
# CONFIG_TERANETICS_PHY is not set
# CONFIG_VITESSE_PHY is not set
# CONFIG_XILINX_GMII2RGMII is not set
# CONFIG_MICREL_KS8995MA is not set
CONFIG_PPP=m
CONFIG_PPP_BSDCOMP=m
CONFIG_PPP_DEFLATE=m
CONFIG_PPP_FILTER=y
CONFIG_PPP_MPPE=m
CONFIG_PPP_MULTILINK=y
CONFIG_PPPOE=m
CONFIG_PPTP=m
CONFIG_PPP_ASYNC=m
CONFIG_PPP_SYNC_TTY=m
# CONFIG_SLIP is not set
CONFIG_SLHC=m
CONFIG_USB_NET_DRIVERS=m
CONFIG_USB_CATC=m
CONFIG_USB_KAWETH=m
CONFIG_USB_PEGASUS=m
CONFIG_USB_RTL8150=m
CONFIG_USB_RTL8152=m
CONFIG_USB_LAN78XX=m
CONFIG_USB_USBNET=m
CONFIG_USB_NET_AX8817X=m
CONFIG_USB_NET_AX88179_178A=m
CONFIG_USB_NET_CDCETHER=m
CONFIG_USB_NET_CDC_EEM=m
CONFIG_USB_NET_CDC_NCM=m
CONFIG_USB_NET_HUAWEI_CDC_NCM=m
CONFIG_USB_NET_CDC_MBIM=m
CONFIG_USB_NET_DM9601=m
CONFIG_USB_NET_SR9700=m
CONFIG_USB_NET_SR9800=m
CONFIG_USB_NET_SMSC75XX=m
CONFIG_USB_NET_SMSC95XX=m
CONFIG_USB_NET_GL620A=m
CONFIG_USB_NET_NET1080=m
CONFIG_USB_NET_PLUSB=m
CONFIG_USB_NET_MCS7830=m
CONFIG_USB_NET_RNDIS_HOST=m
CONFIG_USB_NET_CDC_SUBSET_ENABLE=m
CONFIG_USB_NET_CDC_SUBSET=m
CONFIG_USB_ALI_M5632=y
CONFIG_USB_AN2720=y
CONFIG_USB_BELKIN=y
CONFIG_USB_ARMLINUX=y
CONFIG_USB_EPSON2888=y
CONFIG_USB_KC2190=y
CONFIG_USB_NET_ZAURUS=m
CONFIG_USB_NET_CX82310_ETH=m
CONFIG_USB_NET_KALMIA=m
CONFIG_USB_NET_QMI_WWAN=m
CONFIG_USB_HSO=m
CONFIG_USB_NET_INT51X1=m
CONFIG_USB_IPHETH=m
CONFIG_USB_SIERRA_NET=m
CONFIG_USB_VL600=m
CONFIG_USB_NET_CH9200=m
CONFIG_USB_NET_AQC111=m
CONFIG_WLAN=y
# CONFIG_WLAN_VENDOR_ADMTEK is not set
# CONFIG_WLAN_VENDOR_ATH is not set
# CONFIG_WLAN_VENDOR_ATMEL is not set
# CONFIG_WLAN_VENDOR_BROADCOM is not set
# CONFIG_WLAN_VENDOR_CISCO is not set
CONFIG_WLAN_VENDOR_INTEL=y
CONFIG_IPW2100=m
CONFIG_IPW2100_MONITOR=y
CONFIG_IPW2100_DEBUG=y
CONFIG_IPW2200=m
CONFIG_IPW2200_MONITOR=y
CONFIG_IPW2200_RADIOTAP=y
CONFIG_IPW2200_PROMISCUOUS=y
CONFIG_IPW2200_QOS=y
# CONFIG_IPW2200_DEBUG is not set
CONFIG_LIBIPW=m
# CONFIG_LIBIPW_DEBUG is not set
CONFIG_IWLEGACY=m
CONFIG_IWL4965=m
CONFIG_IWL3945=m

#

# iwl3945 / iwl4965 Debugging Options
#
# CONFIG_IWLEGACY_DEBUG is not set
CONFIG_IWLEGACY_DEBUGFS=y
# end of iwl3945 / iwl4965 Debugging Options

CONFIG_IWLWIFI=m
CONFIG_IWLWIFI_LEDS=y
CONFIG_IWLDVM=m
CONFIG_IWLMVM=m
CONFIG_IWLWIFI_OPMODE_MODULAR=y
# CONFIG_IWLWIFI_BCAST_FILTERING is not set

#
# Debugging Options
#
# CONFIG_IWLWIFI_DEBUG is not set
CONFIG_IWLWIFI_DEBUGFS=y
# CONFIG_IWLWIFI_DEVICE_TRACING is not set

# end of Debugging Options

# CONFIG_WLAN_VENDOR_INTERSIL is not set
# CONFIG_WLAN_VENDOR_MARVELL is not set
# CONFIG_WLAN_VENDOR_MEDIATEK is not set
# CONFIG_WLAN_VENDOR_RALINK is not set
# CONFIG_WLAN_VENDOR_REALTEK is not set
# CONFIG_WLAN_VENDOR_RSI is not set
# CONFIG_WLAN_VENDOR_ST is not set
# CONFIG_WLAN_VENDOR_TI is not set
# CONFIG_WLAN_VENDOR_ZYDAS is not set
# CONFIG_WLAN_VENDOR_QUANTENNA is not set
# CONFIG_PCMCIA_RAYCS is not set
# CONFIG_PCMCIA_WL3501 is not set
# CONFIG_MAC80211_HWSIM is not set
CONFIG_USB_NET_RNDIS_WLAN=m
# CONFIG_VIRT_WIFI is not set

#
# Enable WiMAX (Networking options) to see the WiMAX drivers #
# CONFIG_WAN is not set
# CONFIG_VMXNET3 is not set
# CONFIG_FUJITSU_ES is not set
CONFIG_USB4_NET=m
# CONFIG_NETDEVSIM is not set CONFIG_NET_FAILOVER=y
# CONFIG_ISDN is not set
# CONFIG_NVM is not set

#
# Input device support
#
CONFIG_INPUT=y
CONFIG_INPUT_LEDS=y
CONFIG_INPUT_FF_MEMLESS=y
CONFIG_INPUT_POLLDEV=y
CONFIG_INPUT_SPARSEKMAP=y
# CONFIG_INPUT_MATRIXKMAP is not set

#
# Userland interfaces
#
CONFIG_INPUT_MOUSEDEV=y
CONFIG_INPUT_MOUSEDEV_PSAUX=y
CONFIG_INPUT_MOUSEDEV_SCREEN_X=1024
CONFIG_INPUT_MOUSEDEV_SCREEN_Y=768
CONFIG_INPUT_JOYDEV=y
CONFIG_INPUT_EVDEV=y
# CONFIG_INPUT_EVBUG is not set

#
# Input Device Drivers
#
CONFIG_INPUT_KEYBOARD=y
# CONFIG_KEYBOARD_ADC is not set
# CONFIG_KEYBOARD_ADP5588 is not set
# CONFIG_KEYBOARD_ADP5589 is not set
# CONFIG_KEYBOARD_APPLESPI is not set
CONFIG_KEYBOARD_ATKBD=y
# CONFIG_KEYBOARD_QT1050 is not set
# CONFIG_KEYBOARD_QT1070 is not set
# CONFIG_KEYBOARD_QT2160 is not set
# CONFIG_KEYBOARD_DLINK_DIR685 is not set
# CONFIG_KEYBOARD_LKKBD is not set
# CONFIG_KEYBOARD_GPIO is not set
# CONFIG_KEYBOARD_GPIO_POLLED is not set
# CONFIG_KEYBOARD_TCA6416 is not set
# CONFIG_KEYBOARD_TCA8418 is not set
# CONFIG_KEYBOARD_MATRIX is not set
# CONFIG_KEYBOARD_LM8323 is not set
# CONFIG_KEYBOARD_LM8333 is not set
# CONFIG_KEYBOARD_MAX7359 is not set
# CONFIG_KEYBOARD_MCS is not set
# CONFIG_KEYBOARD_MPR121 is not set
# CONFIG_KEYBOARD_NEWTON is not set
# CONFIG_KEYBOARD_OPENCORES is not set
# CONFIG_KEYBOARD_SAMSUNG is not set
# CONFIG_KEYBOARD_STOWAWAY is not set
# CONFIG_KEYBOARD_SUNKBD is not set
# CONFIG_KEYBOARD_TM2_TOUCHKEY is not set
# CONFIG_KEYBOARD_XTKBD is not set
CONFIG_INPUT_MOUSE=y
CONFIG_MOUSE_PS2=y
CONFIG_MOUSE_PS2_ALPS=y
CONFIG_MOUSE_PS2_BYD=y
CONFIG_MOUSE_PS2_LOGIPS2PP=y
CONFIG_MOUSE_PS2_SYNAPTICS=y
CONFIG_MOUSE_PS2_SYNAPTICS_SMBUS=y
CONFIG_MOUSE_PS2_CYPRESS=y
CONFIG_MOUSE_PS2_LIFEBOOK=y
CONFIG_MOUSE_PS2_TRACKPOINT=y
CONFIG_MOUSE_PS2_ELANTECH=y
CONFIG_MOUSE_PS2_ELANTECH_SMBUS=y
# CONFIG_MOUSE_PS2_SENTELIC is not set
# CONFIG_MOUSE_PS2_TOUCHKIT is not set
CONFIG_MOUSE_PS2_FOCALTECH=y
CONFIG_MOUSE_PS2_SMBUS=y
CONFIG_MOUSE_SERIAL=m
# CONFIG_MOUSE_APPLETOUCH is not set
# CONFIG_MOUSE_BCM5974 is not set
# CONFIG_MOUSE_CYAPA is not set
CONFIG_MOUSE_ELAN_I2C=m
CONFIG_MOUSE_ELAN_I2C_I2C=y
CONFIG_MOUSE_ELAN_I2C_SMBUS=y
# CONFIG_MOUSE_VSXXXAA is not set
# CONFIG_MOUSE_GPIO is not set
CONFIG_MOUSE_SYNAPTICS_I2C=y
CONFIG_MOUSE_SYNAPTICS_USB=y
CONFIG_INPUT_JOYSTICK=y
CONFIG_JOYSTICK_ANALOG=m
CONFIG_JOYSTICK_A3D=m
CONFIG_JOYSTICK_ADI=m
CONFIG_JOYSTICK_COBRA=y
CONFIG_JOYSTICK_GF2K=m
CONFIG_JOYSTICK_GRIP=m
CONFIG_JOYSTICK_GRIP_MP=m
CONFIG_JOYSTICK_GUILLEMOT=m
CONFIG_JOYSTICK_INTERACT=m
CONFIG_JOYSTICK_SIDEWINDER=m
CONFIG_JOYSTICK_TMDC=m
CONFIG_JOYSTICK_IFORCE=m
CONFIG_JOYSTICK_IFORCE_USB=m
CONFIG_JOYSTICK_IFORCE_232=m
CONFIG_JOYSTICK_WARRIOR=m
CONFIG_JOYSTICK_MAGELLAN=m
CONFIG_JOYSTICK_SPACEORB=m
CONFIG_JOYSTICK_SPACEBALL=m
CONFIG_JOYSTICK_STINGER=m
CONFIG_JOYSTICK_TWIDJOY=m
CONFIG_JOYSTICK_ZHENHUA=m
CONFIG_JOYSTICK_AS5011=y
CONFIG_JOYSTICK_JOYDUMP=m
CONFIG_JOYSTICK_XPAD=m
CONFIG_JOYSTICK_XPAD_FF=y
CONFIG_JOYSTICK_XPAD_LEDS=y
CONFIG_JOYSTICK_PSXPAD_SPI=m
CONFIG_JOYSTICK_PSXPAD_SPI_FF=y
CONFIG_JOYSTICK_PXRC=m
CONFIG_JOYSTICK_FSIA6B=m
# CONFIG_INPUT_TABLET is not set
# CONFIG_INPUT_TOUCHSCREEN is not set
CONFIG_INPUT_MISC=y
# CONFIG_INPUT_AD714X is not set
# CONFIG_INPUT_BMA150 is not set
# CONFIG_INPUT_E3X0_BUTTON is not set
# CONFIG_INPUT_MSM_VIBRATOR is not set
CONFIG_INPUT_PCSPKR=y
# CONFIG_INPUT_MMA8450 is not set
# CONFIG_INPUT_APANEL is not set
# CONFIG_INPUT_GP2A is not set
# CONFIG_INPUT_GPIO_BEEPER is not set
# CONFIG_INPUT_GPIO_DECODER is not set
# CONFIG_INPUT_GPIO_VIBRA is not set
# CONFIG_INPUT_ATLAS_BTNS is not set
# CONFIG_INPUT_ATI_REMOTE2 is not set
# CONFIG_INPUT_KEYSPAN_REMOTE is not set
# CONFIG_INPUT_KXTJ9 is not set
# CONFIG_INPUT_POWERMATE is not set
# CONFIG_INPUT_YEALINK is not set
# CONFIG_INPUT_CM109 is not set
# CONFIG_INPUT_REGULATOR_HAPTIC is not set
CONFIG_INPUT_UINPUT=y
# CONFIG_INPUT_PCF8574 is not set
# CONFIG_INPUT_PWM_BEEPER is not set
# CONFIG_INPUT_PWM_VIBRA is not set
# CONFIG_INPUT_GPIO_ROTARY_ENCODER is not set
# CONFIG_INPUT_ADXL34X is not set
# CONFIG_INPUT_IMS_PCU is not set
# CONFIG_INPUT_CMA3000 is not set
# CONFIG_INPUT_IDEAPAD_SLIDEBAR is not set
# CONFIG_INPUT_DRV260X_HAPTICS is not set
# CONFIG_INPUT_DRV2665_HAPTICS is not set
# CONFIG_INPUT_DRV2667_HAPTICS is not set
CONFIG_RMI4_CORE=y
CONFIG_RMI4_I2C=y
CONFIG_RMI4_SPI=y
CONFIG_RMI4_SMB=y
CONFIG_RMI4_F03=y
CONFIG_RMI4_F03_SERIO=y
CONFIG_RMI4_2D_SENSOR=y
CONFIG_RMI4_F11=y
CONFIG_RMI4_F12=y
CONFIG_RMI4_F30=y
CONFIG_RMI4_F34=y
CONFIG_RMI4_F54=y
CONFIG_RMI4_F55=y

4,194 lines not shown · raw message

Part of this message is not shown here. View the raw message.

author maintainer
#48 lore raw
Quoted 13 lines · Andres Freund

Hi,

I was trying to benchmark the benefits of this for the io_uring using postgres I am working on. The initial results where quite promising (reducing cpu usage significantly, to lower than non-uring sync io). But unfortunately trying another workload triggered both panics and before that seemingly returned wrong data.

I first saw that problem with b360d424ce02, which was linux-block/async-buffered.6 at the time. After hitting the issue, I updated to the current linux-block/async-buffered.6, but the problem persists.

Quoted 9 lines

The workload that triggers the bug within a few seconds is postgres doing a parallel sequential scan of a large table (and aggregating the data, but that shouldn't matter). In the triggering case that boils down to 9 processes sequentially reading a number of 1GB files (we chunk tables internally into smaller files). Each process will read a 512kB chunk of the file on its own, and then claim the next 512kB from a shared memory location. Most of the IO will be READV requests, reading 16 * 8kB into postgres' buffer pool (which may or may not be neighboring 8kB pages).

I'll try and reproduce this, any chance you have a test case that can be run so I don't have to write one from scratch? The more detailed instructions the better.

Quoted 68 lines

The io submissions in this case will all be done to the same io_uring, targeting MAP_HUGETLB | MAP_SHARED | MAP_ANONYMOUS memory. The data is on xfs.

The benchmark starts with dropping caches, which helpfully is visible in dmesg... That takes a few seconds, so the actual buffered io_uring load starts soon after.

[  125.526092] tee (7775): drop_caches: 3
[  146.264327] kill_fasync: bad magic number in fasync_struct!

After this, but before the oops, I see some userspace memory or non-io-uring pipe reads being corrupted.

[  146.264327] kill_fasync: bad magic number in fasync_struct!
[  146.285175] kill_fasync: bad magic number in fasync_struct!
[  146.290793] kill_fasync: bad magic number in fasync_struct!
[  146.285175] kill_fasync: bad magic number in fasync_struct!
[  146.290793] kill_fasync: bad magic number in fasync_struct!
[  157.071979] BUG: kernel NULL pointer dereference, address: 0000000000000020
[  157.078945] #PF: supervisor read access in kernel mode
[  157.084082] #PF: error_code(0x0000) - not-present page
[  157.089225] PGD 0 P4D 0
[  157.091763] Oops: 0000 [#1] SMP NOPTI
[  157.095429] CPU: 3 PID: 7756 Comm: postgres Not tainted 5.7.0-rc7-andres-00133-gc8707bf69395 #41
[  157.104208] Hardware name: Supermicro SYS-7049A-T/X11DAi-N, BIOS 3.2 11/13/2019
[  157.111518] RIP: 0010:xfs_log_commit_cil+0x356/0x7f0
[  157.116478] Code: 00 00 48 89 7e 08 49 89 76 30 48 89 11 48 89 4a 08 8b 4c 24 2c 48 89 85 c0 00 00 00 48 89 85 c8 00 00 00 49 8b 46 20 45 31 c9 <8b> 70 20 85 f6 0f 84 d9 02 00 00 45 31 c0 85 c9 7e 4f 41 8b 46 2c
[  157.135226] RSP: 0018:ffffc90021fefb00 EFLAGS: 00010246
[  157.140452] RAX: 0000000000000000 RBX: ffff8897a9ea80b0 RCX: 0000000000000458
[  157.147582] RDX: ffff8897a9ea80c0 RSI: ffff88afc39a1200 RDI: ffff88afb1ae2c18
[  157.154715] RBP: ffff8897a9ea8000 R08: ffffc90021fefb30 R09: 0000000000000000
[  157.161848] R10: 0000000000000084 R11: 0000000000000012 R12: ffff8897721bd400
[  157.168983] R13: ffff88afb1ae2c00 R14: ffff88afb19860c0 R15: ffff8897a9ea80a0
[  157.176115] FS:  00007ffbbe9a1980(0000) GS:ffff8897e0cc0000(0000) knlGS:0000000000000000
[  157.184199] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  157.189946] CR2: 0000000000000020 CR3: 000000179c0ac005 CR4: 00000000007606e0
[  157.197081] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  157.204212] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  157.211343] PKRU: 55555554
[  157.214048] Call Trace:
[  157.216498]  __xfs_trans_commit+0xa1/0x340
[  157.220596]  xfs_create+0x4cc/0x5e0
[  157.224087]  xfs_generic_create+0x241/0x310
[  157.228274]  path_openat+0xdb7/0x1020
[  157.231940]  do_filp_open+0x91/0x100
[  157.235518]  ? __sys_recvfrom+0xe4/0x170
[  157.239444]  ? _cond_resched+0x19/0x30
[  157.243196]  do_sys_openat2+0x215/0x2d0
[  157.247037]  do_sys_open+0x44/0x80
[  157.250443]  do_syscall_64+0x48/0x130
[  157.254108]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  157.259161] RIP: 0033:0x7ffbc0ded307
[  157.262738] Code: 25 00 00 41 00 3d 00 00 41 00 74 47 64 8b 04 25 18 00 00 00 85 c0 75 6b 44 89 e2 48 89 ee bf 9c ff ff ff b8 01 01 00 00 0f 05 <48> 3d 00 f0 ff ff 0f 87 95 00 00 00 48 8b 4c 24 28 64 48 33 0c 25
[  157.281485] RSP: 002b:00007fff520a4940 EFLAGS: 00000246 ORIG_RAX: 0000000000000101
[  157.289052] RAX: ffffffffffffffda RBX: 00005561dc02eca0 RCX: 00007ffbc0ded307
[  157.296185] RDX: 0000000000000241 RSI: 00005561dc013470 RDI: 00000000ffffff9c
[  157.303317] RBP: 00005561dc013470 R08: 0000000000000004 R09: 0000000000000001
[  157.310447] R10: 00000000000001b6 R11: 0000000000000246 R12: 0000000000000241
[  157.317575] R13: 00005561dc02eca0 R14: 0000000000000001 R15: 0000000000000000
[  157.324705] Modules linked in: isst_if_common squashfs nls_iso8859_1 nls_cp437 snd_hda_codec_realtek vfat snd_hda_codec_generic fat iwlmvm ledtrig_audio snd_hda_codec_hdmi x86_pkg_temp_thermal intel_powerclamp snd_hda_intel snd_intel_dspcfg iwlwifi efi_pstore btusb snd_hda_codec btrtl btbcm efivars snd_hwdep btintel snd_hda_core iTCO_wdt iTCO_vendor_support mei_me mei loop coretemp hid_logitech_hidpp hid_logitech_dj hid_lenovo amdgpu gpu_sched i40e ixgbe ast drm_vram_helper drm_ttm_helper ttm mdio xhci_pci xhci_hcd
[  157.370249] CR2: 0000000000000020

There's a lot more of these later, some interspersed (possibly related to grabbing the output via serial->bmc->network->ipmitool). I've attached the whole dmesg and .config.

Quoted 6 lines

What would be helpful for debugging? Should I try the v5 branch instead?

I'll try setting up a VM + passing through NVME to be able to test this without fear... In one instance I did see some minor corruption on another device & fs (ext4 on dm-crypt on nvme). It's all backed up, but...

I have a known issue with request starvation, wonder if that could be it. I'm going to rebase the branch on top of the aops->readahead() changes shortly, and fix that issue. Hopefully that's what's plaguing your run here, but if not, I'll hunt that one down.

Thanks for testing!

Signature · 1 line
Jens Axboe
#49 lore raw

Hi,

Quoted 10 lines · Jens Axboe
Quoted 9 lines

The workload that triggers the bug within a few seconds is postgres doing a parallel sequential scan of a large table (and aggregating the data, but that shouldn't matter). In the triggering case that boils down to 9 processes sequentially reading a number of 1GB files (we chunk tables internally into smaller files). Each process will read a 512kB chunk of the file on its own, and then claim the next 512kB from a shared memory location. Most of the IO will be READV requests, reading 16 * 8kB into postgres' buffer pool (which may or may not be neighboring 8kB pages).

Quoted 3 lines

I'll try and reproduce this, any chance you have a test case that can be run so I don't have to write one from scratch? The more detailed instructions the better.

It shouldn't be too hard to write you a detailed script for reproducing the issue. But it'd not be an all that minimal reproducer, unless it also triggers on smaller scale (it's a 130GB database that triggers the problem reliably, and small tables don't seem to do so reliably).

I'll try to write that up after I set up kvm / repro there.

One thing I forgot in the earlier email: I ran the benchmark using 'perf stat -a -e ...'. I'm fairly, but not absolutely, certain that it also triggered without that. I don't think it's related, but I thought I better mention it.

Quoted 4 lines

I have a known issue with request starvation, wonder if that could be it. I'm going to rebase the branch on top of the aops->readahead() changes shortly, and fix that issue. Hopefully that's what's plaguing your run here, but if not, I'll hunt that one down.

FWIW, I had iostat -xm /dev/nvme1n1 1 running during this. Shortly before the crash I see:

Device            r/s     rMB/s   rrqm/s  %rrqm r_await rareq-sz     w/s     wMB/s   wrqm/s  %wrqm w_await wareq-sz     d/s     dMB/s   drqm/s  %drqm d_await dareq-sz     f/s f_await  aqu-sz  %util
nvme1n1       6221.00    956.09  3428.00  35.53    0.24   157.38    0.00      0.00     0.00   0.00    0.00     0.00    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    1.48  99.00
Device            r/s     rMB/s   rrqm/s  %rrqm r_await rareq-sz     w/s     wMB/s   wrqm/s  %wrqm w_await wareq-sz     d/s     dMB/s   drqm/s  %drqm d_await dareq-sz     f/s f_await  aqu-sz  %util
nvme1n1       6456.00    978.83  3439.00  34.75    0.21   155.25    0.00      0.00     0.00   0.00    0.00     0.00    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    1.38  98.70

It's maybe also worth noting that in this workload the results are *worse* than when using 5.7-rc7 io_uring. So perhaps request starvation isn't the worst guess...

Greetings,

Andres Freund

#50 lore raw

Hi,

Quoted 10 lines · Andres Freund
Quoted 3 lines

I'll try and reproduce this, any chance you have a test case that can be run so I don't have to write one from scratch? The more detailed instructions the better.

It shouldn't be too hard to write you a detailed script for reproducing the issue. But it'd not be an all that minimal reproducer, unless it also triggers on smaller scale (it's a 130GB database that triggers the problem reliably, and small tables don't seem to do so reliably).

I'll try to write that up after I set up kvm / repro there.

Sorry, took a bit longer. Ran into some issues with my aio branch when running on 5.6. Not yet sure if that's my fault, or io_uring's.

Here's a recipe that repros reliably for me. For me it triggers reliably at this size (-s 1000 ends up around ~16GB).

# Build aio branch of postgres
sudo mkdir /srv/src
sudo chown andres. /srv/src
cd /srv/src
git clone -b aio https://github.com/anarazel/postgres.git pg cd pg
./configure --enable-depend --with-liburing --prefix=/home/andres/bin/ make -j48 -s install

# check that target directory is in PATH
type psql
psql is /home/andres/bin/bin/psql

in one shell:

# create database directory, start postgres
echo 1200 | sudo tee /proc/sys/vm/nr_hugepages
initdb /srv/pguringcrash
postgres -D /srv/pguringcrash/ -c bgwriter_delay=10ms -c bgwriter_lru_maxpages=1000 -c wal_level=minimal -c max_wal_senders=0 -c wal_buffers=128MB -c max_wal_size=100GB -c shared_buffers=2GB -c max_parallel_workers_per_gather=8 -c huge_pages=on

in the other shell:

# fill with test data (skipping index creation etc)
pgbench -i -s 1000 postgres -IdtGv -q
# and trigger a parallel sequential scan, using 8 additional workers
echo 3 | sudo tee /proc/sys/vm/drop_caches && psql -c 'SET max_parallel_workers_per_gather=8' -c 'SELECT SUM(abalance) FROM pgbench_accounts ;'

For me that faily reliably triggers the issue within a few seconds.

[  323.312854] BUG: unable to handle page fault for address: 00007f0f1428c000
[  323.319879] #PF: supervisor read access in kernel mode
[  323.321391] #PF: error_code(0x0001) - permissions violation
[  323.323019] PGD 102e760067 P4D 102e760067 PUD 1037878067 PMD 8000000fc7e000e7
[  323.325065] Oops: 0001 [#1] SMP NOPTI
[  323.326248] CPU: 1 PID: 3145 Comm: postgres Not tainted 5.7.0-rc7-andres-00133-gc8707bf69395 #43
[  323.328653] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[  323.330365] RIP: 0010:__wake_up_common+0x53/0x140
[  323.331276] Code: 41 f6 01 04 0f 85 a3 00 00 00 48 8b 43 08 48 8d 78 e8 48 8d 43 08 48 89 c1 48 89 04 24 48 8d 47 18 48 39 c1 0f 84 b8 00 00 00 <48> 8b 47 18 89 54 24 14 31 ed 4c 8d 60 e8 8b 1f f6 c3 04 75 52 48
[  323.334419] RSP: 0018:ffffc90000dcbdc8 EFLAGS: 00010086
[  323.335409] RAX: 00007f0f1428c000 RBX: ffff889038b189f8 RCX: ffff889038b18a00
[  323.336723] RDX: 0000000000000001 RSI: 0000000000000003 RDI: 00007f0f1428bfe8
[  323.338035] RBP: 0000000000000246 R08: 0000000000000001 R09: ffffc90000dcbe18
[  323.339331] R10: ffff889036a5e750 R11: 0000000000000000 R12: 0000000000000001
[  323.340312] R13: 0000000000000003 R14: 0000000000000000 R15: 0000000000000001
[  323.341204] FS:  00007f0f6f271740(0000) GS:ffff88903f840000(0000) knlGS:0000000000000000
[  323.342217] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  323.342950] CR2: 00007f0f1428c000 CR3: 0000001037ed0005 CR4: 0000000000760ee0
[  323.343836] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  323.344724] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  323.345613] PKRU: 55555554
[  323.346017] Call Trace:
[  323.346435]  __wake_up_common_lock+0x7c/0xc0
[  323.347015]  ep_free+0x30/0xd0
[  323.347468]  ep_eventpoll_release+0x16/0x20
[  323.348040]  __fput+0xda/0x240
[  323.348498]  task_work_run+0x62/0x90
[  323.349015]  exit_to_usermode_loop+0xbd/0xe0
[  323.349573]  do_syscall_64+0xf2/0x130
[  323.349987]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  323.350523] RIP: 0033:0x7f0f6f5a5f13
[  323.350906] Code: 00 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb bb 0f 1f 80 00 00 00 00 64 8b 04 25 18 00 00 00 85 c0 75 14 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 45 c3 0f 1f 40 00 48 83 ec 18 89 7c 24 0c e8
[  323.352501] RSP: 002b:00007ffdf3eab5a8 EFLAGS: 00000246 ORIG_RAX: 0000000000000003
[  323.353277] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 00007f0f6f5a5f13
[  323.353947] RDX: 0000000000000001 RSI: 000055ef9f5cb360 RDI: 000000000000002a
[  323.354587] RBP: 000055ef9f5cb2e8 R08: 00000000000280e8 R09: 0000000000000143
[  323.355227] R10: 000000000000000a R11: 0000000000000246 R12: 000055ef9f5cb2e8
[  323.355872] R13: 0000000000000008 R14: 00000000ffffffff R15: 00007f0f6d3407a4
[  323.356510] Modules linked in: 9pnet_virtio isst_if_common iTCO_wdt 9pnet xhci_pci iTCO_vendor_support xhci_hcd
[  323.357477] CR2: 00007f0f1428c000
[  323.357866] ---[ end trace 081898b3c6b5ab1b ]---

I'll try your new branch next.

Greetings,

Andres Freund

author maintainer
#51 lore raw
In reply to Jens Axboe
Quoted 24 lines · Jens Axboe
Quoted 13 lines · Andres Freund

Hi,

I was trying to benchmark the benefits of this for the io_uring using postgres I am working on. The initial results where quite promising (reducing cpu usage significantly, to lower than non-uring sync io). But unfortunately trying another workload triggered both panics and before that seemingly returned wrong data.

I first saw that problem with b360d424ce02, which was linux-block/async-buffered.6 at the time. After hitting the issue, I updated to the current linux-block/async-buffered.6, but the problem persists.

Quoted 9 lines

The workload that triggers the bug within a few seconds is postgres doing a parallel sequential scan of a large table (and aggregating the data, but that shouldn't matter). In the triggering case that boils down to 9 processes sequentially reading a number of 1GB files (we chunk tables internally into smaller files). Each process will read a 512kB chunk of the file on its own, and then claim the next 512kB from a shared memory location. Most of the IO will be READV requests, reading 16 * 8kB into postgres' buffer pool (which may or may not be neighboring 8kB pages).

Quoted 3 lines

I'll try and reproduce this, any chance you have a test case that can be run so I don't have to write one from scratch? The more detailed instructions the better.

Can you try with async-buffered.7? I've rebased it on a new mechanism, and doing something like what you describe above I haven't been able to trigger anything bad. I'd try your test case specifically, so do let know if it's something I can run.

Signature · 1 line
Jens Axboe
#52 lore raw

Hi,

Quoted 4 lines · Jens Axboe

Can you try with async-buffered.7? I've rebased it on a new mechanism, and doing something like what you describe above I haven't been able to trigger anything bad. I'd try your test case specifically, so do let know if it's something I can run.

I tried my test on async-buffered.7?, and I get hangs very quickly after starting. Unfortunately, I don't seem to get an OOPSs, not sure yet why.

Let me know if my test triggers for you.

I'll go and try to figure out why I don't see an oops...

Regards,

Andres

author maintainer
#53 lore raw
Quoted 8 lines · Andres Freund

Hi,

Quoted 4 lines · Jens Axboe

Can you try with async-buffered.7? I've rebased it on a new mechanism, and doing something like what you describe above I haven't been able to trigger anything bad. I'd try your test case specifically, so do let know if it's something I can run.

Quoted 6 lines

I tried my test on async-buffered.7?, and I get hangs very quickly after starting. Unfortunately, I don't seem to get an OOPSs, not sure yet why.

Let me know if my test triggers for you.

I'll go and try to figure out why I don't see an oops...

I'll try the reproducer! Thanks for testing.

Signature · 1 line
Jens Axboe
#54 lore raw
In reply to Andres Freund

Hi,

Quoted 1 line · Andres Freund

I'll go and try to figure out why I don't see an oops...

Err, that probably was a typo on my end in the serial console config. After fixing that, I did get the below.

If helpful I can try with debugging enabled or such.

[   67.910265] tee (2577): drop_caches: 3
[   68.059674] BUG: unable to handle page fault for address: 00007f0b16a3c03c
[   68.062021] #PF: supervisor read access in kernel mode
[   68.063742] #PF: error_code(0x0000) - not-present page
[   68.065517] PGD 102e044067 P4D 102e044067 PUD 102bf7a067 PMD 0 
[   68.067519] Oops: 0000 [#1] SMP NOPTI
[   68.068800] CPU: 2 PID: 2554 Comm: postgres Not tainted 5.7.0-andres-10123-g87823242260e #44
[   68.071505] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[   68.074139] RIP: 0010:__mutex_lock.isra.0+0x76/0x4e0
[   68.075389] Code: b7 01 00 00 48 39 c6 0f 84 a4 03 00 00 65 48 8b 04 25 80 7d 01 00 48 8b 00 a8 08 75 18 49 8b 06 48 83 e0 f8 0f 84 2f 02 00 00 <8b> 50 3c 85 d2 0f 85 12 02 00 00 65 48 8b 04 25 80 7d 01 00 48 8b
[   68.079125] RSP: 0018:ffffc90000befd50 EFLAGS: 00010206
[   68.080260] RAX: 00007f0b16a3c000 RBX: ffff889037617910 RCX: 0000000000000000
[   68.084115] RDX: 00007f0b16a3c000 RSI: ffff88902a4aca80 RDI: ffff8890376178c0
[   68.085374] RBP: ffffc90000befdf0 R08: 0000000000000001 R09: 0000000000000000
[   68.086409] R10: ffff889037617920 R11: ffff88903f8abaf0 R12: ffffc90000befe08
[   68.087447] R13: 0000000000000000 R14: ffff8890376178c0 R15: 0000000000000000
[   68.088697] FS:  00007f0b97743740(0000) GS:ffff88903f880000(0000) knlGS:0000000000000000
[   68.089903] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.090776] CR2: 00007f0b16a3c03c CR3: 000000102cf7c004 CR4: 0000000000760ee0
[   68.091834] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   68.092902] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[   68.093967] PKRU: 55555554
[   68.094427] Call Trace:
[   68.094845]  ? __schedule+0x2ac/0x720
[   68.095350]  ? schedule+0x55/0xc0
[   68.095797]  ? ep_read_events_proc+0xd0/0xd0
[   68.096354]  ep_scan_ready_list.constprop.0+0x16c/0x190
[   68.097016]  ep_poll+0x2a3/0x440
[   68.097449]  ? wait_woken+0x70/0x70
[   68.097904]  do_epoll_wait+0xb0/0xd0
[   68.098375]  __x64_sys_epoll_wait+0x1a/0x20
[   68.098913]  do_syscall_64+0x48/0x130
[   68.099393]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[   68.100030] RIP: 0033:0x7f0b97845606
[   68.100498] Code: 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 41 89 ca 64 8b 04 25 18 00 00 00 85 c0 75 11 b8 e8 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 5a c3 90 48 83 ec 28 89 54 24 18 48 89 74 24
[   68.102718] RSP: 002b:00007ffe80ffdba8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e8
[   68.103644] RAX: ffffffffffffffda RBX: 000055fb76a9a998 RCX: 00007f0b97845606
[   68.104533] RDX: 0000000000000001 RSI: 000055fb76a9aa10 RDI: 0000000000000005
[   68.105418] RBP: 0000000005000007 R08: 0000000005000007 R09: 0000000000000003
[   68.106296] R10: 00000000ffffffff R11: 0000000000000246 R12: 000055fb76a9a998
[   68.107187] R13: 0000000000000001 R14: 0000000000000009 R15: 000055fb76a9a998
[   68.108104] Modules linked in: 9pnet_virtio isst_if_common xhci_pci 9pnet iTCO_wdt intel_pmc_bxt xhci_hcd iTCO_vendor_support
[   68.109505] CR2: 00007f0b16a3c03c
[   68.109962] ---[ end trace 0ca39a5ed99162ce ]---
[   68.110547] RIP: 0010:__mutex_lock.isra.0+0x76/0x4e0
[   68.111214] Code: b7 01 00 00 48 39 c6 0f 84 a4 03 00 00 65 48 8b 04 25 80 7d 01 00 48 8b 00 a8 08 75 18 49 8b 06 48 83 e0 f8 0f 84 2f 02 00 00 <8b> 50 3c 85 d2 0f 85 12 02 00 00 65 48 8b 04 25 80 7d 01 00 48 8b
[   68.113435] RSP: 0018:ffffc90000befd50 EFLAGS: 00010206
[   68.114111] RAX: 00007f0b16a3c000 RBX: ffff889037617910 RCX: 0000000000000000
[   68.115016] RDX: 00007f0b16a3c000 RSI: ffff88902a4aca80 RDI: ffff8890376178c0
[   68.115902] RBP: ffffc90000befdf0 R08: 0000000000000001 R09: 0000000000000000
[   68.116810] R10: ffff889037617920 R11: ffff88903f8abaf0 R12: ffffc90000befe08
[   68.117663] R13: 0000000000000000 R14: ffff8890376178c0 R15: 0000000000000000
[   68.118520] FS:  00007f0b97743740(0000) GS:ffff88903f880000(0000) knlGS:0000000000000000
[   68.119482] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.120181] CR2: 00007f0b16a3c03c CR3: 000000102cf7c004 CR4: 0000000000760ee0
[   68.121043] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   68.121904] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[   68.122790] PKRU: 55555554
[   68.123401] general protection fault, probably for non-canonical address 0xfeeda989fef06266: 0000 [#2] SMP NOPTI
[   68.125052] CPU: 2 PID: 2554 Comm: postgres Tainted: G      D           5.7.0-andres-10123-g87823242260e #44
[   68.126260] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[   68.127274] RIP: 0010:__pv_queued_spin_lock_slowpath+0x1a1/0x2b0
[   68.128032] Code: c4 c1 ea 12 41 be 01 00 00 00 8d 42 ff 41 83 e4 03 4c 8d 6b 14 49 c1 e4 05 48 98 49 81 c4 00 c7 02 00 4c 03 24 c5 e0 e6 fd 82 <49> 89 1c 24 b8 00 80 00 00 eb 15 84 c0 75 0a 41 0f b6 54 24 14 84
[   68.130221] RSP: 0018:ffffc90000befce8 EFLAGS: 00010086
[   68.130867] RAX: 0000000000003ffe RBX: ffff88903f8ac700 RCX: 0000000000000001
[   68.131752] RDX: 0000000000003fff RSI: 0000000000000000 RDI: 0000000000000000
[   68.132637] RBP: ffff889037617924 R08: 0000000000000000 R09: ffffc90000befdf8
[   68.133513] R10: ffff8890334d2bf0 R11: 0000000000000018 R12: feeda989fef06266
[   68.134399] R13: ffff88903f8ac714 R14: 0000000000000001 R15: 00000000000c0000
[   68.135323] FS:  00007f0b97743740(0000) GS:ffff88903f880000(0000) knlGS:0000000000000000
[   68.136307] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.137004] CR2: 00007f0b16a3c03c CR3: 000000000360a005 CR4: 0000000000760ee0
[   68.137866] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   68.138748] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[   68.139606] PKRU: 55555554
[   68.139973] Call Trace:
[   68.140313]  queued_read_lock_slowpath+0x6c/0x70
[   68.140915]  _raw_read_lock_irqsave+0x26/0x30
[   68.141485]  ep_poll_callback+0x3e/0x2b0
[   68.142007]  ? set_next_entity+0xab/0x1f0
[   68.142541]  __wake_up_common+0x7a/0x140
[   68.143077]  __wake_up_common_lock+0x7c/0xc0
[   68.143651]  pipe_release+0x5b/0xd0
[   68.144150]  __fput+0xda/0x240
[   68.144574]  task_work_run+0x62/0x90
[   68.145046]  do_exit+0x35c/0xa70
[   68.145505]  ? do_epoll_wait+0xb0/0xd0
[   68.146000]  rewind_stack_do_exit+0x17/0x20
[   68.146538] RIP: 0033:0x7f0b97845606
[   68.146988] Code: Bad RIP value.
[   68.147405] RSP: 002b:00007ffe80ffdba8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e8
[   68.148314] RAX: ffffffffffffffda RBX: 000055fb76a9a998 RCX: 00007f0b97845606
[   68.149157] RDX: 0000000000000001 RSI: 000055fb76a9aa10 RDI: 0000000000000005
[   68.150021] RBP: 0000000005000007 R08: 0000000005000007 R09: 0000000000000003
[   68.150831] R10: 00000000ffffffff R11: 0000000000000246 R12: 000055fb76a9a998
[   68.151640] R13: 0000000000000001 R14: 0000000000000009 R15: 000055fb76a9a998
[   68.152459] Modules linked in: 9pnet_virtio isst_if_common xhci_pci 9pnet iTCO_wdt intel_pmc_bxt xhci_hcd iTCO_vendor_support
[   68.153707] ---[ end trace 0ca39a5ed99162cf ]---
[   68.154282] RIP: 0010:__mutex_lock.isra.0+0x76/0x4e0
[   68.154884] Code: b7 01 00 00 48 39 c6 0f 84 a4 03 00 00 65 48 8b 04 25 80 7d 01 00 48 8b 00 a8 08 75 18 49 8b 06 48 83 e0 f8 0f 84 2f 02 00 00 <8b> 50 3c 85 d2 0f 85 12 02 00 00 65 48 8b 04 25 80 7d 01 00 48 8b
[   68.156976] RSP: 0018:ffffc90000befd50 EFLAGS: 00010206
[   68.157614] RAX: 00007f0b16a3c000 RBX: ffff889037617910 RCX: 0000000000000000
[   68.158436] RDX: 00007f0b16a3c000 RSI: ffff88902a4aca80 RDI: ffff8890376178c0
[   68.159269] RBP: ffffc90000befdf0 R08: 0000000000000001 R09: 0000000000000000
[   68.160092] R10: ffff889037617920 R11: ffff88903f8abaf0 R12: ffffc90000befe08
[   68.160920] R13: 0000000000000000 R14: ffff8890376178c0 R15: 0000000000000000
[   68.161746] FS:  00007f0b97743740(0000) GS:ffff88903f880000(0000) knlGS:0000000000000000
[   68.162701] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.163386] CR2: 00007f0b978455dc CR3: 000000000360a005 CR4: 0000000000760ee0
[   68.164226] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   68.165079] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[   68.165931] PKRU: 55555554
[   68.166298] Fixing recursive fault but reboot is needed!
[  128.173729] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[  128.179267] rcu: 	11-...0: (1 GPs behind) idle=c56/1/0x4000000000000000 softirq=6897/6898 fqs=5976 
[  128.182232] rcu: 	19-...0: (1 GPs behind) idle=492/1/0x4000000000000000 softirq=1023/1023 fqs=5976 
[  128.185217] 	(detected by 10, t=18003 jiffies, g=15789, q=631)
[  128.186863] Sending NMI from CPU 10 to CPUs 11:
[  128.188902] NMI backtrace for cpu 11
[  128.188903] CPU: 11 PID: 2546 Comm: postgres Tainted: G      D           5.7.0-andres-10123-g87823242260e #44
[  128.188904] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[  128.188904] RIP: 0010:queued_read_lock_slowpath+0x5b/0x70
[  128.188906] Code: 03 00 02 00 00 8b 03 84 c0 74 08 f3 90 8b 13 84 d2 75 f8 48 89 ef e8 74 e6 ff ff 66 90 5b 5d c3 8b 07 84 c0 74 08 f3 90 8b 03 <84> c0 75 f8 5b 5d c3 89 c6 48 89 ef e8 e4 e8 ff ff 66 90 eb bf 0f
[  128.188907] RSP: 0018:ffffc90000348c08 EFLAGS: 00000086
[  128.188908] RAX: 0000000037617cc0 RBX: ffff889037617920 RCX: 00000000000000c3
[  128.188909] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff889037617920
[  128.188910] RBP: ffff889037bb1a80 R08: 00000000000000c3 R09: ffffc90000348cd8
[  128.188910] R10: 0100000000000000 R11: 00000000de2ee17e R12: 0000000000000046
[  128.188911] R13: ffff889037617920 R14: 0000000000000001 R15: 00000000000000c3
[  128.188912] FS:  00007f0b97743740(0000) GS:ffff88903fac0000(0000) knlGS:0000000000000000
[  128.188912] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  128.188913] CR2: 00007f0b16afc00e CR3: 000000102e5c6002 CR4: 0000000000760ee0
[  128.188914] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  128.188914] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  128.188915] PKRU: 55555554
[  128.188915] Call Trace:
[  128.188916]  <IRQ>
[  128.188916]  _raw_read_lock_irqsave+0x26/0x30
[  128.188917]  ep_poll_callback+0x3e/0x2b0
[  128.188917]  ? cpumask_next_and+0x19/0x20
[  128.188918]  ? update_sd_lb_stats.constprop.0+0xfe/0x810
[  128.188918]  __wake_up_common+0x7a/0x140
[  128.188919]  __wake_up_common_lock+0x7c/0xc0
[  128.188919]  sock_def_readable+0x37/0x60
[  128.188920]  __udp_enqueue_schedule_skb+0x168/0x260
[  128.188920]  udpv6_queue_rcv_one_skb+0x284/0x3c0
[  128.188921]  udp6_unicast_rcv_skb.isra.0+0x44/0xa0
[  128.188921]  ip6_protocol_deliver_rcu+0x235/0x4b0
[  128.188922]  ip6_input_finish+0x11/0x20
[  128.188922]  ip6_input+0xa2/0xb0
[  128.188923]  ? ip6_protocol_deliver_rcu+0x4b0/0x4b0
[  128.188923]  ipv6_rcv+0xc0/0xd0
[  128.188924]  ? ip6_rcv_finish_core.isra.0+0xd0/0xd0
[  128.188924]  __netif_receive_skb_one_core+0x63/0xa0
[  128.188925]  process_backlog+0x98/0x140
[  128.188925]  net_rx_action+0x13a/0x370
[  128.188926]  __do_softirq+0xe0/0x2ca
[  128.188926]  do_softirq_own_stack+0x2a/0x40
[  128.188926]  </IRQ>
[  128.188927]  do_softirq.part.0+0x2b/0x30
[  128.188927]  __local_bh_enable_ip+0x4b/0x50
[  128.188928]  ip6_finish_output2+0x264/0x5b0
[  128.188928]  ip6_output+0x73/0x120
[  128.188929]  ? __ip6_finish_output+0x110/0x110
[  128.188929]  ip6_send_skb+0x1e/0x60
[  128.188930]  udp_v6_send_skb.isra.0+0x197/0x460
[  128.188930]  udpv6_sendmsg+0xb4f/0xdb0
[  128.188931]  ? ip_reply_glue_bits+0x40/0x40
[  128.188931]  ? update_load_avg+0x78/0x630
[  128.188932]  ? update_curr+0x73/0x1d0
[  128.188932]  ? __sys_sendto+0x108/0x190
[  128.188933]  __sys_sendto+0x108/0x190
[  128.188933]  ? __fput+0x1a5/0x240
[  128.188934]  ? _cond_resched+0x19/0x30
[  128.188934]  ? task_work_run+0x67/0x90
[  128.188935]  __x64_sys_sendto+0x25/0x30
[  128.188935]  do_syscall_64+0x48/0x130
[  128.188936]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  128.188936] RIP: 0033:0x7f0b97a7826c
[  128.188945] Code: c0 ff ff ff ff eb b9 0f 1f 80 00 00 00 00 41 89 ca 64 8b 04 25 18 00 00 00 85 c0 75 19 45 31 c9 45 31 c0 b8 2c 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 64 c3 0f 1f 00 55 48 83 ec 20 48 89 54 24 10
[  128.188946] RSP: 002b:00007ffe80ffcea8 EFLAGS: 00000246 ORIG_RAX: 000000000000002c
[  128.188947] RAX: ffffffffffffffda RBX: 0000000000000058 RCX: 00007f0b97a7826c
[  128.188948] RDX: 0000000000000058 RSI: 000055fb765264c0 RDI: 0000000000000009
[  128.188949] RBP: 000055fb765264c0 R08: 0000000000000000 R09: 0000000000000000
[  128.188949] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffe80ffcfc0
[  128.188950] R13: 000000000002c600 R14: 0000000000000000 R15: 000055fb7629b751
[  128.188957] Sending NMI from CPU 10 to CPUs 19:
[  128.239939] NMI backtrace for cpu 19
[  128.239940] CPU: 19 PID: 2587 Comm: postgres Tainted: G      D           5.7.0-andres-10123-g87823242260e #44
[  128.239940] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[  128.239940] RIP: 0010:kvm_wait+0x30/0x50
[  128.239941] Code: 8b 05 ac cb f4 7e a9 00 00 f0 00 75 1f 9c 58 fa 0f b6 17 40 38 d6 75 12 f6 c4 02 75 10 e9 07 00 00 00 0f 00 2d 6f ce 54 01 f4 <50> 9d c3 e9 07 00 00 00 0f 00 2d 5f ce 54 01 fb f4 eb ed 66 66 2e
[  128.239942] RSP: 0018:ffffc90000cc78e8 EFLAGS: 00000046
[  128.239942] RAX: 0000000000000046 RBX: ffff88903fcec700 RCX: 0000000000000008
[  128.239943] RDX: 0000000000000003 RSI: 0000000000000003 RDI: ffff889039049d80
[  128.239943] RBP: ffff889039049d80 R08: ffff88907ffe9f80 R09: 00000000000000f8
[  128.239944] R10: 0000000000000000 R11: 0000000000000001 R12: 0000000000000000
[  128.239944] R13: 0000000000000001 R14: 0000000000000100 R15: 0000000000500000
[  128.239944] FS:  00007f0b97743740(0000) GS:ffff88903fcc0000(0000) knlGS:0000000000000000
[  128.239945] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  128.239945] CR2: 000055fb76a96030 CR3: 0000001035882004 CR4: 0000000000760ee0
[  128.239945] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  128.239946] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  128.239946] PKRU: 55555554
[  128.239946] Call Trace:
[  128.239946]  __pv_queued_spin_lock_slowpath+0x26e/0x2b0
[  128.239947]  _raw_spin_lock_irqsave+0x25/0x30
[  128.239947]  __wake_up_common_lock+0x62/0xc0
[  128.239947]  sock_def_write_space+0x49/0x90
[  128.239948]  sock_wfree+0x68/0xb0
[  128.239948]  loopback_xmit+0x49/0xe0
[  128.239948]  dev_hard_start_xmit+0x8d/0x1e0
[  128.239948]  __dev_queue_xmit+0x721/0x8e0
[  128.239949]  ip6_finish_output2+0x250/0x5b0
[  128.239949]  ip6_output+0x73/0x120
[  128.239949]  ? __ip6_finish_output+0x110/0x110
[  128.239950]  ip6_send_skb+0x1e/0x60
[  128.239950]  udp_v6_send_skb.isra.0+0x197/0x460
[  128.239950]  udpv6_sendmsg+0xb4f/0xdb0
[  128.239950]  ? release_pages+0x28f/0x2f0
[  128.239950]  ? ip_reply_glue_bits+0x40/0x40
[  128.239951]  ? _cond_resched+0x19/0x30
[  128.239951]  ? unmap_page_range+0x678/0xa60
[  128.239951]  ? __sys_sendto+0x108/0x190
[  128.239951]  __sys_sendto+0x108/0x190
[  128.239952]  ? __fput+0x1a5/0x240
[  128.239952]  ? _cond_resched+0x19/0x30
[  128.239952]  ? task_work_run+0x67/0x90
[  128.239952]  __x64_sys_sendto+0x25/0x30
[  128.239953]  do_syscall_64+0x48/0x130
[  128.239953]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  128.239953] RIP: 0033:0x7f0b97a7826c
[  128.239954] Code: c0 ff ff ff ff eb b9 0f 1f 80 00 00 00 00 41 89 ca 64 8b 04 25 18 00 00 00 85 c0 75 19 45 31 c9 45 31 c0 b8 2c 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 64 c3 0f 1f 00 55 48 83 ec 20 48 89 54 24 10
[  128.239954] RSP: 002b:00007ffe80ffd7b8 EFLAGS: 00000246 ORIG_RAX: 000000000000002c
[  128.239955] RAX: ffffffffffffffda RBX: 00000000000003a8 RCX: 00007f0b97a7826c
[  128.239955] RDX: 00000000000003a8 RSI: 00007ffe80ffd800 RDI: 0000000000000009
[  128.239955] RBP: 00007ffe80ffd800 R08: 0000000000000000 R09: 0000000000000000
[  128.239956] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffe80ffd800
[  128.239956] R13: 00007ffe80ffd800 R14: 000000000000000e R15: 000055fb76b37e58

Greetings,

Andres Freund

author maintainer
#55 lore raw
Quoted 241 lines · Andres Freund

Hi,

Quoted 1 line · Andres Freund

I'll go and try to figure out why I don't see an oops...

Err, that probably was a typo on my end in the serial console config. After fixing that, I did get the below.

If helpful I can try with debugging enabled or such.

[   67.910265] tee (2577): drop_caches: 3
[   68.059674] BUG: unable to handle page fault for address: 00007f0b16a3c03c
[   68.062021] #PF: supervisor read access in kernel mode
[   68.063742] #PF: error_code(0x0000) - not-present page
[   68.065517] PGD 102e044067 P4D 102e044067 PUD 102bf7a067 PMD 0 
[   68.067519] Oops: 0000 [#1] SMP NOPTI
[   68.068800] CPU: 2 PID: 2554 Comm: postgres Not tainted 5.7.0-andres-10123-g87823242260e #44
[   68.071505] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[   68.074139] RIP: 0010:__mutex_lock.isra.0+0x76/0x4e0
[   68.075389] Code: b7 01 00 00 48 39 c6 0f 84 a4 03 00 00 65 48 8b 04 25 80 7d 01 00 48 8b 00 a8 08 75 18 49 8b 06 48 83 e0 f8 0f 84 2f 02 00 00 <8b> 50 3c 85 d2 0f 85 12 02 00 00 65 48 8b 04 25 80 7d 01 00 48 8b
[   68.079125] RSP: 0018:ffffc90000befd50 EFLAGS: 00010206
[   68.080260] RAX: 00007f0b16a3c000 RBX: ffff889037617910 RCX: 0000000000000000
[   68.084115] RDX: 00007f0b16a3c000 RSI: ffff88902a4aca80 RDI: ffff8890376178c0
[   68.085374] RBP: ffffc90000befdf0 R08: 0000000000000001 R09: 0000000000000000
[   68.086409] R10: ffff889037617920 R11: ffff88903f8abaf0 R12: ffffc90000befe08
[   68.087447] R13: 0000000000000000 R14: ffff8890376178c0 R15: 0000000000000000
[   68.088697] FS:  00007f0b97743740(0000) GS:ffff88903f880000(0000) knlGS:0000000000000000
[   68.089903] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.090776] CR2: 00007f0b16a3c03c CR3: 000000102cf7c004 CR4: 0000000000760ee0
[   68.091834] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   68.092902] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[   68.093967] PKRU: 55555554
[   68.094427] Call Trace:
[   68.094845]  ? __schedule+0x2ac/0x720
[   68.095350]  ? schedule+0x55/0xc0
[   68.095797]  ? ep_read_events_proc+0xd0/0xd0
[   68.096354]  ep_scan_ready_list.constprop.0+0x16c/0x190
[   68.097016]  ep_poll+0x2a3/0x440
[   68.097449]  ? wait_woken+0x70/0x70
[   68.097904]  do_epoll_wait+0xb0/0xd0
[   68.098375]  __x64_sys_epoll_wait+0x1a/0x20
[   68.098913]  do_syscall_64+0x48/0x130
[   68.099393]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[   68.100030] RIP: 0033:0x7f0b97845606
[   68.100498] Code: 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 41 89 ca 64 8b 04 25 18 00 00 00 85 c0 75 11 b8 e8 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 5a c3 90 48 83 ec 28 89 54 24 18 48 89 74 24
[   68.102718] RSP: 002b:00007ffe80ffdba8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e8
[   68.103644] RAX: ffffffffffffffda RBX: 000055fb76a9a998 RCX: 00007f0b97845606
[   68.104533] RDX: 0000000000000001 RSI: 000055fb76a9aa10 RDI: 0000000000000005
[   68.105418] RBP: 0000000005000007 R08: 0000000005000007 R09: 0000000000000003
[   68.106296] R10: 00000000ffffffff R11: 0000000000000246 R12: 000055fb76a9a998
[   68.107187] R13: 0000000000000001 R14: 0000000000000009 R15: 000055fb76a9a998
[   68.108104] Modules linked in: 9pnet_virtio isst_if_common xhci_pci 9pnet iTCO_wdt intel_pmc_bxt xhci_hcd iTCO_vendor_support
[   68.109505] CR2: 00007f0b16a3c03c
[   68.109962] ---[ end trace 0ca39a5ed99162ce ]---
[   68.110547] RIP: 0010:__mutex_lock.isra.0+0x76/0x4e0
[   68.111214] Code: b7 01 00 00 48 39 c6 0f 84 a4 03 00 00 65 48 8b 04 25 80 7d 01 00 48 8b 00 a8 08 75 18 49 8b 06 48 83 e0 f8 0f 84 2f 02 00 00 <8b> 50 3c 85 d2 0f 85 12 02 00 00 65 48 8b 04 25 80 7d 01 00 48 8b
[   68.113435] RSP: 0018:ffffc90000befd50 EFLAGS: 00010206
[   68.114111] RAX: 00007f0b16a3c000 RBX: ffff889037617910 RCX: 0000000000000000
[   68.115016] RDX: 00007f0b16a3c000 RSI: ffff88902a4aca80 RDI: ffff8890376178c0
[   68.115902] RBP: ffffc90000befdf0 R08: 0000000000000001 R09: 0000000000000000
[   68.116810] R10: ffff889037617920 R11: ffff88903f8abaf0 R12: ffffc90000befe08
[   68.117663] R13: 0000000000000000 R14: ffff8890376178c0 R15: 0000000000000000
[   68.118520] FS:  00007f0b97743740(0000) GS:ffff88903f880000(0000) knlGS:0000000000000000
[   68.119482] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.120181] CR2: 00007f0b16a3c03c CR3: 000000102cf7c004 CR4: 0000000000760ee0
[   68.121043] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   68.121904] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[   68.122790] PKRU: 55555554
[   68.123401] general protection fault, probably for non-canonical address 0xfeeda989fef06266: 0000 [#2] SMP NOPTI
[   68.125052] CPU: 2 PID: 2554 Comm: postgres Tainted: G      D           5.7.0-andres-10123-g87823242260e #44
[   68.126260] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[   68.127274] RIP: 0010:__pv_queued_spin_lock_slowpath+0x1a1/0x2b0
[   68.128032] Code: c4 c1 ea 12 41 be 01 00 00 00 8d 42 ff 41 83 e4 03 4c 8d 6b 14 49 c1 e4 05 48 98 49 81 c4 00 c7 02 00 4c 03 24 c5 e0 e6 fd 82 <49> 89 1c 24 b8 00 80 00 00 eb 15 84 c0 75 0a 41 0f b6 54 24 14 84
[   68.130221] RSP: 0018:ffffc90000befce8 EFLAGS: 00010086
[   68.130867] RAX: 0000000000003ffe RBX: ffff88903f8ac700 RCX: 0000000000000001
[   68.131752] RDX: 0000000000003fff RSI: 0000000000000000 RDI: 0000000000000000
[   68.132637] RBP: ffff889037617924 R08: 0000000000000000 R09: ffffc90000befdf8
[   68.133513] R10: ffff8890334d2bf0 R11: 0000000000000018 R12: feeda989fef06266
[   68.134399] R13: ffff88903f8ac714 R14: 0000000000000001 R15: 00000000000c0000
[   68.135323] FS:  00007f0b97743740(0000) GS:ffff88903f880000(0000) knlGS:0000000000000000
[   68.136307] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.137004] CR2: 00007f0b16a3c03c CR3: 000000000360a005 CR4: 0000000000760ee0
[   68.137866] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   68.138748] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[   68.139606] PKRU: 55555554
[   68.139973] Call Trace:
[   68.140313]  queued_read_lock_slowpath+0x6c/0x70
[   68.140915]  _raw_read_lock_irqsave+0x26/0x30
[   68.141485]  ep_poll_callback+0x3e/0x2b0
[   68.142007]  ? set_next_entity+0xab/0x1f0
[   68.142541]  __wake_up_common+0x7a/0x140
[   68.143077]  __wake_up_common_lock+0x7c/0xc0
[   68.143651]  pipe_release+0x5b/0xd0
[   68.144150]  __fput+0xda/0x240
[   68.144574]  task_work_run+0x62/0x90
[   68.145046]  do_exit+0x35c/0xa70
[   68.145505]  ? do_epoll_wait+0xb0/0xd0
[   68.146000]  rewind_stack_do_exit+0x17/0x20
[   68.146538] RIP: 0033:0x7f0b97845606
[   68.146988] Code: Bad RIP value.
[   68.147405] RSP: 002b:00007ffe80ffdba8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e8
[   68.148314] RAX: ffffffffffffffda RBX: 000055fb76a9a998 RCX: 00007f0b97845606
[   68.149157] RDX: 0000000000000001 RSI: 000055fb76a9aa10 RDI: 0000000000000005
[   68.150021] RBP: 0000000005000007 R08: 0000000005000007 R09: 0000000000000003
[   68.150831] R10: 00000000ffffffff R11: 0000000000000246 R12: 000055fb76a9a998
[   68.151640] R13: 0000000000000001 R14: 0000000000000009 R15: 000055fb76a9a998
[   68.152459] Modules linked in: 9pnet_virtio isst_if_common xhci_pci 9pnet iTCO_wdt intel_pmc_bxt xhci_hcd iTCO_vendor_support
[   68.153707] ---[ end trace 0ca39a5ed99162cf ]---
[   68.154282] RIP: 0010:__mutex_lock.isra.0+0x76/0x4e0
[   68.154884] Code: b7 01 00 00 48 39 c6 0f 84 a4 03 00 00 65 48 8b 04 25 80 7d 01 00 48 8b 00 a8 08 75 18 49 8b 06 48 83 e0 f8 0f 84 2f 02 00 00 <8b> 50 3c 85 d2 0f 85 12 02 00 00 65 48 8b 04 25 80 7d 01 00 48 8b
[   68.156976] RSP: 0018:ffffc90000befd50 EFLAGS: 00010206
[   68.157614] RAX: 00007f0b16a3c000 RBX: ffff889037617910 RCX: 0000000000000000
[   68.158436] RDX: 00007f0b16a3c000 RSI: ffff88902a4aca80 RDI: ffff8890376178c0
[   68.159269] RBP: ffffc90000befdf0 R08: 0000000000000001 R09: 0000000000000000
[   68.160092] R10: ffff889037617920 R11: ffff88903f8abaf0 R12: ffffc90000befe08
[   68.160920] R13: 0000000000000000 R14: ffff8890376178c0 R15: 0000000000000000
[   68.161746] FS:  00007f0b97743740(0000) GS:ffff88903f880000(0000) knlGS:0000000000000000
[   68.162701] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.163386] CR2: 00007f0b978455dc CR3: 000000000360a005 CR4: 0000000000760ee0
[   68.164226] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   68.165079] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[   68.165931] PKRU: 55555554
[   68.166298] Fixing recursive fault but reboot is needed!
[  128.173729] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[  128.179267] rcu: 	11-...0: (1 GPs behind) idle=c56/1/0x4000000000000000 softirq=6897/6898 fqs=5976 
[  128.182232] rcu: 	19-...0: (1 GPs behind) idle=492/1/0x4000000000000000 softirq=1023/1023 fqs=5976 
[  128.185217] 	(detected by 10, t=18003 jiffies, g=15789, q=631)
[  128.186863] Sending NMI from CPU 10 to CPUs 11:
[  128.188902] NMI backtrace for cpu 11
[  128.188903] CPU: 11 PID: 2546 Comm: postgres Tainted: G      D           5.7.0-andres-10123-g87823242260e #44
[  128.188904] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[  128.188904] RIP: 0010:queued_read_lock_slowpath+0x5b/0x70
[  128.188906] Code: 03 00 02 00 00 8b 03 84 c0 74 08 f3 90 8b 13 84 d2 75 f8 48 89 ef e8 74 e6 ff ff 66 90 5b 5d c3 8b 07 84 c0 74 08 f3 90 8b 03 <84> c0 75 f8 5b 5d c3 89 c6 48 89 ef e8 e4 e8 ff ff 66 90 eb bf 0f
[  128.188907] RSP: 0018:ffffc90000348c08 EFLAGS: 00000086
[  128.188908] RAX: 0000000037617cc0 RBX: ffff889037617920 RCX: 00000000000000c3
[  128.188909] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff889037617920
[  128.188910] RBP: ffff889037bb1a80 R08: 00000000000000c3 R09: ffffc90000348cd8
[  128.188910] R10: 0100000000000000 R11: 00000000de2ee17e R12: 0000000000000046
[  128.188911] R13: ffff889037617920 R14: 0000000000000001 R15: 00000000000000c3
[  128.188912] FS:  00007f0b97743740(0000) GS:ffff88903fac0000(0000) knlGS:0000000000000000
[  128.188912] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  128.188913] CR2: 00007f0b16afc00e CR3: 000000102e5c6002 CR4: 0000000000760ee0
[  128.188914] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  128.188914] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  128.188915] PKRU: 55555554
[  128.188915] Call Trace:
[  128.188916]  <IRQ>
[  128.188916]  _raw_read_lock_irqsave+0x26/0x30
[  128.188917]  ep_poll_callback+0x3e/0x2b0
[  128.188917]  ? cpumask_next_and+0x19/0x20
[  128.188918]  ? update_sd_lb_stats.constprop.0+0xfe/0x810
[  128.188918]  __wake_up_common+0x7a/0x140
[  128.188919]  __wake_up_common_lock+0x7c/0xc0
[  128.188919]  sock_def_readable+0x37/0x60
[  128.188920]  __udp_enqueue_schedule_skb+0x168/0x260
[  128.188920]  udpv6_queue_rcv_one_skb+0x284/0x3c0
[  128.188921]  udp6_unicast_rcv_skb.isra.0+0x44/0xa0
[  128.188921]  ip6_protocol_deliver_rcu+0x235/0x4b0
[  128.188922]  ip6_input_finish+0x11/0x20
[  128.188922]  ip6_input+0xa2/0xb0
[  128.188923]  ? ip6_protocol_deliver_rcu+0x4b0/0x4b0
[  128.188923]  ipv6_rcv+0xc0/0xd0
[  128.188924]  ? ip6_rcv_finish_core.isra.0+0xd0/0xd0
[  128.188924]  __netif_receive_skb_one_core+0x63/0xa0
[  128.188925]  process_backlog+0x98/0x140
[  128.188925]  net_rx_action+0x13a/0x370
[  128.188926]  __do_softirq+0xe0/0x2ca
[  128.188926]  do_softirq_own_stack+0x2a/0x40
[  128.188926]  </IRQ>
[  128.188927]  do_softirq.part.0+0x2b/0x30
[  128.188927]  __local_bh_enable_ip+0x4b/0x50
[  128.188928]  ip6_finish_output2+0x264/0x5b0
[  128.188928]  ip6_output+0x73/0x120
[  128.188929]  ? __ip6_finish_output+0x110/0x110
[  128.188929]  ip6_send_skb+0x1e/0x60
[  128.188930]  udp_v6_send_skb.isra.0+0x197/0x460
[  128.188930]  udpv6_sendmsg+0xb4f/0xdb0
[  128.188931]  ? ip_reply_glue_bits+0x40/0x40
[  128.188931]  ? update_load_avg+0x78/0x630
[  128.188932]  ? update_curr+0x73/0x1d0
[  128.188932]  ? __sys_sendto+0x108/0x190
[  128.188933]  __sys_sendto+0x108/0x190
[  128.188933]  ? __fput+0x1a5/0x240
[  128.188934]  ? _cond_resched+0x19/0x30
[  128.188934]  ? task_work_run+0x67/0x90
[  128.188935]  __x64_sys_sendto+0x25/0x30
[  128.188935]  do_syscall_64+0x48/0x130
[  128.188936]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  128.188936] RIP: 0033:0x7f0b97a7826c
[  128.188945] Code: c0 ff ff ff ff eb b9 0f 1f 80 00 00 00 00 41 89 ca 64 8b 04 25 18 00 00 00 85 c0 75 19 45 31 c9 45 31 c0 b8 2c 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 64 c3 0f 1f 00 55 48 83 ec 20 48 89 54 24 10
[  128.188946] RSP: 002b:00007ffe80ffcea8 EFLAGS: 00000246 ORIG_RAX: 000000000000002c
[  128.188947] RAX: ffffffffffffffda RBX: 0000000000000058 RCX: 00007f0b97a7826c
[  128.188948] RDX: 0000000000000058 RSI: 000055fb765264c0 RDI: 0000000000000009
[  128.188949] RBP: 000055fb765264c0 R08: 0000000000000000 R09: 0000000000000000
[  128.188949] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffe80ffcfc0
[  128.188950] R13: 000000000002c600 R14: 0000000000000000 R15: 000055fb7629b751
[  128.188957] Sending NMI from CPU 10 to CPUs 19:
[  128.239939] NMI backtrace for cpu 19
[  128.239940] CPU: 19 PID: 2587 Comm: postgres Tainted: G      D           5.7.0-andres-10123-g87823242260e #44
[  128.239940] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[  128.239940] RIP: 0010:kvm_wait+0x30/0x50
[  128.239941] Code: 8b 05 ac cb f4 7e a9 00 00 f0 00 75 1f 9c 58 fa 0f b6 17 40 38 d6 75 12 f6 c4 02 75 10 e9 07 00 00 00 0f 00 2d 6f ce 54 01 f4 <50> 9d c3 e9 07 00 00 00 0f 00 2d 5f ce 54 01 fb f4 eb ed 66 66 2e
[  128.239942] RSP: 0018:ffffc90000cc78e8 EFLAGS: 00000046
[  128.239942] RAX: 0000000000000046 RBX: ffff88903fcec700 RCX: 0000000000000008
[  128.239943] RDX: 0000000000000003 RSI: 0000000000000003 RDI: ffff889039049d80
[  128.239943] RBP: ffff889039049d80 R08: ffff88907ffe9f80 R09: 00000000000000f8
[  128.239944] R10: 0000000000000000 R11: 0000000000000001 R12: 0000000000000000
[  128.239944] R13: 0000000000000001 R14: 0000000000000100 R15: 0000000000500000
[  128.239944] FS:  00007f0b97743740(0000) GS:ffff88903fcc0000(0000) knlGS:0000000000000000
[  128.239945] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  128.239945] CR2: 000055fb76a96030 CR3: 0000001035882004 CR4: 0000000000760ee0
[  128.239945] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  128.239946] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  128.239946] PKRU: 55555554
[  128.239946] Call Trace:
[  128.239946]  __pv_queued_spin_lock_slowpath+0x26e/0x2b0
[  128.239947]  _raw_spin_lock_irqsave+0x25/0x30
[  128.239947]  __wake_up_common_lock+0x62/0xc0
[  128.239947]  sock_def_write_space+0x49/0x90
[  128.239948]  sock_wfree+0x68/0xb0
[  128.239948]  loopback_xmit+0x49/0xe0
[  128.239948]  dev_hard_start_xmit+0x8d/0x1e0
[  128.239948]  __dev_queue_xmit+0x721/0x8e0
[  128.239949]  ip6_finish_output2+0x250/0x5b0
[  128.239949]  ip6_output+0x73/0x120
[  128.239949]  ? __ip6_finish_output+0x110/0x110
[  128.239950]  ip6_send_skb+0x1e/0x60
[  128.239950]  udp_v6_send_skb.isra.0+0x197/0x460
[  128.239950]  udpv6_sendmsg+0xb4f/0xdb0
[  128.239950]  ? release_pages+0x28f/0x2f0
[  128.239950]  ? ip_reply_glue_bits+0x40/0x40
[  128.239951]  ? _cond_resched+0x19/0x30
[  128.239951]  ? unmap_page_range+0x678/0xa60
[  128.239951]  ? __sys_sendto+0x108/0x190
[  128.239951]  __sys_sendto+0x108/0x190
[  128.239952]  ? __fput+0x1a5/0x240
[  128.239952]  ? _cond_resched+0x19/0x30
[  128.239952]  ? task_work_run+0x67/0x90
[  128.239952]  __x64_sys_sendto+0x25/0x30
[  128.239953]  do_syscall_64+0x48/0x130
[  128.239953]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
Quoted 8 lines
[  128.239953] RIP: 0033:0x7f0b97a7826c
[  128.239954] Code: c0 ff ff ff ff eb b9 0f 1f 80 00 00 00 00 41 89 ca 64 8b 04 25 18 00 00 00 85 c0 75 19 45 31 c9 45 31 c0 b8 2c 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 64 c3 0f 1f 00 55 48 83 ec 20 48 89 54 24 10
[  128.239954] RSP: 002b:00007ffe80ffd7b8 EFLAGS: 00000246 ORIG_RAX: 000000000000002c
[  128.239955] RAX: ffffffffffffffda RBX: 00000000000003a8 RCX: 00007f0b97a7826c
[  128.239955] RDX: 00000000000003a8 RSI: 00007ffe80ffd800 RDI: 0000000000000009
[  128.239955] RBP: 00007ffe80ffd800 R08: 0000000000000000 R09: 0000000000000000
[  128.239956] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffe80ffd800
[  128.239956] R13: 00007ffe80ffd800 R14: 000000000000000e R15: 000055fb76b37e58

I can reproduce this, and I see what it is. I'll send out a patch soonish.

Signature · 1 line
Jens Axboe
author maintainer
#56 lore raw
Quoted 251 lines · Jens Axboe
Quoted 241 lines · Andres Freund

Hi,

Quoted 1 line · Andres Freund

I'll go and try to figure out why I don't see an oops...

Err, that probably was a typo on my end in the serial console config. After fixing that, I did get the below.

If helpful I can try with debugging enabled or such.

[   67.910265] tee (2577): drop_caches: 3
[   68.059674] BUG: unable to handle page fault for address: 00007f0b16a3c03c
[   68.062021] #PF: supervisor read access in kernel mode
[   68.063742] #PF: error_code(0x0000) - not-present page
[   68.065517] PGD 102e044067 P4D 102e044067 PUD 102bf7a067 PMD 0 
[   68.067519] Oops: 0000 [#1] SMP NOPTI
[   68.068800] CPU: 2 PID: 2554 Comm: postgres Not tainted 5.7.0-andres-10123-g87823242260e #44
[   68.071505] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[   68.074139] RIP: 0010:__mutex_lock.isra.0+0x76/0x4e0
[   68.075389] Code: b7 01 00 00 48 39 c6 0f 84 a4 03 00 00 65 48 8b 04 25 80 7d 01 00 48 8b 00 a8 08 75 18 49 8b 06 48 83 e0 f8 0f 84 2f 02 00 00 <8b> 50 3c 85 d2 0f 85 12 02 00 00 65 48 8b 04 25 80 7d 01 00 48 8b
[   68.079125] RSP: 0018:ffffc90000befd50 EFLAGS: 00010206
[   68.080260] RAX: 00007f0b16a3c000 RBX: ffff889037617910 RCX: 0000000000000000
[   68.084115] RDX: 00007f0b16a3c000 RSI: ffff88902a4aca80 RDI: ffff8890376178c0
[   68.085374] RBP: ffffc90000befdf0 R08: 0000000000000001 R09: 0000000000000000
[   68.086409] R10: ffff889037617920 R11: ffff88903f8abaf0 R12: ffffc90000befe08
[   68.087447] R13: 0000000000000000 R14: ffff8890376178c0 R15: 0000000000000000
[   68.088697] FS:  00007f0b97743740(0000) GS:ffff88903f880000(0000) knlGS:0000000000000000
[   68.089903] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.090776] CR2: 00007f0b16a3c03c CR3: 000000102cf7c004 CR4: 0000000000760ee0
[   68.091834] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   68.092902] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[   68.093967] PKRU: 55555554
[   68.094427] Call Trace:
[   68.094845]  ? __schedule+0x2ac/0x720
[   68.095350]  ? schedule+0x55/0xc0
[   68.095797]  ? ep_read_events_proc+0xd0/0xd0
[   68.096354]  ep_scan_ready_list.constprop.0+0x16c/0x190
[   68.097016]  ep_poll+0x2a3/0x440
[   68.097449]  ? wait_woken+0x70/0x70
[   68.097904]  do_epoll_wait+0xb0/0xd0
[   68.098375]  __x64_sys_epoll_wait+0x1a/0x20
[   68.098913]  do_syscall_64+0x48/0x130
[   68.099393]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[   68.100030] RIP: 0033:0x7f0b97845606
[   68.100498] Code: 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 41 89 ca 64 8b 04 25 18 00 00 00 85 c0 75 11 b8 e8 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 5a c3 90 48 83 ec 28 89 54 24 18 48 89 74 24
[   68.102718] RSP: 002b:00007ffe80ffdba8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e8
[   68.103644] RAX: ffffffffffffffda RBX: 000055fb76a9a998 RCX: 00007f0b97845606
[   68.104533] RDX: 0000000000000001 RSI: 000055fb76a9aa10 RDI: 0000000000000005
[   68.105418] RBP: 0000000005000007 R08: 0000000005000007 R09: 0000000000000003
[   68.106296] R10: 00000000ffffffff R11: 0000000000000246 R12: 000055fb76a9a998
[   68.107187] R13: 0000000000000001 R14: 0000000000000009 R15: 000055fb76a9a998
[   68.108104] Modules linked in: 9pnet_virtio isst_if_common xhci_pci 9pnet iTCO_wdt intel_pmc_bxt xhci_hcd iTCO_vendor_support
[   68.109505] CR2: 00007f0b16a3c03c
[   68.109962] ---[ end trace 0ca39a5ed99162ce ]---
[   68.110547] RIP: 0010:__mutex_lock.isra.0+0x76/0x4e0
[   68.111214] Code: b7 01 00 00 48 39 c6 0f 84 a4 03 00 00 65 48 8b 04 25 80 7d 01 00 48 8b 00 a8 08 75 18 49 8b 06 48 83 e0 f8 0f 84 2f 02 00 00 <8b> 50 3c 85 d2 0f 85 12 02 00 00 65 48 8b 04 25 80 7d 01 00 48 8b
[   68.113435] RSP: 0018:ffffc90000befd50 EFLAGS: 00010206
[   68.114111] RAX: 00007f0b16a3c000 RBX: ffff889037617910 RCX: 0000000000000000
[   68.115016] RDX: 00007f0b16a3c000 RSI: ffff88902a4aca80 RDI: ffff8890376178c0
[   68.115902] RBP: ffffc90000befdf0 R08: 0000000000000001 R09: 0000000000000000
[   68.116810] R10: ffff889037617920 R11: ffff88903f8abaf0 R12: ffffc90000befe08
[   68.117663] R13: 0000000000000000 R14: ffff8890376178c0 R15: 0000000000000000
[   68.118520] FS:  00007f0b97743740(0000) GS:ffff88903f880000(0000) knlGS:0000000000000000
[   68.119482] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.120181] CR2: 00007f0b16a3c03c CR3: 000000102cf7c004 CR4: 0000000000760ee0
[   68.121043] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   68.121904] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[   68.122790] PKRU: 55555554
[   68.123401] general protection fault, probably for non-canonical address 0xfeeda989fef06266: 0000 [#2] SMP NOPTI
[   68.125052] CPU: 2 PID: 2554 Comm: postgres Tainted: G      D           5.7.0-andres-10123-g87823242260e #44
[   68.126260] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[   68.127274] RIP: 0010:__pv_queued_spin_lock_slowpath+0x1a1/0x2b0
[   68.128032] Code: c4 c1 ea 12 41 be 01 00 00 00 8d 42 ff 41 83 e4 03 4c 8d 6b 14 49 c1 e4 05 48 98 49 81 c4 00 c7 02 00 4c 03 24 c5 e0 e6 fd 82 <49> 89 1c 24 b8 00 80 00 00 eb 15 84 c0 75 0a 41 0f b6 54 24 14 84
[   68.130221] RSP: 0018:ffffc90000befce8 EFLAGS: 00010086
[   68.130867] RAX: 0000000000003ffe RBX: ffff88903f8ac700 RCX: 0000000000000001
[   68.131752] RDX: 0000000000003fff RSI: 0000000000000000 RDI: 0000000000000000
[   68.132637] RBP: ffff889037617924 R08: 0000000000000000 R09: ffffc90000befdf8
[   68.133513] R10: ffff8890334d2bf0 R11: 0000000000000018 R12: feeda989fef06266
[   68.134399] R13: ffff88903f8ac714 R14: 0000000000000001 R15: 00000000000c0000
[   68.135323] FS:  00007f0b97743740(0000) GS:ffff88903f880000(0000) knlGS:0000000000000000
[   68.136307] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.137004] CR2: 00007f0b16a3c03c CR3: 000000000360a005 CR4: 0000000000760ee0
[   68.137866] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   68.138748] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[   68.139606] PKRU: 55555554
[   68.139973] Call Trace:
[   68.140313]  queued_read_lock_slowpath+0x6c/0x70
[   68.140915]  _raw_read_lock_irqsave+0x26/0x30
[   68.141485]  ep_poll_callback+0x3e/0x2b0
[   68.142007]  ? set_next_entity+0xab/0x1f0
[   68.142541]  __wake_up_common+0x7a/0x140
[   68.143077]  __wake_up_common_lock+0x7c/0xc0
[   68.143651]  pipe_release+0x5b/0xd0
[   68.144150]  __fput+0xda/0x240
[   68.144574]  task_work_run+0x62/0x90
[   68.145046]  do_exit+0x35c/0xa70
[   68.145505]  ? do_epoll_wait+0xb0/0xd0
[   68.146000]  rewind_stack_do_exit+0x17/0x20
[   68.146538] RIP: 0033:0x7f0b97845606
[   68.146988] Code: Bad RIP value.
[   68.147405] RSP: 002b:00007ffe80ffdba8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e8
[   68.148314] RAX: ffffffffffffffda RBX: 000055fb76a9a998 RCX: 00007f0b97845606
[   68.149157] RDX: 0000000000000001 RSI: 000055fb76a9aa10 RDI: 0000000000000005
[   68.150021] RBP: 0000000005000007 R08: 0000000005000007 R09: 0000000000000003
[   68.150831] R10: 00000000ffffffff R11: 0000000000000246 R12: 000055fb76a9a998
[   68.151640] R13: 0000000000000001 R14: 0000000000000009 R15: 000055fb76a9a998
[   68.152459] Modules linked in: 9pnet_virtio isst_if_common xhci_pci 9pnet iTCO_wdt intel_pmc_bxt xhci_hcd iTCO_vendor_support
[   68.153707] ---[ end trace 0ca39a5ed99162cf ]---
[   68.154282] RIP: 0010:__mutex_lock.isra.0+0x76/0x4e0
[   68.154884] Code: b7 01 00 00 48 39 c6 0f 84 a4 03 00 00 65 48 8b 04 25 80 7d 01 00 48 8b 00 a8 08 75 18 49 8b 06 48 83 e0 f8 0f 84 2f 02 00 00 <8b> 50 3c 85 d2 0f 85 12 02 00 00 65 48 8b 04 25 80 7d 01 00 48 8b
[   68.156976] RSP: 0018:ffffc90000befd50 EFLAGS: 00010206
[   68.157614] RAX: 00007f0b16a3c000 RBX: ffff889037617910 RCX: 0000000000000000
[   68.158436] RDX: 00007f0b16a3c000 RSI: ffff88902a4aca80 RDI: ffff8890376178c0
[   68.159269] RBP: ffffc90000befdf0 R08: 0000000000000001 R09: 0000000000000000
[   68.160092] R10: ffff889037617920 R11: ffff88903f8abaf0 R12: ffffc90000befe08
[   68.160920] R13: 0000000000000000 R14: ffff8890376178c0 R15: 0000000000000000
[   68.161746] FS:  00007f0b97743740(0000) GS:ffff88903f880000(0000) knlGS:0000000000000000
[   68.162701] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.163386] CR2: 00007f0b978455dc CR3: 000000000360a005 CR4: 0000000000760ee0
[   68.164226] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   68.165079] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[   68.165931] PKRU: 55555554
[   68.166298] Fixing recursive fault but reboot is needed!
[  128.173729] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[  128.179267] rcu: 	11-...0: (1 GPs behind) idle=c56/1/0x4000000000000000 softirq=6897/6898 fqs=5976 
[  128.182232] rcu: 	19-...0: (1 GPs behind) idle=492/1/0x4000000000000000 softirq=1023/1023 fqs=5976 
[  128.185217] 	(detected by 10, t=18003 jiffies, g=15789, q=631)
[  128.186863] Sending NMI from CPU 10 to CPUs 11:
[  128.188902] NMI backtrace for cpu 11
[  128.188903] CPU: 11 PID: 2546 Comm: postgres Tainted: G      D           5.7.0-andres-10123-g87823242260e #44
[  128.188904] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[  128.188904] RIP: 0010:queued_read_lock_slowpath+0x5b/0x70
[  128.188906] Code: 03 00 02 00 00 8b 03 84 c0 74 08 f3 90 8b 13 84 d2 75 f8 48 89 ef e8 74 e6 ff ff 66 90 5b 5d c3 8b 07 84 c0 74 08 f3 90 8b 03 <84> c0 75 f8 5b 5d c3 89 c6 48 89 ef e8 e4 e8 ff ff 66 90 eb bf 0f
[  128.188907] RSP: 0018:ffffc90000348c08 EFLAGS: 00000086
[  128.188908] RAX: 0000000037617cc0 RBX: ffff889037617920 RCX: 00000000000000c3
[  128.188909] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff889037617920
[  128.188910] RBP: ffff889037bb1a80 R08: 00000000000000c3 R09: ffffc90000348cd8
[  128.188910] R10: 0100000000000000 R11: 00000000de2ee17e R12: 0000000000000046
[  128.188911] R13: ffff889037617920 R14: 0000000000000001 R15: 00000000000000c3
[  128.188912] FS:  00007f0b97743740(0000) GS:ffff88903fac0000(0000) knlGS:0000000000000000
[  128.188912] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  128.188913] CR2: 00007f0b16afc00e CR3: 000000102e5c6002 CR4: 0000000000760ee0
[  128.188914] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  128.188914] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  128.188915] PKRU: 55555554
[  128.188915] Call Trace:
[  128.188916]  <IRQ>
[  128.188916]  _raw_read_lock_irqsave+0x26/0x30
[  128.188917]  ep_poll_callback+0x3e/0x2b0
[  128.188917]  ? cpumask_next_and+0x19/0x20
[  128.188918]  ? update_sd_lb_stats.constprop.0+0xfe/0x810
[  128.188918]  __wake_up_common+0x7a/0x140
[  128.188919]  __wake_up_common_lock+0x7c/0xc0
[  128.188919]  sock_def_readable+0x37/0x60
[  128.188920]  __udp_enqueue_schedule_skb+0x168/0x260
[  128.188920]  udpv6_queue_rcv_one_skb+0x284/0x3c0
[  128.188921]  udp6_unicast_rcv_skb.isra.0+0x44/0xa0
[  128.188921]  ip6_protocol_deliver_rcu+0x235/0x4b0
[  128.188922]  ip6_input_finish+0x11/0x20
[  128.188922]  ip6_input+0xa2/0xb0
[  128.188923]  ? ip6_protocol_deliver_rcu+0x4b0/0x4b0
[  128.188923]  ipv6_rcv+0xc0/0xd0
[  128.188924]  ? ip6_rcv_finish_core.isra.0+0xd0/0xd0
[  128.188924]  __netif_receive_skb_one_core+0x63/0xa0
[  128.188925]  process_backlog+0x98/0x140
[  128.188925]  net_rx_action+0x13a/0x370
[  128.188926]  __do_softirq+0xe0/0x2ca
[  128.188926]  do_softirq_own_stack+0x2a/0x40
[  128.188926]  </IRQ>
[  128.188927]  do_softirq.part.0+0x2b/0x30
[  128.188927]  __local_bh_enable_ip+0x4b/0x50
[  128.188928]  ip6_finish_output2+0x264/0x5b0
[  128.188928]  ip6_output+0x73/0x120
[  128.188929]  ? __ip6_finish_output+0x110/0x110
[  128.188929]  ip6_send_skb+0x1e/0x60
[  128.188930]  udp_v6_send_skb.isra.0+0x197/0x460
[  128.188930]  udpv6_sendmsg+0xb4f/0xdb0
[  128.188931]  ? ip_reply_glue_bits+0x40/0x40
[  128.188931]  ? update_load_avg+0x78/0x630
[  128.188932]  ? update_curr+0x73/0x1d0
[  128.188932]  ? __sys_sendto+0x108/0x190
[  128.188933]  __sys_sendto+0x108/0x190
[  128.188933]  ? __fput+0x1a5/0x240
[  128.188934]  ? _cond_resched+0x19/0x30
[  128.188934]  ? task_work_run+0x67/0x90
[  128.188935]  __x64_sys_sendto+0x25/0x30
[  128.188935]  do_syscall_64+0x48/0x130
[  128.188936]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  128.188936] RIP: 0033:0x7f0b97a7826c
[  128.188945] Code: c0 ff ff ff ff eb b9 0f 1f 80 00 00 00 00 41 89 ca 64 8b 04 25 18 00 00 00 85 c0 75 19 45 31 c9 45 31 c0 b8 2c 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 64 c3 0f 1f 00 55 48 83 ec 20 48 89 54 24 10
[  128.188946] RSP: 002b:00007ffe80ffcea8 EFLAGS: 00000246 ORIG_RAX: 000000000000002c
[  128.188947] RAX: ffffffffffffffda RBX: 0000000000000058 RCX: 00007f0b97a7826c
[  128.188948] RDX: 0000000000000058 RSI: 000055fb765264c0 RDI: 0000000000000009
[  128.188949] RBP: 000055fb765264c0 R08: 0000000000000000 R09: 0000000000000000
[  128.188949] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffe80ffcfc0
[  128.188950] R13: 000000000002c600 R14: 0000000000000000 R15: 000055fb7629b751
[  128.188957] Sending NMI from CPU 10 to CPUs 19:
[  128.239939] NMI backtrace for cpu 19
[  128.239940] CPU: 19 PID: 2587 Comm: postgres Tainted: G      D           5.7.0-andres-10123-g87823242260e #44
[  128.239940] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[  128.239940] RIP: 0010:kvm_wait+0x30/0x50
[  128.239941] Code: 8b 05 ac cb f4 7e a9 00 00 f0 00 75 1f 9c 58 fa 0f b6 17 40 38 d6 75 12 f6 c4 02 75 10 e9 07 00 00 00 0f 00 2d 6f ce 54 01 f4 <50> 9d c3 e9 07 00 00 00 0f 00 2d 5f ce 54 01 fb f4 eb ed 66 66 2e
[  128.239942] RSP: 0018:ffffc90000cc78e8 EFLAGS: 00000046
[  128.239942] RAX: 0000000000000046 RBX: ffff88903fcec700 RCX: 0000000000000008
[  128.239943] RDX: 0000000000000003 RSI: 0000000000000003 RDI: ffff889039049d80
[  128.239943] RBP: ffff889039049d80 R08: ffff88907ffe9f80 R09: 00000000000000f8
[  128.239944] R10: 0000000000000000 R11: 0000000000000001 R12: 0000000000000000
[  128.239944] R13: 0000000000000001 R14: 0000000000000100 R15: 0000000000500000
[  128.239944] FS:  00007f0b97743740(0000) GS:ffff88903fcc0000(0000) knlGS:0000000000000000
[  128.239945] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  128.239945] CR2: 000055fb76a96030 CR3: 0000001035882004 CR4: 0000000000760ee0
[  128.239945] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  128.239946] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  128.239946] PKRU: 55555554
[  128.239946] Call Trace:
[  128.239946]  __pv_queued_spin_lock_slowpath+0x26e/0x2b0
[  128.239947]  _raw_spin_lock_irqsave+0x25/0x30
[  128.239947]  __wake_up_common_lock+0x62/0xc0
[  128.239947]  sock_def_write_space+0x49/0x90
[  128.239948]  sock_wfree+0x68/0xb0
[  128.239948]  loopback_xmit+0x49/0xe0
[  128.239948]  dev_hard_start_xmit+0x8d/0x1e0
[  128.239948]  __dev_queue_xmit+0x721/0x8e0
[  128.239949]  ip6_finish_output2+0x250/0x5b0
[  128.239949]  ip6_output+0x73/0x120
[  128.239949]  ? __ip6_finish_output+0x110/0x110
[  128.239950]  ip6_send_skb+0x1e/0x60
[  128.239950]  udp_v6_send_skb.isra.0+0x197/0x460
[  128.239950]  udpv6_sendmsg+0xb4f/0xdb0
[  128.239950]  ? release_pages+0x28f/0x2f0
[  128.239950]  ? ip_reply_glue_bits+0x40/0x40
[  128.239951]  ? _cond_resched+0x19/0x30
[  128.239951]  ? unmap_page_range+0x678/0xa60
[  128.239951]  ? __sys_sendto+0x108/0x190
[  128.239951]  __sys_sendto+0x108/0x190
[  128.239952]  ? __fput+0x1a5/0x240
[  128.239952]  ? _cond_resched+0x19/0x30
[  128.239952]  ? task_work_run+0x67/0x90
[  128.239952]  __x64_sys_sendto+0x25/0x30
[  128.239953]  do_syscall_64+0x48/0x130
[  128.239953]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
Quoted 8 lines
[  128.239953] RIP: 0033:0x7f0b97a7826c
[  128.239954] Code: c0 ff ff ff ff eb b9 0f 1f 80 00 00 00 00 41 89 ca 64 8b 04 25 18 00 00 00 85 c0 75 19 45 31 c9 45 31 c0 b8 2c 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 64 c3 0f 1f 00 55 48 83 ec 20 48 89 54 24 10
[  128.239954] RSP: 002b:00007ffe80ffd7b8 EFLAGS: 00000246 ORIG_RAX: 000000000000002c
[  128.239955] RAX: ffffffffffffffda RBX: 00000000000003a8 RCX: 00007f0b97a7826c
[  128.239955] RDX: 00000000000003a8 RSI: 00007ffe80ffd800 RDI: 0000000000000009
[  128.239955] RBP: 00007ffe80ffd800 R08: 0000000000000000 R09: 0000000000000000
[  128.239956] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffe80ffd800
[  128.239956] R13: 00007ffe80ffd800 R14: 000000000000000e R15: 000055fb76b37e58
Quoted 1 line

I can reproduce this, and I see what it is. I'll send out a patch soonish.

Thinko, can you try with this on top?

fs/io_uring.c +4 -2
index d22830a423f1..ca96ece3ac18 100644
@@ -2787,9 +2787,11 @@ static int io_read(struct io_kiocb *req, bool force_nonblock)
 			/* if we can retry, do so with the callbacks armed */
 			if (io_rw_should_retry(req)) {
 				ret2 = io_iter_do_read(req, &iter);
-				if (ret2 != -EAGAIN) {
+				if (ret2 == -EIOCBQUEUED) {
+					return 0;
+				} else if (ret2 != -EAGAIN) {
 					kiocb_done(kiocb, ret2);
-					goto out_free;
+					return 0;
 				}
 			}
 			kiocb->ki_flags &= ~IOCB_WAITQ;
Signature · 1 line
Jens Axboe
author maintainer
#57 lore raw
Quoted 252 lines · Jens Axboe
Quoted 251 lines · Jens Axboe
Quoted 249 lines · Andres Freund

Hi,

Quoted 1 line · Andres Freund

I'll go and try to figure out why I don't see an oops...

Err, that probably was a typo on my end in the serial console config. After fixing that, I did get the below.

If helpful I can try with debugging enabled or such.

[   67.910265] tee (2577): drop_caches: 3
[   68.059674] BUG: unable to handle page fault for address: 00007f0b16a3c03c
[   68.062021] #PF: supervisor read access in kernel mode
[   68.063742] #PF: error_code(0x0000) - not-present page
[   68.065517] PGD 102e044067 P4D 102e044067 PUD 102bf7a067 PMD 0 
[   68.067519] Oops: 0000 [#1] SMP NOPTI
[   68.068800] CPU: 2 PID: 2554 Comm: postgres Not tainted 5.7.0-andres-10123-g87823242260e #44
[   68.071505] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[   68.074139] RIP: 0010:__mutex_lock.isra.0+0x76/0x4e0
[   68.075389] Code: b7 01 00 00 48 39 c6 0f 84 a4 03 00 00 65 48 8b 04 25 80 7d 01 00 48 8b 00 a8 08 75 18 49 8b 06 48 83 e0 f8 0f 84 2f 02 00 00 <8b> 50 3c 85 d2 0f 85 12 02 00 00 65 48 8b 04 25 80 7d 01 00 48 8b
[   68.079125] RSP: 0018:ffffc90000befd50 EFLAGS: 00010206
[   68.080260] RAX: 00007f0b16a3c000 RBX: ffff889037617910 RCX: 0000000000000000
[   68.084115] RDX: 00007f0b16a3c000 RSI: ffff88902a4aca80 RDI: ffff8890376178c0
[   68.085374] RBP: ffffc90000befdf0 R08: 0000000000000001 R09: 0000000000000000
[   68.086409] R10: ffff889037617920 R11: ffff88903f8abaf0 R12: ffffc90000befe08
[   68.087447] R13: 0000000000000000 R14: ffff8890376178c0 R15: 0000000000000000
[   68.088697] FS:  00007f0b97743740(0000) GS:ffff88903f880000(0000) knlGS:0000000000000000
[   68.089903] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.090776] CR2: 00007f0b16a3c03c CR3: 000000102cf7c004 CR4: 0000000000760ee0
[   68.091834] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   68.092902] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[   68.093967] PKRU: 55555554
[   68.094427] Call Trace:
[   68.094845]  ? __schedule+0x2ac/0x720
[   68.095350]  ? schedule+0x55/0xc0
[   68.095797]  ? ep_read_events_proc+0xd0/0xd0
[   68.096354]  ep_scan_ready_list.constprop.0+0x16c/0x190
[   68.097016]  ep_poll+0x2a3/0x440
[   68.097449]  ? wait_woken+0x70/0x70
[   68.097904]  do_epoll_wait+0xb0/0xd0
[   68.098375]  __x64_sys_epoll_wait+0x1a/0x20
[   68.098913]  do_syscall_64+0x48/0x130
[   68.099393]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[   68.100030] RIP: 0033:0x7f0b97845606
[   68.100498] Code: 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 41 89 ca 64 8b 04 25 18 00 00 00 85 c0 75 11 b8 e8 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 5a c3 90 48 83 ec 28 89 54 24 18 48 89 74 24
[   68.102718] RSP: 002b:00007ffe80ffdba8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e8
[   68.103644] RAX: ffffffffffffffda RBX: 000055fb76a9a998 RCX: 00007f0b97845606
[   68.104533] RDX: 0000000000000001 RSI: 000055fb76a9aa10 RDI: 0000000000000005
[   68.105418] RBP: 0000000005000007 R08: 0000000005000007 R09: 0000000000000003
[   68.106296] R10: 00000000ffffffff R11: 0000000000000246 R12: 000055fb76a9a998
[   68.107187] R13: 0000000000000001 R14: 0000000000000009 R15: 000055fb76a9a998
[   68.108104] Modules linked in: 9pnet_virtio isst_if_common xhci_pci 9pnet iTCO_wdt intel_pmc_bxt xhci_hcd iTCO_vendor_support
[   68.109505] CR2: 00007f0b16a3c03c
[   68.109962] ---[ end trace 0ca39a5ed99162ce ]---
[   68.110547] RIP: 0010:__mutex_lock.isra.0+0x76/0x4e0
[   68.111214] Code: b7 01 00 00 48 39 c6 0f 84 a4 03 00 00 65 48 8b 04 25 80 7d 01 00 48 8b 00 a8 08 75 18 49 8b 06 48 83 e0 f8 0f 84 2f 02 00 00 <8b> 50 3c 85 d2 0f 85 12 02 00 00 65 48 8b 04 25 80 7d 01 00 48 8b
[   68.113435] RSP: 0018:ffffc90000befd50 EFLAGS: 00010206
[   68.114111] RAX: 00007f0b16a3c000 RBX: ffff889037617910 RCX: 0000000000000000
[   68.115016] RDX: 00007f0b16a3c000 RSI: ffff88902a4aca80 RDI: ffff8890376178c0
[   68.115902] RBP: ffffc90000befdf0 R08: 0000000000000001 R09: 0000000000000000
[   68.116810] R10: ffff889037617920 R11: ffff88903f8abaf0 R12: ffffc90000befe08
[   68.117663] R13: 0000000000000000 R14: ffff8890376178c0 R15: 0000000000000000
[   68.118520] FS:  00007f0b97743740(0000) GS:ffff88903f880000(0000) knlGS:0000000000000000
[   68.119482] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.120181] CR2: 00007f0b16a3c03c CR3: 000000102cf7c004 CR4: 0000000000760ee0
[   68.121043] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   68.121904] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[   68.122790] PKRU: 55555554
[   68.123401] general protection fault, probably for non-canonical address 0xfeeda989fef06266: 0000 [#2] SMP NOPTI
[   68.125052] CPU: 2 PID: 2554 Comm: postgres Tainted: G      D           5.7.0-andres-10123-g87823242260e #44
[   68.126260] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[   68.127274] RIP: 0010:__pv_queued_spin_lock_slowpath+0x1a1/0x2b0
[   68.128032] Code: c4 c1 ea 12 41 be 01 00 00 00 8d 42 ff 41 83 e4 03 4c 8d 6b 14 49 c1 e4 05 48 98 49 81 c4 00 c7 02 00 4c 03 24 c5 e0 e6 fd 82 <49> 89 1c 24 b8 00 80 00 00 eb 15 84 c0 75 0a 41 0f b6 54 24 14 84
[   68.130221] RSP: 0018:ffffc90000befce8 EFLAGS: 00010086
[   68.130867] RAX: 0000000000003ffe RBX: ffff88903f8ac700 RCX: 0000000000000001
[   68.131752] RDX: 0000000000003fff RSI: 0000000000000000 RDI: 0000000000000000
[   68.132637] RBP: ffff889037617924 R08: 0000000000000000 R09: ffffc90000befdf8
[   68.133513] R10: ffff8890334d2bf0 R11: 0000000000000018 R12: feeda989fef06266
[   68.134399] R13: ffff88903f8ac714 R14: 0000000000000001 R15: 00000000000c0000
[   68.135323] FS:  00007f0b97743740(0000) GS:ffff88903f880000(0000) knlGS:0000000000000000
[   68.136307] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.137004] CR2: 00007f0b16a3c03c CR3: 000000000360a005 CR4: 0000000000760ee0
[   68.137866] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   68.138748] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[   68.139606] PKRU: 55555554
[   68.139973] Call Trace:
[   68.140313]  queued_read_lock_slowpath+0x6c/0x70
[   68.140915]  _raw_read_lock_irqsave+0x26/0x30
[   68.141485]  ep_poll_callback+0x3e/0x2b0
[   68.142007]  ? set_next_entity+0xab/0x1f0
[   68.142541]  __wake_up_common+0x7a/0x140
[   68.143077]  __wake_up_common_lock+0x7c/0xc0
[   68.143651]  pipe_release+0x5b/0xd0
[   68.144150]  __fput+0xda/0x240
[   68.144574]  task_work_run+0x62/0x90
[   68.145046]  do_exit+0x35c/0xa70
[   68.145505]  ? do_epoll_wait+0xb0/0xd0
[   68.146000]  rewind_stack_do_exit+0x17/0x20
[   68.146538] RIP: 0033:0x7f0b97845606
[   68.146988] Code: Bad RIP value.
[   68.147405] RSP: 002b:00007ffe80ffdba8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e8
[   68.148314] RAX: ffffffffffffffda RBX: 000055fb76a9a998 RCX: 00007f0b97845606
[   68.149157] RDX: 0000000000000001 RSI: 000055fb76a9aa10 RDI: 0000000000000005
[   68.150021] RBP: 0000000005000007 R08: 0000000005000007 R09: 0000000000000003
[   68.150831] R10: 00000000ffffffff R11: 0000000000000246 R12: 000055fb76a9a998
[   68.151640] R13: 0000000000000001 R14: 0000000000000009 R15: 000055fb76a9a998
[   68.152459] Modules linked in: 9pnet_virtio isst_if_common xhci_pci 9pnet iTCO_wdt intel_pmc_bxt xhci_hcd iTCO_vendor_support
[   68.153707] ---[ end trace 0ca39a5ed99162cf ]---
[   68.154282] RIP: 0010:__mutex_lock.isra.0+0x76/0x4e0
[   68.154884] Code: b7 01 00 00 48 39 c6 0f 84 a4 03 00 00 65 48 8b 04 25 80 7d 01 00 48 8b 00 a8 08 75 18 49 8b 06 48 83 e0 f8 0f 84 2f 02 00 00 <8b> 50 3c 85 d2 0f 85 12 02 00 00 65 48 8b 04 25 80 7d 01 00 48 8b
[   68.156976] RSP: 0018:ffffc90000befd50 EFLAGS: 00010206
[   68.157614] RAX: 00007f0b16a3c000 RBX: ffff889037617910 RCX: 0000000000000000
[   68.158436] RDX: 00007f0b16a3c000 RSI: ffff88902a4aca80 RDI: ffff8890376178c0
[   68.159269] RBP: ffffc90000befdf0 R08: 0000000000000001 R09: 0000000000000000
[   68.160092] R10: ffff889037617920 R11: ffff88903f8abaf0 R12: ffffc90000befe08
[   68.160920] R13: 0000000000000000 R14: ffff8890376178c0 R15: 0000000000000000
[   68.161746] FS:  00007f0b97743740(0000) GS:ffff88903f880000(0000) knlGS:0000000000000000
[   68.162701] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.163386] CR2: 00007f0b978455dc CR3: 000000000360a005 CR4: 0000000000760ee0
[   68.164226] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   68.165079] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[   68.165931] PKRU: 55555554
[   68.166298] Fixing recursive fault but reboot is needed!
[  128.173729] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[  128.179267] rcu: 	11-...0: (1 GPs behind) idle=c56/1/0x4000000000000000 softirq=6897/6898 fqs=5976 
[  128.182232] rcu: 	19-...0: (1 GPs behind) idle=492/1/0x4000000000000000 softirq=1023/1023 fqs=5976 
[  128.185217] 	(detected by 10, t=18003 jiffies, g=15789, q=631)
[  128.186863] Sending NMI from CPU 10 to CPUs 11:
[  128.188902] NMI backtrace for cpu 11
[  128.188903] CPU: 11 PID: 2546 Comm: postgres Tainted: G      D           5.7.0-andres-10123-g87823242260e #44
[  128.188904] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[  128.188904] RIP: 0010:queued_read_lock_slowpath+0x5b/0x70
[  128.188906] Code: 03 00 02 00 00 8b 03 84 c0 74 08 f3 90 8b 13 84 d2 75 f8 48 89 ef e8 74 e6 ff ff 66 90 5b 5d c3 8b 07 84 c0 74 08 f3 90 8b 03 <84> c0 75 f8 5b 5d c3 89 c6 48 89 ef e8 e4 e8 ff ff 66 90 eb bf 0f
[  128.188907] RSP: 0018:ffffc90000348c08 EFLAGS: 00000086
[  128.188908] RAX: 0000000037617cc0 RBX: ffff889037617920 RCX: 00000000000000c3
[  128.188909] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff889037617920
[  128.188910] RBP: ffff889037bb1a80 R08: 00000000000000c3 R09: ffffc90000348cd8
[  128.188910] R10: 0100000000000000 R11: 00000000de2ee17e R12: 0000000000000046
[  128.188911] R13: ffff889037617920 R14: 0000000000000001 R15: 00000000000000c3
[  128.188912] FS:  00007f0b97743740(0000) GS:ffff88903fac0000(0000) knlGS:0000000000000000
[  128.188912] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  128.188913] CR2: 00007f0b16afc00e CR3: 000000102e5c6002 CR4: 0000000000760ee0
[  128.188914] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  128.188914] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  128.188915] PKRU: 55555554
[  128.188915] Call Trace:
[  128.188916]  <IRQ>
[  128.188916]  _raw_read_lock_irqsave+0x26/0x30
[  128.188917]  ep_poll_callback+0x3e/0x2b0
[  128.188917]  ? cpumask_next_and+0x19/0x20
[  128.188918]  ? update_sd_lb_stats.constprop.0+0xfe/0x810
[  128.188918]  __wake_up_common+0x7a/0x140
[  128.188919]  __wake_up_common_lock+0x7c/0xc0
[  128.188919]  sock_def_readable+0x37/0x60
[  128.188920]  __udp_enqueue_schedule_skb+0x168/0x260
[  128.188920]  udpv6_queue_rcv_one_skb+0x284/0x3c0
[  128.188921]  udp6_unicast_rcv_skb.isra.0+0x44/0xa0
[  128.188921]  ip6_protocol_deliver_rcu+0x235/0x4b0
[  128.188922]  ip6_input_finish+0x11/0x20
[  128.188922]  ip6_input+0xa2/0xb0
[  128.188923]  ? ip6_protocol_deliver_rcu+0x4b0/0x4b0
[  128.188923]  ipv6_rcv+0xc0/0xd0
[  128.188924]  ? ip6_rcv_finish_core.isra.0+0xd0/0xd0
[  128.188924]  __netif_receive_skb_one_core+0x63/0xa0
[  128.188925]  process_backlog+0x98/0x140
[  128.188925]  net_rx_action+0x13a/0x370
[  128.188926]  __do_softirq+0xe0/0x2ca
[  128.188926]  do_softirq_own_stack+0x2a/0x40
[  128.188926]  </IRQ>
[  128.188927]  do_softirq.part.0+0x2b/0x30
[  128.188927]  __local_bh_enable_ip+0x4b/0x50
[  128.188928]  ip6_finish_output2+0x264/0x5b0
[  128.188928]  ip6_output+0x73/0x120
[  128.188929]  ? __ip6_finish_output+0x110/0x110
[  128.188929]  ip6_send_skb+0x1e/0x60
[  128.188930]  udp_v6_send_skb.isra.0+0x197/0x460
[  128.188930]  udpv6_sendmsg+0xb4f/0xdb0
[  128.188931]  ? ip_reply_glue_bits+0x40/0x40
[  128.188931]  ? update_load_avg+0x78/0x630
[  128.188932]  ? update_curr+0x73/0x1d0
[  128.188932]  ? __sys_sendto+0x108/0x190
[  128.188933]  __sys_sendto+0x108/0x190
[  128.188933]  ? __fput+0x1a5/0x240
[  128.188934]  ? _cond_resched+0x19/0x30
[  128.188934]  ? task_work_run+0x67/0x90
[  128.188935]  __x64_sys_sendto+0x25/0x30
[  128.188935]  do_syscall_64+0x48/0x130
[  128.188936]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  128.188936] RIP: 0033:0x7f0b97a7826c
[  128.188945] Code: c0 ff ff ff ff eb b9 0f 1f 80 00 00 00 00 41 89 ca 64 8b 04 25 18 00 00 00 85 c0 75 19 45 31 c9 45 31 c0 b8 2c 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 64 c3 0f 1f 00 55 48 83 ec 20 48 89 54 24 10
[  128.188946] RSP: 002b:00007ffe80ffcea8 EFLAGS: 00000246 ORIG_RAX: 000000000000002c
[  128.188947] RAX: ffffffffffffffda RBX: 0000000000000058 RCX: 00007f0b97a7826c
[  128.188948] RDX: 0000000000000058 RSI: 000055fb765264c0 RDI: 0000000000000009
[  128.188949] RBP: 000055fb765264c0 R08: 0000000000000000 R09: 0000000000000000
[  128.188949] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffe80ffcfc0
[  128.188950] R13: 000000000002c600 R14: 0000000000000000 R15: 000055fb7629b751
[  128.188957] Sending NMI from CPU 10 to CPUs 19:
[  128.239939] NMI backtrace for cpu 19
[  128.239940] CPU: 19 PID: 2587 Comm: postgres Tainted: G      D           5.7.0-andres-10123-g87823242260e #44
[  128.239940] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[  128.239940] RIP: 0010:kvm_wait+0x30/0x50
[  128.239941] Code: 8b 05 ac cb f4 7e a9 00 00 f0 00 75 1f 9c 58 fa 0f b6 17 40 38 d6 75 12 f6 c4 02 75 10 e9 07 00 00 00 0f 00 2d 6f ce 54 01 f4 <50> 9d c3 e9 07 00 00 00 0f 00 2d 5f ce 54 01 fb f4 eb ed 66 66 2e
[  128.239942] RSP: 0018:ffffc90000cc78e8 EFLAGS: 00000046
[  128.239942] RAX: 0000000000000046 RBX: ffff88903fcec700 RCX: 0000000000000008
[  128.239943] RDX: 0000000000000003 RSI: 0000000000000003 RDI: ffff889039049d80
[  128.239943] RBP: ffff889039049d80 R08: ffff88907ffe9f80 R09: 00000000000000f8
[  128.239944] R10: 0000000000000000 R11: 0000000000000001 R12: 0000000000000000
[  128.239944] R13: 0000000000000001 R14: 0000000000000100 R15: 0000000000500000
[  128.239944] FS:  00007f0b97743740(0000) GS:ffff88903fcc0000(0000) knlGS:0000000000000000
[  128.239945] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  128.239945] CR2: 000055fb76a96030 CR3: 0000001035882004 CR4: 0000000000760ee0
[  128.239945] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  128.239946] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  128.239946] PKRU: 55555554
[  128.239946] Call Trace:
[  128.239946]  __pv_queued_spin_lock_slowpath+0x26e/0x2b0
[  128.239947]  _raw_spin_lock_irqsave+0x25/0x30
[  128.239947]  __wake_up_common_lock+0x62/0xc0
[  128.239947]  sock_def_write_space+0x49/0x90
[  128.239948]  sock_wfree+0x68/0xb0
[  128.239948]  loopback_xmit+0x49/0xe0
[  128.239948]  dev_hard_start_xmit+0x8d/0x1e0
[  128.239948]  __dev_queue_xmit+0x721/0x8e0
[  128.239949]  ip6_finish_output2+0x250/0x5b0
[  128.239949]  ip6_output+0x73/0x120
[  128.239949]  ? __ip6_finish_output+0x110/0x110
[  128.239950]  ip6_send_skb+0x1e/0x60
[  128.239950]  udp_v6_send_skb.isra.0+0x197/0x460
[  128.239950]  udpv6_sendmsg+0xb4f/0xdb0
[  128.239950]  ? release_pages+0x28f/0x2f0
[  128.239950]  ? ip_reply_glue_bits+0x40/0x40
[  128.239951]  ? _cond_resched+0x19/0x30
[  128.239951]  ? unmap_page_range+0x678/0xa60
[  128.239951]  ? __sys_sendto+0x108/0x190
[  128.239951]  __sys_sendto+0x108/0x190
[  128.239952]  ? __fput+0x1a5/0x240
[  128.239952]  ? _cond_resched+0x19/0x30
[  128.239952]  ? task_work_run+0x67/0x90
[  128.239952]  __x64_sys_sendto+0x25/0x30
[  128.239953]  do_syscall_64+0x48/0x130
[  128.239953]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  128.239953] RIP: 0033:0x7f0b97a7826c
[  128.239954] Code: c0 ff ff ff ff eb b9 0f 1f 80 00 00 00 00 41 89 ca 64 8b 04 25 18 00 00 00 85 c0 75 19 45 31 c9 45 31 c0 b8 2c 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 64 c3 0f 1f 00 55 48 83 ec 20 48 89 54 24 10
[  128.239954] RSP: 002b:00007ffe80ffd7b8 EFLAGS: 00000246 ORIG_RAX: 000000000000002c
[  128.239955] RAX: ffffffffffffffda RBX: 00000000000003a8 RCX: 00007f0b97a7826c
[  128.239955] RDX: 00000000000003a8 RSI: 00007ffe80ffd800 RDI: 0000000000000009
[  128.239955] RBP: 00007ffe80ffd800 R08: 0000000000000000 R09: 0000000000000000
[  128.239956] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffe80ffd800
[  128.239956] R13: 00007ffe80ffd800 R14: 000000000000000e R15: 000055fb76b37e58
Quoted 3 lines
Quoted 1 line

I can reproduce this, and I see what it is. I'll send out a patch soonish.

Thinko, can you try with this on top?

Sorry that was incomplete, please use this one!

fs/io_uring.c +6 -6
index d22830a423f1..0075107dd09a 100644
@@ -2779,7 +2779,7 @@ static int io_read(struct io_kiocb *req, bool force_nonblock)
 			ret = io_setup_async_rw(req, io_size, iovec,
 						inline_vecs, &iter);
 			if (ret)
-				goto out_free;
+				goto out;
 			/* any defer here is final, must blocking retry */
 			if (!(req->flags & REQ_F_NOWAIT) &&
 			    !file_can_poll(req->file))
@@ -2787,18 +2787,18 @@ static int io_read(struct io_kiocb *req, bool force_nonblock)
 			/* if we can retry, do so with the callbacks armed */
 			if (io_rw_should_retry(req)) {
 				ret2 = io_iter_do_read(req, &iter);
-				if (ret2 != -EAGAIN) {
+				if (ret2 == -EIOCBQUEUED) {
+					goto out;
+				} else if (ret2 != -EAGAIN) {
 					kiocb_done(kiocb, ret2);
-					goto out_free;
+					goto out;
 				}
 			}
 			kiocb->ki_flags &= ~IOCB_WAITQ;
 			return -EAGAIN;
 		}
 	}
-out_free:
-	kfree(iovec);
-	req->flags &= ~REQ_F_NEED_CLEANUP;
+out:
 	return ret;
 }
 
Signature · 1 line
Jens Axboe
#58 lore raw

Hi,

Quoted 5 lines · Jens Axboe
Quoted 3 lines
Quoted 1 line

I can reproduce this, and I see what it is. I'll send out a patch soonish.

Thinko, can you try with this on top?

Sorry that was incomplete, please use this one!

That seems to fix it! Yay.

Bulk buffered reads somehow don't quite seem to be performing that well though, looking into it. Could be on the pg side too.

Greetings,

Andres Freund

#59 lore raw

Hi,

Quoted 5 lines · Andres Freund
Quoted 4 lines · Jens Axboe
Quoted 3 lines
Quoted 1 line

I can reproduce this, and I see what it is. I'll send out a patch soonish.

Thinko, can you try with this on top?

Quoted 7 lines
Quoted 1 line

Sorry that was incomplete, please use this one!

That seems to fix it! Yay.

Bulk buffered reads somehow don't quite seem to be performing that well though, looking into it. Could be on the pg side too.

While looking into that, I played with setting /sys/<dev>/queue/read_ahead_kb to 0 and noticed that seems to result in all/most IO done in workers. Is that to be expected?

Greetings,

Andres Freund

author maintainer
#60 lore raw
Quoted 13 lines · Andres Freund

Hi,

Quoted 10 lines · Andres Freund
Quoted 5 lines · Jens Axboe
Quoted 3 lines
Quoted 1 line

I can reproduce this, and I see what it is. I'll send out a patch soonish.

Thinko, can you try with this on top?

Sorry that was incomplete, please use this one!

That seems to fix it! Yay.

Quoted 6 lines
Quoted 2 lines

Bulk buffered reads somehow don't quite seem to be performing that well though, looking into it. Could be on the pg side too.

While looking into that, I played with setting /sys/<dev>/queue/read_ahead_kb to 0 and noticed that seems to result in all/most IO done in workers. Is that to be expected?

Yes that's expected, if we have to fallback to ->readpage(), then it'll go to a worker. read-ahead is what drives the async nature of it, as we issue the range (plus more, depending on RA window) as read-ahead for the normal read, then wait for it.

Signature · 1 line
Jens Axboe
#61 lore raw

Hi,

Quoted 4 lines · Jens Axboe

Yes that's expected, if we have to fallback to ->readpage(), then it'll go to a worker. read-ahead is what drives the async nature of it, as we issue the range (plus more, depending on RA window) as read-ahead for the normal read, then wait for it.

But I assume async would still work for files with POSIX_FADV_RANDOM set, or not? Assuming the system wide setting isn't zero, of course.

Greetings,

Andres Freund

author maintainer
#62 lore raw
Quoted 10 lines · Andres Freund

Hi,

Quoted 4 lines · Jens Axboe

Yes that's expected, if we have to fallback to ->readpage(), then it'll go to a worker. read-ahead is what drives the async nature of it, as we issue the range (plus more, depending on RA window) as read-ahead for the normal read, then wait for it.

But I assume async would still work for files with POSIX_FADV_RANDOM set, or not? Assuming the system wide setting isn't zero, of course.

Yes it'll work if FADV_RANDOM is set. But just not if read-ahead is totally disabled. I guess we could make that work too, though not sure that it's super important.

Signature · 1 line
Jens Axboe
#63 lore raw

Hi,

Quoted 11 lines · Jens Axboe
Quoted 8 lines · Andres Freund
Quoted 4 lines · Jens Axboe

Yes that's expected, if we have to fallback to ->readpage(), then it'll go to a worker. read-ahead is what drives the async nature of it, as we issue the range (plus more, depending on RA window) as read-ahead for the normal read, then wait for it.

But I assume async would still work for files with POSIX_FADV_RANDOM set, or not? Assuming the system wide setting isn't zero, of course.

Yes it'll work if FADV_RANDOM is set.

Cool.

Quoted 2 lines

But just not if read-ahead is totally disabled. I guess we could make that work too, though not sure that it's super important.

It's not from my end. I was just trying to check if the reduced performance I saw was related to interactions between PG prefetching and kernel level prefetching. And changing the /sys entry seemed easier than making postgres set POSIX_FADV_RANDOM...

Greetings,

Andres Freund

#64 lore raw
In reply to Jens Axboe
Quoted 298 lines · Jens Axboe
Quoted 252 lines · Jens Axboe
Quoted 251 lines · Jens Axboe
Quoted 249 lines · Andres Freund

Hi,

Quoted 1 line · Andres Freund

I'll go and try to figure out why I don't see an oops...

Err, that probably was a typo on my end in the serial console config. After fixing that, I did get the below.

If helpful I can try with debugging enabled or such.

[   67.910265] tee (2577): drop_caches: 3
[   68.059674] BUG: unable to handle page fault for address: 00007f0b16a3c03c
[   68.062021] #PF: supervisor read access in kernel mode
[   68.063742] #PF: error_code(0x0000) - not-present page
[   68.065517] PGD 102e044067 P4D 102e044067 PUD 102bf7a067 PMD 0
[   68.067519] Oops: 0000 [#1] SMP NOPTI
[   68.068800] CPU: 2 PID: 2554 Comm: postgres Not tainted 5.7.0-andres-10123-g87823242260e #44
[   68.071505] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[   68.074139] RIP: 0010:__mutex_lock.isra.0+0x76/0x4e0
[   68.075389] Code: b7 01 00 00 48 39 c6 0f 84 a4 03 00 00 65 48 8b 04 25 80 7d 01 00 48 8b 00 a8 08 75 18 49 8b 06 48 83 e0 f8 0f 84 2f 02 00 00 <8b> 50 3c 85 d2 0f 85 12 02 00 00 65 48 8b 04 25 80 7d 01 00 48 8b
[   68.079125] RSP: 0018:ffffc90000befd50 EFLAGS: 00010206
[   68.080260] RAX: 00007f0b16a3c000 RBX: ffff889037617910 RCX: 0000000000000000
[   68.084115] RDX: 00007f0b16a3c000 RSI: ffff88902a4aca80 RDI: ffff8890376178c0
[   68.085374] RBP: ffffc90000befdf0 R08: 0000000000000001 R09: 0000000000000000
[   68.086409] R10: ffff889037617920 R11: ffff88903f8abaf0 R12: ffffc90000befe08
[   68.087447] R13: 0000000000000000 R14: ffff8890376178c0 R15: 0000000000000000
[   68.088697] FS:  00007f0b97743740(0000) GS:ffff88903f880000(0000) knlGS:0000000000000000
[   68.089903] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.090776] CR2: 00007f0b16a3c03c CR3: 000000102cf7c004 CR4: 0000000000760ee0
[   68.091834] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   68.092902] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[   68.093967] PKRU: 55555554
[   68.094427] Call Trace:
[   68.094845]  ? __schedule+0x2ac/0x720
[   68.095350]  ? schedule+0x55/0xc0
[   68.095797]  ? ep_read_events_proc+0xd0/0xd0
[   68.096354]  ep_scan_ready_list.constprop.0+0x16c/0x190
[   68.097016]  ep_poll+0x2a3/0x440
[   68.097449]  ? wait_woken+0x70/0x70
[   68.097904]  do_epoll_wait+0xb0/0xd0
[   68.098375]  __x64_sys_epoll_wait+0x1a/0x20
[   68.098913]  do_syscall_64+0x48/0x130
[   68.099393]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[   68.100030] RIP: 0033:0x7f0b97845606
[   68.100498] Code: 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 41 89 ca 64 8b 04 25 18 00 00 00 85 c0 75 11 b8 e8 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 5a c3 90 48 83 ec 28 89 54 24 18 48 89 74 24
[   68.102718] RSP: 002b:00007ffe80ffdba8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e8
[   68.103644] RAX: ffffffffffffffda RBX: 000055fb76a9a998 RCX: 00007f0b97845606
[   68.104533] RDX: 0000000000000001 RSI: 000055fb76a9aa10 RDI: 0000000000000005
[   68.105418] RBP: 0000000005000007 R08: 0000000005000007 R09: 0000000000000003
[   68.106296] R10: 00000000ffffffff R11: 0000000000000246 R12: 000055fb76a9a998
[   68.107187] R13: 0000000000000001 R14: 0000000000000009 R15: 000055fb76a9a998
[   68.108104] Modules linked in: 9pnet_virtio isst_if_common xhci_pci 9pnet iTCO_wdt intel_pmc_bxt xhci_hcd iTCO_vendor_support
[   68.109505] CR2: 00007f0b16a3c03c
[   68.109962] ---[ end trace 0ca39a5ed99162ce ]---
[   68.110547] RIP: 0010:__mutex_lock.isra.0+0x76/0x4e0
[   68.111214] Code: b7 01 00 00 48 39 c6 0f 84 a4 03 00 00 65 48 8b 04 25 80 7d 01 00 48 8b 00 a8 08 75 18 49 8b 06 48 83 e0 f8 0f 84 2f 02 00 00 <8b> 50 3c 85 d2 0f 85 12 02 00 00 65 48 8b 04 25 80 7d 01 00 48 8b
[   68.113435] RSP: 0018:ffffc90000befd50 EFLAGS: 00010206
[   68.114111] RAX: 00007f0b16a3c000 RBX: ffff889037617910 RCX: 0000000000000000
[   68.115016] RDX: 00007f0b16a3c000 RSI: ffff88902a4aca80 RDI: ffff8890376178c0
[   68.115902] RBP: ffffc90000befdf0 R08: 0000000000000001 R09: 0000000000000000
[   68.116810] R10: ffff889037617920 R11: ffff88903f8abaf0 R12: ffffc90000befe08
[   68.117663] R13: 0000000000000000 R14: ffff8890376178c0 R15: 0000000000000000
[   68.118520] FS:  00007f0b97743740(0000) GS:ffff88903f880000(0000) knlGS:0000000000000000
[   68.119482] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.120181] CR2: 00007f0b16a3c03c CR3: 000000102cf7c004 CR4: 0000000000760ee0
[   68.121043] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   68.121904] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[   68.122790] PKRU: 55555554
[   68.123401] general protection fault, probably for non-canonical address 0xfeeda989fef06266: 0000 [#2] SMP NOPTI
[   68.125052] CPU: 2 PID: 2554 Comm: postgres Tainted: G      D           5.7.0-andres-10123-g87823242260e #44
[   68.126260] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[   68.127274] RIP: 0010:__pv_queued_spin_lock_slowpath+0x1a1/0x2b0
[   68.128032] Code: c4 c1 ea 12 41 be 01 00 00 00 8d 42 ff 41 83 e4 03 4c 8d 6b 14 49 c1 e4 05 48 98 49 81 c4 00 c7 02 00 4c 03 24 c5 e0 e6 fd 82 <49> 89 1c 24 b8 00 80 00 00 eb 15 84 c0 75 0a 41 0f b6 54 24 14 84
[   68.130221] RSP: 0018:ffffc90000befce8 EFLAGS: 00010086
[   68.130867] RAX: 0000000000003ffe RBX: ffff88903f8ac700 RCX: 0000000000000001
[   68.131752] RDX: 0000000000003fff RSI: 0000000000000000 RDI: 0000000000000000
[   68.132637] RBP: ffff889037617924 R08: 0000000000000000 R09: ffffc90000befdf8
[   68.133513] R10: ffff8890334d2bf0 R11: 0000000000000018 R12: feeda989fef06266
[   68.134399] R13: ffff88903f8ac714 R14: 0000000000000001 R15: 00000000000c0000
[   68.135323] FS:  00007f0b97743740(0000) GS:ffff88903f880000(0000) knlGS:0000000000000000
[   68.136307] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.137004] CR2: 00007f0b16a3c03c CR3: 000000000360a005 CR4: 0000000000760ee0
[   68.137866] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   68.138748] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[   68.139606] PKRU: 55555554
[   68.139973] Call Trace:
[   68.140313]  queued_read_lock_slowpath+0x6c/0x70
[   68.140915]  _raw_read_lock_irqsave+0x26/0x30
[   68.141485]  ep_poll_callback+0x3e/0x2b0
[   68.142007]  ? set_next_entity+0xab/0x1f0
[   68.142541]  __wake_up_common+0x7a/0x140
[   68.143077]  __wake_up_common_lock+0x7c/0xc0
[   68.143651]  pipe_release+0x5b/0xd0
[   68.144150]  __fput+0xda/0x240
[   68.144574]  task_work_run+0x62/0x90
[   68.145046]  do_exit+0x35c/0xa70
[   68.145505]  ? do_epoll_wait+0xb0/0xd0
[   68.146000]  rewind_stack_do_exit+0x17/0x20
[   68.146538] RIP: 0033:0x7f0b97845606
[   68.146988] Code: Bad RIP value.
[   68.147405] RSP: 002b:00007ffe80ffdba8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e8
[   68.148314] RAX: ffffffffffffffda RBX: 000055fb76a9a998 RCX: 00007f0b97845606
[   68.149157] RDX: 0000000000000001 RSI: 000055fb76a9aa10 RDI: 0000000000000005
[   68.150021] RBP: 0000000005000007 R08: 0000000005000007 R09: 0000000000000003
[   68.150831] R10: 00000000ffffffff R11: 0000000000000246 R12: 000055fb76a9a998
[   68.151640] R13: 0000000000000001 R14: 0000000000000009 R15: 000055fb76a9a998
[   68.152459] Modules linked in: 9pnet_virtio isst_if_common xhci_pci 9pnet iTCO_wdt intel_pmc_bxt xhci_hcd iTCO_vendor_support
[   68.153707] ---[ end trace 0ca39a5ed99162cf ]---
[   68.154282] RIP: 0010:__mutex_lock.isra.0+0x76/0x4e0
[   68.154884] Code: b7 01 00 00 48 39 c6 0f 84 a4 03 00 00 65 48 8b 04 25 80 7d 01 00 48 8b 00 a8 08 75 18 49 8b 06 48 83 e0 f8 0f 84 2f 02 00 00 <8b> 50 3c 85 d2 0f 85 12 02 00 00 65 48 8b 04 25 80 7d 01 00 48 8b
[   68.156976] RSP: 0018:ffffc90000befd50 EFLAGS: 00010206
[   68.157614] RAX: 00007f0b16a3c000 RBX: ffff889037617910 RCX: 0000000000000000
[   68.158436] RDX: 00007f0b16a3c000 RSI: ffff88902a4aca80 RDI: ffff8890376178c0
[   68.159269] RBP: ffffc90000befdf0 R08: 0000000000000001 R09: 0000000000000000
[   68.160092] R10: ffff889037617920 R11: ffff88903f8abaf0 R12: ffffc90000befe08
[   68.160920] R13: 0000000000000000 R14: ffff8890376178c0 R15: 0000000000000000
[   68.161746] FS:  00007f0b97743740(0000) GS:ffff88903f880000(0000) knlGS:0000000000000000
[   68.162701] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.163386] CR2: 00007f0b978455dc CR3: 000000000360a005 CR4: 0000000000760ee0
[   68.164226] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   68.165079] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[   68.165931] PKRU: 55555554
[   68.166298] Fixing recursive fault but reboot is needed!
[  128.173729] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[  128.179267] rcu:         11-...0: (1 GPs behind) idle=c56/1/0x4000000000000000 softirq=6897/6898 fqs=5976
[  128.182232] rcu:         19-...0: (1 GPs behind) idle=492/1/0x4000000000000000 softirq=1023/1023 fqs=5976
[  128.185217]      (detected by 10, t=18003 jiffies, g=15789, q=631)
[  128.186863] Sending NMI from CPU 10 to CPUs 11:
[  128.188902] NMI backtrace for cpu 11
[  128.188903] CPU: 11 PID: 2546 Comm: postgres Tainted: G      D           5.7.0-andres-10123-g87823242260e #44
[  128.188904] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[  128.188904] RIP: 0010:queued_read_lock_slowpath+0x5b/0x70
[  128.188906] Code: 03 00 02 00 00 8b 03 84 c0 74 08 f3 90 8b 13 84 d2 75 f8 48 89 ef e8 74 e6 ff ff 66 90 5b 5d c3 8b 07 84 c0 74 08 f3 90 8b 03 <84> c0 75 f8 5b 5d c3 89 c6 48 89 ef e8 e4 e8 ff ff 66 90 eb bf 0f
[  128.188907] RSP: 0018:ffffc90000348c08 EFLAGS: 00000086
[  128.188908] RAX: 0000000037617cc0 RBX: ffff889037617920 RCX: 00000000000000c3
[  128.188909] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff889037617920
[  128.188910] RBP: ffff889037bb1a80 R08: 00000000000000c3 R09: ffffc90000348cd8
[  128.188910] R10: 0100000000000000 R11: 00000000de2ee17e R12: 0000000000000046
[  128.188911] R13: ffff889037617920 R14: 0000000000000001 R15: 00000000000000c3
[  128.188912] FS:  00007f0b97743740(0000) GS:ffff88903fac0000(0000) knlGS:0000000000000000
[  128.188912] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  128.188913] CR2: 00007f0b16afc00e CR3: 000000102e5c6002 CR4: 0000000000760ee0
[  128.188914] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  128.188914] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  128.188915] PKRU: 55555554
[  128.188915] Call Trace:
[  128.188916]  <IRQ>
[  128.188916]  _raw_read_lock_irqsave+0x26/0x30
[  128.188917]  ep_poll_callback+0x3e/0x2b0
[  128.188917]  ? cpumask_next_and+0x19/0x20
[  128.188918]  ? update_sd_lb_stats.constprop.0+0xfe/0x810
[  128.188918]  __wake_up_common+0x7a/0x140
[  128.188919]  __wake_up_common_lock+0x7c/0xc0
[  128.188919]  sock_def_readable+0x37/0x60
[  128.188920]  __udp_enqueue_schedule_skb+0x168/0x260
[  128.188920]  udpv6_queue_rcv_one_skb+0x284/0x3c0
[  128.188921]  udp6_unicast_rcv_skb.isra.0+0x44/0xa0
[  128.188921]  ip6_protocol_deliver_rcu+0x235/0x4b0
[  128.188922]  ip6_input_finish+0x11/0x20
[  128.188922]  ip6_input+0xa2/0xb0
[  128.188923]  ? ip6_protocol_deliver_rcu+0x4b0/0x4b0
[  128.188923]  ipv6_rcv+0xc0/0xd0
[  128.188924]  ? ip6_rcv_finish_core.isra.0+0xd0/0xd0
[  128.188924]  __netif_receive_skb_one_core+0x63/0xa0
[  128.188925]  process_backlog+0x98/0x140
[  128.188925]  net_rx_action+0x13a/0x370
[  128.188926]  __do_softirq+0xe0/0x2ca
[  128.188926]  do_softirq_own_stack+0x2a/0x40
[  128.188926]  </IRQ>
[  128.188927]  do_softirq.part.0+0x2b/0x30
[  128.188927]  __local_bh_enable_ip+0x4b/0x50
[  128.188928]  ip6_finish_output2+0x264/0x5b0
[  128.188928]  ip6_output+0x73/0x120
[  128.188929]  ? __ip6_finish_output+0x110/0x110
[  128.188929]  ip6_send_skb+0x1e/0x60
[  128.188930]  udp_v6_send_skb.isra.0+0x197/0x460
[  128.188930]  udpv6_sendmsg+0xb4f/0xdb0
[  128.188931]  ? ip_reply_glue_bits+0x40/0x40
[  128.188931]  ? update_load_avg+0x78/0x630
[  128.188932]  ? update_curr+0x73/0x1d0
[  128.188932]  ? __sys_sendto+0x108/0x190
[  128.188933]  __sys_sendto+0x108/0x190
[  128.188933]  ? __fput+0x1a5/0x240
[  128.188934]  ? _cond_resched+0x19/0x30
[  128.188934]  ? task_work_run+0x67/0x90
[  128.188935]  __x64_sys_sendto+0x25/0x30
[  128.188935]  do_syscall_64+0x48/0x130
[  128.188936]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  128.188936] RIP: 0033:0x7f0b97a7826c
[  128.188945] Code: c0 ff ff ff ff eb b9 0f 1f 80 00 00 00 00 41 89 ca 64 8b 04 25 18 00 00 00 85 c0 75 19 45 31 c9 45 31 c0 b8 2c 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 64 c3 0f 1f 00 55 48 83 ec 20 48 89 54 24 10
[  128.188946] RSP: 002b:00007ffe80ffcea8 EFLAGS: 00000246 ORIG_RAX: 000000000000002c
[  128.188947] RAX: ffffffffffffffda RBX: 0000000000000058 RCX: 00007f0b97a7826c
[  128.188948] RDX: 0000000000000058 RSI: 000055fb765264c0 RDI: 0000000000000009
[  128.188949] RBP: 000055fb765264c0 R08: 0000000000000000 R09: 0000000000000000
[  128.188949] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffe80ffcfc0
[  128.188950] R13: 000000000002c600 R14: 0000000000000000 R15: 000055fb7629b751
[  128.188957] Sending NMI from CPU 10 to CPUs 19:
[  128.239939] NMI backtrace for cpu 19
[  128.239940] CPU: 19 PID: 2587 Comm: postgres Tainted: G      D           5.7.0-andres-10123-g87823242260e #44
[  128.239940] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[  128.239940] RIP: 0010:kvm_wait+0x30/0x50
[  128.239941] Code: 8b 05 ac cb f4 7e a9 00 00 f0 00 75 1f 9c 58 fa 0f b6 17 40 38 d6 75 12 f6 c4 02 75 10 e9 07 00 00 00 0f 00 2d 6f ce 54 01 f4 <50> 9d c3 e9 07 00 00 00 0f 00 2d 5f ce 54 01 fb f4 eb ed 66 66 2e
[  128.239942] RSP: 0018:ffffc90000cc78e8 EFLAGS: 00000046
[  128.239942] RAX: 0000000000000046 RBX: ffff88903fcec700 RCX: 0000000000000008
[  128.239943] RDX: 0000000000000003 RSI: 0000000000000003 RDI: ffff889039049d80
[  128.239943] RBP: ffff889039049d80 R08: ffff88907ffe9f80 R09: 00000000000000f8
[  128.239944] R10: 0000000000000000 R11: 0000000000000001 R12: 0000000000000000
[  128.239944] R13: 0000000000000001 R14: 0000000000000100 R15: 0000000000500000
[  128.239944] FS:  00007f0b97743740(0000) GS:ffff88903fcc0000(0000) knlGS:0000000000000000
[  128.239945] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  128.239945] CR2: 000055fb76a96030 CR3: 0000001035882004 CR4: 0000000000760ee0
[  128.239945] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  128.239946] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  128.239946] PKRU: 55555554
[  128.239946] Call Trace:
[  128.239946]  __pv_queued_spin_lock_slowpath+0x26e/0x2b0
[  128.239947]  _raw_spin_lock_irqsave+0x25/0x30
[  128.239947]  __wake_up_common_lock+0x62/0xc0
[  128.239947]  sock_def_write_space+0x49/0x90
[  128.239948]  sock_wfree+0x68/0xb0
[  128.239948]  loopback_xmit+0x49/0xe0
[  128.239948]  dev_hard_start_xmit+0x8d/0x1e0
[  128.239948]  __dev_queue_xmit+0x721/0x8e0
[  128.239949]  ip6_finish_output2+0x250/0x5b0
[  128.239949]  ip6_output+0x73/0x120
[  128.239949]  ? __ip6_finish_output+0x110/0x110
[  128.239950]  ip6_send_skb+0x1e/0x60
[  128.239950]  udp_v6_send_skb.isra.0+0x197/0x460
[  128.239950]  udpv6_sendmsg+0xb4f/0xdb0
[  128.239950]  ? release_pages+0x28f/0x2f0
[  128.239950]  ? ip_reply_glue_bits+0x40/0x40
[  128.239951]  ? _cond_resched+0x19/0x30
[  128.239951]  ? unmap_page_range+0x678/0xa60
[  128.239951]  ? __sys_sendto+0x108/0x190
[  128.239951]  __sys_sendto+0x108/0x190
[  128.239952]  ? __fput+0x1a5/0x240
[  128.239952]  ? _cond_resched+0x19/0x30
[  128.239952]  ? task_work_run+0x67/0x90
[  128.239952]  __x64_sys_sendto+0x25/0x30
[  128.239953]  do_syscall_64+0x48/0x130
[  128.239953]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  128.239953] RIP: 0033:0x7f0b97a7826c
[  128.239954] Code: c0 ff ff ff ff eb b9 0f 1f 80 00 00 00 00 41 89 ca 64 8b 04 25 18 00 00 00 85 c0 75 19 45 31 c9 45 31 c0 b8 2c 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 64 c3 0f 1f 00 55 48 83 ec 20 48 89 54 24 10
[  128.239954] RSP: 002b:00007ffe80ffd7b8 EFLAGS: 00000246 ORIG_RAX: 000000000000002c
[  128.239955] RAX: ffffffffffffffda RBX: 00000000000003a8 RCX: 00007f0b97a7826c
[  128.239955] RDX: 00000000000003a8 RSI: 00007ffe80ffd800 RDI: 0000000000000009
[  128.239955] RBP: 00007ffe80ffd800 R08: 0000000000000000 R09: 0000000000000000
[  128.239956] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffe80ffd800
[  128.239956] R13: 00007ffe80ffd800 R14: 000000000000000e R15: 000055fb76b37e58
Quoted 3 lines
Quoted 1 line

I can reproduce this, and I see what it is. I'll send out a patch soonish.

Thinko, can you try with this on top?

Sorry that was incomplete, please use this one!

fs/io_uring.c +6 -7
index d22830a423f1..0075107dd09a 100644
@@ -2779,7 +2779,7 @@ static int io_read(struct io_kiocb *req, bool force_nonblock)
                        ret = io_setup_async_rw(req, io_size, iovec,
                                                inline_vecs, &iter);
                        if (ret)
-                               goto out_free;
+                               goto out;
                        /* any defer here is final, must blocking retry */
                        if (!(req->flags & REQ_F_NOWAIT) &&
                            !file_can_poll(req->file))
@@ -2787,18 +2787,18 @@ static int io_read(struct io_kiocb *req, bool force_nonblock)
                        /* if we can retry, do so with the callbacks armed */
                        if (io_rw_should_retry(req)) {
                                ret2 = io_iter_do_read(req, &iter);
-                               if (ret2 != -EAGAIN) {
+                               if (ret2 == -EIOCBQUEUED) {
+                                       goto out;
+                               } else if (ret2 != -EAGAIN) {
                                        kiocb_done(kiocb, ret2);
-                                       goto out_free;
+                                       goto out;
                                }
                        }
                        kiocb->ki_flags &= ~IOCB_WAITQ;
                        return -EAGAIN;
                }
        }
-out_free:
-       kfree(iovec);
-       req->flags &= ~REQ_F_NEED_CLEANUP;
+out:
        return ret;
 }
 
--
Quoted 2 lines

Jens Axboe

Hi Jens,

I have tested with today's linux-block.git#async-buffered.7 and my usual testcases:

[ FIO ]

root# echo 1 > /sys/kernel/debug/tracing/events/io_uring/io_uring_create/enable

root# cat /sys/kernel/debug/tracing/events/io_uring/io_uring_create/enable 1

root# cat buf-test-dileks-min
[buf-test-dileks-min] filename=/mnt/backup/thinkpad-t530/home/sdi/Downloads/iso-images/iso_debian-stretch/firmware-stretch-live-amd64/debian-live-9.2.0-amd64-kde+nonfree.iso buffered=1
ioengine=io_uring

root# fio ./buf-test-dileks-min
buf-test-dileks-min: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=io_uring, iodepth=1 fio-3.20
Starting 1 process
Jobs: 1 (f=1): [R(1)][100.0%][r=87.1MiB/s][r=22.3k IOPS][eta 00m:00s]
buf-test-dileks-min: (groupid=0, jobs=1): err= 0: pid=4076: Sat Jun 6 02:22:20 2020
read: IOPS=20.8k, BW=81.2MiB/s (85.1MB/s)(2811MiB/34626msec)

    slat (usec): min=2, max=395, avg= 8.95, stdev=18.43
    clat (nsec): min=130, max=159571k, avg=36797.18, stdev=520010.15
     lat (usec): min=2, max=159779, avg=46.04, stdev=528.95
    clat percentiles (nsec):
     |  1.00th=[     225],  5.00th=[     302], 10.00th=[     330],
     | 20.00th=[     358], 30.00th=[     378], 40.00th=[     390],
     | 50.00th=[     406], 60.00th=[     418], 70.00th=[     430],
     | 80.00th=[     446], 90.00th=[     478], 95.00th=[     732],
     | 99.00th=[ 1531904], 99.50th=[ 1695744], 99.90th=[ 3555328],
     | 99.95th=[ 3686400], 99.99th=[16711680]
   bw (  KiB/s): min=34235, max=94554, per=100.00%, avg=83141.75,
stdev=11118.80, samples=69
   iops        : min= 8558, max=23638, avg=20785.14, stdev=2779.73, samples=69
  lat (nsec)   : 250=1.63%, 500=89.57%, 750=3.94%, 1000=0.85%
  lat (usec)   : 2=1.55%, 4=0.21%, 10=0.03%, 20=0.01%, 50=0.02%
  lat (usec)   : 100=0.01%, 250=0.50%, 500=0.11%, 750=0.02%, 1000=0.01%
  lat (msec)   : 2=1.18%, 4=0.34%, 10=0.01%, 20=0.01%, 50=0.01%
  lat (msec)   : 100=0.01%, 250=0.01%
  cpu          : usr=9.80%, sys=17.79%, ctx=15869, majf=0, minf=15
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=719568,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
READ: bw=81.2MiB/s (85.1MB/s), 81.2MiB/s-81.2MiB/s
(85.1MB/s-85.1MB/s), io=2811MiB (2947MB), run=34626-34626msec

Disk stats (read/write):
sdc: ios=15784/53, merge=0/89, ticks=57005/536, in_queue=58011, util=99.75%

root# fio --showcmd ./buf-test-dileks-min
fio --name=buf-test-dileks-min --buffered=1 --ioengine=io_uring --filename=/mnt/backup/thinkpad-t530/home/sdi/Downloads/iso-images/iso_debian-stretch/firmware-stretch-live-amd64/debian-live-9.2.0-amd64-kde+nonfree.iso

root# tail /sys/kernel/debug/tracing/trace
# entries-in-buffer/entries-written: 1/1 #P:4
#
# _-----=> irqs-off
# / _----=> need-resched

#                            | / _---=> hardirq/softirq
#                            || / _--=> preempt-depth
#                            ||| /     delay
#           TASK-PID   CPU#  ||||    TIMESTAMP  FUNCTION
#              | |       |   ||||       |         |
             fio-4076  [001] ....   641.669846: io_uring_create: ring

00000000a88caba9, fd 5 sq size 1, cq size 2, flags 0

[ SYSTEMD-ANALYZE ]

user$ sudo systemd-analyze --no-pager time
Startup finished in 6.228s (kernel) + 41.559s (userspace) = 47.787s graphical.target reached after 41.539s in userspace

user$ sudo systemd-analyze --no-pager blame
19.800s accounts-daemon.service
19.001s udisks2.service
13.282s NetworkManager-wait-online.service
9.956s polkit.service
9.590s avahi-daemon.service
9.479s NetworkManager.service
9.436s rtkit-daemon.service
9.367s systemd-logind.service
9.272s switcheroo-control.service
9.257s wpa_supplicant.service
9.215s dev-sdc2.device
9.079s powertop.service
8.875s smartmontools.service
8.108s ModemManager.service
7.070s zramswap.service
5.443s networking.service
5.181s rsyslog.service
4.870s gpm.service
3.846s e2scrub_reap.service
3.718s systemd-fsck@dev-disk-by\x2duuid-cfd78a9b\x2dfadd\x2d4870\x2d88c2\x2d5277dae4e59f.service 3.550s apparmor.service
1.807s systemd-journal-flush.service
1.570s systemd-tmpfiles-setup.service
1.269s keyboard-setup.service
1.259s atd.service
1.207s systemd-udevd.service
1.055s bluetooth.service
1.052s binfmt-support.service
935ms exim4.service
901ms systemd-journald.service
850ms systemd-modules-load.service
843ms systemd-sysusers.service
814ms upower.service
807ms dev-hugepages.mount
803ms pppd-dns.service
790ms dev-mqueue.mount
771ms sys-kernel-debug.mount
770ms sys-kernel-tracing.mount
697ms systemd-timesyncd.service
677ms [email protected]
630ms ifupdown-wait-online.service
604ms systemd-rfkill.service
561ms systemd-tmpfiles-setup-dev.service
521ms systemd-remount-fs.service
476ms systemd-sysctl.service
397ms systemd-random-seed.service
394ms systemd-backlight@backlight:intel_backlight.service
376ms systemd-tmpfiles-clean.service
289ms kmod-static-nodes.service
269ms [email protected]
194ms console-setup.service
182ms systemd-udev-trigger.service
134ms systemd-update-utmp.service
125ms proc-sys-fs-binfmt_misc.mount
69ms systemd-user-sessions.service
52ms alsa-restore.service
21ms [email protected]
17ms mnt-sandisk.mount
13ms systemd-update-utmp-runlevel.service
6ms sys-fs-fuse-connections.mount
4ms ifupdown-pre.service

user$ sudo systemd-analyze --no-pager critical-chain
The time when unit became active or started is printed after the "@" character. The time the unit took to start is printed after the "+" character.

graphical.target @41.539s

└─multi-user.target @41.538s
  └─exim4.service @40.601s +935ms
    └─network-online.target @40.599s
      └─NetworkManager-wait-online.service @27.314s +13.282s
        └─NetworkManager.service @17.831s +9.479s
          └─dbus.service @17.824s
            └─basic.target @17.675s
              └─sockets.target @17.672s
                └─dbus.socket @17.670s
                  └─sysinit.target @17.584s
                    └─systemd-udev-trigger.service @26.747s +182ms
                      └─systemd-udevd-kernel.socket @3.027s
                        └─system.slice @2.440s
                          └─-.slice @2.440s

Hope this helps you.

If you want some further informations and/or testing, please let me know and give clear instructions.

Thanks.

Regards,
- Sedat -

author maintainer
#65 lore raw
Quoted 468 lines · Sedat Dilek
Quoted 298 lines · Jens Axboe
Quoted 252 lines · Jens Axboe
Quoted 251 lines · Jens Axboe
Quoted 249 lines · Andres Freund

Hi,

Quoted 1 line · Andres Freund

I'll go and try to figure out why I don't see an oops...

Err, that probably was a typo on my end in the serial console config. After fixing that, I did get the below.

If helpful I can try with debugging enabled or such.

[   67.910265] tee (2577): drop_caches: 3
[   68.059674] BUG: unable to handle page fault for address: 00007f0b16a3c03c
[   68.062021] #PF: supervisor read access in kernel mode
[   68.063742] #PF: error_code(0x0000) - not-present page
[   68.065517] PGD 102e044067 P4D 102e044067 PUD 102bf7a067 PMD 0
[   68.067519] Oops: 0000 [#1] SMP NOPTI
[   68.068800] CPU: 2 PID: 2554 Comm: postgres Not tainted 5.7.0-andres-10123-g87823242260e #44
[   68.071505] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[   68.074139] RIP: 0010:__mutex_lock.isra.0+0x76/0x4e0
[   68.075389] Code: b7 01 00 00 48 39 c6 0f 84 a4 03 00 00 65 48 8b 04 25 80 7d 01 00 48 8b 00 a8 08 75 18 49 8b 06 48 83 e0 f8 0f 84 2f 02 00 00 <8b> 50 3c 85 d2 0f 85 12 02 00 00 65 48 8b 04 25 80 7d 01 00 48 8b
[   68.079125] RSP: 0018:ffffc90000befd50 EFLAGS: 00010206
[   68.080260] RAX: 00007f0b16a3c000 RBX: ffff889037617910 RCX: 0000000000000000
[   68.084115] RDX: 00007f0b16a3c000 RSI: ffff88902a4aca80 RDI: ffff8890376178c0
[   68.085374] RBP: ffffc90000befdf0 R08: 0000000000000001 R09: 0000000000000000
[   68.086409] R10: ffff889037617920 R11: ffff88903f8abaf0 R12: ffffc90000befe08
[   68.087447] R13: 0000000000000000 R14: ffff8890376178c0 R15: 0000000000000000
[   68.088697] FS:  00007f0b97743740(0000) GS:ffff88903f880000(0000) knlGS:0000000000000000
[   68.089903] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.090776] CR2: 00007f0b16a3c03c CR3: 000000102cf7c004 CR4: 0000000000760ee0
[   68.091834] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   68.092902] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[   68.093967] PKRU: 55555554
[   68.094427] Call Trace:
[   68.094845]  ? __schedule+0x2ac/0x720
[   68.095350]  ? schedule+0x55/0xc0
[   68.095797]  ? ep_read_events_proc+0xd0/0xd0
[   68.096354]  ep_scan_ready_list.constprop.0+0x16c/0x190
[   68.097016]  ep_poll+0x2a3/0x440
[   68.097449]  ? wait_woken+0x70/0x70
[   68.097904]  do_epoll_wait+0xb0/0xd0
[   68.098375]  __x64_sys_epoll_wait+0x1a/0x20
[   68.098913]  do_syscall_64+0x48/0x130
[   68.099393]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[   68.100030] RIP: 0033:0x7f0b97845606
[   68.100498] Code: 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 41 89 ca 64 8b 04 25 18 00 00 00 85 c0 75 11 b8 e8 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 5a c3 90 48 83 ec 28 89 54 24 18 48 89 74 24
[   68.102718] RSP: 002b:00007ffe80ffdba8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e8
[   68.103644] RAX: ffffffffffffffda RBX: 000055fb76a9a998 RCX: 00007f0b97845606
[   68.104533] RDX: 0000000000000001 RSI: 000055fb76a9aa10 RDI: 0000000000000005
[   68.105418] RBP: 0000000005000007 R08: 0000000005000007 R09: 0000000000000003
[   68.106296] R10: 00000000ffffffff R11: 0000000000000246 R12: 000055fb76a9a998
[   68.107187] R13: 0000000000000001 R14: 0000000000000009 R15: 000055fb76a9a998
[   68.108104] Modules linked in: 9pnet_virtio isst_if_common xhci_pci 9pnet iTCO_wdt intel_pmc_bxt xhci_hcd iTCO_vendor_support
[   68.109505] CR2: 00007f0b16a3c03c
[   68.109962] ---[ end trace 0ca39a5ed99162ce ]---
[   68.110547] RIP: 0010:__mutex_lock.isra.0+0x76/0x4e0
[   68.111214] Code: b7 01 00 00 48 39 c6 0f 84 a4 03 00 00 65 48 8b 04 25 80 7d 01 00 48 8b 00 a8 08 75 18 49 8b 06 48 83 e0 f8 0f 84 2f 02 00 00 <8b> 50 3c 85 d2 0f 85 12 02 00 00 65 48 8b 04 25 80 7d 01 00 48 8b
[   68.113435] RSP: 0018:ffffc90000befd50 EFLAGS: 00010206
[   68.114111] RAX: 00007f0b16a3c000 RBX: ffff889037617910 RCX: 0000000000000000
[   68.115016] RDX: 00007f0b16a3c000 RSI: ffff88902a4aca80 RDI: ffff8890376178c0
[   68.115902] RBP: ffffc90000befdf0 R08: 0000000000000001 R09: 0000000000000000
[   68.116810] R10: ffff889037617920 R11: ffff88903f8abaf0 R12: ffffc90000befe08
[   68.117663] R13: 0000000000000000 R14: ffff8890376178c0 R15: 0000000000000000
[   68.118520] FS:  00007f0b97743740(0000) GS:ffff88903f880000(0000) knlGS:0000000000000000
[   68.119482] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.120181] CR2: 00007f0b16a3c03c CR3: 000000102cf7c004 CR4: 0000000000760ee0
[   68.121043] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   68.121904] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[   68.122790] PKRU: 55555554
[   68.123401] general protection fault, probably for non-canonical address 0xfeeda989fef06266: 0000 [#2] SMP NOPTI
[   68.125052] CPU: 2 PID: 2554 Comm: postgres Tainted: G      D           5.7.0-andres-10123-g87823242260e #44
[   68.126260] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[   68.127274] RIP: 0010:__pv_queued_spin_lock_slowpath+0x1a1/0x2b0
[   68.128032] Code: c4 c1 ea 12 41 be 01 00 00 00 8d 42 ff 41 83 e4 03 4c 8d 6b 14 49 c1 e4 05 48 98 49 81 c4 00 c7 02 00 4c 03 24 c5 e0 e6 fd 82 <49> 89 1c 24 b8 00 80 00 00 eb 15 84 c0 75 0a 41 0f b6 54 24 14 84
[   68.130221] RSP: 0018:ffffc90000befce8 EFLAGS: 00010086
[   68.130867] RAX: 0000000000003ffe RBX: ffff88903f8ac700 RCX: 0000000000000001
[   68.131752] RDX: 0000000000003fff RSI: 0000000000000000 RDI: 0000000000000000
[   68.132637] RBP: ffff889037617924 R08: 0000000000000000 R09: ffffc90000befdf8
[   68.133513] R10: ffff8890334d2bf0 R11: 0000000000000018 R12: feeda989fef06266
[   68.134399] R13: ffff88903f8ac714 R14: 0000000000000001 R15: 00000000000c0000
[   68.135323] FS:  00007f0b97743740(0000) GS:ffff88903f880000(0000) knlGS:0000000000000000
[   68.136307] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.137004] CR2: 00007f0b16a3c03c CR3: 000000000360a005 CR4: 0000000000760ee0
[   68.137866] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   68.138748] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[   68.139606] PKRU: 55555554
[   68.139973] Call Trace:
[   68.140313]  queued_read_lock_slowpath+0x6c/0x70
[   68.140915]  _raw_read_lock_irqsave+0x26/0x30
[   68.141485]  ep_poll_callback+0x3e/0x2b0
[   68.142007]  ? set_next_entity+0xab/0x1f0
[   68.142541]  __wake_up_common+0x7a/0x140
[   68.143077]  __wake_up_common_lock+0x7c/0xc0
[   68.143651]  pipe_release+0x5b/0xd0
[   68.144150]  __fput+0xda/0x240
[   68.144574]  task_work_run+0x62/0x90
[   68.145046]  do_exit+0x35c/0xa70
[   68.145505]  ? do_epoll_wait+0xb0/0xd0
[   68.146000]  rewind_stack_do_exit+0x17/0x20
[   68.146538] RIP: 0033:0x7f0b97845606
[   68.146988] Code: Bad RIP value.
[   68.147405] RSP: 002b:00007ffe80ffdba8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e8
[   68.148314] RAX: ffffffffffffffda RBX: 000055fb76a9a998 RCX: 00007f0b97845606
[   68.149157] RDX: 0000000000000001 RSI: 000055fb76a9aa10 RDI: 0000000000000005
[   68.150021] RBP: 0000000005000007 R08: 0000000005000007 R09: 0000000000000003
[   68.150831] R10: 00000000ffffffff R11: 0000000000000246 R12: 000055fb76a9a998
[   68.151640] R13: 0000000000000001 R14: 0000000000000009 R15: 000055fb76a9a998
[   68.152459] Modules linked in: 9pnet_virtio isst_if_common xhci_pci 9pnet iTCO_wdt intel_pmc_bxt xhci_hcd iTCO_vendor_support
[   68.153707] ---[ end trace 0ca39a5ed99162cf ]---
[   68.154282] RIP: 0010:__mutex_lock.isra.0+0x76/0x4e0
[   68.154884] Code: b7 01 00 00 48 39 c6 0f 84 a4 03 00 00 65 48 8b 04 25 80 7d 01 00 48 8b 00 a8 08 75 18 49 8b 06 48 83 e0 f8 0f 84 2f 02 00 00 <8b> 50 3c 85 d2 0f 85 12 02 00 00 65 48 8b 04 25 80 7d 01 00 48 8b
[   68.156976] RSP: 0018:ffffc90000befd50 EFLAGS: 00010206
[   68.157614] RAX: 00007f0b16a3c000 RBX: ffff889037617910 RCX: 0000000000000000
[   68.158436] RDX: 00007f0b16a3c000 RSI: ffff88902a4aca80 RDI: ffff8890376178c0
[   68.159269] RBP: ffffc90000befdf0 R08: 0000000000000001 R09: 0000000000000000
[   68.160092] R10: ffff889037617920 R11: ffff88903f8abaf0 R12: ffffc90000befe08
[   68.160920] R13: 0000000000000000 R14: ffff8890376178c0 R15: 0000000000000000
[   68.161746] FS:  00007f0b97743740(0000) GS:ffff88903f880000(0000) knlGS:0000000000000000
[   68.162701] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.163386] CR2: 00007f0b978455dc CR3: 000000000360a005 CR4: 0000000000760ee0
[   68.164226] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   68.165079] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[   68.165931] PKRU: 55555554
[   68.166298] Fixing recursive fault but reboot is needed!
[  128.173729] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[  128.179267] rcu:         11-...0: (1 GPs behind) idle=c56/1/0x4000000000000000 softirq=6897/6898 fqs=5976
[  128.182232] rcu:         19-...0: (1 GPs behind) idle=492/1/0x4000000000000000 softirq=1023/1023 fqs=5976
[  128.185217]      (detected by 10, t=18003 jiffies, g=15789, q=631)
[  128.186863] Sending NMI from CPU 10 to CPUs 11:
[  128.188902] NMI backtrace for cpu 11
[  128.188903] CPU: 11 PID: 2546 Comm: postgres Tainted: G      D           5.7.0-andres-10123-g87823242260e #44
[  128.188904] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[  128.188904] RIP: 0010:queued_read_lock_slowpath+0x5b/0x70
[  128.188906] Code: 03 00 02 00 00 8b 03 84 c0 74 08 f3 90 8b 13 84 d2 75 f8 48 89 ef e8 74 e6 ff ff 66 90 5b 5d c3 8b 07 84 c0 74 08 f3 90 8b 03 <84> c0 75 f8 5b 5d c3 89 c6 48 89 ef e8 e4 e8 ff ff 66 90 eb bf 0f
[  128.188907] RSP: 0018:ffffc90000348c08 EFLAGS: 00000086
[  128.188908] RAX: 0000000037617cc0 RBX: ffff889037617920 RCX: 00000000000000c3
[  128.188909] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff889037617920
[  128.188910] RBP: ffff889037bb1a80 R08: 00000000000000c3 R09: ffffc90000348cd8
[  128.188910] R10: 0100000000000000 R11: 00000000de2ee17e R12: 0000000000000046
[  128.188911] R13: ffff889037617920 R14: 0000000000000001 R15: 00000000000000c3
[  128.188912] FS:  00007f0b97743740(0000) GS:ffff88903fac0000(0000) knlGS:0000000000000000
[  128.188912] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  128.188913] CR2: 00007f0b16afc00e CR3: 000000102e5c6002 CR4: 0000000000760ee0
[  128.188914] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  128.188914] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  128.188915] PKRU: 55555554
[  128.188915] Call Trace:
[  128.188916]  <IRQ>
[  128.188916]  _raw_read_lock_irqsave+0x26/0x30
[  128.188917]  ep_poll_callback+0x3e/0x2b0
[  128.188917]  ? cpumask_next_and+0x19/0x20
[  128.188918]  ? update_sd_lb_stats.constprop.0+0xfe/0x810
[  128.188918]  __wake_up_common+0x7a/0x140
[  128.188919]  __wake_up_common_lock+0x7c/0xc0
[  128.188919]  sock_def_readable+0x37/0x60
[  128.188920]  __udp_enqueue_schedule_skb+0x168/0x260
[  128.188920]  udpv6_queue_rcv_one_skb+0x284/0x3c0
[  128.188921]  udp6_unicast_rcv_skb.isra.0+0x44/0xa0
[  128.188921]  ip6_protocol_deliver_rcu+0x235/0x4b0
[  128.188922]  ip6_input_finish+0x11/0x20
[  128.188922]  ip6_input+0xa2/0xb0
[  128.188923]  ? ip6_protocol_deliver_rcu+0x4b0/0x4b0
[  128.188923]  ipv6_rcv+0xc0/0xd0
[  128.188924]  ? ip6_rcv_finish_core.isra.0+0xd0/0xd0
[  128.188924]  __netif_receive_skb_one_core+0x63/0xa0
[  128.188925]  process_backlog+0x98/0x140
[  128.188925]  net_rx_action+0x13a/0x370
[  128.188926]  __do_softirq+0xe0/0x2ca
[  128.188926]  do_softirq_own_stack+0x2a/0x40
[  128.188926]  </IRQ>
[  128.188927]  do_softirq.part.0+0x2b/0x30
[  128.188927]  __local_bh_enable_ip+0x4b/0x50
[  128.188928]  ip6_finish_output2+0x264/0x5b0
[  128.188928]  ip6_output+0x73/0x120
[  128.188929]  ? __ip6_finish_output+0x110/0x110
[  128.188929]  ip6_send_skb+0x1e/0x60
[  128.188930]  udp_v6_send_skb.isra.0+0x197/0x460
[  128.188930]  udpv6_sendmsg+0xb4f/0xdb0
[  128.188931]  ? ip_reply_glue_bits+0x40/0x40
[  128.188931]  ? update_load_avg+0x78/0x630
[  128.188932]  ? update_curr+0x73/0x1d0
[  128.188932]  ? __sys_sendto+0x108/0x190
[  128.188933]  __sys_sendto+0x108/0x190
[  128.188933]  ? __fput+0x1a5/0x240
[  128.188934]  ? _cond_resched+0x19/0x30
[  128.188934]  ? task_work_run+0x67/0x90
[  128.188935]  __x64_sys_sendto+0x25/0x30
[  128.188935]  do_syscall_64+0x48/0x130
[  128.188936]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  128.188936] RIP: 0033:0x7f0b97a7826c
[  128.188945] Code: c0 ff ff ff ff eb b9 0f 1f 80 00 00 00 00 41 89 ca 64 8b 04 25 18 00 00 00 85 c0 75 19 45 31 c9 45 31 c0 b8 2c 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 64 c3 0f 1f 00 55 48 83 ec 20 48 89 54 24 10
[  128.188946] RSP: 002b:00007ffe80ffcea8 EFLAGS: 00000246 ORIG_RAX: 000000000000002c
[  128.188947] RAX: ffffffffffffffda RBX: 0000000000000058 RCX: 00007f0b97a7826c
[  128.188948] RDX: 0000000000000058 RSI: 000055fb765264c0 RDI: 0000000000000009
[  128.188949] RBP: 000055fb765264c0 R08: 0000000000000000 R09: 0000000000000000
[  128.188949] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffe80ffcfc0
[  128.188950] R13: 000000000002c600 R14: 0000000000000000 R15: 000055fb7629b751
[  128.188957] Sending NMI from CPU 10 to CPUs 19:
[  128.239939] NMI backtrace for cpu 19
[  128.239940] CPU: 19 PID: 2587 Comm: postgres Tainted: G      D           5.7.0-andres-10123-g87823242260e #44
[  128.239940] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.13.0-1 04/01/2014
[  128.239940] RIP: 0010:kvm_wait+0x30/0x50
[  128.239941] Code: 8b 05 ac cb f4 7e a9 00 00 f0 00 75 1f 9c 58 fa 0f b6 17 40 38 d6 75 12 f6 c4 02 75 10 e9 07 00 00 00 0f 00 2d 6f ce 54 01 f4 <50> 9d c3 e9 07 00 00 00 0f 00 2d 5f ce 54 01 fb f4 eb ed 66 66 2e
[  128.239942] RSP: 0018:ffffc90000cc78e8 EFLAGS: 00000046
[  128.239942] RAX: 0000000000000046 RBX: ffff88903fcec700 RCX: 0000000000000008
[  128.239943] RDX: 0000000000000003 RSI: 0000000000000003 RDI: ffff889039049d80
[  128.239943] RBP: ffff889039049d80 R08: ffff88907ffe9f80 R09: 00000000000000f8
[  128.239944] R10: 0000000000000000 R11: 0000000000000001 R12: 0000000000000000
[  128.239944] R13: 0000000000000001 R14: 0000000000000100 R15: 0000000000500000
[  128.239944] FS:  00007f0b97743740(0000) GS:ffff88903fcc0000(0000) knlGS:0000000000000000
[  128.239945] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  128.239945] CR2: 000055fb76a96030 CR3: 0000001035882004 CR4: 0000000000760ee0
[  128.239945] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  128.239946] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  128.239946] PKRU: 55555554
[  128.239946] Call Trace:
[  128.239946]  __pv_queued_spin_lock_slowpath+0x26e/0x2b0
[  128.239947]  _raw_spin_lock_irqsave+0x25/0x30
[  128.239947]  __wake_up_common_lock+0x62/0xc0
[  128.239947]  sock_def_write_space+0x49/0x90
[  128.239948]  sock_wfree+0x68/0xb0
[  128.239948]  loopback_xmit+0x49/0xe0
[  128.239948]  dev_hard_start_xmit+0x8d/0x1e0
[  128.239948]  __dev_queue_xmit+0x721/0x8e0
[  128.239949]  ip6_finish_output2+0x250/0x5b0
[  128.239949]  ip6_output+0x73/0x120
[  128.239949]  ? __ip6_finish_output+0x110/0x110
[  128.239950]  ip6_send_skb+0x1e/0x60
[  128.239950]  udp_v6_send_skb.isra.0+0x197/0x460
[  128.239950]  udpv6_sendmsg+0xb4f/0xdb0
[  128.239950]  ? release_pages+0x28f/0x2f0
[  128.239950]  ? ip_reply_glue_bits+0x40/0x40
[  128.239951]  ? _cond_resched+0x19/0x30
[  128.239951]  ? unmap_page_range+0x678/0xa60
[  128.239951]  ? __sys_sendto+0x108/0x190
[  128.239951]  __sys_sendto+0x108/0x190
[  128.239952]  ? __fput+0x1a5/0x240
[  128.239952]  ? _cond_resched+0x19/0x30
[  128.239952]  ? task_work_run+0x67/0x90
[  128.239952]  __x64_sys_sendto+0x25/0x30
[  128.239953]  do_syscall_64+0x48/0x130
[  128.239953]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[  128.239953] RIP: 0033:0x7f0b97a7826c
[  128.239954] Code: c0 ff ff ff ff eb b9 0f 1f 80 00 00 00 00 41 89 ca 64 8b 04 25 18 00 00 00 85 c0 75 19 45 31 c9 45 31 c0 b8 2c 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 64 c3 0f 1f 00 55 48 83 ec 20 48 89 54 24 10
[  128.239954] RSP: 002b:00007ffe80ffd7b8 EFLAGS: 00000246 ORIG_RAX: 000000000000002c
[  128.239955] RAX: ffffffffffffffda RBX: 00000000000003a8 RCX: 00007f0b97a7826c
[  128.239955] RDX: 00000000000003a8 RSI: 00007ffe80ffd800 RDI: 0000000000000009
[  128.239955] RBP: 00007ffe80ffd800 R08: 0000000000000000 R09: 0000000000000000
[  128.239956] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffe80ffd800
[  128.239956] R13: 00007ffe80ffd800 R14: 000000000000000e R15: 000055fb76b37e58
Quoted 3 lines
Quoted 1 line

I can reproduce this, and I see what it is. I'll send out a patch soonish.

Thinko, can you try with this on top?

Sorry that was incomplete, please use this one!

fs/io_uring.c +6 -7
index d22830a423f1..0075107dd09a 100644
@@ -2779,7 +2779,7 @@ static int io_read(struct io_kiocb *req, bool force_nonblock)
                        ret = io_setup_async_rw(req, io_size, iovec,
                                                inline_vecs, &iter);
                        if (ret)
-                               goto out_free;
+                               goto out;
                        /* any defer here is final, must blocking retry */
                        if (!(req->flags & REQ_F_NOWAIT) &&
                            !file_can_poll(req->file))
@@ -2787,18 +2787,18 @@ static int io_read(struct io_kiocb *req, bool force_nonblock)
                        /* if we can retry, do so with the callbacks armed */
                        if (io_rw_should_retry(req)) {
                                ret2 = io_iter_do_read(req, &iter);
-                               if (ret2 != -EAGAIN) {
+                               if (ret2 == -EIOCBQUEUED) {
+                                       goto out;
+                               } else if (ret2 != -EAGAIN) {
                                        kiocb_done(kiocb, ret2);
-                                       goto out_free;
+                                       goto out;
                                }
                        }
                        kiocb->ki_flags &= ~IOCB_WAITQ;
                        return -EAGAIN;
                }
        }
-out_free:
-       kfree(iovec);
-       req->flags &= ~REQ_F_NEED_CLEANUP;
+out:
        return ret;
 }
 
--
Quoted 2 lines

Jens Axboe

Hi Jens,

I have tested with today's linux-block.git#async-buffered.7 and my usual testcases:

[ FIO ]

root# echo 1 > /sys/kernel/debug/tracing/events/io_uring/io_uring_create/enable

root# cat /sys/kernel/debug/tracing/events/io_uring/io_uring_create/enable 1

root# cat buf-test-dileks-min
[buf-test-dileks-min] filename=/mnt/backup/thinkpad-t530/home/sdi/Downloads/iso-images/iso_debian-stretch/firmware-stretch-live-amd64/debian-live-9.2.0-amd64-kde+nonfree.iso buffered=1
ioengine=io_uring

root# fio ./buf-test-dileks-min
buf-test-dileks-min: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=io_uring, iodepth=1 fio-3.20
Starting 1 process
Jobs: 1 (f=1): [R(1)][100.0%][r=87.1MiB/s][r=22.3k IOPS][eta 00m:00s]
buf-test-dileks-min: (groupid=0, jobs=1): err= 0: pid=4076: Sat Jun 6 02:22:20 2020
read: IOPS=20.8k, BW=81.2MiB/s (85.1MB/s)(2811MiB/34626msec)

    slat (usec): min=2, max=395, avg= 8.95, stdev=18.43
    clat (nsec): min=130, max=159571k, avg=36797.18, stdev=520010.15
     lat (usec): min=2, max=159779, avg=46.04, stdev=528.95
    clat percentiles (nsec):
     |  1.00th=[     225],  5.00th=[     302], 10.00th=[     330],
     | 20.00th=[     358], 30.00th=[     378], 40.00th=[     390],
     | 50.00th=[     406], 60.00th=[     418], 70.00th=[     430],
     | 80.00th=[     446], 90.00th=[     478], 95.00th=[     732],
     | 99.00th=[ 1531904], 99.50th=[ 1695744], 99.90th=[ 3555328],
     | 99.95th=[ 3686400], 99.99th=[16711680]
   bw (  KiB/s): min=34235, max=94554, per=100.00%, avg=83141.75,
stdev=11118.80, samples=69
   iops        : min= 8558, max=23638, avg=20785.14, stdev=2779.73, samples=69
  lat (nsec)   : 250=1.63%, 500=89.57%, 750=3.94%, 1000=0.85%
  lat (usec)   : 2=1.55%, 4=0.21%, 10=0.03%, 20=0.01%, 50=0.02%
  lat (usec)   : 100=0.01%, 250=0.50%, 500=0.11%, 750=0.02%, 1000=0.01%
  lat (msec)   : 2=1.18%, 4=0.34%, 10=0.01%, 20=0.01%, 50=0.01%
  lat (msec)   : 100=0.01%, 250=0.01%
  cpu          : usr=9.80%, sys=17.79%, ctx=15869, majf=0, minf=15
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=719568,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):

   READ: bw=81.2MiB/s (85.1MB/s), 81.2MiB/s-81.2MiB/s

(85.1MB/s-85.1MB/s), io=2811MiB (2947MB), run=34626-34626msec

Disk stats (read/write):
sdc: ios=15784/53, merge=0/89, ticks=57005/536, in_queue=58011, util=99.75%

root# fio --showcmd ./buf-test-dileks-min
fio --name=buf-test-dileks-min --buffered=1 --ioengine=io_uring --filename=/mnt/backup/thinkpad-t530/home/sdi/Downloads/iso-images/iso_debian-stretch/firmware-stretch-live-amd64/debian-live-9.2.0-amd64-kde+nonfree.iso

root# tail /sys/kernel/debug/tracing/trace
# entries-in-buffer/entries-written: 1/1 #P:4
#
# _-----=> irqs-off
# / _----=> need-resched

#                            | / _---=> hardirq/softirq
#                            || / _--=> preempt-depth
#                            ||| /     delay
#           TASK-PID   CPU#  ||||    TIMESTAMP  FUNCTION
#              | |       |   ||||       |         |
             fio-4076  [001] ....   641.669846: io_uring_create: ring

00000000a88caba9, fd 5 sq size 1, cq size 2, flags 0

[ SYSTEMD-ANALYZE ]

user$ sudo systemd-analyze --no-pager time
Startup finished in 6.228s (kernel) + 41.559s (userspace) = 47.787s graphical.target reached after 41.539s in userspace

user$ sudo systemd-analyze --no-pager blame
19.800s accounts-daemon.service
19.001s udisks2.service
13.282s NetworkManager-wait-online.service
9.956s polkit.service
9.590s avahi-daemon.service
9.479s NetworkManager.service
9.436s rtkit-daemon.service
9.367s systemd-logind.service
9.272s switcheroo-control.service
9.257s wpa_supplicant.service
9.215s dev-sdc2.device
9.079s powertop.service
8.875s smartmontools.service
8.108s ModemManager.service
7.070s zramswap.service
5.443s networking.service
5.181s rsyslog.service
4.870s gpm.service
3.846s e2scrub_reap.service
3.718s systemd-fsck@dev-disk-by\x2duuid-cfd78a9b\x2dfadd\x2d4870\x2d88c2\x2d5277dae4e59f.service 3.550s apparmor.service
1.807s systemd-journal-flush.service
1.570s systemd-tmpfiles-setup.service
1.269s keyboard-setup.service
1.259s atd.service
1.207s systemd-udevd.service
1.055s bluetooth.service
1.052s binfmt-support.service
935ms exim4.service
901ms systemd-journald.service
850ms systemd-modules-load.service
843ms systemd-sysusers.service
814ms upower.service
807ms dev-hugepages.mount
803ms pppd-dns.service
790ms dev-mqueue.mount
771ms sys-kernel-debug.mount
770ms sys-kernel-tracing.mount
697ms systemd-timesyncd.service
677ms [email protected]
630ms ifupdown-wait-online.service
604ms systemd-rfkill.service
561ms systemd-tmpfiles-setup-dev.service
521ms systemd-remount-fs.service
476ms systemd-sysctl.service
397ms systemd-random-seed.service
394ms systemd-backlight@backlight:intel_backlight.service
376ms systemd-tmpfiles-clean.service
289ms kmod-static-nodes.service
269ms [email protected]
194ms console-setup.service
182ms systemd-udev-trigger.service
134ms systemd-update-utmp.service
125ms proc-sys-fs-binfmt_misc.mount
69ms systemd-user-sessions.service
52ms alsa-restore.service
21ms [email protected]
17ms mnt-sandisk.mount
13ms systemd-update-utmp-runlevel.service
6ms sys-fs-fuse-connections.mount
4ms ifupdown-pre.service

user$ sudo systemd-analyze --no-pager critical-chain
The time when unit became active or started is printed after the "@" character. The time the unit took to start is printed after the "+" character.

graphical.target @41.539s

└─multi-user.target @41.538s
  └─exim4.service @40.601s +935ms
    └─network-online.target @40.599s
      └─NetworkManager-wait-online.service @27.314s +13.282s
        └─NetworkManager.service @17.831s +9.479s
          └─dbus.service @17.824s
            └─basic.target @17.675s
              └─sockets.target @17.672s
                └─dbus.socket @17.670s
                  └─sysinit.target @17.584s
                    └─systemd-udev-trigger.service @26.747s +182ms
                      └─systemd-udevd-kernel.socket @3.027s
                        └─system.slice @2.440s
                          └─-.slice @2.440s
Quoted 4 lines

Hope this helps you.

If you want some further informations and/or testing, please let me know and give clear instructions.

Thanks for testing, appreciate it!

Signature · 1 line
Jens Axboe