mm: reparent slab memory on cgroup removal
Subsystems (5)
v7 cover mm: reparent slab memory on cgroup removal
# Why do we need this?
We've noticed that the number of dying cgroups is steadily growing on most of our hosts in production. The following investigation revealed an issue in the userspace memory reclaim code [1], accounting of kernel stacks [2], and also the main reason: slab objects.
The underlying problem is quite simple: any page charged to a cgroup holds a reference to it, so the cgroup can't be reclaimed unless all charged pages are gone. If a slab object is actively used by other cgroups, it won't be reclaimed, and will prevent the origin cgroup from being reclaimed.
Slab objects, and first of all vfs cache, is shared between cgroups, which are using the same underlying fs, and what's even more important, it's shared between multiple generations of the same workload. So if something is running periodically every time in a new cgroup (like how systemd works), we do accumulate multiple dying cgroups.
Strictly speaking pagecache isn't different here, but there is a key difference:
we disable protection and apply some extra pressure on LRUs of dying cgroups, and these LRUs contain all charged pages.
My experiments show that with the disabled kernel memory accounting the number of dying cgroups stabilizes at a relatively small number (~100, depends on memory pressure and cgroup creation rate), and with kernel memory accounting it grows pretty steadily up to several thousands.
Memory cgroups are quite complex and big objects (mostly due to percpu stats), so it leads to noticeable memory losses. Memory occupied by dying cgroups is measured in hundreds of megabytes. I've even seen a host with more than 100Gb of memory wasted for dying cgroups. It leads to a degradation of performance with the uptime, and generally limits the usage of cgroups.
My previous attempt [3] to fix the problem by applying extra pressure on slab shrinker lists caused a regressions with xfs and ext4, and has been reverted [4]. The following attempts to find the right balance [5, 6] were not successful.
So instead of trying to find a maybe non-existing balance, let's do reparent accounted slab caches to the parent cgroup on cgroup removal.
# Implementation approach
There is however a significant problem with reparenting of slab memory:
there is no list of charged pages. Some of them are in shrinker lists, but not all. Introducing of a new list is really not an option.
But fortunately there is a way forward: every slab page has a stable pointer to the corresponding kmem_cache. So the idea is to reparent kmem_caches instead of slab pages.
It's actually simpler and cheaper, but requires some underlying changes:
1) Make kmem_caches to hold a single reference to the memory cgroup, instead of a separate reference per every slab page.
2) Stop setting page->mem_cgroup pointer for memcg slab pages and use page->kmem_cache->memcg indirection instead. It's used only on slab page release, so performance overhead shouldn't be a big issue.
3) Introduce a refcounter for non-root slab caches. It's required to be able to destroy kmem_caches when they become empty and release the associated memory cgroup.
There is a bonus: currently we release all memcg kmem_caches all together with the memory cgroup itself. This patchset allows individual kmem_caches to be released as soon as they become inactive and free.
Some additional implementation details are provided in corresponding commit messages.
# Results
Below is the average number of dying cgroups on two groups of our production hosts. They do run some sort of web frontend workload, the memory pressure is moderate. As we can see, with the kernel memory reparenting the number stabilizes in 60s range; however with the original version it grows almost linearly and doesn't show any signs of plateauing. The difference in slab and percpu usage between patched and unpatched versions also grows linearly. In 7 days it exceeded 200Mb.
day 0 1 2 3 4 5 6 7
original 56 362 628 752 1070 1250 1490 1560
patched 23 46 51 55 60 57 67 69
mem diff(Mb) 22 74 123 152 164 182 214 241
# History
v7:
1) refined cover letter and some commit logs
2) dropped patch 1
3) dropped the dying check on kmem_cache creation path
4) dropped __rcu annotation in patch 10, switched to READ_ONCE()/WRITE_ONCE() where is necessary
v6:
1) split biggest patches into parts to make the review easier
2) changed synchronization around the dying flag
3) sysfs entry removal on deactivation is back
4) got rid of redundant rcu wait on kmem_cache release
5) fixed getting memcg pointer in mem_cgroup_from_kmem()
5) fixed missed smp_rmb()
6) removed redundant CONFIG_SLOB
7) some renames and cosmetic fixes
v5:
1) fixed a compilation warning around missing kmemcg_queue_cache_shutdown()
2) s/rcu_read_lock()/rcu_read_unlock() in memcg_kmem_get_cache()
v4:
1) removed excessive memcg != parent check in memcg_deactivate_kmem_caches()
2) fixed rcu_read_lock() usage in memcg_charge_slab()
3) fixed synchronization around dying flag in kmemcg_queue_cache_shutdown()
4) refreshed test results data
5) reworked PageTail() checks in memcg_from_slab_page()
6) added some comments in multiple places
v3:
1) reworked memcg kmem_cache search on allocation path
2) fixed /proc/kpagecgroup interface
v2:
1) switched to percpu kmem_cache refcounter
2) a reference to kmem_cache is held during the allocation
3) slabs stats are fixed for !MEMCG case (and the refactoring is separated into a standalone patch)
4) kmem_cache reparenting is performed from deactivatation context
v1:
https://lkml.org/lkml/2019/4/17/1095
# Links
[1]: commit 68600f623d69 ("mm: don't miss the last page because of round-off error")
[2]: commit 9b6f7e163cd0 ("mm: rework memcg kernel stack accounting") [3]: commit 172b06c32b94 ("mm: slowly shrink slabs with a relatively small number of objects")
[4]: commit a9a238e83fbb ("Revert "mm: slowly shrink slabs with a relatively small number of objects")
[5]: https://lkml.org/lkml/2019/1/28/1865
[6]: https://marc.info/?l=linux-mm&m=155064763626437&w=2
Roman Gushchin (10):
mm: postpone kmem_cache memcg pointer initialization to
memcg_link_cache()
mm: rename slab delayed deactivation functions and fields
mm: generalize postponed non-root kmem_cache deactivation
mm: introduce __memcg_kmem_uncharge_memcg()
mm: unify SLAB and SLUB page accounting
mm: don't check the dying flag on kmem_cache creation
mm: synchronize access to kmem_cache dying flag using a spinlock
mm: rework non-root kmem_cache lifecycle management
mm: stop setting page->mem_cgroup pointer for slab pages
mm: reparent memcg kmem_caches on cgroup removal
include/linux/memcontrol.h | 10 +++ include/linux/slab.h | 11 +-- mm/list_lru.c | 3 +- mm/memcontrol.c | 101 ++++++++++++++++------- mm/slab.c | 25 ++---- mm/slab.h | 143 +++++++++++++++++++++++--------- mm/slab_common.c | 164 ++++++++++++++++++++++--------------- mm/slub.c | 24 +----- 8 files changed, 301 insertions(+), 180 deletions(-)
Signature · 1 line
2.21.0
PATCH v7 1/10 mm: postpone kmem_cache memcg pointer initialization to memcg_link_cache()
Initialize kmem_cache->memcg_params.memcg pointer in memcg_link_cache() rather than in init_memcg_params().
Once kmem_cache will hold a reference to the memory cgroup, it will simplify the refcounting.
For non-root kmem_caches memcg_link_cache() is always called before the kmem_cache becomes visible to a user, so it's safe.
--- mm/slab.c | 2 +- mm/slab.h | 5 +++-- mm/slab_common.c | 14 +++++++------- mm/slub.c | 2 +- 4 files changed, 12 insertions(+), 11 deletions(-)
mm/slab.c +1 -1
@@ -1239,7 +1239,7 @@ void __init kmem_cache_init(void) nr_node_ids *sizeof (struct kmem_cache_node *), SLAB_HWCACHE_ALIGN, 0, 0);list_add (&kmem_cache->list, &slab_caches); -memcg_link_cache (kmem_cache); +memcg_link_cache (kmem_cache,NULL ); slab_state =PARTIAL ;/*
mm/slab.h +3 -2
@@ -289,7 +289,7 @@ static __always_inline void memcg_uncharge_slab(struct page *page, int order, }extern void slab_init_memcg_params (struct kmem_cache *); -extern void memcg_link_cache (struct kmem_cache *s); +extern void memcg_link_cache (struct kmem_cache *s,struct mem_cgroup *memcg);extern void slab_deactivate_memcg_cache_rcu_sched (struct kmem_cache *s,void (*deact_fn)(struct kmem_cache *));
@@ -344,7 +344,8 @@ static inline void slab_init_memcg_params(struct kmem_cache *s) { } -static inline void memcg_link_cache (struct kmem_cache *s) +static inline void memcg_link_cache (struct kmem_cache *s, +struct mem_cgroup *memcg) { }
mm/slab_common.c +7 -7
@@ -140,13 +140,12 @@ void slab_init_memcg_params(struct kmem_cache *s) }static int init_memcg_params (struct kmem_cache *s, -struct mem_cgroup *memcg,struct kmem_cache *root_cache) +struct kmem_cache *root_cache) {struct memcg_cache_array *arr;if (root_cache) { s->memcg_params.root_cache = root_cache; - s->memcg_params.memcg = memcg;INIT_LIST_HEAD (&s->memcg_params.children_node);INIT_LIST_HEAD (&s->memcg_params.kmem_caches_node);return 0 ;
@@ -221,11 +220,12 @@ int memcg_update_all_caches(int num_memcgs)return ret; } -void memcg_link_cache (struct kmem_cache *s) +void memcg_link_cache (struct kmem_cache *s,struct mem_cgroup *memcg) {if (is_root_cache (s)) {list_add (&s->root_caches_node, &slab_root_caches); }else { + s->memcg_params.memcg = memcg;list_add (&s->memcg_params.children_node, &s->memcg_params.root_cache->memcg_params.children); list_add(&s->memcg_params.kmem_caches_node,
@@ -244,7 +244,7 @@ static void memcg_unlink_cache(struct kmem_cache *s) }#else static inline int init_memcg_params (struct kmem_cache *s, -struct mem_cgroup *memcg,struct kmem_cache *root_cache) +struct kmem_cache *root_cache) {return 0 ; }
@@ -384,7 +384,7 @@ static struct kmem_cache *create_cache(const char *name, s->useroffset = useroffset; s->usersize = usersize; - err =init_memcg_params (s, memcg, root_cache); + err =init_memcg_params (s, root_cache);if (err) goto out_free_cache;
@@ -394,7 +394,7 @@ static struct kmem_cache *create_cache(const char *name, s->refcount =1 ;list_add (&s->list, &slab_caches); -memcg_link_cache (s); +memcg_link_cache (s, memcg); out:if (err)return ERR_PTR (err);
@@ -997,7 +997,7 @@ struct kmem_cache *__init create_kmalloc_cache(const char *name,create_boot_cache (s, name, size, flags, useroffset, usersize);list_add (&s->list, &slab_caches); -memcg_link_cache (s); +memcg_link_cache (s,NULL ); s->refcount =1 ;return s; }
mm/slub.c +1 -1
@@ -4213,7 +4213,7 @@ static struct kmem_cache * __init bootstrap(struct kmem_cache *static_cache) }slab_init_memcg_params (s);list_add (&s->list, &slab_caches); -memcg_link_cache (s); +memcg_link_cache (s,NULL );return s; }
Signature · 1 line
2.21.0
Andrew Morton
maintainerRe: [PATCH v7 01/10] mm: postpone kmem_cache memcg pointer initialization to memcg_link_cache()
Quoted 1 line · On Tue, 11 Jun 2019 16:18:04 -0700 Roman Gushchin <[email protected]> wrote:
Subject: [PATCH v7 01/10] mm: postpone
kmem_cachememcg pointer initialization tomemcg_link_cache()]
I think mm is too large a place for patches to be described as affecting simply "mm". So I'll irritatingly rewrite all these titles to "mm: memcg/slab:".
Re: [PATCH v7 01/10] mm: postpone kmem_cache memcg pointer initialization to memcg_link_cache()
Quoted 7 lines · Andrew Morton
Quoted 1 line · On Tue, 11 Jun 2019 16:18:04 -0700 Roman Gushchin <[email protected]> wrote:
Subject: [PATCH v7 01/10] mm: postpone
kmem_cachememcg pointer initialization tomemcg_link_cache()]I think mm is too large a place for patches to be described as affecting simply "mm". So I'll irritatingly rewrite all these titles to "mm: memcg/slab:".
Works for me. Thanks!
PATCH v7 2/10 mm: rename slab delayed deactivation functions and fields
In reply to Roman GushchinThe delayed work/rcu deactivation infrastructure of non-root kmem_caches can be also used for asynchronous release of these objects. Let's get rid of the word "deactivation" in corresponding names to make the code look better after generalization.
It's easier to make the renaming first, so that the generalized code will look consistent from scratch.
Let's rename struct memcg_cache_params fields:
deact_fn -> work_fn
deact_rcu_head -> rcu_head
deact_work -> work
And RCU/delayed work callbacks in slab common code:
kmemcg_deactivate_rcufn -> kmemcg_rcufn kmemcg_deactivate_workfn -> kmemcg_workfn
This patch contains no functional changes, only renamings.
--- include/linux/slab.h | 6 +++--- mm/slab.h | 2 +- mm/slab_common.c | 30 +++++++++++++++--------------- 3 files changed, 19 insertions(+), 19 deletions(-)
include/linux/slab.h +3 -3
@@ -642,10 +642,10 @@ struct memcg_cache_params {struct list_head children_node;struct list_head kmem_caches_node; -void (*deact_fn)(struct kmem_cache *); +void (*work_fn)(struct kmem_cache *);union { -struct rcu_head deact_rcu_head; -struct work_struct deact_work; +struct rcu_head rcu_head; +struct work_struct work; }; }; };
mm/slab.h +1 -1
@@ -291,7 +291,7 @@ static __always_inline void memcg_uncharge_slab(struct page *page, int order,extern void slab_init_memcg_params (struct kmem_cache *);extern void memcg_link_cache (struct kmem_cache *s,struct mem_cgroup *memcg);extern void slab_deactivate_memcg_cache_rcu_sched (struct kmem_cache *s, -void (*deact_fn)(struct kmem_cache *)); +void (*work_fn)(struct kmem_cache *));#else /* CONFIG_MEMCG_KMEM */
mm/slab_common.c +15 -15
@@ -691,17 +691,17 @@ void memcg_create_kmem_cache(struct mem_cgroup *memcg,put_online_cpus (); } -static void kmemcg_deactivate_workfn (struct work_struct *work) +static void kmemcg_workfn (struct work_struct *work) { struct kmem_cache *s = container_of(work, struct kmem_cache, - memcg_params.deact_work); + memcg_params.work);get_online_cpus ();get_online_mems ();mutex_lock (&slab_mutex); - s->memcg_params.deact_fn (s); + s->memcg_params.work_fn (s);mutex_unlock (&slab_mutex);
@@ -712,36 +712,36 @@ static void kmemcg_deactivate_workfn(struct work_struct *work)css_put (&s->memcg_params.memcg->css); } -static void kmemcg_deactivate_rcufn (struct rcu_head *head) +static void kmemcg_rcufn (struct rcu_head *head) { struct kmem_cache *s = container_of(head, struct kmem_cache, - memcg_params.deact_rcu_head); + memcg_params.rcu_head);/* -* We need to grab blocking locks. Bounce to ->deact_work. The +* We need to grab blocking locks. Bounce to ->work. The * work item shares the space with the RCU head and can't be * initialized eariler. */ -INIT_WORK (&s->memcg_params.deact_work, kmemcg_deactivate_workfn); -queue_work (memcg_kmem_cache_wq, &s->memcg_params.deact_work); +INIT_WORK (&s->memcg_params.work, kmemcg_workfn); +queue_work (memcg_kmem_cache_wq, &s->memcg_params.work); }/** * slab_deactivate_memcg_cache_rcu_sched - schedule deactivation after a * sched RCU grace period * @s: target kmem_cache -* @deact_fn: deactivation function to call +* @work_fn: deactivation function to call * -* Schedule @deact_fn to be invoked with online cpus, mems and slab_mutex +* Schedule @work_fn to be invoked with online cpus, mems and slab_mutex * held after a sched RCU grace period. The slab is guaranteed to stay -* alive until @deact_fn is finished. This is to be used from +* alive until @work_fn is finished. This is to be used from * __kmemcg_cache_deactivate(). */ void slab_deactivate_memcg_cache_rcu_sched (struct kmem_cache *s, -void (*deact_fn)(struct kmem_cache *)) +void (*work_fn)(struct kmem_cache *)) {if (WARN_ON_ONCE (is_root_cache (s)) || -WARN_ON_ONCE (s->memcg_params.deact_fn)) +WARN_ON_ONCE (s->memcg_params.work_fn))return ;if (s->memcg_params.root_cache->memcg_params.dying)
@@ -750,8 +750,8 @@ void slab_deactivate_memcg_cache_rcu_sched(struct kmem_cache *s,/* pin memcg so that @s doesn't get destroyed in the middle */ css_get (&s->memcg_params.memcg->css); - s->memcg_params.deact_fn = deact_fn; -call_rcu (&s->memcg_params.deact_rcu_head, kmemcg_deactivate_rcufn); + s->memcg_params.work_fn = work_fn; +call_rcu (&s->memcg_params.rcu_head, kmemcg_rcufn); }void memcg_deactivate_kmem_caches (struct mem_cgroup *memcg)
Signature · 1 line
2.21.0
Re: [PATCH v7 02/10] mm: rename slab delayed deactivation functions and fields
Quoted 14 lines · Roman Gushchin
The delayed work/rcu deactivation infrastructure of non-root
kmem_cachescan be also used for asynchronous release of these objects. Let's get rid of the word "deactivation" in corresponding names to make the code look better after generalization.It's easier to make the renaming first, so that the generalized code will look consistent from scratch.
Let's rename struct
memcg_cache_paramsfields:
deact_fn->work_fn
deact_rcu_head->rcu_head
deact_work-> work
Quoted 8 lines
And RCU/delayed work callbacks in slab common code:
kmemcg_deactivate_rcufn->kmemcg_rcufnkmemcg_deactivate_workfn->kmemcg_workfnThis patch contains no functional changes, only renamings.
Signed-off-by Roman Gushchin <[email protected]>Acked-by Vladimir Davydov <[email protected]>
PATCH v7 3/10 mm: generalize postponed non-root kmem_cache deactivation
In reply to Roman GushchinCurrently SLUB uses a work scheduled after an RCU grace period to deactivate a non-root kmem_cache. This mechanism can be reused for kmem_caches release, but requires generalization for SLAB case.
Introduce kmemcg_cache_deactivate() function, which calls allocator-specific __kmem_cache_deactivate() and schedules execution of __kmem_cache_deactivate_after_rcu() with all necessary locks in a worker context after an rcu grace period.
Here is the new calling scheme:
kmemcg_cache_deactivate()
__kmemcg_cache_deactivate() SLAB/SLUB-specific
kmemcg_rcufn() rcu
kmemcg_workfn() work
__kmemcg_cache_deactivate_after_rcu() SLAB/SLUB-specificinstead of:
__kmemcg_cache_deactivate() SLAB/SLUB-specific
slab_deactivate_memcg_cache_rcu_sched() SLUB-only
kmemcg_rcufn() rcu
kmemcg_workfn() work
kmemcg_cache_deact_after_rcu() SLUB-onlyFor consistency, all allocator-specific functions start with "__".
--- mm/slab.c | 4 ++++ mm/slab.h | 3 +-- mm/slab_common.c | 27 ++++++++------------------- mm/slub.c | 8 +------- 4 files changed, 14 insertions(+), 28 deletions(-)
mm/slab.c +4 -0
@@ -2252,6 +2252,10 @@ void __kmemcg_cache_deactivate(struct kmem_cache *cachep) {__kmem_cache_shrink (cachep); } + +void __kmemcg_cache_deactivate_after_rcu (struct kmem_cache *s) +{ +}#endif int __kmem_cache_shutdown (struct kmem_cache *cachep)
mm/slab.h +1 -2
@@ -172,6 +172,7 @@ int __kmem_cache_shutdown(struct kmem_cache *);void __kmem_cache_release (struct kmem_cache *);int __kmem_cache_shrink (struct kmem_cache *);void __kmemcg_cache_deactivate (struct kmem_cache *s); +void __kmemcg_cache_deactivate_after_rcu (struct kmem_cache *s);void slab_kmem_cache_release (struct kmem_cache *);struct seq_file ;
@@ -290,8 +291,6 @@ static __always_inline void memcg_uncharge_slab(struct page *page, int order,extern void slab_init_memcg_params (struct kmem_cache *);extern void memcg_link_cache (struct kmem_cache *s,struct mem_cgroup *memcg); -extern void slab_deactivate_memcg_cache_rcu_sched (struct kmem_cache *s, -void (*work_fn)(struct kmem_cache *));#else /* CONFIG_MEMCG_KMEM */
mm/slab_common.c +8 -19
@@ -708,7 +708,7 @@ static void kmemcg_workfn(struct work_struct *work)put_online_mems ();put_online_cpus (); -/* done, put the ref from slab_deactivate_memcg_cache_rcu_sched() */ +/* done, put the ref from kmemcg_cache_deactivate() */ css_put (&s->memcg_params.memcg->css); }
@@ -726,31 +726,21 @@ static void kmemcg_rcufn(struct rcu_head *head)queue_work (memcg_kmem_cache_wq, &s->memcg_params.work); } -/** -* slab_deactivate_memcg_cache_rcu_sched - schedule deactivation after a -* sched RCU grace period -* @s: target kmem_cache -* @work_fn: deactivation function to call -* -* Schedule @work_fn to be invoked with online cpus, mems and slab_mutex -* held after a sched RCU grace period. The slab is guaranteed to stay -* alive until @work_fn is finished. This is to be used from -* __kmemcg_cache_deactivate(). -*/ -void slab_deactivate_memcg_cache_rcu_sched (struct kmem_cache *s, -void (*work_fn)(struct kmem_cache *)) +static void kmemcg_cache_deactivate (struct kmem_cache *s) {if (WARN_ON_ONCE (is_root_cache (s)) ||WARN_ON_ONCE (s->memcg_params.work_fn))return ; +__kmemcg_cache_deactivate (s); +if (s->memcg_params.root_cache->memcg_params.dying)return ;/* pin memcg so that @s doesn't get destroyed in the middle */ css_get (&s->memcg_params.memcg->css); - s->memcg_params.work_fn = work_fn; + s->memcg_params.work_fn = __kmemcg_cache_deactivate_after_rcu;call_rcu (&s->memcg_params.rcu_head, kmemcg_rcufn); }
@@ -773,7 +763,7 @@ void memcg_deactivate_kmem_caches(struct mem_cgroup *memcg)if (!c)continue ; -__kmemcg_cache_deactivate (c); +kmemcg_cache_deactivate (c); arr->entries[idx] =NULL ; }mutex_unlock (&slab_mutex);
@@ -866,11 +856,10 @@ static void flush_memcg_workqueue(struct kmem_cache *s)mutex_unlock (&slab_mutex);/* -* SLUB deactivates the kmem_caches through call_rcu. Make +* SLAB and SLUB deactivate the kmem_caches through call_rcu. Make * sure all registered rcu callbacks have been invoked. */ -if (IS_ENABLED (CONFIG_SLUB )) -rcu_barrier (); +rcu_barrier ();/* * SLAB and SLUB create memcg kmem_caches through workqueue and SLUB
mm/slub.c +1 -7
@@ -4022,7 +4022,7 @@ int __kmem_cache_shrink(struct kmem_cache *s) }#ifdef CONFIG_MEMCG -static void kmemcg_cache_deact_after_rcu (struct kmem_cache *s) +void __kmemcg_cache_deactivate_after_rcu (struct kmem_cache *s) {/* * Called with all the locks held after a sched RCU grace period.
@@ -4048,12 +4048,6 @@ void __kmemcg_cache_deactivate(struct kmem_cache *s)*/ slub_set_cpu_partial (s,0 ); s->min_partial = 0; - -/* -* s->cpu_partial is checked locklessly (see put_cpu_partial), so -* we have to make sure the change is visible before shrinking. -*/ - slab_deactivate_memcg_cache_rcu_sched(s, kmemcg_cache_deact_after_rcu); }#endif /* CONFIG_MEMCG */
Signature · 1 line
2.21.0
Re: [PATCH v7 03/10] mm: generalize postponed non-root kmem_cache deactivation
Quoted 25 lines · Roman Gushchin
Currently SLUB uses a work scheduled after an RCU grace period to deactivate a non-root
kmem_cache. This mechanism can be reused forkmem_cachesrelease, but requires generalization for SLAB case.Introduce
kmemcg_cache_deactivate()function, which calls allocator-specific__kmem_cache_deactivate()and schedules execution of__kmem_cache_deactivate_after_rcu()with all necessary locks in a worker context after an rcu grace period.Here is the new calling scheme:
kmemcg_cache_deactivate()__kmemcg_cache_deactivate() SLAB/SLUB-specific kmemcg_rcufn() rcu kmemcg_workfn() work __kmemcg_cache_deactivate_after_rcu() SLAB/SLUB-specificinstead of:
__kmemcg_cache_deactivate() SLAB/SLUB-specific slab_deactivate_memcg_cache_rcu_sched() SLUB-only kmemcg_rcufn() rcu kmemcg_workfn() work kmemcg_cache_deact_after_rcu() SLUB-only
Quoted 4 lines
For consistency, all allocator-specific functions start with "__".
Signed-off-by Roman Gushchin <[email protected]>Acked-by Vladimir Davydov <[email protected]>
PATCH v7 4/10 mm: introduce __memcg_kmem_uncharge_memcg()
In reply to Roman GushchinLet's separate the page counter modification code out of __memcg_kmem_uncharge() in a way similar to what __memcg_kmem_charge() and __memcg_kmem_charge_memcg() work.
This will allow to reuse this code later using a new memcg_kmem_uncharge_memcg() wrapper, which calls __memcg_kmem_uncharge_memcg() if memcg_kmem_enabled() check is passed.
--- include/linux/memcontrol.h | 10 ++++++++++ mm/memcontrol.c | 25 +++++++++++++++++-------- 2 files changed, 27 insertions(+), 8 deletions(-)
include/linux/memcontrol.h +10 -0
@@ -1304,6 +1304,8 @@ int __memcg_kmem_charge(struct page *page, gfp_t gfp, int order);void __memcg_kmem_uncharge (struct page *page,int order);int __memcg_kmem_charge_memcg (struct page *page,gfp_t gfp,int order,struct mem_cgroup *memcg); +void __memcg_kmem_uncharge_memcg (struct mem_cgroup *memcg, +unsigned int nr_pages);extern struct static_key_false memcg_kmem_enabled_key;extern struct workqueue_struct *memcg_kmem_cache_wq;
@@ -1345,6 +1347,14 @@ static inline int memcg_kmem_charge_memcg(struct page *page, gfp_t gfp,return __memcg_kmem_charge_memcg (page, gfp, order, memcg);return 0 ; } + +static inline void memcg_kmem_uncharge_memcg (struct page *page,int order, +struct mem_cgroup *memcg) +{ +if (memcg_kmem_enabled ()) +__memcg_kmem_uncharge_memcg (memcg,1 << order); +} +/* * helper for accessing a memcg's index. It will be used as an index in the * child cache array in kmem_cache, and also to derive its name. This function
mm/memcontrol.c +17 -8
@@ -2812,6 +2812,22 @@ int __memcg_kmem_charge(struct page *page, gfp_t gfp, int order)css_put (&memcg->css);return ret; } + +/** +* __memcg_kmem_uncharge_memcg: uncharge a kmem page +* @memcg: memcg to uncharge +* @nr_pages: number of pages to uncharge +*/ +void __memcg_kmem_uncharge_memcg (struct mem_cgroup *memcg, +unsigned int nr_pages) +{ +if (!cgroup_subsys_on_dfl (memory_cgrp_subsys)) +page_counter_uncharge (&memcg->kmem, nr_pages); + +page_counter_uncharge (&memcg->memory, nr_pages); +if (do_memsw_account ()) +page_counter_uncharge (&memcg->memsw, nr_pages); +}/** * __memcg_kmem_uncharge: uncharge a kmem page * @page: page to uncharge
@@ -2826,14 +2842,7 @@ void __memcg_kmem_uncharge(struct page *page, int order)return ;VM_BUG_ON_PAGE (mem_cgroup_is_root (memcg), page); - -if (!cgroup_subsys_on_dfl (memory_cgrp_subsys)) -page_counter_uncharge (&memcg->kmem, nr_pages); - -page_counter_uncharge (&memcg->memory, nr_pages); -if (do_memsw_account ()) -page_counter_uncharge (&memcg->memsw, nr_pages); - +__memcg_kmem_uncharge_memcg (memcg, nr_pages); page->mem_cgroup =NULL ;/* slab pages do not have PageKmemcg flag set */
Signature · 1 line
2.21.0
PATCH v7 5/10 mm: unify SLAB and SLUB page accounting
In reply to Roman GushchinCurrently the page accounting code is duplicated in SLAB and SLUB internals. Let's move it into new (un)charge_slab_page helpers in the slab_common.c file. These helpers will be responsible for statistics (global and memcg-aware) and memcg charging. So they are replacing direct memcg_(un)charge_slab() calls.
--- mm/slab.c | 19 +++---------------- mm/slab.h | 25 +++++++++++++++++++++++++ mm/slub.c | 14 ++------------ 3 files changed, 30 insertions(+), 28 deletions(-)
mm/slab.c +3 -16
@@ -1360,7 +1360,6 @@ static struct page *kmem_getpages(struct kmem_cache *cachep, gfp_t flags, int nodeid) {struct page *page; -int nr_pages; flags |= cachep->allocflags;
@@ -1370,17 +1369,11 @@ static struct page *kmem_getpages(struct kmem_cache *cachep, gfp_t flags,return NULL ; } -if (memcg_charge_slab (page, flags, cachep->gfporder, cachep)) { +if (charge_slab_page (page, flags, cachep->gfporder, cachep)) {__free_pages (page, cachep->gfporder);return NULL ; } - nr_pages = (1 << cachep->gfporder); -if (cachep->flags &SLAB_RECLAIM_ACCOUNT ) -mod_lruvec_page_state (page,NR_SLAB_RECLAIMABLE , nr_pages); -else -mod_lruvec_page_state (page,NR_SLAB_UNRECLAIMABLE , nr_pages); -__SetPageSlab (page);/* Record if ALLOC_NO_WATERMARKS was set when allocating the slab */ if (sk_memalloc_socks () &&page_is_pfmemalloc (page))
@@ -1395,12 +1388,6 @@ static struct page *kmem_getpages(struct kmem_cache *cachep, gfp_t flags,static void kmem_freepages (struct kmem_cache *cachep,struct page *page) {int order = cachep->gfporder; -unsigned long nr_freed = (1 << order); - -if (cachep->flags &SLAB_RECLAIM_ACCOUNT ) -mod_lruvec_page_state (page,NR_SLAB_RECLAIMABLE , -nr_freed); -else -mod_lruvec_page_state (page,NR_SLAB_UNRECLAIMABLE , -nr_freed);BUG_ON (!PageSlab (page));__ClearPageSlabPfmemalloc (page);
@@ -1409,8 +1396,8 @@ static void kmem_freepages(struct kmem_cache *cachep, struct page *page) page->mapping =NULL ;if (current->reclaim_state) - current->reclaim_state->reclaimed_slab += nr_freed; -memcg_uncharge_slab (page, order, cachep); + current->reclaim_state->reclaimed_slab +=1 << order; +uncharge_slab_page (page, order, cachep);__free_pages (page, order); }
mm/slab.h +25 -0
@@ -205,6 +205,12 @@ ssize_t slabinfo_write(struct file *file, const char __user *buffer,void __kmem_cache_free_bulk (struct kmem_cache *,size_t ,void **);int __kmem_cache_alloc_bulk (struct kmem_cache *,gfp_t ,size_t ,void **); +static inline int cache_vmstat_idx (struct kmem_cache *s) +{ +return (s->flags &SLAB_RECLAIM_ACCOUNT ) ? +NR_SLAB_RECLAIMABLE :NR_SLAB_UNRECLAIMABLE ; +} +#ifdef CONFIG_MEMCG_KMEM /* List of all root caches. */
@@ -361,6 +367,25 @@ static inline struct kmem_cache *virt_to_cache(const void *obj)return page->slab_cache; } +static __always_inline int charge_slab_page(struct page *page, +gfp_t gfp,int order, +struct kmem_cache *s) +{ +int ret =memcg_charge_slab (page, gfp, order, s); + +if (!ret) +mod_lruvec_page_state (page,cache_vmstat_idx (s),1 << order); + +return ret; +} + +static __always_inline void uncharge_slab_page(struct page *page, int order, +struct kmem_cache *s) +{ +mod_lruvec_page_state (page,cache_vmstat_idx (s), -(1 << order)); +memcg_uncharge_slab (page, order, s); +} +static inline struct kmem_cache *cache_from_obj (struct kmem_cache *s,void *x) {struct kmem_cache *cachep;
mm/slub.c +2 -12
@@ -1488,7 +1488,7 @@ static inline struct page *alloc_slab_page(struct kmem_cache *s,else page =__alloc_pages_node (node, flags, order); -if (page &&memcg_charge_slab (page, flags, order, s)) { +if (page &&charge_slab_page (page, flags, order, s)) {__free_pages (page, order); page =NULL ; }
@@ -1681,11 +1681,6 @@ static struct page *allocate_slab(struct kmem_cache *s, gfp_t flags, int node)if (!page)return NULL ; -mod_lruvec_page_state (page, - (s->flags &SLAB_RECLAIM_ACCOUNT ) ? -NR_SLAB_RECLAIMABLE :NR_SLAB_UNRECLAIMABLE , -1 <<oo_order (oo)); -inc_slabs_node (s,page_to_nid (page), page->objects);return page;
@@ -1719,18 +1714,13 @@ static void __free_slab(struct kmem_cache *s, struct page *page)check_object (s, page, p,SLUB_RED_INACTIVE ); } -mod_lruvec_page_state (page, - (s->flags &SLAB_RECLAIM_ACCOUNT ) ? -NR_SLAB_RECLAIMABLE :NR_SLAB_UNRECLAIMABLE , - -pages); -__ClearPageSlabPfmemalloc (page);__ClearPageSlab (page); page->mapping =NULL ;if (current->reclaim_state) current->reclaim_state->reclaimed_slab += pages; -memcg_uncharge_slab (page, order, s); +uncharge_slab_page (page, order, s);__free_pages (page, order); }
Signature · 1 line
2.21.0
PATCH v7 6/10 mm: don't check the dying flag on kmem_cache creation
In reply to Roman GushchinThere is no point in checking the root_cache->memcg_params.dying flag on kmem_cache creation path. New allocations shouldn't be performed using a dead root kmem_cache, so no new memcg kmem_cache creation can be scheduled after the flag is set. And if it was scheduled before, flush_memcg_workqueue() will wait for it anyway.
So let's drop this check to simplify the code.
--- mm/slab_common.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
mm/slab_common.c +1 -1
@@ -640,7 +640,7 @@ void memcg_create_kmem_cache(struct mem_cgroup *memcg,* The memory cgroup could have been offlined while the cache * creation work was pending. */ -if (memcg->kmem_state !=KMEM_ONLINE || root_cache->memcg_params.dying) +if (memcg->kmem_state !=KMEM_ONLINE ) goto out_unlock; idx =memcg_cache_id (memcg);
Signature · 1 line
2.21.0
Re: [PATCH v7 06/10] mm: don't check the dying flag on kmem_cache creation
Quoted 9 lines · Roman Gushchin
There is no point in checking the
root_cache->memcg_params.dyingflag onkmem_cachecreation path. New allocations shouldn't be performed using a dead rootkmem_cache, so no new memcgkmem_cachecreation can be scheduled after the flag is set. And if it was scheduled before,flush_memcg_workqueue()will wait for it anyway.So let's drop this check to simplify the code.
Signed-off-by Roman Gushchin <[email protected]>
Re: [PATCH v7 06/10] mm: don't check the dying flag on kmem_cache creation
In reply to Roman GushchinQuoted 4 lines · Roman Gushchin
There is no point in checking the
root_cache->memcg_params.dyingflag onkmem_cachecreation path. New allocations shouldn't be performed using a dead rootkmem_cache,
Yes, it's the user's responsibility to synchronize the kmem cache destruction and allocations.
Quoted 7 lines
so no new memcg
kmem_cache
creation can be scheduled after the flag is set. And if it was scheduled before,flush_memcg_workqueue()will wait for it anyway.So let's drop this check to simplify the code.
Signed-off-by Roman Gushchin <[email protected]>
PATCH v7 7/10 mm: synchronize access to kmem_cache dying flag using a spinlock
In reply to Roman GushchinCurrently the memcg_params.dying flag and the corresponding workqueue used for the asynchronous deactivation of kmem_caches is synchronized using the slab_mutex.
It makes impossible to check this flag from the irq context, which will be required in order to implement asynchronous release of kmem_caches.
So let's switch over to the irq-save flavor of the spinlock-based synchronization.
--- mm/slab_common.c | 15 ++++++++++++--- 1 file changed, 12 insertions(+), 3 deletions(-)
mm/slab_common.c +12 -3
@@ -130,6 +130,7 @@ int __kmem_cache_alloc_bulk(struct kmem_cache *s, gfp_t flags, size_t nr,#ifdef CONFIG_MEMCG_KMEM LIST_HEAD (slab_root_caches); +static DEFINE_SPINLOCK (memcg_kmem_wq_lock);void slab_init_memcg_params (struct kmem_cache *s) {
@@ -734,14 +735,22 @@ static void kmemcg_cache_deactivate(struct kmem_cache *s)__kmemcg_cache_deactivate (s); +/* +* memcg_kmem_wq_lock is used to synchronize memcg_params.dying +* flag and make sure that no new kmem_cache deactivation tasks +* are queued (see flush_memcg_workqueue() ). +*/ +spin_lock_irq (&memcg_kmem_wq_lock);if (s->memcg_params.root_cache->memcg_params.dying) -return ; + goto unlock;/* pin memcg so that @s doesn't get destroyed in the middle */ css_get (&s->memcg_params.memcg->css); s->memcg_params.work_fn = __kmemcg_cache_deactivate_after_rcu;call_rcu (&s->memcg_params.rcu_head, kmemcg_rcufn); +unlock: +spin_unlock_irq (&memcg_kmem_wq_lock); }void memcg_deactivate_kmem_caches (struct mem_cgroup *memcg)
@@ -851,9 +860,9 @@ static int shutdown_memcg_caches(struct kmem_cache *s)static void flush_memcg_workqueue (struct kmem_cache *s) { -mutex_lock (&slab_mutex); +spin_lock_irq (&memcg_kmem_wq_lock); s->memcg_params.dying = true; -mutex_unlock (&slab_mutex); +spin_unlock_irq (&memcg_kmem_wq_lock);/* * SLAB and SLUB deactivate the kmem_caches through call_rcu. Make
Signature · 1 line
2.21.0
Re: [PATCH v7 07/10] mm: synchronize access to kmem_cache dying flag using a spinlock
Quoted 4 lines · Roman Gushchin
Currently the memcg_params.dying flag and the corresponding workqueue used for the asynchronous deactivation of
kmem_cachesis synchronized using theslab_mutex.
Quoted 8 lines
It makes impossible to check this flag from the irq context, which will be required in order to implement asynchronous release of
kmem_caches.So let's switch over to the irq-save flavor of the spinlock-based synchronization.
Signed-off-by Roman Gushchin <[email protected]>
Re: [PATCH v7 07/10] mm: synchronize access to kmem_cache dying flag using a spinlock
In reply to Roman GushchinQuoted 5 lines · Roman Gushchin
Currently the memcg_params.dying flag and the corresponding workqueue used for the asynchronous deactivation of
kmem_cachesis synchronized using theslab_mutex.
Quoted 8 lines
It makes impossible to check this flag from the irq context, which will be required in order to implement asynchronous release of
kmem_caches.So let's switch over to the irq-save flavor of the spinlock-based synchronization.
Signed-off-by Roman Gushchin <[email protected]>
PATCH v7 8/10 mm: rework non-root kmem_cache lifecycle management
In reply to Roman GushchinCurrently each charged slab page holds a reference to the cgroup to which it's charged. Kmem_caches are held by the memcg and are released all together with the memory cgroup. It means that none of kmem_caches are released unless at least one reference to the memcg exists, which is very far from optimal.
Let's rework it in a way that allows releasing individual kmem_caches as soon as the cgroup is offline, the kmem_cache is empty and there are no pending allocations.
To make it possible, let's introduce a new percpu refcounter for non-root kmem caches. The counter is initialized to the percpu mode, and is switched to the atomic mode during kmem_cache deactivation. The counter is bumped for every charged page and also for every running allocation. So the kmem_cache can't be released unless all allocations complete.
To shutdown non-active empty kmem_caches, let's reuse the work queue, previously used for the kmem_cache deactivation. Once the reference counter reaches 0, let's schedule an asynchronous kmem_cache release.
* I used the following simple approach to test the performance (stolen from another patchset by T. Harding):
time find / -name fname-no-exist
echo 2 > /proc/sys/vm/drop_caches
repeat 10 times
Results:
orig patched
real 0m1.455s real 0m1.355s
user 0m0.206s user 0m0.219s
sys 0m0.855s sys 0m0.807s
real 0m1.487s real 0m1.699s
user 0m0.221s user 0m0.256s
sys 0m0.806s sys 0m0.948s
real 0m1.515s real 0m1.505s
user 0m0.183s user 0m0.215s
sys 0m0.876s sys 0m0.858s
real 0m1.291s real 0m1.380s
user 0m0.193s user 0m0.198s
sys 0m0.843s sys 0m0.786s
real 0m1.364s real 0m1.374s
user 0m0.180s user 0m0.182s
sys 0m0.868s sys 0m0.806s
real 0m1.352s real 0m1.312s
user 0m0.201s user 0m0.212s
sys 0m0.820s sys 0m0.761s
real 0m1.302s real 0m1.349s
user 0m0.205s user 0m0.203s
sys 0m0.803s sys 0m0.792s
real 0m1.334s real 0m1.301s
user 0m0.194s user 0m0.201s
sys 0m0.806s sys 0m0.779s
real 0m1.426s real 0m1.434s
user 0m0.216s user 0m0.181s
sys 0m0.824s sys 0m0.864s
real 0m1.350s real 0m1.295s
user 0m0.200s user 0m0.190s
sys 0m0.842s sys 0m0.811s
So it looks like the difference is not noticeable in this test.
--- include/linux/slab.h | 3 +- mm/memcontrol.c | 50 +++++++++++++++++++++------- mm/slab.h | 44 +++++++----------------- mm/slab_common.c | 79 ++++++++++++++++++++++++++------------------ 4 files changed, 99 insertions(+), 77 deletions(-)
include/linux/slab.h +2 -1
@@ -16,6 +16,7 @@#include <linux/overflow.h> #include <linux/types.h> #include <linux/workqueue.h> +#include <linux/percpu-refcount.h> /*
@@ -152,7 +153,6 @@ int kmem_cache_shrink(struct kmem_cache *);void memcg_create_kmem_cache (struct mem_cgroup *,struct kmem_cache *);void memcg_deactivate_kmem_caches (struct mem_cgroup *); -void memcg_destroy_kmem_caches (struct mem_cgroup *);/* * Please use this macro to create slab caches. Simply specify the
@@ -641,6 +641,7 @@ struct memcg_cache_params {struct mem_cgroup *memcg;struct list_head children_node;struct list_head kmem_caches_node; +struct percpu_ref refcnt;void (*work_fn)(struct kmem_cache *);union {
mm/memcontrol.c +38 -12
94 lines not on this page · raw message
mm/slab.h +12 -32
69 lines not on this page · raw message
mm/slab_common.c +47 -32
146 lines not on this page · raw message
Signature · 1 line
2.21.0
Re: [PATCH v7 08/10] mm: rework non-root kmem_cache lifecycle management
Quoted 69 lines · Roman Gushchin
Currently each charged slab page holds a reference to the cgroup to which it's charged.
Kmem_cachesare held by the memcg and are released all together with the memory cgroup. It means that none ofkmem_cachesare released unless at least one reference to the memcg exists, which is very far from optimal.Let's rework it in a way that allows releasing individual
kmem_cachesas soon as the cgroup is offline, thekmem_cacheis empty and there are no pending allocations.To make it possible, let's introduce a new percpu refcounter for non-root kmem caches. The counter is initialized to the percpu mode, and is switched to the atomic mode during
kmem_cachedeactivation. The counter is bumped for every charged page and also for every running allocation. So thekmem_cachecan't be released unless all allocations complete.To shutdown non-active empty
kmem_caches, let's reuse the work queue, previously used for thekmem_cachedeactivation. Once the reference counter reaches 0, let's schedule an asynchronouskmem_cacherelease.* I used the following simple approach to test the performance (stolen from another patchset by T. Harding):
time find / -name fname-no-exist
echo 2 >/proc/sys/vm/drop_caches
repeat 10 timesResults:
orig patched
real 0m1.455s real 0m1.355s user 0m0.206s user 0m0.219s sys 0m0.855s sys 0m0.807sreal 0m1.487s real 0m1.699s user 0m0.221s user 0m0.256s sys 0m0.806s sys 0m0.948sreal 0m1.515s real 0m1.505s user 0m0.183s user 0m0.215s sys 0m0.876s sys 0m0.858sreal 0m1.291s real 0m1.380s user 0m0.193s user 0m0.198s sys 0m0.843s sys 0m0.786sreal 0m1.364s real 0m1.374s user 0m0.180s user 0m0.182s sys 0m0.868s sys 0m0.806sreal 0m1.352s real 0m1.312s user 0m0.201s user 0m0.212s sys 0m0.820s sys 0m0.761sreal 0m1.302s real 0m1.349s user 0m0.205s user 0m0.203s sys 0m0.803s sys 0m0.792sreal 0m1.334s real 0m1.301s user 0m0.194s user 0m0.201s sys 0m0.806s sys 0m0.779sreal 0m1.426s real 0m1.434s user 0m0.216s user 0m0.181s sys 0m0.824s sys 0m0.864s
Quoted 8 lines
real 0m1.350s real 0m1.295s user 0m0.200s user 0m0.190s sys 0m0.842s sys 0m0.811sSo it looks like the difference is not noticeable in this test.
Signed-off-by Roman Gushchin <[email protected]>Acked-by Vladimir Davydov <[email protected]>
WARNING bisected (was Re: [PATCH v7 08/10] mm: rework non-root kmem_cache lifecycle management)
In reply to Roman GushchinFolks,
I do get errors like the following when running a new testcase in our KVM CI. The test basically unloads kvm, reloads with with hpage=1 (enable huge page support for guests on s390) start a guest with libvirt and hugepages, shut the guest down and unload the kvm module.
WARNING: CPU: 8 PID: 208 at lib/percpu-refcount.c:108 percpu_ref_exit+0x50/0x58
Modules linked in: kvm(-) xt_CHECKSUM xt_MASQUERADE bonding xt_tcpudp ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_na>
CPU: 8 PID: 208 Comm: kworker/8:1 Not tainted 5.2.0+ #66
Hardware name: IBM 2964 NC9 712 (LPAR)
Workqueue: events sysfs_slab_remove_workfn
Krnl PSW : 0704e00180000000 0000001529746850 (percpu_ref_exit+0x50/0x58)
R:0 T:1 IO:1 EX:1 Key:0 M:1 W:0 P:0 AS:3 CC:2 PM:0 RI:0 EA:3
Krnl GPRS: 00000000ffff8808 0000001529746740 000003f4e30e8e18 0036008100000000
0000001f00000000 0035008100000000 0000001fb3573ab8 0000000000000000
0000001fbdb6de00 0000000000000000 0000001529f01328 0000001fb3573b00
0000001fbb27e000 0000001fbdb69300 000003e009263d00 000003e009263cd0
Krnl Code: 0000001529746842: f0a0000407fe srp 4(11,%r0),2046,0
0000001529746848: 47000700 bc 0,1792
#000000152974684c: a7f40001 brc 15,152974684e
>0000001529746850: a7f4fff2 brc 15,1529746834
0000001529746854: 0707 bcr 0,%r7
0000001529746856: 0707 bcr 0,%r7
0000001529746858: eb8ff0580024 stmg %r8,%r15,88(%r15)
000000152974685e: a738ffff lhi %r3,-1
Call Trace:
([<000003e009263d00>] 0x3e009263d00)
[<00000015293252ea>] slab_kmem_cache_release+0x3a/0x70
[<0000001529b04882>] kobject_put+0xaa/0xe8
[<000000152918cf28>] process_one_work+0x1e8/0x428
[<000000152918d1b0>] worker_thread+0x48/0x460
[<00000015291942c6>] kthread+0x126/0x160
[<0000001529b22344>] ret_from_fork+0x28/0x30
[<0000001529b2234c>] kernel_thread_starter+0x0/0x10
Last Breaking-Event-Address:
[<000000152974684c>] percpu_ref_exit+0x4c/0x58
---[ end trace b035e7da5788eb09 ]---I have bisected this to
# first bad commit: [f0a3a24b532d9a7e56a33c5112b2a212ed6ec580] mm: memcg/slab: rework non-root kmem_cache lifecycle management
unmounting /sys/fs/cgroup/memory/ before the test makes the problem go away so it really seems to be related to the new percpu-refs from this patch.
Any ideas?
Christian
Re: WARNING bisected (was Re: [PATCH v7 08/10] mm: rework non-root kmem_cache lifecycle management)
Quoted 6 lines · Christian Borntraeger
Folks,
I do get errors like the following when running a new testcase in our KVM CI. The test basically unloads kvm, reloads with with hpage=1 (enable huge page support for guests on s390) start a guest with libvirt and hugepages, shut the guest down and unload the kvm module.
It also crashes without large pages. The trigger is really that the time between "guest is going away" and rmmod kvm is really short.
i
Quoted 43 lines
WARNING: CPU: 8 PID: 208 at lib/percpu-refcount.c:108 percpu_ref_exit+0x50/0x58 Modules linked in: kvm(-) xt_CHECKSUM xt_MASQUERADE bonding xt_tcpudp ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_na> CPU: 8 PID: 208 Comm: kworker/8:1 Not tainted 5.2.0+ #66 Hardware name: IBM 2964 NC9 712 (LPAR) Workqueue: events sysfs_slab_remove_workfn Krnl PSW : 0704e00180000000 0000001529746850 (percpu_ref_exit+0x50/0x58) R:0 T:1 IO:1 EX:1 Key:0 M:1 W:0 P:0 AS:3 CC:2 PM:0 RI:0 EA:3 Krnl GPRS: 00000000ffff8808 0000001529746740 000003f4e30e8e18 0036008100000000 0000001f00000000 0035008100000000 0000001fb3573ab8 0000000000000000 0000001fbdb6de00 0000000000000000 0000001529f01328 0000001fb3573b00 0000001fbb27e000 0000001fbdb69300 000003e009263d00 000003e009263cd0 Krnl Code: 0000001529746842: f0a0000407fe srp 4(11,%r0),2046,0 0000001529746848: 47000700 bc 0,1792 #000000152974684c: a7f40001 brc 15,152974684e >0000001529746850: a7f4fff2 brc 15,1529746834 0000001529746854: 0707 bcr 0,%r7 0000001529746856: 0707 bcr 0,%r7 0000001529746858: eb8ff0580024 stmg %r8,%r15,88(%r15) 000000152974685e: a738ffff lhi %r3,-1 Call Trace: ([<000003e009263d00>] 0x3e009263d00) [<00000015293252ea>] slab_kmem_cache_release+0x3a/0x70 [<0000001529b04882>] kobject_put+0xaa/0xe8 [<000000152918cf28>] process_one_work+0x1e8/0x428 [<000000152918d1b0>] worker_thread+0x48/0x460 [<00000015291942c6>] kthread+0x126/0x160 [<0000001529b22344>] ret_from_fork+0x28/0x30 [<0000001529b2234c>] kernel_thread_starter+0x0/0x10 Last Breaking-Event-Address: [<000000152974684c>] percpu_ref_exit+0x4c/0x58 ---[ end trace b035e7da5788eb09 ]---I have bisected this to
# first bad commit: [f0a3a24b532d9a7e56a33c5112b2a212ed6ec580] mm: memcg/slab: rework non-root kmem_cache lifecycle managementunmounting
/sys/fs/cgroup/memory/before the test makes the problem go away so it really seems to be related to the new percpu-refs from this patch.Any ideas?
Christian
Re: WARNING bisected (was Re: [PATCH v7 08/10] mm: rework non-root kmem_cache lifecycle management)
In reply to Christian BorntraegerQuoted 39 lines · Christian Borntraeger
Folks,
I do get errors like the following when running a new testcase in our KVM CI. The test basically unloads kvm, reloads with with hpage=1 (enable huge page support for guests on s390) start a guest with libvirt and hugepages, shut the guest down and unload the kvm module.
WARNING: CPU: 8 PID: 208 at lib/percpu-refcount.c:108 percpu_ref_exit+0x50/0x58 Modules linked in: kvm(-) xt_CHECKSUM xt_MASQUERADE bonding xt_tcpudp ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_na> CPU: 8 PID: 208 Comm: kworker/8:1 Not tainted 5.2.0+ #66 Hardware name: IBM 2964 NC9 712 (LPAR) Workqueue: events sysfs_slab_remove_workfn Krnl PSW : 0704e00180000000 0000001529746850 (percpu_ref_exit+0x50/0x58) R:0 T:1 IO:1 EX:1 Key:0 M:1 W:0 P:0 AS:3 CC:2 PM:0 RI:0 EA:3 Krnl GPRS: 00000000ffff8808 0000001529746740 000003f4e30e8e18 0036008100000000 0000001f00000000 0035008100000000 0000001fb3573ab8 0000000000000000 0000001fbdb6de00 0000000000000000 0000001529f01328 0000001fb3573b00 0000001fbb27e000 0000001fbdb69300 000003e009263d00 000003e009263cd0 Krnl Code: 0000001529746842: f0a0000407fe srp 4(11,%r0),2046,0 0000001529746848: 47000700 bc 0,1792 #000000152974684c: a7f40001 brc 15,152974684e >0000001529746850: a7f4fff2 brc 15,1529746834 0000001529746854: 0707 bcr 0,%r7 0000001529746856: 0707 bcr 0,%r7 0000001529746858: eb8ff0580024 stmg %r8,%r15,88(%r15) 000000152974685e: a738ffff lhi %r3,-1 Call Trace: ([<000003e009263d00>] 0x3e009263d00) [<00000015293252ea>] slab_kmem_cache_release+0x3a/0x70 [<0000001529b04882>] kobject_put+0xaa/0xe8 [<000000152918cf28>] process_one_work+0x1e8/0x428 [<000000152918d1b0>] worker_thread+0x48/0x460 [<00000015291942c6>] kthread+0x126/0x160 [<0000001529b22344>] ret_from_fork+0x28/0x30 [<0000001529b2234c>] kernel_thread_starter+0x0/0x10 Last Breaking-Event-Address: [<000000152974684c>] percpu_ref_exit+0x4c/0x58 ---[ end trace b035e7da5788eb09 ]---
Quoted 7 lines
I have bisected this to
# first bad commit: [f0a3a24b532d9a7e56a33c5112b2a212ed6ec580] mm: memcg/slab: rework non-root kmem_cache lifecycle managementunmounting
/sys/fs/cgroup/memory/before the test makes the problem go away so it really seems to be related to the new percpu-refs from this patch.Any ideas?
Hello, Christian!
It seems to be a race between releasing of the root kmem_cache (caused by rmmod) and a memcg kmem_cache. Does delaying rmmod for say, a minute, "resolve" the issue?
I'll take a look at this code path.
Thanks!
Re: WARNING bisected (was Re: [PATCH v7 08/10] mm: rework non-root kmem_cache lifecycle management)
Quoted 46 lines · Roman Gushchin
Quoted 45 lines · Christian Borntraeger
Folks,
I do get errors like the following when running a new testcase in our KVM CI. The test basically unloads kvm, reloads with with hpage=1 (enable huge page support for guests on s390) start a guest with libvirt and hugepages, shut the guest down and unload the kvm module.
WARNING: CPU: 8 PID: 208 at lib/percpu-refcount.c:108 percpu_ref_exit+0x50/0x58 Modules linked in: kvm(-) xt_CHECKSUM xt_MASQUERADE bonding xt_tcpudp ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_na> CPU: 8 PID: 208 Comm: kworker/8:1 Not tainted 5.2.0+ #66 Hardware name: IBM 2964 NC9 712 (LPAR) Workqueue: events sysfs_slab_remove_workfn Krnl PSW : 0704e00180000000 0000001529746850 (percpu_ref_exit+0x50/0x58) R:0 T:1 IO:1 EX:1 Key:0 M:1 W:0 P:0 AS:3 CC:2 PM:0 RI:0 EA:3 Krnl GPRS: 00000000ffff8808 0000001529746740 000003f4e30e8e18 0036008100000000 0000001f00000000 0035008100000000 0000001fb3573ab8 0000000000000000 0000001fbdb6de00 0000000000000000 0000001529f01328 0000001fb3573b00 0000001fbb27e000 0000001fbdb69300 000003e009263d00 000003e009263cd0 Krnl Code: 0000001529746842: f0a0000407fe srp 4(11,%r0),2046,0 0000001529746848: 47000700 bc 0,1792 #000000152974684c: a7f40001 brc 15,152974684e >0000001529746850: a7f4fff2 brc 15,1529746834 0000001529746854: 0707 bcr 0,%r7 0000001529746856: 0707 bcr 0,%r7 0000001529746858: eb8ff0580024 stmg %r8,%r15,88(%r15) 000000152974685e: a738ffff lhi %r3,-1 Call Trace: ([<000003e009263d00>] 0x3e009263d00) [<00000015293252ea>] slab_kmem_cache_release+0x3a/0x70 [<0000001529b04882>] kobject_put+0xaa/0xe8 [<000000152918cf28>] process_one_work+0x1e8/0x428 [<000000152918d1b0>] worker_thread+0x48/0x460 [<00000015291942c6>] kthread+0x126/0x160 [<0000001529b22344>] ret_from_fork+0x28/0x30 [<0000001529b2234c>] kernel_thread_starter+0x0/0x10 Last Breaking-Event-Address: [<000000152974684c>] percpu_ref_exit+0x4c/0x58 ---[ end trace b035e7da5788eb09 ]---I have bisected this to
# first bad commit: [f0a3a24b532d9a7e56a33c5112b2a212ed6ec580] mm: memcg/slab: rework non-root kmem_cache lifecycle managementunmounting
/sys/fs/cgroup/memory/before the test makes the problem go away so it really seems to be related to the new percpu-refs from this patch.
Quoted 7 lines
Quoted 1 line
Any ideas?
Hello, Christian!
It seems to be a race between releasing of the root
kmem_cache(caused by rmmod) and a memcgkmem_cache. Does delaying rmmod for say, a minute, "resolve" the issue?
Yes, rmmod has to be called directly after the guest shutdown to see the issue. See my 2nd mail.
Re: WARNING bisected (was Re: [PATCH v7 08/10] mm: rework non-root kmem_cache lifecycle management)
Quoted 51 lines · Christian Borntraeger
Quoted 48 lines · Roman Gushchin
Quoted 46 lines · Christian Borntraeger
Folks,
I do get errors like the following when running a new testcase in our KVM CI. The test basically unloads kvm, reloads with with hpage=1 (enable huge page support for guests on s390) start a guest with libvirt and hugepages, shut the guest down and unload the kvm module.
WARNING: CPU: 8 PID: 208 at lib/percpu-refcount.c:108 percpu_ref_exit+0x50/0x58 Modules linked in: kvm(-) xt_CHECKSUM xt_MASQUERADE bonding xt_tcpudp ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_na> CPU: 8 PID: 208 Comm: kworker/8:1 Not tainted 5.2.0+ #66 Hardware name: IBM 2964 NC9 712 (LPAR) Workqueue: events sysfs_slab_remove_workfn Krnl PSW : 0704e00180000000 0000001529746850 (percpu_ref_exit+0x50/0x58) R:0 T:1 IO:1 EX:1 Key:0 M:1 W:0 P:0 AS:3 CC:2 PM:0 RI:0 EA:3 Krnl GPRS: 00000000ffff8808 0000001529746740 000003f4e30e8e18 0036008100000000 0000001f00000000 0035008100000000 0000001fb3573ab8 0000000000000000 0000001fbdb6de00 0000000000000000 0000001529f01328 0000001fb3573b00 0000001fbb27e000 0000001fbdb69300 000003e009263d00 000003e009263cd0 Krnl Code: 0000001529746842: f0a0000407fe srp 4(11,%r0),2046,0 0000001529746848: 47000700 bc 0,1792 #000000152974684c: a7f40001 brc 15,152974684e >0000001529746850: a7f4fff2 brc 15,1529746834 0000001529746854: 0707 bcr 0,%r7 0000001529746856: 0707 bcr 0,%r7 0000001529746858: eb8ff0580024 stmg %r8,%r15,88(%r15) 000000152974685e: a738ffff lhi %r3,-1 Call Trace: ([<000003e009263d00>] 0x3e009263d00) [<00000015293252ea>] slab_kmem_cache_release+0x3a/0x70 [<0000001529b04882>] kobject_put+0xaa/0xe8 [<000000152918cf28>] process_one_work+0x1e8/0x428 [<000000152918d1b0>] worker_thread+0x48/0x460 [<00000015291942c6>] kthread+0x126/0x160 [<0000001529b22344>] ret_from_fork+0x28/0x30 [<0000001529b2234c>] kernel_thread_starter+0x0/0x10 Last Breaking-Event-Address: [<000000152974684c>] percpu_ref_exit+0x4c/0x58 ---[ end trace b035e7da5788eb09 ]---I have bisected this to
# first bad commit: [f0a3a24b532d9a7e56a33c5112b2a212ed6ec580] mm: memcg/slab: rework non-root kmem_cache lifecycle managementunmounting
/sys/fs/cgroup/memory/before the test makes the problem go away so it really seems to be related to the new percpu-refs from this patch.Any ideas?
Quoted 8 lines
Quoted 5 lines
Hello, Christian!
It seems to be a race between releasing of the root
kmem_cache(caused by rmmod) and a memcgkmem_cache. Does delaying rmmod for say, a minute, "resolve" the issue?Yes, rmmod has to be called directly after the guest shutdown to see the issue. See my 2nd mail.
I see. Do you know, which kmem_cache it is? If not, can you, please, figure it out?
I tried to reproduce the issue, but wasn't successful so far. So I wonder what can make your case special.
Thanks!
Re: WARNING bisected (was Re: [PATCH v7 08/10] mm: rework non-root kmem_cache lifecycle management)
Quoted 8 lines · Roman Gushchin
Quoted 5 lines · Christian Borntraeger
Yes, rmmod has to be called directly after the guest shutdown to see the issue.
See my 2nd mail.
Quoted 6 lines
I see. Do you know, which
kmem_cacheit is? If not, can you, please, figure it out?I tried to reproduce the issue, but wasn't successful so far. So I wonder
what can make your case special.
I do not know either, but have a guess.
My guess would be that either the slab object or the slab page is RCU freed, and the kmem_cache destruction is called before that RCU callback has completed.
Re: WARNING bisected (was Re: [PATCH v7 08/10] mm: rework non-root kmem_cache lifecycle management)
Quoted 16 lines · Rik van Riel
Quoted 8 lines · Roman Gushchin
Quoted 5 lines · Christian Borntraeger
Yes, rmmod has to be called directly after the guest shutdown to see the issue.
See my 2nd mail.Quoted 6 lines
I see. Do you know, which
kmem_cacheit is? If not, can you, please, figure it out?I tried to reproduce the issue, but wasn't successful so far. So I wonder
what can make your case special.
Quoted 6 lines
I do not know either, but have a guess.
My guess would be that either the slab object or the slab page is RCU freed, and the
kmem_cachedestruction is called before that RCU callback has completed.
I've a reproducer, but it requires SLAB_TYPESAFE_BY_RCU to panic. The only question is if it's the same or different issues. As soon as I'll have a fix, I'll post it here to test.
Thanks!
Re: WARNING bisected (was Re: [PATCH v7 08/10] mm: rework non-root kmem_cache lifecycle management)
Quoted 19 lines · Roman Gushchin
Quoted 18 lines · Rik van Riel
Quoted 8 lines · Roman Gushchin
Quoted 5 lines · Christian Borntraeger
Yes, rmmod has to be called directly after the guest shutdown to see the issue.
See my 2nd mail.Quoted 6 lines
I see. Do you know, which
kmem_cacheit is? If not, can you, please, figure it out?I tried to reproduce the issue, but wasn't successful so far. So I wonder
what can make your case special.I do not know either, but have a guess.
Quoted 8 lines
Quoted 4 lines
My guess would be that either the slab object or the slab page is RCU freed, and the
kmem_cachedestruction is called before that RCU callback has completed.I've a reproducer, but it requires
SLAB_TYPESAFE_BY_RCUto panic. The only question is if it's the same or different issues. As soon as I'll have a fix, I'll post it here to test.
Ah, no, the issue I've reproduced is already fixed by commit b749ecfaf6c5 ("mm: memcg/slab: fix panic in __free_slab() caused by premature memcg pointer release").
Christian, can you, please, confirm that you have this one in your tree?
Also, can you, please, provide you config?
And you mentioned some panics, but didn't send any dmesg messages. Can you, please, provide them?
Thanks!
Re: WARNING bisected (was Re: [PATCH v7 08/10] mm: rework non-root kmem_cache lifecycle management)
Quoted 7 lines · Roman Gushchin
Quoted 6 lines · Roman Gushchin
Quoted 5 lines · Rik van Riel
Quoted 4 lines · Roman Gushchin
Quoted 2 lines · Christian Borntraeger
Quoted 6 lines
Quoted 6 lines
Quoted 6 lines
Quoted 6 lines
Quoted 3 lines
Yes, rmmod has to be called directly after the guest shutdown to see the issue.
See my 2nd mail.I see. Do you know, which
kmem_cacheit is? If not, can you, please, figure it out?
I can try to figure out.
Quoted 12 lines
Quoted 12 lines
Quoted 11 lines
Quoted 4 lines
I tried to reproduce the issue, but wasn't successful so far. So I wonder
what can make your case special.I do not know either, but have a guess.
My guess would be that either the slab object or the slab page is RCU freed, and the
kmem_cachedestruction is called before that RCU callback has completed.
Quoted 8 lines
Quoted 3 lines
I've a reproducer, but it requires
SLAB_TYPESAFE_BY_RCUto panic. The only question is if it's the same or different issues. As soon as I'll have a fix, I'll post it here to test.Ah, no, the issue I've reproduced is already fixed by commit
b749ecfaf6c5("mm: memcg/slab: fix panic in__free_slab()caused by premature memcg pointer release").Christian, can you, please, confirm that you have this one in your tree?
The problem still reproduces on the latest next kernel.
Quoted 2 lines
Also, can you, please, provide you config?
I can but this is an s390 config.
Quoted 2 lines
And you mentioned some panics, but didn't send any dmesg messages. Can you, please, provide them?
Those were all the WARN_ONs from percpu_ref_exit, I just had panic_on_warn enabled.
I attached my config and dmesg just in case for the next kernel of today.
#
# Automatically generated file; DO NOT EDIT.
# Linux/s390 5.4.0-rc8 Kernel Configuration
#
#
# Compiler: gcc (GCC) 9.2.1 20190827 (Red Hat 9.2.1-1) #CONFIG_CC_IS_GCC=yCONFIG_GCC_VERSION=90201 CONFIG_CLANG_VERSION=0CONFIG_CC_CAN_LINK=yCONFIG_CC_HAS_ASM_GOTO=y CONFIG_CC_HAS_ASM_INLINE=y CONFIG_CC_HAS_WARN_MAYBE_UNINITIALIZED=y CONFIG_IRQ_WORK=y CONFIG_BUILDTIME_EXTABLE_SORT=y CONFIG_THREAD_INFO_IN_TASK=y
#
# General setup
#CONFIG_INIT_ENV_ARG_LIMIT=32
# CONFIG_COMPILE_TEST is not setCONFIG_LOCALVERSION=""
# CONFIG_LOCALVERSION_AUTO is not setCONFIG_BUILD_SALT=""CONFIG_HAVE_KERNEL_GZIP=yCONFIG_HAVE_KERNEL_BZIP2=yCONFIG_HAVE_KERNEL_LZMA=yCONFIG_HAVE_KERNEL_XZ=yCONFIG_HAVE_KERNEL_LZO=yCONFIG_HAVE_KERNEL_LZ4=yCONFIG_HAVE_KERNEL_UNCOMPRESSED=yCONFIG_KERNEL_GZIP=y
# CONFIG_KERNEL_BZIP2 is not set
# CONFIG_KERNEL_LZMA is not set
# CONFIG_KERNEL_XZ is not set
# CONFIG_KERNEL_LZO is not set
# CONFIG_KERNEL_LZ4 is not set
# CONFIG_KERNEL_UNCOMPRESSED is not setCONFIG_DEFAULT_HOSTNAME="(none)"CONFIG_SWAP=yCONFIG_SYSVIPC=yCONFIG_SYSVIPC_SYSCTL=yCONFIG_POSIX_MQUEUE=yCONFIG_POSIX_MQUEUE_SYSCTL=yCONFIG_CROSS_MEMORY_ATTACH=y
# CONFIG_USELIB is not setCONFIG_AUDIT=yCONFIG_HAVE_ARCH_AUDITSYSCALL=yCONFIG_AUDITSYSCALL=y
#
# IRQ subsystem
#CONFIG_IRQ_DOMAIN=yCONFIG_IRQ_DOMAIN_HIERARCHY=yCONFIG_GENERIC_MSI_IRQ=yCONFIG_GENERIC_MSI_IRQ_DOMAIN=yCONFIG_SPARSE_IRQ=y
# CONFIG_GENERIC_IRQ_DEBUGFS is not set
# end of IRQ subsystem
CONFIG_GENERIC_TIME_VSYSCALL=yCONFIG_GENERIC_CLOCKEVENTS=y
#
# Timers subsystem
#CONFIG_TICK_ONESHOT=yCONFIG_NO_HZ_COMMON=y
# CONFIG_HZ_PERIODIC is not setCONFIG_NO_HZ_IDLE=y
# CONFIG_NO_HZ is not setCONFIG_HIGH_RES_TIMERS=y
# end of Timers subsystem
CONFIG_PREEMPT_NONE=y
# CONFIG_PREEMPT_VOLUNTARY is not set
# CONFIG_PREEMPT is not set
#
# CPU/Task time and stats accounting
#CONFIG_VIRT_CPU_ACCOUNTING=yCONFIG_VIRT_CPU_ACCOUNTING_NATIVE=yCONFIG_BSD_PROCESS_ACCT=yCONFIG_BSD_PROCESS_ACCT_V3=yCONFIG_TASKSTATS=yCONFIG_TASK_DELAY_ACCT=yCONFIG_TASK_XACCT=yCONFIG_TASK_IO_ACCOUNTING=y
# CONFIG_PSI is not set
# end of CPU/Task time and stats accounting
CONFIG_CPU_ISOLATION=y
#
# RCU Subsystem
#CONFIG_TREE_RCU=y
# CONFIG_RCU_EXPERT is not setCONFIG_SRCU=yCONFIG_TREE_SRCU=yCONFIG_TASKS_RCU=yCONFIG_RCU_STALL_COMMON=yCONFIG_RCU_NEED_SEGCBLIST=y
# end of RCU Subsystem
CONFIG_BUILD_BIN2C=yCONFIG_IKCONFIG=yCONFIG_IKCONFIG_PROC=y
# CONFIG_IKHEADERS is not setCONFIG_LOG_BUF_SHIFT=17CONFIG_LOG_CPU_MAX_BUF_SHIFT=12CONFIG_PRINTK_SAFE_LOG_BUF_SHIFT=13
#
# Scheduler features
#
# end of Scheduler features
CONFIG_ARCH_SUPPORTS_NUMA_BALANCING=yCONFIG_CC_HAS_INT128=yCONFIG_NUMA_BALANCING=yCONFIG_NUMA_BALANCING_DEFAULT_ENABLED=yCONFIG_CGROUPS=yCONFIG_PAGE_COUNTER=yCONFIG_MEMCG=yCONFIG_MEMCG_SWAP=yCONFIG_MEMCG_SWAP_ENABLED=yCONFIG_MEMCG_KMEM=yCONFIG_BLK_CGROUP=yCONFIG_CGROUP_WRITEBACK=yCONFIG_CGROUP_SCHED=yCONFIG_FAIR_GROUP_SCHED=yCONFIG_CFS_BANDWIDTH=yCONFIG_RT_GROUP_SCHED=yCONFIG_CGROUP_PIDS=yCONFIG_CGROUP_RDMA=yCONFIG_CGROUP_FREEZER=yCONFIG_CGROUP_HUGETLB=yCONFIG_CPUSETS=yCONFIG_PROC_PID_CPUSET=yCONFIG_CGROUP_DEVICE=yCONFIG_CGROUP_CPUACCT=yCONFIG_CGROUP_PERF=yCONFIG_CGROUP_BPF=y
# CONFIG_CGROUP_DEBUG is not setCONFIG_SOCK_CGROUP_DATA=yCONFIG_NAMESPACES=yCONFIG_UTS_NS=yCONFIG_IPC_NS=yCONFIG_USER_NS=yCONFIG_PID_NS=yCONFIG_NET_NS=yCONFIG_CHECKPOINT_RESTORE=yCONFIG_SCHED_AUTOGROUP=y
# CONFIG_SYSFS_DEPRECATED is not setCONFIG_RELAY=yCONFIG_BLK_DEV_INITRD=yCONFIG_INITRAMFS_SOURCE=""CONFIG_RD_GZIP=yCONFIG_RD_BZIP2=yCONFIG_RD_LZMA=yCONFIG_RD_XZ=yCONFIG_RD_LZO=yCONFIG_RD_LZ4=yCONFIG_CC_OPTIMIZE_FOR_PERFORMANCE=y
# CONFIG_CC_OPTIMIZE_FOR_SIZE is not setCONFIG_SYSCTL=yCONFIG_HAVE_UID16=yCONFIG_SYSCTL_EXCEPTION_TRACE=yCONFIG_BPF=yCONFIG_EXPERT=yCONFIG_UID16=yCONFIG_MULTIUSER=y
# CONFIG_SGETMASK_SYSCALL is not set
# CONFIG_SYSFS_SYSCALL is not set
# CONFIG_SYSCTL_SYSCALL is not setCONFIG_FHANDLE=yCONFIG_POSIX_TIMERS=yCONFIG_PRINTK=yCONFIG_PRINTK_NMI=yCONFIG_BUG=yCONFIG_ELF_CORE=yCONFIG_BASE_FULL=yCONFIG_FUTEX=yCONFIG_FUTEX_PI=yCONFIG_HAVE_FUTEX_CMPXCHG=yCONFIG_EPOLL=yCONFIG_SIGNALFD=yCONFIG_TIMERFD=yCONFIG_EVENTFD=yCONFIG_SHMEM=yCONFIG_AIO=yCONFIG_IO_URING=yCONFIG_ADVISE_SYSCALLS=yCONFIG_MEMBARRIER=yCONFIG_KALLSYMS=yCONFIG_KALLSYMS_ALL=yCONFIG_KALLSYMS_BASE_RELATIVE=yCONFIG_BPF_SYSCALL=y
# CONFIG_BPF_JIT_ALWAYS_ON is not setCONFIG_USERFAULTFD=yCONFIG_RSEQ=y
# CONFIG_DEBUG_RSEQ is not set
# CONFIG_EMBEDDED is not setCONFIG_HAVE_PERF_EVENTS=y
# CONFIG_PC104 is not set
#
# Kernel Performance Events And Counters
#CONFIG_PERF_EVENTS=y
# CONFIG_DEBUG_PERF_USE_VMALLOC is not set
# end of Kernel Performance Events And Counters
CONFIG_VM_EVENT_COUNTERS=yCONFIG_SLUB_DEBUG=y
# CONFIG_SLUB_MEMCG_SYSFS_ON is not set
# CONFIG_COMPAT_BRK is not set
# CONFIG_SLAB is not setCONFIG_SLUB=y
# CONFIG_SLOB is not setCONFIG_SLAB_MERGE_DEFAULT=y
# CONFIG_SLAB_FREELIST_RANDOM is not set
# CONFIG_SLAB_FREELIST_HARDENED is not set
# CONFIG_SHUFFLE_PAGE_ALLOCATOR is not setCONFIG_SLUB_CPU_PARTIAL=yCONFIG_SYSTEM_DATA_VERIFICATION=yCONFIG_PROFILING=yCONFIG_TRACEPOINTS=y
# end of General setup
CONFIG_MMU=yCONFIG_ZONE_DMA=yCONFIG_CPU_BIG_ENDIAN=yCONFIG_LOCKDEP_SUPPORT=yCONFIG_STACKTRACE_SUPPORT=yCONFIG_GENERIC_HWEIGHT=yCONFIG_GENERIC_BUG=yCONFIG_GENERIC_BUG_RELATIVE_POINTERS=yCONFIG_PGSTE=yCONFIG_ARCH_SUPPORTS_DEBUG_PAGEALLOC=yCONFIG_AUDIT_ARCH=yCONFIG_NO_IOPORT_MAP=y
# CONFIG_PCI_QUIRKS is not setCONFIG_ARCH_SUPPORTS_UPROBES=yCONFIG_S390=yCONFIG_SCHED_OMIT_FRAME_POINTER=yCONFIG_PGTABLE_LEVELS=5CONFIG_HAVE_LIVEPATCH=yCONFIG_LIVEPATCH=y
#
# Processor type and features
#CONFIG_HAVE_MARCH_Z900_FEATURES=yCONFIG_HAVE_MARCH_Z990_FEATURES=yCONFIG_HAVE_MARCH_Z9_109_FEATURES=yCONFIG_HAVE_MARCH_Z10_FEATURES=yCONFIG_HAVE_MARCH_Z196_FEATURES=y
# CONFIG_MARCH_Z900 is not set
# CONFIG_MARCH_Z990 is not set
# CONFIG_MARCH_Z9_109 is not set
# CONFIG_MARCH_Z10 is not setCONFIG_MARCH_Z196=y
# CONFIG_MARCH_ZEC12 is not set
# CONFIG_MARCH_Z13 is not set
# CONFIG_MARCH_Z14 is not setCONFIG_MARCH_ZEC12_TUNE=y
# CONFIG_TUNE_DEFAULT is not set
# CONFIG_TUNE_Z900 is not set
# CONFIG_TUNE_Z990 is not set
# CONFIG_TUNE_Z9_109 is not set
# CONFIG_TUNE_Z10 is not set
# CONFIG_TUNE_Z196 is not setCONFIG_TUNE_ZEC12=y
# CONFIG_TUNE_Z13 is not set
# CONFIG_TUNE_Z14 is not setCONFIG_64BIT=yCONFIG_COMPAT=yCONFIG_COMPAT_VDSO=yCONFIG_SYSVIPC_COMPAT=yCONFIG_SMP=yCONFIG_NR_CPUS=512CONFIG_HOTPLUG_CPU=yCONFIG_NODES_SPAN_OTHER_NODES=yCONFIG_NUMA=yCONFIG_NODES_SHIFT=4
#
# Select NUMA modes
#
# CONFIG_NUMA_EMU is not set
# end of Select NUMA modes
CONFIG_SCHED_SMT=yCONFIG_SCHED_MC=yCONFIG_SCHED_BOOK=yCONFIG_SCHED_DRAWER=yCONFIG_SCHED_TOPOLOGY=yCONFIG_HZ_100=y
# CONFIG_HZ_250 is not set
# CONFIG_HZ_300 is not set
# CONFIG_HZ_1000 is not setCONFIG_HZ=100CONFIG_SCHED_HRTICK=yCONFIG_KEXEC=yCONFIG_KEXEC_FILE=yCONFIG_ARCH_HAS_KEXEC_PURGATORY=yCONFIG_KEXEC_SIG=yCONFIG_ARCH_RANDOM=y
# CONFIG_KERNEL_NOBP is not setCONFIG_EXPOLINE=y
# CONFIG_EXPOLINE_OFF is not setCONFIG_EXPOLINE_AUTO=y
# CONFIG_EXPOLINE_FULL is not setCONFIG_RELOCATABLE=yCONFIG_RANDOMIZE_BASE=y
# end of Processor type and features
#
# Memory setup
#CONFIG_ARCH_SPARSEMEM_ENABLE=yCONFIG_ARCH_SPARSEMEM_DEFAULT=yCONFIG_ARCH_ENABLE_MEMORY_HOTPLUG=yCONFIG_ARCH_ENABLE_MEMORY_HOTREMOVE=yCONFIG_ARCH_ENABLE_SPLIT_PMD_PTLOCK=yCONFIG_FORCE_MAX_ZONEORDER=9CONFIG_MAX_PHYSMEM_BITS=46CONFIG_PACK_STACK=y
# CONFIG_WARN_DYNAMIC_STACK is not set
# end of Memory setup
#
# I/O subsystem
#CONFIG_QDIO=yCONFIG_PCI_NR_FUNCTIONS=128CONFIG_HAS_IOMEM=yCONFIG_CHSC_SCH=yCONFIG_SCM_BUS=yCONFIG_EADM_SCH=mCONFIG_VFIO_CCW=mCONFIG_VFIO_AP=m
# end of I/O subsystem
#
# Dump support
#CONFIG_CRASH_DUMP=y
# end of Dump support
CONFIG_SECCOMP=y
#
# Power Management
#CONFIG_ARCH_HIBERNATION_POSSIBLE=yCONFIG_HIBERNATE_CALLBACKS=yCONFIG_HIBERNATION=yCONFIG_ARCH_SAVE_PAGE_KEYS=yCONFIG_PM_STD_PARTITION=""CONFIG_PM_SLEEP=yCONFIG_PM_SLEEP_SMP=y
# CONFIG_PM_AUTOSLEEP is not set
# CONFIG_PM_WAKELOCKS is not setCONFIG_PM=yCONFIG_PM_DEBUG=y
# CONFIG_PM_ADVANCED_DEBUG is not setCONFIG_PM_SLEEP_DEBUG=y
# CONFIG_WQ_POWER_EFFICIENT_DEFAULT is not set
# end of Power Management
CONFIG_CCW=yCONFIG_HAVE_PNETID=y
#
# Virtualization
#
# CONFIG_PROTECTED_VIRTUALIZATION_GUEST is not set CONFIG_PFAULT=yCONFIG_CMM=mCONFIG_CMM_IUCV=yCONFIG_APPLDATA_BASE=y CONFIG_APPLDATA_MEM=mCONFIG_APPLDATA_OS=m CONFIG_APPLDATA_NET_SUM=m CONFIG_S390_HYPFS_FS=yCONFIG_HAVE_KVM=y CONFIG_HAVE_KVM_IRQCHIP=y CONFIG_HAVE_KVM_IRQFD=y CONFIG_HAVE_KVM_IRQ_ROUTING=y CONFIG_HAVE_KVM_EVENTFD=y CONFIG_KVM_ASYNC_PF=y CONFIG_KVM_ASYNC_PF_SYNC=y CONFIG_HAVE_KVM_CPU_RELAX_INTERCEPT=y CONFIG_KVM_VFIO=y CONFIG_HAVE_KVM_INVALID_WAKEUPS=y CONFIG_HAVE_KVM_VCPU_ASYNC_IOCTL=y CONFIG_HAVE_KVM_NO_POLL=y CONFIG_VIRTUALIZATION=yCONFIG_KVM=m
# CONFIG_KVM_S390_UCONTROL is not set CONFIG_VHOST_NET=mCONFIG_VHOST_VSOCK=mCONFIG_VHOST=m
# CONFIG_VHOST_CROSS_ENDIAN_LEGACY is not set CONFIG_S390_GUEST=y
# end of Virtualization
#
# General architecture-dependent options
#CONFIG_CRASH_CORE=yCONFIG_KEXEC_CORE=yCONFIG_OPROFILE=mCONFIG_HAVE_OPROFILE=yCONFIG_KPROBES=yCONFIG_JUMP_LABEL=y
# CONFIG_STATIC_KEYS_SELFTEST is not setCONFIG_UPROBES=yCONFIG_HAVE_EFFICIENT_UNALIGNED_ACCESS=yCONFIG_ARCH_USE_BUILTIN_BSWAP=yCONFIG_KRETPROBES=yCONFIG_HAVE_KPROBES=yCONFIG_HAVE_KRETPROBES=yCONFIG_HAVE_NMI=yCONFIG_HAVE_ARCH_TRACEHOOK=yCONFIG_HAVE_DMA_CONTIGUOUS=yCONFIG_GENERIC_SMP_IDLE_THREAD=yCONFIG_ARCH_HAS_FORTIFY_SOURCE=yCONFIG_ARCH_HAS_SET_MEMORY=yCONFIG_ARCH_WANTS_DYNAMIC_TASK_STRUCT=yCONFIG_HAVE_ASM_MODVERSIONS=yCONFIG_HAVE_REGS_AND_STACK_ACCESS_API=yCONFIG_HAVE_RSEQ=yCONFIG_HAVE_PERF_REGS=yCONFIG_HAVE_PERF_USER_STACK_DUMP=yCONFIG_HAVE_ARCH_JUMP_LABEL=yCONFIG_HAVE_ARCH_JUMP_LABEL_RELATIVE=yCONFIG_HAVE_RCU_TABLE_FREE=yCONFIG_HAVE_MMU_GATHER_NO_GATHER=yCONFIG_ARCH_HAVE_NMI_SAFE_CMPXCHG=yCONFIG_HAVE_ALIGNED_STRUCT_PAGE=yCONFIG_HAVE_CMPXCHG_LOCAL=yCONFIG_HAVE_CMPXCHG_DOUBLE=yCONFIG_ARCH_WANT_IPC_PARSE_VERSION=yCONFIG_ARCH_WANT_COMPAT_IPC_PARSE_VERSION=yCONFIG_ARCH_WANT_OLD_COMPAT_IPC=yCONFIG_HAVE_ARCH_SECCOMP_FILTER=yCONFIG_SECCOMP_FILTER=yCONFIG_CC_HAS_STACKPROTECTOR_NONE=yCONFIG_HAVE_VIRT_CPU_ACCOUNTING=yCONFIG_ARCH_HAS_SCALED_CPUTIME=yCONFIG_HAVE_VIRT_CPU_ACCOUNTING_GEN=yCONFIG_HAVE_ARCH_TRANSPARENT_HUGEPAGE=yCONFIG_HAVE_ARCH_SOFT_DIRTY=yCONFIG_HAVE_MOD_ARCH_SPECIFIC=yCONFIG_MODULES_USE_ELF_RELA=yCONFIG_ARCH_HAS_ELF_RANDOMIZE=yCONFIG_HAVE_COPY_THREAD_TLS=yCONFIG_CLONE_BACKWARDS2=yCONFIG_OLD_SIGSUSPEND3=yCONFIG_OLD_SIGACTION=yCONFIG_COMPAT_OLD_SIGACTION=yCONFIG_COMPAT_32BIT_TIME=yCONFIG_HAVE_ARCH_VMAP_STACK=yCONFIG_VMAP_STACK=yCONFIG_ARCH_HAS_STRICT_KERNEL_RWX=yCONFIG_STRICT_KERNEL_RWX=yCONFIG_ARCH_HAS_STRICT_MODULE_RWX=yCONFIG_STRICT_MODULE_RWX=y
# CONFIG_REFCOUNT_FULL is not set
# CONFIG_LOCK_EVENT_COUNTS is not setCONFIG_ARCH_HAS_MEM_ENCRYPT=y
#
# GCOV-based kernel profiling
#
# CONFIG_GCOV_KERNEL is not setCONFIG_ARCH_HAS_GCOV_PROFILE_ALL=y
# end of GCOV-based kernel profiling
CONFIG_PLUGIN_HOSTCC="g++"CONFIG_HAVE_GCC_PLUGINS=yCONFIG_GCC_PLUGINS=y
#
# GCC plugins
#
# CONFIG_GCC_PLUGIN_CYC_COMPLEXITY is not set
# CONFIG_GCC_PLUGIN_LATENT_ENTROPY is not set
# CONFIG_GCC_PLUGIN_RANDSTRUCT is not set
# end of GCC plugins # end of General architecture-dependent options
CONFIG_RT_MUTEXES=yCONFIG_BASE_SMALL=0CONFIG_MODULE_SIG_FORMAT=yCONFIG_MODULES=yCONFIG_MODULE_FORCE_LOAD=yCONFIG_MODULE_UNLOAD=y CONFIG_MODULE_FORCE_UNLOAD=yCONFIG_MODVERSIONS=yCONFIG_ASM_MODVERSIONS=yCONFIG_MODULE_REL_CRCS=y CONFIG_MODULE_SRCVERSION_ALL=y CONFIG_MODULE_SIG=y
# CONFIG_MODULE_SIG_FORCE is not set CONFIG_MODULE_SIG_ALL=y
# CONFIG_MODULE_SIG_SHA1 is not set
# CONFIG_MODULE_SIG_SHA224 is not set CONFIG_MODULE_SIG_SHA256=y
# CONFIG_MODULE_SIG_SHA384 is not set
# CONFIG_MODULE_SIG_SHA512 is not set CONFIG_MODULE_SIG_HASH="sha256"
# CONFIG_MODULE_COMPRESS is not set
# CONFIG_MODULE_ALLOW_MISSING_NAMESPACE_IMPORTS is not set CONFIG_UNUSED_SYMBOLS=y CONFIG_MODULES_TREE_LOOKUP=yCONFIG_BLOCK=yCONFIG_BLK_RQ_ALLOC_TIME=y CONFIG_BLK_SCSI_REQUEST=y CONFIG_BLK_CGROUP_RWSTAT=yCONFIG_BLK_DEV_BSG=yCONFIG_BLK_DEV_BSGLIB=y CONFIG_BLK_DEV_INTEGRITY=y
# CONFIG_BLK_DEV_ZONED is not set CONFIG_BLK_DEV_THROTTLING=y
# CONFIG_BLK_DEV_THROTTLING_LOW is not set
# CONFIG_BLK_CMDLINE_PARSER is not set CONFIG_BLK_WBT=yCONFIG_BLK_CGROUP_IOLATENCY=y CONFIG_BLK_CGROUP_IOCOST=yCONFIG_BLK_WBT_MQ=yCONFIG_BLK_DEBUG_FS=y
# CONFIG_BLK_SED_OPAL is not set
#
# Partition Types
#CONFIG_PARTITION_ADVANCED=y
# CONFIG_ACORN_PARTITION is not set
# CONFIG_AIX_PARTITION is not set
# CONFIG_OSF_PARTITION is not set
# CONFIG_AMIGA_PARTITION is not set
# CONFIG_ATARI_PARTITION is not setCONFIG_IBM_PARTITION=y
# CONFIG_MAC_PARTITION is not setCONFIG_MSDOS_PARTITION=yCONFIG_BSD_DISKLABEL=yCONFIG_MINIX_SUBPARTITION=yCONFIG_SOLARIS_X86_PARTITION=yCONFIG_UNIXWARE_DISKLABEL=y
# CONFIG_LDM_PARTITION is not set
# CONFIG_SGI_PARTITION is not set
# CONFIG_ULTRIX_PARTITION is not set
# CONFIG_SUN_PARTITION is not set
# CONFIG_KARMA_PARTITION is not setCONFIG_EFI_PARTITION=y
# CONFIG_SYSV68_PARTITION is not set
# CONFIG_CMDLINE_PARTITION is not set
# end of Partition Types
CONFIG_BLOCK_COMPAT=yCONFIG_BLK_MQ_PCI=yCONFIG_BLK_MQ_VIRTIO=yCONFIG_BLK_MQ_RDMA=yCONFIG_BLK_PM=y
#
# IO Schedulers
#CONFIG_MQ_IOSCHED_DEADLINE=yCONFIG_MQ_IOSCHED_KYBER=yCONFIG_IOSCHED_BFQ=yCONFIG_BFQ_GROUP_IOSCHED=y
# CONFIG_BFQ_CGROUP_DEBUG is not set
# end of IO Schedulers
CONFIG_PREEMPT_NOTIFIERS=yCONFIG_PADATA=yCONFIG_ASN1=yCONFIG_ARCH_INLINE_SPIN_TRYLOCK=yCONFIG_ARCH_INLINE_SPIN_TRYLOCK_BH=yCONFIG_ARCH_INLINE_SPIN_LOCK=yCONFIG_ARCH_INLINE_SPIN_LOCK_BH=yCONFIG_ARCH_INLINE_SPIN_LOCK_IRQ=yCONFIG_ARCH_INLINE_SPIN_LOCK_IRQSAVE=yCONFIG_ARCH_INLINE_SPIN_UNLOCK=yCONFIG_ARCH_INLINE_SPIN_UNLOCK_BH=yCONFIG_ARCH_INLINE_SPIN_UNLOCK_IRQ=yCONFIG_ARCH_INLINE_SPIN_UNLOCK_IRQRESTORE=yCONFIG_ARCH_INLINE_READ_TRYLOCK=yCONFIG_ARCH_INLINE_READ_LOCK=yCONFIG_ARCH_INLINE_READ_LOCK_BH=yCONFIG_ARCH_INLINE_READ_LOCK_IRQ=yCONFIG_ARCH_INLINE_READ_LOCK_IRQSAVE=yCONFIG_ARCH_INLINE_READ_UNLOCK=yCONFIG_ARCH_INLINE_READ_UNLOCK_BH=yCONFIG_ARCH_INLINE_READ_UNLOCK_IRQ=yCONFIG_ARCH_INLINE_READ_UNLOCK_IRQRESTORE=yCONFIG_ARCH_INLINE_WRITE_TRYLOCK=yCONFIG_ARCH_INLINE_WRITE_LOCK=yCONFIG_ARCH_INLINE_WRITE_LOCK_BH=yCONFIG_ARCH_INLINE_WRITE_LOCK_IRQ=yCONFIG_ARCH_INLINE_WRITE_LOCK_IRQSAVE=yCONFIG_ARCH_INLINE_WRITE_UNLOCK=yCONFIG_ARCH_INLINE_WRITE_UNLOCK_BH=yCONFIG_ARCH_INLINE_WRITE_UNLOCK_IRQ=yCONFIG_ARCH_INLINE_WRITE_UNLOCK_IRQRESTORE=yCONFIG_INLINE_SPIN_TRYLOCK=yCONFIG_INLINE_SPIN_TRYLOCK_BH=yCONFIG_INLINE_SPIN_LOCK=yCONFIG_INLINE_SPIN_LOCK_BH=yCONFIG_INLINE_SPIN_LOCK_IRQ=yCONFIG_INLINE_SPIN_LOCK_IRQSAVE=yCONFIG_INLINE_SPIN_UNLOCK_BH=yCONFIG_INLINE_SPIN_UNLOCK_IRQ=yCONFIG_INLINE_SPIN_UNLOCK_IRQRESTORE=yCONFIG_INLINE_READ_TRYLOCK=yCONFIG_INLINE_READ_LOCK=yCONFIG_INLINE_READ_LOCK_BH=yCONFIG_INLINE_READ_LOCK_IRQ=yCONFIG_INLINE_READ_LOCK_IRQSAVE=yCONFIG_INLINE_READ_UNLOCK=yCONFIG_INLINE_READ_UNLOCK_BH=yCONFIG_INLINE_READ_UNLOCK_IRQ=yCONFIG_INLINE_READ_UNLOCK_IRQRESTORE=yCONFIG_INLINE_WRITE_TRYLOCK=yCONFIG_INLINE_WRITE_LOCK=yCONFIG_INLINE_WRITE_LOCK_BH=yCONFIG_INLINE_WRITE_LOCK_IRQ=yCONFIG_INLINE_WRITE_LOCK_IRQSAVE=yCONFIG_INLINE_WRITE_UNLOCK=yCONFIG_INLINE_WRITE_UNLOCK_BH=yCONFIG_INLINE_WRITE_UNLOCK_IRQ=yCONFIG_INLINE_WRITE_UNLOCK_IRQRESTORE=yCONFIG_ARCH_SUPPORTS_ATOMIC_RMW=yCONFIG_MUTEX_SPIN_ON_OWNER=yCONFIG_RWSEM_SPIN_ON_OWNER=yCONFIG_LOCK_SPIN_ON_OWNER=yCONFIG_ARCH_HAS_SYSCALL_WRAPPER=yCONFIG_FREEZER=y
#
# Executable file formats
#CONFIG_BINFMT_ELF=yCONFIG_COMPAT_BINFMT_ELF=yCONFIG_ARCH_BINFMT_ELF_STATE=yCONFIG_ELFCORE=yCONFIG_CORE_DUMP_DEFAULT_ELF_HEADERS=yCONFIG_BINFMT_SCRIPT=yCONFIG_BINFMT_MISC=mCONFIG_COREDUMP=y
# end of Executable file formats
#
# Memory Management options
#CONFIG_SPARSEMEM=yCONFIG_NEED_MULTIPLE_NODES=yCONFIG_HAVE_MEMORY_PRESENT=yCONFIG_SPARSEMEM_EXTREME=yCONFIG_SPARSEMEM_VMEMMAP_ENABLE=yCONFIG_SPARSEMEM_VMEMMAP=yCONFIG_HAVE_MEMBLOCK_NODE_MAP=yCONFIG_HAVE_MEMBLOCK_PHYS_MAP=yCONFIG_HAVE_FAST_GUP=yCONFIG_ARCH_KEEP_MEMBLOCK=yCONFIG_MEMORY_ISOLATION=yCONFIG_MEMORY_HOTPLUG=yCONFIG_MEMORY_HOTPLUG_SPARSE=y
# CONFIG_MEMORY_HOTPLUG_DEFAULT_ONLINE is not setCONFIG_MEMORY_HOTREMOVE=yCONFIG_SPLIT_PTLOCK_CPUS=4CONFIG_MEMORY_BALLOON=yCONFIG_BALLOON_COMPACTION=yCONFIG_COMPACTION=yCONFIG_MIGRATION=yCONFIG_CONTIG_ALLOC=yCONFIG_PHYS_ADDR_T_64BIT=yCONFIG_BOUNCE=yCONFIG_MMU_NOTIFIER=yCONFIG_KSM=yCONFIG_DEFAULT_MMAP_MIN_ADDR=4096CONFIG_TRANSPARENT_HUGEPAGE=yCONFIG_TRANSPARENT_HUGEPAGE_ALWAYS=y
# CONFIG_TRANSPARENT_HUGEPAGE_MADVISE is not setCONFIG_TRANSPARENT_HUGE_PAGECACHE=yCONFIG_CLEANCACHE=yCONFIG_FRONTSWAP=yCONFIG_CMA=y
# CONFIG_CMA_DEBUG is not set
# CONFIG_CMA_DEBUGFS is not setCONFIG_CMA_AREAS=7CONFIG_MEM_SOFT_DIRTY=yCONFIG_ZSWAP=yCONFIG_ZPOOL=yCONFIG_ZBUD=m
# CONFIG_Z3FOLD is not setCONFIG_ZSMALLOC=m
# CONFIG_PGTABLE_MAPPING is not setCONFIG_ZSMALLOC_STAT=yCONFIG_DEFERRED_STRUCT_PAGE_INIT=yCONFIG_IDLE_PAGE_TRACKING=yCONFIG_PERCPU_STATS=yCONFIG_GUP_BENCHMARK=y
# CONFIG_READ_ONLY_THP_FOR_FS is not setCONFIG_ARCH_HAS_PTE_SPECIAL=y
# end of Memory Management options
CONFIG_NET=yCONFIG_NET_INGRESS=yCONFIG_NET_EGRESS=yCONFIG_SKB_EXTENSIONS=y
#
# Networking options
#CONFIG_PACKET=yCONFIG_PACKET_DIAG=mCONFIG_UNIX=yCONFIG_UNIX_SCM=yCONFIG_UNIX_DIAG=m
# CONFIG_TLS is not setCONFIG_XFRM=yCONFIG_XFRM_ALGO=mCONFIG_XFRM_USER=m
# CONFIG_XFRM_INTERFACE is not set
# CONFIG_XFRM_SUB_POLICY is not set
# CONFIG_XFRM_MIGRATE is not set
# CONFIG_XFRM_STATISTICS is not setCONFIG_XFRM_IPCOMP=mCONFIG_NET_KEY=m
# CONFIG_NET_KEY_MIGRATE is not setCONFIG_IUCV=yCONFIG_AFIUCV=mCONFIG_SMC=mCONFIG_SMC_DIAG=m
# CONFIG_XDP_SOCKETS is not setCONFIG_INET=yCONFIG_IP_MULTICAST=yCONFIG_IP_ADVANCED_ROUTER=y
# CONFIG_IP_FIB_TRIE_STATS is not setCONFIG_IP_MULTIPLE_TABLES=yCONFIG_IP_ROUTE_MULTIPATH=yCONFIG_IP_ROUTE_VERBOSE=yCONFIG_IP_ROUTE_CLASSID=y
# CONFIG_IP_PNP is not setCONFIG_NET_IPIP=mCONFIG_NET_IPGRE_DEMUX=mCONFIG_NET_IP_TUNNEL=mCONFIG_NET_IPGRE=mCONFIG_NET_IPGRE_BROADCAST=yCONFIG_IP_MROUTE_COMMON=yCONFIG_IP_MROUTE=yCONFIG_IP_MROUTE_MULTIPLE_TABLES=yCONFIG_IP_PIMSM_V1=yCONFIG_IP_PIMSM_V2=yCONFIG_SYN_COOKIES=yCONFIG_NET_IPVTI=mCONFIG_NET_UDP_TUNNEL=m
# CONFIG_NET_FOU is not set
# CONFIG_NET_FOU_IP_TUNNELS is not setCONFIG_INET_AH=mCONFIG_INET_ESP=m
# CONFIG_INET_ESP_OFFLOAD is not setCONFIG_INET_IPCOMP=mCONFIG_INET_XFRM_TUNNEL=mCONFIG_INET_TUNNEL=mCONFIG_INET_DIAG=mCONFIG_INET_TCP_DIAG=mCONFIG_INET_UDP_DIAG=m
# CONFIG_INET_RAW_DIAG is not set
# CONFIG_INET_DIAG_DESTROY is not setCONFIG_TCP_CONG_ADVANCED=yCONFIG_TCP_CONG_BIC=mCONFIG_TCP_CONG_CUBIC=yCONFIG_TCP_CONG_WESTWOOD=mCONFIG_TCP_CONG_HTCP=mCONFIG_TCP_CONG_HSTCP=mCONFIG_TCP_CONG_HYBLA=mCONFIG_TCP_CONG_VEGAS=m
# CONFIG_TCP_CONG_NV is not setCONFIG_TCP_CONG_SCALABLE=mCONFIG_TCP_CONG_LP=mCONFIG_TCP_CONG_VENO=mCONFIG_TCP_CONG_YEAH=mCONFIG_TCP_CONG_ILLINOIS=m
# CONFIG_TCP_CONG_DCTCP is not set
# CONFIG_TCP_CONG_CDG is not set
# CONFIG_TCP_CONG_BBR is not setCONFIG_DEFAULT_CUBIC=y
# CONFIG_DEFAULT_RENO is not setCONFIG_DEFAULT_TCP_CONG="cubic"
# CONFIG_TCP_MD5SIG is not setCONFIG_IPV6=yCONFIG_IPV6_ROUTER_PREF=y
# CONFIG_IPV6_ROUTE_INFO is not set
# CONFIG_IPV6_OPTIMISTIC_DAD is not setCONFIG_INET6_AH=mCONFIG_INET6_ESP=m
# CONFIG_INET6_ESP_OFFLOAD is not setCONFIG_INET6_IPCOMP=mCONFIG_IPV6_MIP6=m
# CONFIG_IPV6_ILA is not setCONFIG_INET6_XFRM_TUNNEL=mCONFIG_INET6_TUNNEL=mCONFIG_IPV6_VTI=mCONFIG_IPV6_SIT=m
# CONFIG_IPV6_SIT_6RD is not setCONFIG_IPV6_NDISC_NODETYPE=yCONFIG_IPV6_TUNNEL=mCONFIG_IPV6_GRE=mCONFIG_IPV6_MULTIPLE_TABLES=yCONFIG_IPV6_SUBTREES=y
# CONFIG_IPV6_MROUTE is not set
# CONFIG_IPV6_SEG6_LWTUNNEL is not set
# CONFIG_IPV6_SEG6_HMAC is not set
# CONFIG_NETLABEL is not setCONFIG_NETWORK_SECMARK=y
# CONFIG_NETWORK_PHY_TIMESTAMPING is not setCONFIG_NETFILTER=yCONFIG_NETFILTER_ADVANCED=yCONFIG_BRIDGE_NETFILTER=m
#
# Core Netfilter Configuration
#CONFIG_NETFILTER_INGRESS=yCONFIG_NETFILTER_NETLINK=mCONFIG_NETFILTER_FAMILY_BRIDGE=yCONFIG_NETFILTER_FAMILY_ARP=yCONFIG_NETFILTER_NETLINK_ACCT=mCONFIG_NETFILTER_NETLINK_QUEUE=mCONFIG_NETFILTER_NETLINK_LOG=mCONFIG_NETFILTER_NETLINK_OSF=mCONFIG_NF_CONNTRACK=mCONFIG_NF_LOG_COMMON=m
# CONFIG_NF_LOG_NETDEV is not setCONFIG_NETFILTER_CONNCOUNT=mCONFIG_NF_CONNTRACK_MARK=yCONFIG_NF_CONNTRACK_SECMARK=y
# CONFIG_NF_CONNTRACK_ZONES is not setCONFIG_NF_CONNTRACK_PROCFS=yCONFIG_NF_CONNTRACK_EVENTS=yCONFIG_NF_CONNTRACK_TIMEOUT=yCONFIG_NF_CONNTRACK_TIMESTAMP=yCONFIG_NF_CONNTRACK_LABELS=yCONFIG_NF_CT_PROTO_DCCP=yCONFIG_NF_CT_PROTO_GRE=yCONFIG_NF_CT_PROTO_SCTP=yCONFIG_NF_CT_PROTO_UDPLITE=yCONFIG_NF_CONNTRACK_AMANDA=mCONFIG_NF_CONNTRACK_FTP=mCONFIG_NF_CONNTRACK_H323=mCONFIG_NF_CONNTRACK_IRC=mCONFIG_NF_CONNTRACK_BROADCAST=mCONFIG_NF_CONNTRACK_NETBIOS_NS=mCONFIG_NF_CONNTRACK_SNMP=mCONFIG_NF_CONNTRACK_PPTP=mCONFIG_NF_CONNTRACK_SANE=mCONFIG_NF_CONNTRACK_SIP=mCONFIG_NF_CONNTRACK_TFTP=mCONFIG_NF_CT_NETLINK=mCONFIG_NF_CT_NETLINK_TIMEOUT=m
# CONFIG_NETFILTER_NETLINK_GLUE_CT is not setCONFIG_NF_NAT=mCONFIG_NF_NAT_AMANDA=mCONFIG_NF_NAT_FTP=mCONFIG_NF_NAT_IRC=mCONFIG_NF_NAT_SIP=mCONFIG_NF_NAT_TFTP=mCONFIG_NF_NAT_MASQUERADE=yCONFIG_NF_TABLES=m
# CONFIG_NF_TABLES_SET is not set
# CONFIG_NF_TABLES_INET is not set
# CONFIG_NF_TABLES_NETDEV is not set
# CONFIG_NFT_NUMGEN is not setCONFIG_NFT_CT=mCONFIG_NFT_COUNTER=m
# CONFIG_NFT_CONNLIMIT is not setCONFIG_NFT_LOG=mCONFIG_NFT_LIMIT=m
# CONFIG_NFT_MASQ is not set
# CONFIG_NFT_REDIR is not setCONFIG_NFT_NAT=m
# CONFIG_NFT_TUNNEL is not set
# CONFIG_NFT_OBJREF is not set
# CONFIG_NFT_QUEUE is not set
# CONFIG_NFT_QUOTA is not set
# CONFIG_NFT_REJECT is not setCONFIG_NFT_COMPAT=mCONFIG_NFT_HASH=m
# CONFIG_NFT_XFRM is not set
# CONFIG_NFT_SOCKET is not set
# CONFIG_NFT_OSF is not set
# CONFIG_NFT_TPROXY is not set
# CONFIG_NFT_SYNPROXY is not set
# CONFIG_NF_FLOW_TABLE is not setCONFIG_NETFILTER_XTABLES=m
#
# Xtables combined modules
#CONFIG_NETFILTER_XT_MARK=mCONFIG_NETFILTER_XT_CONNMARK=mCONFIG_NETFILTER_XT_SET=m
#
# Xtables targets
#CONFIG_NETFILTER_XT_TARGET_AUDIT=mCONFIG_NETFILTER_XT_TARGET_CHECKSUM=mCONFIG_NETFILTER_XT_TARGET_CLASSIFY=mCONFIG_NETFILTER_XT_TARGET_CONNMARK=mCONFIG_NETFILTER_XT_TARGET_CONNSECMARK=mCONFIG_NETFILTER_XT_TARGET_CT=mCONFIG_NETFILTER_XT_TARGET_DSCP=mCONFIG_NETFILTER_XT_TARGET_HL=mCONFIG_NETFILTER_XT_TARGET_HMARK=mCONFIG_NETFILTER_XT_TARGET_IDLETIMER=mCONFIG_NETFILTER_XT_TARGET_LOG=mCONFIG_NETFILTER_XT_TARGET_MARK=mCONFIG_NETFILTER_XT_NAT=m
# CONFIG_NETFILTER_XT_TARGET_NETMAP is not setCONFIG_NETFILTER_XT_TARGET_NFLOG=mCONFIG_NETFILTER_XT_TARGET_NFQUEUE=m
# CONFIG_NETFILTER_XT_TARGET_NOTRACK is not setCONFIG_NETFILTER_XT_TARGET_RATEEST=m
# CONFIG_NETFILTER_XT_TARGET_REDIRECT is not setCONFIG_NETFILTER_XT_TARGET_MASQUERADE=mCONFIG_NETFILTER_XT_TARGET_TEE=mCONFIG_NETFILTER_XT_TARGET_TPROXY=mCONFIG_NETFILTER_XT_TARGET_TRACE=mCONFIG_NETFILTER_XT_TARGET_SECMARK=mCONFIG_NETFILTER_XT_TARGET_TCPMSS=mCONFIG_NETFILTER_XT_TARGET_TCPOPTSTRIP=m
#
# Xtables matches
#CONFIG_NETFILTER_XT_MATCH_ADDRTYPE=mCONFIG_NETFILTER_XT_MATCH_BPF=m
# CONFIG_NETFILTER_XT_MATCH_CGROUP is not setCONFIG_NETFILTER_XT_MATCH_CLUSTER=mCONFIG_NETFILTER_XT_MATCH_COMMENT=mCONFIG_NETFILTER_XT_MATCH_CONNBYTES=mCONFIG_NETFILTER_XT_MATCH_CONNLABEL=mCONFIG_NETFILTER_XT_MATCH_CONNLIMIT=mCONFIG_NETFILTER_XT_MATCH_CONNMARK=mCONFIG_NETFILTER_XT_MATCH_CONNTRACK=mCONFIG_NETFILTER_XT_MATCH_CPU=mCONFIG_NETFILTER_XT_MATCH_DCCP=mCONFIG_NETFILTER_XT_MATCH_DEVGROUP=mCONFIG_NETFILTER_XT_MATCH_DSCP=mCONFIG_NETFILTER_XT_MATCH_ECN=mCONFIG_NETFILTER_XT_MATCH_ESP=mCONFIG_NETFILTER_XT_MATCH_HASHLIMIT=mCONFIG_NETFILTER_XT_MATCH_HELPER=mCONFIG_NETFILTER_XT_MATCH_HL=m
# CONFIG_NETFILTER_XT_MATCH_IPCOMP is not setCONFIG_NETFILTER_XT_MATCH_IPRANGE=mCONFIG_NETFILTER_XT_MATCH_IPVS=mCONFIG_NETFILTER_XT_MATCH_L2TP=mCONFIG_NETFILTER_XT_MATCH_LENGTH=mCONFIG_NETFILTER_XT_MATCH_LIMIT=mCONFIG_NETFILTER_XT_MATCH_MAC=mCONFIG_NETFILTER_XT_MATCH_MARK=mCONFIG_NETFILTER_XT_MATCH_MULTIPORT=mCONFIG_NETFILTER_XT_MATCH_NFACCT=mCONFIG_NETFILTER_XT_MATCH_OSF=mCONFIG_NETFILTER_XT_MATCH_OWNER=mCONFIG_NETFILTER_XT_MATCH_POLICY=mCONFIG_NETFILTER_XT_MATCH_PHYSDEV=mCONFIG_NETFILTER_XT_MATCH_PKTTYPE=mCONFIG_NETFILTER_XT_MATCH_QUOTA=mCONFIG_NETFILTER_XT_MATCH_RATEEST=mCONFIG_NETFILTER_XT_MATCH_REALM=mCONFIG_NETFILTER_XT_MATCH_RECENT=mCONFIG_NETFILTER_XT_MATCH_SCTP=m
# CONFIG_NETFILTER_XT_MATCH_SOCKET is not setCONFIG_NETFILTER_XT_MATCH_STATE=mCONFIG_NETFILTER_XT_MATCH_STATISTIC=mCONFIG_NETFILTER_XT_MATCH_STRING=mCONFIG_NETFILTER_XT_MATCH_TCPMSS=mCONFIG_NETFILTER_XT_MATCH_TIME=mCONFIG_NETFILTER_XT_MATCH_U32=m
# end of Core Netfilter Configuration
CONFIG_IP_SET=mCONFIG_IP_SET_MAX=256CONFIG_IP_SET_BITMAP_IP=mCONFIG_IP_SET_BITMAP_IPMAC=mCONFIG_IP_SET_BITMAP_PORT=mCONFIG_IP_SET_HASH_IP=m
# CONFIG_IP_SET_HASH_IPMARK is not setCONFIG_IP_SET_HASH_IPPORT=mCONFIG_IP_SET_HASH_IPPORTIP=mCONFIG_IP_SET_HASH_IPPORTNET=m
# CONFIG_IP_SET_HASH_IPMAC is not set
# CONFIG_IP_SET_HASH_MAC is not setCONFIG_IP_SET_HASH_NETPORTNET=mCONFIG_IP_SET_HASH_NET=mCONFIG_IP_SET_HASH_NETNET=mCONFIG_IP_SET_HASH_NETPORT=mCONFIG_IP_SET_HASH_NETIFACE=mCONFIG_IP_SET_LIST_SET=mCONFIG_IP_VS=m
# CONFIG_IP_VS_IPV6 is not set
# CONFIG_IP_VS_DEBUG is not setCONFIG_IP_VS_TAB_BITS=12
#
# IPVS transport protocol load balancing support
#CONFIG_IP_VS_PROTO_TCP=yCONFIG_IP_VS_PROTO_UDP=yCONFIG_IP_VS_PROTO_AH_ESP=yCONFIG_IP_VS_PROTO_ESP=yCONFIG_IP_VS_PROTO_AH=y
# CONFIG_IP_VS_PROTO_SCTP is not set
#
# IPVS scheduler
#CONFIG_IP_VS_RR=mCONFIG_IP_VS_WRR=mCONFIG_IP_VS_LC=mCONFIG_IP_VS_WLC=m
# CONFIG_IP_VS_FO is not set
# CONFIG_IP_VS_OVF is not setCONFIG_IP_VS_LBLC=mCONFIG_IP_VS_LBLCR=mCONFIG_IP_VS_DH=mCONFIG_IP_VS_SH=m
# CONFIG_IP_VS_MH is not setCONFIG_IP_VS_SED=mCONFIG_IP_VS_NQ=m
#
# IPVS SH scheduler
#CONFIG_IP_VS_SH_TAB_BITS=8
#
# IPVS MH scheduler
#CONFIG_IP_VS_MH_TAB_INDEX=12
#
# IPVS application helper
#CONFIG_IP_VS_FTP=mCONFIG_IP_VS_NFCT=yCONFIG_IP_VS_PE_SIP=m
#
# IP: Netfilter Configuration
#CONFIG_NF_DEFRAG_IPV4=m
# CONFIG_NF_SOCKET_IPV4 is not setCONFIG_NF_TPROXY_IPV4=mCONFIG_NF_TABLES_IPV4=y
# CONFIG_NFT_DUP_IPV4 is not set
# CONFIG_NFT_FIB_IPV4 is not setCONFIG_NF_TABLES_ARP=yCONFIG_NF_DUP_IPV4=m
# CONFIG_NF_LOG_ARP is not setCONFIG_NF_LOG_IPV4=mCONFIG_NF_REJECT_IPV4=mCONFIG_NF_NAT_SNMP_BASIC=mCONFIG_NF_NAT_PPTP=mCONFIG_NF_NAT_H323=mCONFIG_IP_NF_IPTABLES=mCONFIG_IP_NF_MATCH_AH=mCONFIG_IP_NF_MATCH_ECN=mCONFIG_IP_NF_MATCH_RPFILTER=mCONFIG_IP_NF_MATCH_TTL=mCONFIG_IP_NF_FILTER=mCONFIG_IP_NF_TARGET_REJECT=m
# CONFIG_IP_NF_TARGET_SYNPROXY is not setCONFIG_IP_NF_NAT=mCONFIG_IP_NF_TARGET_MASQUERADE=m
# CONFIG_IP_NF_TARGET_NETMAP is not set
# CONFIG_IP_NF_TARGET_REDIRECT is not setCONFIG_IP_NF_MANGLE=mCONFIG_IP_NF_TARGET_CLUSTERIP=mCONFIG_IP_NF_TARGET_ECN=mCONFIG_IP_NF_TARGET_TTL=mCONFIG_IP_NF_RAW=mCONFIG_IP_NF_SECURITY=mCONFIG_IP_NF_ARPTABLES=mCONFIG_IP_NF_ARPFILTER=mCONFIG_IP_NF_ARP_MANGLE=m
# end of IP: Netfilter Configuration
#
# IPv6: Netfilter Configuration
#
# CONFIG_NF_SOCKET_IPV6 is not setCONFIG_NF_TPROXY_IPV6=mCONFIG_NF_TABLES_IPV6=y
# CONFIG_NFT_DUP_IPV6 is not set
# CONFIG_NFT_FIB_IPV6 is not setCONFIG_NF_DUP_IPV6=mCONFIG_NF_REJECT_IPV6=mCONFIG_NF_LOG_IPV6=mCONFIG_IP6_NF_IPTABLES=mCONFIG_IP6_NF_MATCH_AH=mCONFIG_IP6_NF_MATCH_EUI64=mCONFIG_IP6_NF_MATCH_FRAG=mCONFIG_IP6_NF_MATCH_OPTS=mCONFIG_IP6_NF_MATCH_HL=mCONFIG_IP6_NF_MATCH_IPV6HEADER=mCONFIG_IP6_NF_MATCH_MH=mCONFIG_IP6_NF_MATCH_RPFILTER=mCONFIG_IP6_NF_MATCH_RT=m
# CONFIG_IP6_NF_MATCH_SRH is not setCONFIG_IP6_NF_TARGET_HL=mCONFIG_IP6_NF_FILTER=mCONFIG_IP6_NF_TARGET_REJECT=m
# CONFIG_IP6_NF_TARGET_SYNPROXY is not setCONFIG_IP6_NF_MANGLE=mCONFIG_IP6_NF_RAW=mCONFIG_IP6_NF_SECURITY=mCONFIG_IP6_NF_NAT=mCONFIG_IP6_NF_TARGET_MASQUERADE=m
# CONFIG_IP6_NF_TARGET_NPT is not set
# end of IPv6: Netfilter Configuration
CONFIG_NF_DEFRAG_IPV6=mCONFIG_NF_TABLES_BRIDGE=m
# CONFIG_NFT_BRIDGE_META is not set
# CONFIG_NF_LOG_BRIDGE is not set
# CONFIG_NF_CONNTRACK_BRIDGE is not set
# CONFIG_BRIDGE_NF_EBTABLES is not set
# CONFIG_BPFILTER is not set
# CONFIG_IP_DCCP is not setCONFIG_IP_SCTP=m
# CONFIG_SCTP_DBG_OBJCNT is not setCONFIG_SCTP_DEFAULT_COOKIE_HMAC_MD5=y
# CONFIG_SCTP_DEFAULT_COOKIE_HMAC_SHA1 is not set
# CONFIG_SCTP_DEFAULT_COOKIE_HMAC_NONE is not setCONFIG_SCTP_COOKIE_HMAC_MD5=y
# CONFIG_SCTP_COOKIE_HMAC_SHA1 is not setCONFIG_INET_SCTP_DIAG=mCONFIG_RDS=mCONFIG_RDS_RDMA=mCONFIG_RDS_TCP=m
# CONFIG_RDS_DEBUG is not set
# CONFIG_TIPC is not set
# CONFIG_ATM is not setCONFIG_L2TP=mCONFIG_L2TP_DEBUGFS=mCONFIG_L2TP_V3=yCONFIG_L2TP_IP=mCONFIG_L2TP_ETH=mCONFIG_STP=mCONFIG_GARP=mCONFIG_BRIDGE=mCONFIG_BRIDGE_IGMP_SNOOPING=y
# CONFIG_BRIDGE_VLAN_FILTERING is not setCONFIG_VLAN_8021Q=mCONFIG_VLAN_8021Q_GVRP=y
# CONFIG_VLAN_8021Q_MVRP is not set
# CONFIG_DECNET is not setCONFIG_LLC=m
# CONFIG_LLC2 is not set
# CONFIG_ATALK is not set
# CONFIG_X25 is not set
# CONFIG_LAPB is not set
# CONFIG_PHONET is not set
# CONFIG_6LOWPAN is not set
# CONFIG_IEEE802154 is not setCONFIG_NET_SCHED=y
#
# Queueing/Scheduling
#CONFIG_NET_SCH_CBQ=mCONFIG_NET_SCH_HTB=mCONFIG_NET_SCH_HFSC=mCONFIG_NET_SCH_PRIO=mCONFIG_NET_SCH_MULTIQ=mCONFIG_NET_SCH_RED=mCONFIG_NET_SCH_SFB=mCONFIG_NET_SCH_SFQ=mCONFIG_NET_SCH_TEQL=mCONFIG_NET_SCH_TBF=m
# CONFIG_NET_SCH_CBS is not set
# CONFIG_NET_SCH_ETF is not set
# CONFIG_NET_SCH_TAPRIO is not setCONFIG_NET_SCH_GRED=mCONFIG_NET_SCH_DSMARK=mCONFIG_NET_SCH_NETEM=mCONFIG_NET_SCH_DRR=mCONFIG_NET_SCH_MQPRIO=m
# CONFIG_NET_SCH_SKBPRIO is not setCONFIG_NET_SCH_CHOKE=mCONFIG_NET_SCH_QFQ=mCONFIG_NET_SCH_CODEL=mCONFIG_NET_SCH_FQ_CODEL=m
# CONFIG_NET_SCH_CAKE is not set
# CONFIG_NET_SCH_FQ is not set
# CONFIG_NET_SCH_HHF is not set
# CONFIG_NET_SCH_PIE is not setCONFIG_NET_SCH_INGRESS=mCONFIG_NET_SCH_PLUG=m
# CONFIG_NET_SCH_DEFAULT is not set
#
# Classification
#CONFIG_NET_CLS=yCONFIG_NET_CLS_BASIC=mCONFIG_NET_CLS_TCINDEX=mCONFIG_NET_CLS_ROUTE4=mCONFIG_NET_CLS_FW=mCONFIG_NET_CLS_U32=mCONFIG_CLS_U32_PERF=yCONFIG_CLS_U32_MARK=yCONFIG_NET_CLS_RSVP=mCONFIG_NET_CLS_RSVP6=mCONFIG_NET_CLS_FLOW=mCONFIG_NET_CLS_CGROUP=yCONFIG_NET_CLS_BPF=m
# CONFIG_NET_CLS_FLOWER is not set
# CONFIG_NET_CLS_MATCHALL is not set
# CONFIG_NET_EMATCH is not setCONFIG_NET_CLS_ACT=yCONFIG_NET_ACT_POLICE=mCONFIG_NET_ACT_GACT=mCONFIG_GACT_PROB=yCONFIG_NET_ACT_MIRRED=m
# CONFIG_NET_ACT_SAMPLE is not setCONFIG_NET_ACT_IPT=mCONFIG_NET_ACT_NAT=mCONFIG_NET_ACT_PEDIT=mCONFIG_NET_ACT_SIMP=mCONFIG_NET_ACT_SKBEDIT=mCONFIG_NET_ACT_CSUM=m
# CONFIG_NET_ACT_MPLS is not set
# CONFIG_NET_ACT_VLAN is not set
# CONFIG_NET_ACT_BPF is not set
# CONFIG_NET_ACT_CONNMARK is not set
# CONFIG_NET_ACT_CTINFO is not set
# CONFIG_NET_ACT_SKBMOD is not set
# CONFIG_NET_ACT_IFE is not set
# CONFIG_NET_ACT_TUNNEL_KEY is not set
# CONFIG_NET_ACT_CT is not set
# CONFIG_NET_TC_SKB_EXT is not setCONFIG_NET_SCH_FIFO=y
# CONFIG_DCB is not setCONFIG_DNS_RESOLVER=y
# CONFIG_BATMAN_ADV is not setCONFIG_OPENVSWITCH=mCONFIG_OPENVSWITCH_GRE=mCONFIG_OPENVSWITCH_VXLAN=mCONFIG_VSOCKETS=mCONFIG_VSOCKETS_DIAG=mCONFIG_VIRTIO_VSOCKETS=mCONFIG_VIRTIO_VSOCKETS_COMMON=mCONFIG_NETLINK_DIAG=mCONFIG_MPLS=yCONFIG_NET_MPLS_GSO=m
# CONFIG_MPLS_ROUTING is not setCONFIG_NET_NSH=m
# CONFIG_HSR is not set
# CONFIG_NET_SWITCHDEV is not set
# CONFIG_NET_L3_MASTER_DEV is not set
# CONFIG_NET_NCSI is not setCONFIG_RPS=yCONFIG_RFS_ACCEL=yCONFIG_XPS=yCONFIG_CGROUP_NET_PRIO=yCONFIG_CGROUP_NET_CLASSID=yCONFIG_NET_RX_BUSY_POLL=yCONFIG_BQL=yCONFIG_BPF_JIT=y
# CONFIG_BPF_STREAM_PARSER is not setCONFIG_NET_FLOW_LIMIT=y
#
# Network testing
#CONFIG_NET_PKTGEN=m
# CONFIG_NET_DROP_MONITOR is not set
# end of Network testing # end of Networking options
# CONFIG_CAN is not set
# CONFIG_AF_RXRPC is not set
# CONFIG_AF_KCM is not setCONFIG_FIB_RULES=y
# CONFIG_WIMAX is not set
# CONFIG_RFKILL is not set
# CONFIG_NET_9P is not set
# CONFIG_CAIF is not setCONFIG_CEPH_LIB=m
# CONFIG_CEPH_LIB_PRETTYDEBUG is not set
# CONFIG_CEPH_LIB_USE_DNS_RESOLVER is not set
# CONFIG_NFC is not set
# CONFIG_PSAMPLE is not set
# CONFIG_NET_IFE is not set
# CONFIG_LWTUNNEL is not setCONFIG_DST_CACHE=yCONFIG_GRO_CELLS=yCONFIG_NET_DEVLINK=yCONFIG_PAGE_POOL=yCONFIG_FAILOVER=mCONFIG_HAVE_EBPF_JIT=y
#
# Device Drivers
#CONFIG_HAVE_PCI=yCONFIG_PCI=yCONFIG_PCI_DOMAINS=y
# CONFIG_PCIEPORTBUS is not setCONFIG_PCIEASPM=yCONFIG_PCIEASPM_DEFAULT=y
# CONFIG_PCIEASPM_POWERSAVE is not set
# CONFIG_PCIEASPM_POWER_SUPERSAVE is not set
# CONFIG_PCIEASPM_PERFORMANCE is not set
# CONFIG_PCIE_PTM is not setCONFIG_PCI_MSI=yCONFIG_PCI_MSI_IRQ_DOMAIN=y
# CONFIG_PCI_DEBUG is not set
# CONFIG_PCI_STUB is not set
# CONFIG_PCI_IOV is not set
# CONFIG_PCI_PRI is not set
# CONFIG_PCI_PASID is not setCONFIG_HOTPLUG_PCI=y
# CONFIG_HOTPLUG_PCI_CPCI is not set
# CONFIG_HOTPLUG_PCI_SHPC is not setCONFIG_HOTPLUG_PCI_S390=y
#
# PCI controller drivers
#
#
# DesignWare PCI Core Support
#
# CONFIG_PCIE_DW_PLAT_HOST is not set
# CONFIG_PCI_MESON is not set
# end of DesignWare PCI Core Support
#
# Cadence PCIe controllers support
#
# end of Cadence PCIe controllers support # end of PCI controller drivers
#
# PCI Endpoint
#
# CONFIG_PCI_ENDPOINT is not set
# end of PCI Endpoint
#
# PCI switch controller drivers
#
# CONFIG_PCI_SW_SWITCHTEC is not set
# end of PCI switch controller drivers
# CONFIG_PCCARD is not set
# CONFIG_RAPIDIO is not set
#
# Generic Driver Options
#CONFIG_UEVENT_HELPER=yCONFIG_UEVENT_HELPER_PATH=""CONFIG_DEVTMPFS=y
# CONFIG_DEVTMPFS_MOUNT is not setCONFIG_STANDALONE=yCONFIG_PREVENT_FIRMWARE_BUILD=y
#
# Firmware loader
#CONFIG_FW_LOADER=yCONFIG_EXTRA_FIRMWARE=""
# CONFIG_FW_LOADER_USER_HELPER is not set
# CONFIG_FW_LOADER_COMPRESS is not setCONFIG_FW_CACHE=y
# end of Firmware loader
CONFIG_ALLOW_DEV_COREDUMP=y
# CONFIG_DEBUG_DRIVER is not set
# CONFIG_DEBUG_DEVRES is not set
# CONFIG_DEBUG_TEST_DRIVER_REMOVE is not set
# CONFIG_TEST_ASYNC_DRIVER_PROBE is not setCONFIG_SYS_HYPERVISOR=yCONFIG_GENERIC_CPU_AUTOPROBE=yCONFIG_GENERIC_CPU_VULNERABILITIES=yCONFIG_DMA_SHARED_BUFFER=y
# CONFIG_DMA_FENCE_TRACE is not set
# end of Generic Driver Options
#
# Bus devices
#
# end of Bus devices
CONFIG_CONNECTOR=yCONFIG_PROC_EVENTS=y
# CONFIG_GNSS is not set
# CONFIG_MTD is not set
# CONFIG_OF is not set
# CONFIG_PARPORT is not setCONFIG_BLK_DEV=y
# CONFIG_BLK_DEV_NULL_BLK is not setCONFIG_CDROM=m
# CONFIG_BLK_DEV_PCIESSD_MTIP32XX is not setCONFIG_ZRAM=m
# CONFIG_ZRAM_WRITEBACK is not set
# CONFIG_ZRAM_MEMORY_TRACKING is not set
# CONFIG_BLK_DEV_UMEM is not setCONFIG_BLK_DEV_LOOP=mCONFIG_BLK_DEV_LOOP_MIN_COUNT=8CONFIG_BLK_DEV_CRYPTOLOOP=mCONFIG_BLK_DEV_DRBD=m
# CONFIG_DRBD_FAULT_INJECTION is not setCONFIG_BLK_DEV_NBD=m
# CONFIG_BLK_DEV_SKD is not set
# CONFIG_BLK_DEV_SX8 is not setCONFIG_BLK_DEV_RAM=yCONFIG_BLK_DEV_RAM_COUNT=16CONFIG_BLK_DEV_RAM_SIZE=32768
# CONFIG_CDROM_PKTCDVD is not set
# CONFIG_ATA_OVER_ETH is not set
#
# S/390 block device drivers
#
# CONFIG_BLK_DEV_XPRAM is not setCONFIG_DCSSBLK=mCONFIG_DASD=yCONFIG_DASD_PROFILE=yCONFIG_DASD_ECKD=yCONFIG_DASD_FBA=yCONFIG_DASD_DIAG=yCONFIG_DASD_EER=yCONFIG_SCM_BLOCK=mCONFIG_VIRTIO_BLK=y
# CONFIG_VIRTIO_BLK_SCSI is not setCONFIG_BLK_DEV_RBD=m
# CONFIG_BLK_DEV_RSXX is not set
#
# NVME Support
#CONFIG_NVME_CORE=mCONFIG_BLK_DEV_NVME=m
# CONFIG_NVME_MULTIPATH is not set
# CONFIG_NVME_RDMA is not set
# CONFIG_NVME_FC is not set
# CONFIG_NVME_TCP is not set
# CONFIG_NVME_TARGET is not set
# end of NVME Support
#
# Misc devices
#
# CONFIG_WATCH_QUEUE is not set
# CONFIG_DUMMY_IRQ is not set
# CONFIG_PHANTOM is not set
# CONFIG_TIFM_CORE is not setCONFIG_ENCLOSURE_SERVICES=m
# CONFIG_HP_ILO is not set
# CONFIG_SRAM is not set
# CONFIG_PCI_ENDPOINT_TEST is not set
# CONFIG_XILINX_SDFEC is not set
# CONFIG_C2PORT is not set
#
# EEPROM support
#
# CONFIG_EEPROM_93CX6 is not set
# end of EEPROM support
# CONFIG_CB710_CORE is not set
#
# Texas Instruments shared transport line discipline #
# end of Texas Instruments shared transport line discipline
#
# Altera FPGA firmware download module (requires I2C) #
#
# Intel MIC & related support
#
# CONFIG_VOP_BUS is not set
# end of Intel MIC & related support
CONFIG_GENWQE=mCONFIG_GENWQE_PLATFORM_ERROR_RECOVERY=0
# CONFIG_ECHO is not set
# CONFIG_MISC_ALCOR_PCI is not set
# CONFIG_MISC_RTSX_PCI is not set
# CONFIG_HABANA_AI is not set
# end of Misc devices
#
# SCSI device support
#CONFIG_SCSI_MOD=yCONFIG_RAID_ATTRS=mCONFIG_SCSI=yCONFIG_SCSI_DMA=yCONFIG_SCSI_NETLINK=yCONFIG_SCSI_PROC_FS=y
#
# SCSI support type (disk, tape, CD-ROM)
#CONFIG_BLK_DEV_SD=yCONFIG_CHR_DEV_ST=mCONFIG_BLK_DEV_SR=m
# CONFIG_BLK_DEV_SR_VENDOR is not setCONFIG_CHR_DEV_SG=yCONFIG_CHR_DEV_SCH=mCONFIG_SCSI_ENCLOSURE=mCONFIG_SCSI_CONSTANTS=yCONFIG_SCSI_LOGGING=y
# CONFIG_SCSI_SCAN_ASYNC is not set
#
# SCSI Transports
#CONFIG_SCSI_SPI_ATTRS=mCONFIG_SCSI_FC_ATTRS=yCONFIG_SCSI_ISCSI_ATTRS=mCONFIG_SCSI_SAS_ATTRS=mCONFIG_SCSI_SAS_LIBSAS=mCONFIG_SCSI_SAS_HOST_SMP=yCONFIG_SCSI_SRP_ATTRS=m
# end of SCSI Transports
CONFIG_SCSI_LOWLEVEL=yCONFIG_ISCSI_TCP=m
# CONFIG_ISCSI_BOOT_SYSFS is not set
# CONFIG_SCSI_CXGB3_ISCSI is not set
# CONFIG_SCSI_CXGB4_ISCSI is not set
# CONFIG_SCSI_BNX2_ISCSI is not set
# CONFIG_BE2ISCSI is not set
# CONFIG_BLK_DEV_3W_XXXX_RAID is not set
# CONFIG_SCSI_HPSA is not set
# CONFIG_SCSI_3W_9XXX is not set
# CONFIG_SCSI_3W_SAS is not set
# CONFIG_SCSI_ACARD is not set
# CONFIG_SCSI_AACRAID is not set
# CONFIG_SCSI_AIC7XXX is not set
# CONFIG_SCSI_AIC79XX is not set
# CONFIG_SCSI_AIC94XX is not set
# CONFIG_SCSI_MVSAS is not set
# CONFIG_SCSI_MVUMI is not set
# CONFIG_SCSI_ADVANSYS is not set
# CONFIG_SCSI_ARCMSR is not set
# CONFIG_SCSI_ESAS2R is not set
# CONFIG_MEGARAID_NEWGEN is not set
# CONFIG_MEGARAID_LEGACY is not set
# CONFIG_MEGARAID_SAS is not set
# CONFIG_SCSI_MPT3SAS is not set
# CONFIG_SCSI_MPT2SAS is not set
# CONFIG_SCSI_UFSHCD is not set
# CONFIG_SCSI_HPTIOP is not set
# CONFIG_SCSI_MYRB is not set
# CONFIG_LIBFC is not set
# CONFIG_SCSI_SNIC is not set
# CONFIG_SCSI_DMX3191D is not set
# CONFIG_SCSI_FDOMAIN_PCI is not set
# CONFIG_SCSI_GDTH is not set
# CONFIG_SCSI_IPS is not set
# CONFIG_SCSI_INITIO is not set
# CONFIG_SCSI_INIA100 is not set
# CONFIG_SCSI_STEX is not set
# CONFIG_SCSI_SYM53C8XX_2 is not set
# CONFIG_SCSI_QLOGIC_1280 is not set
# CONFIG_SCSI_QLA_FC is not set
# CONFIG_SCSI_QLA_ISCSI is not set
# CONFIG_SCSI_LPFC is not set
# CONFIG_SCSI_DC395x is not set
# CONFIG_SCSI_AM53C974 is not set
# CONFIG_SCSI_WD719X is not setCONFIG_SCSI_DEBUG=mCONFIG_ZFCP=y
# CONFIG_SCSI_PMCRAID is not set
# CONFIG_SCSI_PM8001 is not set
# CONFIG_SCSI_BFA_FC is not setCONFIG_SCSI_VIRTIO=m
# CONFIG_SCSI_CHELSIO_FCOE is not setCONFIG_SCSI_DH=yCONFIG_SCSI_DH_RDAC=mCONFIG_SCSI_DH_HP_SW=mCONFIG_SCSI_DH_EMC=mCONFIG_SCSI_DH_ALUA=m
# end of SCSI device support
# CONFIG_ATA is not setCONFIG_MD=yCONFIG_BLK_DEV_MD=yCONFIG_MD_AUTODETECT=yCONFIG_MD_LINEAR=mCONFIG_MD_RAID0=mCONFIG_MD_RAID1=mCONFIG_MD_RAID10=mCONFIG_MD_RAID456=mCONFIG_MD_MULTIPATH=mCONFIG_MD_FAULTY=mCONFIG_MD_CLUSTER=mCONFIG_BCACHE=m
# CONFIG_BCACHE_DEBUG is not set
# CONFIG_BCACHE_CLOSURES_DEBUG is not set CONFIG_BLK_DEV_DM_BUILTIN=y CONFIG_BLK_DEV_DM=m
# CONFIG_DM_DEBUG is not set CONFIG_DM_BUFIO=m
# CONFIG_DM_DEBUG_BLOCK_MANAGER_LOCKING is not set CONFIG_DM_BIO_PRISON=m CONFIG_DM_PERSISTENT_DATA=m CONFIG_DM_UNSTRIPED=mCONFIG_DM_CRYPT=mCONFIG_DM_SNAPSHOT=m CONFIG_DM_THIN_PROVISIONING=m
# CONFIG_DM_CACHE is not set CONFIG_DM_WRITECACHE=m
# CONFIG_DM_ERA is not set CONFIG_DM_CLONE=mCONFIG_DM_MIRROR=m CONFIG_DM_LOG_USERSPACE=mCONFIG_DM_RAID=mCONFIG_DM_ZERO=mCONFIG_DM_MULTIPATH=m CONFIG_DM_MULTIPATH_QL=m CONFIG_DM_MULTIPATH_ST=mCONFIG_DM_DELAY=m
# CONFIG_DM_DUST is not set CONFIG_DM_UEVENT=yCONFIG_DM_FLAKEY=mCONFIG_DM_VERITY=m CONFIG_DM_VERITY_VERIFY_ROOTHASH_SIG=y
# CONFIG_DM_VERITY_FEC is not set CONFIG_DM_SWITCH=m
# CONFIG_DM_LOG_WRITES is not set CONFIG_DM_INTEGRITY=m
# CONFIG_TARGET_CORE is not set
# CONFIG_FUSION is not set
#
# IEEE 1394 (FireWire) support
#
# CONFIG_FIREWIRE is not set
# CONFIG_FIREWIRE_NOSY is not set
# end of IEEE 1394 (FireWire) support
CONFIG_NETDEVICES=yCONFIG_NET_CORE=yCONFIG_BONDING=mCONFIG_DUMMY=mCONFIG_EQUALIZER=m
# CONFIG_NET_FC is not setCONFIG_IFB=m
# CONFIG_NET_TEAM is not setCONFIG_MACVLAN=mCONFIG_MACVTAP=m
# CONFIG_IPVLAN is not setCONFIG_VXLAN=m
# CONFIG_GENEVE is not set
# CONFIG_GTP is not set
# CONFIG_MACSEC is not set
# CONFIG_NETCONSOLE is not setCONFIG_TUN=mCONFIG_TAP=m
# CONFIG_TUN_VNET_CROSS_LE is not setCONFIG_VETH=mCONFIG_VIRTIO_NET=mCONFIG_NLMON=m
# CONFIG_VSOCKMON is not set
# CONFIG_ARCNET is not setCONFIG_ETHERNET=y
# CONFIG_NET_VENDOR_3COM is not set
# CONFIG_NET_VENDOR_ADAPTEC is not set
# CONFIG_NET_VENDOR_AGERE is not set
# CONFIG_NET_VENDOR_ALACRITECH is not set
# CONFIG_NET_VENDOR_ALTEON is not set
# CONFIG_ALTERA_TSE is not set
# CONFIG_NET_VENDOR_AMAZON is not set
# CONFIG_NET_VENDOR_AMD is not set
# CONFIG_NET_VENDOR_AQUANTIA is not set
# CONFIG_NET_VENDOR_ARC is not set
# CONFIG_NET_VENDOR_ATHEROS is not set
# CONFIG_NET_VENDOR_AURORA is not set
# CONFIG_NET_VENDOR_BROADCOM is not set
# CONFIG_NET_VENDOR_BROCADE is not set
# CONFIG_NET_VENDOR_CADENCE is not set
# CONFIG_NET_VENDOR_CAVIUM is not set
# CONFIG_NET_VENDOR_CHELSIO is not set
# CONFIG_NET_VENDOR_CISCO is not set
# CONFIG_NET_VENDOR_CORTINA is not set
# CONFIG_DNET is not set
# CONFIG_NET_VENDOR_DEC is not set
# CONFIG_NET_VENDOR_DLINK is not set
# CONFIG_NET_VENDOR_EMULEX is not set
# CONFIG_NET_VENDOR_EZCHIP is not set
# CONFIG_NET_VENDOR_GOOGLE is not set
# CONFIG_NET_VENDOR_HUAWEI is not set
# CONFIG_NET_VENDOR_INTEL is not set
# CONFIG_JME is not set
# CONFIG_NET_VENDOR_MARVELL is not setCONFIG_NET_VENDOR_MELLANOX=yCONFIG_MLX4_EN=mCONFIG_MLX4_CORE=mCONFIG_MLX4_DEBUG=yCONFIG_MLX4_CORE_GEN2=yCONFIG_MLX5_CORE=m
# CONFIG_MLX5_FPGA is not setCONFIG_MLX5_CORE_EN=yCONFIG_MLX5_EN_ARFS=yCONFIG_MLX5_EN_RXNFC=yCONFIG_MLX5_MPFS=y
# CONFIG_MLX5_CORE_IPOIB is not set
# CONFIG_MLXSW_CORE is not set
# CONFIG_MLXFW is not set
# CONFIG_NET_VENDOR_MICREL is not set
# CONFIG_NET_VENDOR_MICROCHIP is not set
# CONFIG_NET_VENDOR_MICROSEMI is not set
# CONFIG_NET_VENDOR_MYRI is not set
# CONFIG_FEALNX is not set
# CONFIG_NET_VENDOR_NATSEMI is not set
# CONFIG_NET_VENDOR_NETERION is not set
# CONFIG_NET_VENDOR_NETRONOME is not set
# CONFIG_NET_VENDOR_NI is not set
# CONFIG_NET_VENDOR_NVIDIA is not set
# CONFIG_NET_VENDOR_OKI is not set
# CONFIG_ETHOC is not set
# CONFIG_NET_VENDOR_PACKET_ENGINES is not set
# CONFIG_NET_VENDOR_PENSANDO is not set
# CONFIG_NET_VENDOR_QLOGIC is not set
# CONFIG_NET_VENDOR_QUALCOMM is not set
# CONFIG_NET_VENDOR_RDC is not set
# CONFIG_NET_VENDOR_REALTEK is not set
# CONFIG_NET_VENDOR_RENESAS is not set
# CONFIG_NET_VENDOR_ROCKER is not set
# CONFIG_NET_VENDOR_SAMSUNG is not set
# CONFIG_NET_VENDOR_SEEQ is not set
# CONFIG_NET_VENDOR_SOLARFLARE is not set
# CONFIG_NET_VENDOR_SILAN is not set
# CONFIG_NET_VENDOR_SIS is not set
# CONFIG_NET_VENDOR_SMSC is not set
# CONFIG_NET_VENDOR_SOCIONEXT is not set
# CONFIG_NET_VENDOR_STMICRO is not set
# CONFIG_NET_VENDOR_SUN is not set
# CONFIG_NET_VENDOR_SYNOPSYS is not set
# CONFIG_NET_VENDOR_TEHUTI is not set
# CONFIG_NET_VENDOR_TI is not set
# CONFIG_NET_VENDOR_VIA is not set
# CONFIG_NET_VENDOR_WIZNET is not setCONFIG_NET_VENDOR_XILINX=y
# CONFIG_XILINX_AXI_EMAC is not set
# CONFIG_FDDI is not set
# CONFIG_HIPPI is not set
# CONFIG_MDIO_DEVICE is not set
# CONFIG_PHYLIB is not setCONFIG_PPP=mCONFIG_PPP_BSDCOMP=mCONFIG_PPP_DEFLATE=mCONFIG_PPP_FILTER=yCONFIG_PPP_MPPE=mCONFIG_PPP_MULTILINK=yCONFIG_PPPOE=mCONFIG_PPTP=mCONFIG_PPPOL2TP=mCONFIG_PPP_ASYNC=mCONFIG_PPP_SYNC_TTY=m
# CONFIG_SLIP is not setCONFIG_SLHC=m
#
# S/390 network device drivers
#CONFIG_LCS=mCONFIG_CTCM=mCONFIG_NETIUCV=mCONFIG_SMSGIUCV=mCONFIG_SMSGIUCV_EVENT=mCONFIG_QETH=yCONFIG_QETH_L2=yCONFIG_QETH_L3=yCONFIG_CCWGROUP=yCONFIG_ISM=m
# end of S/390 network device drivers
#
# Host-side USB support is needed for USB Network Adapter support #
#
# Enable WiMAX (Networking options) to see the WiMAX drivers #
# CONFIG_WAN is not set
# CONFIG_VMXNET3 is not set
# CONFIG_NETDEVSIM is not set CONFIG_NET_FAILOVER=m
# CONFIG_NVM is not set
#
# Input device support
#CONFIG_INPUT=y
# CONFIG_INPUT_FF_MEMLESS is not set
# CONFIG_INPUT_POLLDEV is not set
# CONFIG_INPUT_SPARSEKMAP is not set
# CONFIG_INPUT_MATRIXKMAP is not set
#
# Userland interfaces
#
# CONFIG_INPUT_MOUSEDEV is not set
# CONFIG_INPUT_JOYDEV is not setCONFIG_INPUT_EVDEV=y
# CONFIG_INPUT_EVBUG is not set
#
# Input Device Drivers
#
# CONFIG_INPUT_KEYBOARD is not set
# CONFIG_INPUT_MOUSE is not set
# CONFIG_INPUT_JOYSTICK is not set
# CONFIG_INPUT_TABLET is not set
# CONFIG_INPUT_TOUCHSCREEN is not set
# CONFIG_INPUT_MISC is not set
# CONFIG_RMI4_CORE is not set
#
# Hardware I/O ports
#
# CONFIG_SERIO is not set
# CONFIG_GAMEPORT is not set
# end of Hardware I/O ports # end of Input device support
#
# Character devices
#CONFIG_TTY=yCONFIG_VT=yCONFIG_CONSOLE_TRANSLATIONS=yCONFIG_VT_CONSOLE=yCONFIG_VT_CONSOLE_SLEEP=yCONFIG_HW_CONSOLE=yCONFIG_VT_HW_CONSOLE_BINDING=yCONFIG_UNIX98_PTYS=yCONFIG_LEGACY_PTYS=yCONFIG_LEGACY_PTY_COUNT=0
# CONFIG_SERIAL_NONSTANDARD is not set
# CONFIG_NOZOMI is not set
# CONFIG_N_GSM is not set
# CONFIG_TRACE_SINK is not setCONFIG_NULL_TTY=mCONFIG_LDISC_AUTOLOAD=yCONFIG_DEVMEM=y
# CONFIG_DEVKMEM is not set
#
# Serial drivers
#
#
# Non-8250 serial port support
#
# CONFIG_SERIAL_UARTLITE is not set
# CONFIG_SERIAL_JSM is not set
# CONFIG_SERIAL_SCCNXP is not set
# CONFIG_SERIAL_ALTERA_JTAGUART is not set
# CONFIG_SERIAL_ALTERA_UART is not set
# CONFIG_SERIAL_ARC is not set
# CONFIG_SERIAL_RP2 is not set
# CONFIG_SERIAL_FSL_LPUART is not set
# CONFIG_SERIAL_FSL_LINFLEXUART is not set
# end of Serial drivers
# CONFIG_SERIAL_DEV_BUS is not set
# CONFIG_TTY_PRINTK is not setCONFIG_HVC_DRIVER=yCONFIG_HVC_IUCV=yCONFIG_VIRTIO_CONSOLE=y
# CONFIG_IPMI_HANDLER is not setCONFIG_HW_RANDOM=m
# CONFIG_HW_RANDOM_TIMERIOMEM is not setCONFIG_HW_RANDOM_VIRTIO=mCONFIG_HW_RANDOM_S390=m
# CONFIG_APPLICOM is not setCONFIG_RAW_DRIVER=mCONFIG_MAX_RAW_DEVS=256CONFIG_HANGCHECK_TIMER=mCONFIG_TCG_TPM=y
# CONFIG_TCG_VTPM_PROXY is not setCONFIG_DEVPORT=y
#
# S/390 character device drivers
#CONFIG_TN3270=yCONFIG_TN3270_TTY=yCONFIG_TN3270_FS=yCONFIG_TN3270_CONSOLE=yCONFIG_TN3215=yCONFIG_TN3215_CONSOLE=yCONFIG_CCW_CONSOLE=yCONFIG_SCLP_TTY=yCONFIG_SCLP_CONSOLE=yCONFIG_SCLP_VT220_TTY=yCONFIG_SCLP_VT220_CONSOLE=yCONFIG_HMC_DRV=m
# CONFIG_SCLP_OFB is not setCONFIG_S390_TAPE=m
#
# S/390 tape hardware support
#CONFIG_S390_TAPE_34XX=mCONFIG_S390_TAPE_3590=mCONFIG_VMLOGRDR=mCONFIG_VMCP=yCONFIG_VMCP_CMA_SIZE=4CONFIG_MONREADER=mCONFIG_MONWRITER=mCONFIG_S390_VMUR=m
# CONFIG_XILLYBUS is not set
# end of Character devices
# CONFIG_RANDOM_TRUST_CPU is not set
# CONFIG_RANDOM_TRUST_BOOTLOADER is not set
#
# I2C support
#
# CONFIG_I2C is not set
# end of I2C support
# CONFIG_I3C is not set
# CONFIG_SPI is not set
# CONFIG_SPMI is not set
# CONFIG_HSI is not set
# CONFIG_PPS is not set
#
# PTP clock support
#
# CONFIG_PTP_1588_CLOCK is not set
#
# Enable PHYLIB and NETWORK_PHY_TIMESTAMPING to see the additional clocks. #
# end of PTP clock support
# CONFIG_PINCTRL is not set
# CONFIG_GPIOLIB is not set
# CONFIG_W1 is not set
# CONFIG_POWER_AVS is not set
# CONFIG_POWER_RESET is not set
# CONFIG_POWER_SUPPLY is not set
# CONFIG_HWMON is not set
# CONFIG_THERMAL is not setCONFIG_WATCHDOG=yCONFIG_WATCHDOG_CORE=yCONFIG_WATCHDOG_NOWAYOUT=yCONFIG_WATCHDOG_HANDLE_BOOT_ENABLED=yCONFIG_WATCHDOG_OPEN_TIMEOUT=0
# CONFIG_WATCHDOG_SYSFS is not set
#
# Watchdog Pretimeout Governors
#
# CONFIG_WATCHDOG_PRETIMEOUT_GOV is not set
#
# Watchdog Device Drivers
#CONFIG_SOFT_WATCHDOG=m
# CONFIG_XILINX_WATCHDOG is not set
# CONFIG_CADENCE_WATCHDOG is not set
# CONFIG_DW_WATCHDOG is not set
# CONFIG_MAX63XX_WATCHDOG is not set
# CONFIG_ALIM7101_WDT is not set
# CONFIG_I6300ESB_WDT is not setCONFIG_DIAG288_WATCHDOG=m
#
# PCI-based Watchdog Cards
#
# CONFIG_PCIPCWATCHDOG is not set
# CONFIG_WDTPCI is not setCONFIG_SSB_POSSIBLE=y
# CONFIG_SSB is not setCONFIG_BCMA_POSSIBLE=y
# CONFIG_BCMA is not set
#
# Multifunction device drivers
#
# CONFIG_MFD_MADERA is not set
# CONFIG_HTC_PASIC3 is not set
# CONFIG_LPC_ICH is not set
# CONFIG_LPC_SCH is not set
# CONFIG_MFD_JANZ_CMODIO is not set
# CONFIG_MFD_KEMPLD is not set
# CONFIG_MFD_MT6397 is not set
# CONFIG_MFD_RDC321X is not set
# CONFIG_MFD_SM501 is not set
# CONFIG_ABX500_CORE is not set
# CONFIG_MFD_SYSCON is not set
# CONFIG_MFD_TI_AM335X_TSCADC is not set
# CONFIG_MFD_TQMX86 is not set
# CONFIG_MFD_VX855 is not set
# end of Multifunction device drivers
# CONFIG_REGULATOR is not set
# CONFIG_RC_CORE is not set
# CONFIG_MEDIA_SUPPORT is not set
#
# Graphics support
#
# CONFIG_DRM is not set
# CONFIG_DRM_DP_CEC is not set
#
# ARM devices
#
# end of ARM devices
#
# ACP (Audio CoProcessor) Configuration
#
# end of ACP (Audio CoProcessor) Configuration
#
# Frame buffer Devices
#CONFIG_FB_CMDLINE=yCONFIG_FB_NOTIFY=yCONFIG_FB=y
# CONFIG_FIRMWARE_EDID is not set
# CONFIG_FB_FOREIGN_ENDIAN is not set
# CONFIG_FB_MODE_HELPERS is not set
# CONFIG_FB_TILEBLITTING is not set
#
# Frame buffer hardware drivers
#
# CONFIG_FB_CIRRUS is not set
# CONFIG_FB_PM2 is not set
# CONFIG_FB_CYBER2000 is not set
# CONFIG_FB_ASILIANT is not set
# CONFIG_FB_IMSTT is not set
# CONFIG_FB_UVESA is not set
# CONFIG_FB_OPENCORES is not set
# CONFIG_FB_S1D13XXX is not set
# CONFIG_FB_NVIDIA is not set
# CONFIG_FB_RIVA is not set
# CONFIG_FB_I740 is not set
# CONFIG_FB_MATROX is not set
# CONFIG_FB_RADEON is not set
# CONFIG_FB_ATY128 is not set
# CONFIG_FB_ATY is not set
# CONFIG_FB_S3 is not set
# CONFIG_FB_SAVAGE is not set
# CONFIG_FB_SIS is not set
# CONFIG_FB_NEOMAGIC is not set
# CONFIG_FB_KYRO is not set
# CONFIG_FB_3DFX is not set
# CONFIG_FB_VOODOO1 is not set
# CONFIG_FB_VT8623 is not set
# CONFIG_FB_TRIDENT is not set
# CONFIG_FB_ARK is not set
# CONFIG_FB_PM3 is not set
# CONFIG_FB_CARMINE is not set
# CONFIG_FB_IBM_GXT4500 is not set
# CONFIG_FB_VIRTUAL is not set
# CONFIG_FB_METRONOME is not set
# CONFIG_FB_MB862XX is not set
# CONFIG_FB_SIMPLE is not set
# CONFIG_FB_SM712 is not set
# end of Frame buffer Devices
#
# Backlight & LCD device support
#
# CONFIG_LCD_CLASS_DEVICE is not set
# CONFIG_BACKLIGHT_CLASS_DEVICE is not set
# end of Backlight & LCD device support
#
# Console display driver support
#CONFIG_DUMMY_CONSOLE=y CONFIG_DUMMY_CONSOLE_COLUMNS=80 CONFIG_DUMMY_CONSOLE_ROWS=25 CONFIG_FRAMEBUFFER_CONSOLE=y CONFIG_FRAMEBUFFER_CONSOLE_DETECT_PRIMARY=y
# CONFIG_FRAMEBUFFER_CONSOLE_ROTATION is not set # CONFIG_FRAMEBUFFER_CONSOLE_DEFERRED_TAKEOVER is not set
# end of Console display driver support
# CONFIG_LOGO is not set
# end of Graphics support
# CONFIG_SOUND is not set
#
# HID support
#
# CONFIG_HID is not set
# end of HID support
CONFIG_USB_OHCI_LITTLE_ENDIAN=y
# CONFIG_USB_SUPPORT is not set
# CONFIG_MMC is not set
# CONFIG_MEMSTICK is not set
# CONFIG_NEW_LEDS is not set
# CONFIG_ACCESSIBILITY is not set CONFIG_INFINIBAND=m
# CONFIG_INFINIBAND_USER_MAD is not set CONFIG_INFINIBAND_USER_ACCESS=m
# CONFIG_INFINIBAND_EXP_LEGACY_VERBS_NEW_UAPI is not set CONFIG_INFINIBAND_USER_MEM=y CONFIG_INFINIBAND_ON_DEMAND_PAGING=y CONFIG_INFINIBAND_ADDR_TRANS=y CONFIG_INFINIBAND_ADDR_TRANS_CONFIGFS=y
# CONFIG_INFINIBAND_MTHCA is not set CONFIG_MLX4_INFINIBAND=m CONFIG_MLX5_INFINIBAND=m
# CONFIG_INFINIBAND_OCRDMA is not set
# CONFIG_RDMA_RXE is not set
# CONFIG_RDMA_SIW is not set
# CONFIG_INFINIBAND_IPOIB is not set
# CONFIG_INFINIBAND_SRP is not set
# CONFIG_INFINIBAND_ISER is not set
# CONFIG_DMADEVICES is not set
#
# DMABUF options
#CONFIG_SYNC_FILE=y
# CONFIG_SW_SYNC is not set
# CONFIG_UDMABUF is not set
# CONFIG_DMABUF_SELFTESTS is not set
# end of DMABUF options
# CONFIG_AUXDISPLAY is not set
# CONFIG_UIO is not setCONFIG_VFIO_IOMMU_TYPE1=mCONFIG_VFIO_VIRQFD=mCONFIG_VFIO=m
# CONFIG_VFIO_NOIOMMU is not setCONFIG_VFIO_PCI=mCONFIG_VFIO_MDEV=mCONFIG_VFIO_MDEV_DEVICE=mCONFIG_IRQ_BYPASS_MANAGER=m
# CONFIG_VIRT_DRIVERS is not setCONFIG_VIRTIO=yCONFIG_VIRTIO_MENU=yCONFIG_VIRTIO_PCI=mCONFIG_VIRTIO_PCI_LEGACY=yCONFIG_VIRTIO_BALLOON=mCONFIG_VIRTIO_INPUT=y
# CONFIG_VIRTIO_MMIO is not set
#
# Microsoft Hyper-V guest support
#
# end of Microsoft Hyper-V guest support
# CONFIG_GREYBUS is not set
# CONFIG_STAGING is not set
# CONFIG_GOLDFISH is not set
# CONFIG_HWSPINLOCK is not set
#
# Clock Source drivers
#
# end of Clock Source drivers
# CONFIG_MAILBOX is not setCONFIG_IOMMU_API=yCONFIG_IOMMU_SUPPORT=y
#
# Generic IOMMU Pagetable Support
#
# end of Generic IOMMU Pagetable Support
# CONFIG_IOMMU_DEBUGFS is not set
# CONFIG_IOMMU_DEFAULT_PASSTHROUGH is not setCONFIG_S390_IOMMU=yCONFIG_S390_CCW_IOMMU=yCONFIG_S390_AP_IOMMU=y
#
# Remoteproc drivers
#
# CONFIG_REMOTEPROC is not set
# end of Remoteproc drivers
#
# Rpmsg drivers
#
# CONFIG_RPMSG_VIRTIO is not set
# end of Rpmsg drivers
#
# SOC (System On Chip) specific Drivers
#
#
# Amlogic SoC drivers
#
# end of Amlogic SoC drivers
#
# Aspeed SoC drivers
#
# end of Aspeed SoC drivers
#
# Broadcom SoC drivers
#
# end of Broadcom SoC drivers
#
# NXP/Freescale QorIQ SoC drivers
#
# end of NXP/Freescale QorIQ SoC drivers
#
# i.MX SoC drivers
#
# end of i.MX SoC drivers
#
# Qualcomm SoC drivers
#
# end of Qualcomm SoC drivers
# CONFIG_SOC_TI is not set
#
# Xilinx SoC drivers
#
# CONFIG_XILINX_VCU is not set
# end of Xilinx SoC drivers # end of SOC (System On Chip) specific Drivers
# CONFIG_PM_DEVFREQ is not set
# CONFIG_EXTCON is not set
# CONFIG_MEMORY is not set
# CONFIG_IIO is not set
# CONFIG_NTB is not set
# CONFIG_VME_BUS is not set
# CONFIG_PWM is not set
#
# IRQ chip support
#
# end of IRQ chip support
# CONFIG_IPACK_BUS is not set
# CONFIG_RESET_CONTROLLER is not set
#
# PHY Subsystem
#
# CONFIG_GENERIC_PHY is not set
# CONFIG_BCM_KONA_USB2_PHY is not set
# CONFIG_PHY_PXA_28NM_HSIC is not set
# CONFIG_PHY_PXA_28NM_USB2 is not set
# end of PHY Subsystem
# CONFIG_POWERCAP is not set
# CONFIG_MCB is not set
#
# Performance monitor support
#
# end of Performance monitor support
# CONFIG_RAS is not set
#
# Android
#
# CONFIG_ANDROID is not set
# end of Android
# CONFIG_LIBNVDIMM is not setCONFIG_DAX_DRIVER=yCONFIG_DAX=y
# CONFIG_DEV_DAX is not set
# CONFIG_NVMEM is not set
#
# HW tracing support
#
# CONFIG_STM is not set
# CONFIG_INTEL_TH is not set
# end of HW tracing support
# CONFIG_FPGA is not set
# CONFIG_SIOX is not set
# CONFIG_SLIMBUS is not set
# CONFIG_INTERCONNECT is not set
# CONFIG_COUNTER is not set
# end of Device Drivers
#
# File systems
#
# CONFIG_VALIDATE_FS_PARSER is not setCONFIG_FS_IOMAP=y
# CONFIG_EXT2_FS is not set
# CONFIG_EXT3_FS is not setCONFIG_EXT4_FS=yCONFIG_EXT4_USE_FOR_EXT2=yCONFIG_EXT4_FS_POSIX_ACL=yCONFIG_EXT4_FS_SECURITY=y
# CONFIG_EXT4_DEBUG is not setCONFIG_JBD2=yCONFIG_JBD2_DEBUG=yCONFIG_FS_MBCACHE=y
# CONFIG_REISERFS_FS is not setCONFIG_JFS_FS=mCONFIG_JFS_POSIX_ACL=yCONFIG_JFS_SECURITY=y
# CONFIG_JFS_DEBUG is not setCONFIG_JFS_STATISTICS=yCONFIG_XFS_FS=yCONFIG_XFS_QUOTA=yCONFIG_XFS_POSIX_ACL=yCONFIG_XFS_RT=y
# CONFIG_XFS_ONLINE_SCRUB is not set
# CONFIG_XFS_WARN is not set
# CONFIG_XFS_DEBUG is not setCONFIG_GFS2_FS=mCONFIG_GFS2_FS_LOCKING_DLM=yCONFIG_OCFS2_FS=mCONFIG_OCFS2_FS_O2CB=mCONFIG_OCFS2_FS_USERSPACE_CLUSTER=mCONFIG_OCFS2_FS_STATS=yCONFIG_OCFS2_DEBUG_MASKLOG=y
# CONFIG_OCFS2_DEBUG_FS is not setCONFIG_BTRFS_FS=yCONFIG_BTRFS_FS_POSIX_ACL=y
# CONFIG_BTRFS_FS_CHECK_INTEGRITY is not set
# CONFIG_BTRFS_FS_RUN_SANITY_TESTS is not set
# CONFIG_BTRFS_DEBUG is not set
# CONFIG_BTRFS_ASSERT is not set
# CONFIG_BTRFS_FS_REF_VERIFY is not setCONFIG_NILFS2_FS=m
# CONFIG_F2FS_FS is not setCONFIG_FS_DAX=yCONFIG_FS_DAX_LIMITED=yCONFIG_FS_POSIX_ACL=yCONFIG_EXPORTFS=yCONFIG_EXPORTFS_BLOCK_OPS=yCONFIG_FILE_LOCKING=yCONFIG_MANDATORY_FILE_LOCKING=yCONFIG_FS_ENCRYPTION=yCONFIG_FS_VERITY=y
# CONFIG_FS_VERITY_DEBUG is not setCONFIG_FS_VERITY_BUILTIN_SIGNATURES=yCONFIG_FSNOTIFY=yCONFIG_DNOTIFY=yCONFIG_INOTIFY_USER=yCONFIG_FANOTIFY=yCONFIG_FANOTIFY_ACCESS_PERMISSIONS=yCONFIG_QUOTA=yCONFIG_QUOTA_NETLINK_INTERFACE=yCONFIG_PRINT_QUOTA_WARNING=y
# CONFIG_QUOTA_DEBUG is not setCONFIG_QUOTA_TREE=mCONFIG_QFMT_V1=mCONFIG_QFMT_V2=mCONFIG_QUOTACTL=yCONFIG_AUTOFS4_FS=mCONFIG_AUTOFS_FS=mCONFIG_FUSE_FS=yCONFIG_CUSE=mCONFIG_VIRTIO_FS=mCONFIG_OVERLAY_FS=m
# CONFIG_OVERLAY_FS_REDIRECT_DIR is not setCONFIG_OVERLAY_FS_REDIRECT_ALWAYS_FOLLOW=y
# CONFIG_OVERLAY_FS_INDEX is not set
# CONFIG_OVERLAY_FS_XINO_AUTO is not set
# CONFIG_OVERLAY_FS_METACOPY is not set
#
# Caches
#CONFIG_FSCACHE=m
# CONFIG_FSCACHE_STATS is not set
# CONFIG_FSCACHE_HISTOGRAM is not set
# CONFIG_FSCACHE_DEBUG is not set
# CONFIG_FSCACHE_OBJECT_LIST is not setCONFIG_CACHEFILES=m
# CONFIG_CACHEFILES_DEBUG is not set
# CONFIG_CACHEFILES_HISTOGRAM is not set
# end of Caches
#
# CD-ROM/DVD Filesystems
#CONFIG_ISO9660_FS=yCONFIG_JOLIET=yCONFIG_ZISOFS=yCONFIG_UDF_FS=m
# end of CD-ROM/DVD Filesystems
#
# DOS/FAT/NT Filesystems
#CONFIG_FAT_FS=mCONFIG_MSDOS_FS=mCONFIG_VFAT_FS=mCONFIG_FAT_DEFAULT_CODEPAGE=437CONFIG_FAT_DEFAULT_IOCHARSET="iso8859-1"
# CONFIG_FAT_DEFAULT_UTF8 is not setCONFIG_NTFS_FS=m
# CONFIG_NTFS_DEBUG is not setCONFIG_NTFS_RW=y
# end of DOS/FAT/NT Filesystems
#
# Pseudo filesystems
#CONFIG_PROC_FS=yCONFIG_PROC_KCORE=yCONFIG_PROC_VMCORE=y
# CONFIG_PROC_VMCORE_DEVICE_DUMP is not setCONFIG_PROC_SYSCTL=yCONFIG_PROC_PAGE_MONITOR=yCONFIG_PROC_CHILDREN=yCONFIG_KERNFS=yCONFIG_SYSFS=yCONFIG_TMPFS=yCONFIG_TMPFS_POSIX_ACL=yCONFIG_TMPFS_XATTR=yCONFIG_HUGETLBFS=yCONFIG_HUGETLB_PAGE=yCONFIG_MEMFD_CREATE=yCONFIG_ARCH_HAS_GIGANTIC_PAGE=yCONFIG_CONFIGFS_FS=m
# end of Pseudo filesystems
CONFIG_MISC_FILESYSTEMS=y
# CONFIG_ORANGEFS_FS is not set
# CONFIG_ADFS_FS is not set
# CONFIG_AFFS_FS is not set CONFIG_ECRYPT_FS=m
# CONFIG_ECRYPT_FS_MESSAGING is not set
# CONFIG_HFS_FS is not set
# CONFIG_HFSPLUS_FS is not set
# CONFIG_BEFS_FS is not set
# CONFIG_BFS_FS is not set
# CONFIG_EFS_FS is not setCONFIG_CRAMFS=mCONFIG_CRAMFS_BLOCKDEV=yCONFIG_SQUASHFS=m CONFIG_SQUASHFS_FILE_CACHE=y
# CONFIG_SQUASHFS_FILE_DIRECT is not set CONFIG_SQUASHFS_DECOMP_SINGLE=y
# CONFIG_SQUASHFS_DECOMP_MULTI is not set
# CONFIG_SQUASHFS_DECOMP_MULTI_PERCPU is not set CONFIG_SQUASHFS_XATTR=y CONFIG_SQUASHFS_ZLIB=yCONFIG_SQUASHFS_LZ4=yCONFIG_SQUASHFS_LZO=yCONFIG_SQUASHFS_XZ=yCONFIG_SQUASHFS_ZSTD=y
# CONFIG_SQUASHFS_4K_DEVBLK_SIZE is not set # CONFIG_SQUASHFS_EMBEDDED is not set CONFIG_SQUASHFS_FRAGMENT_CACHE_SIZE=3
# CONFIG_VXFS_FS is not set
# CONFIG_MINIX_FS is not set
# CONFIG_OMFS_FS is not set
# CONFIG_HPFS_FS is not set
# CONFIG_QNX4FS_FS is not set
# CONFIG_QNX6FS_FS is not set CONFIG_ROMFS_FS=m CONFIG_ROMFS_BACKED_BY_BLOCK=y CONFIG_ROMFS_ON_BLOCK=y
# CONFIG_PSTORE is not set
# CONFIG_SYSV_FS is not set
# CONFIG_UFS_FS is not set
# CONFIG_EROFS_FS is not set CONFIG_NETWORK_FILESYSTEMS=yCONFIG_NFS_FS=mCONFIG_NFS_V2=mCONFIG_NFS_V3=mCONFIG_NFS_V3_ACL=yCONFIG_NFS_V4=mCONFIG_NFS_SWAP=y
# CONFIG_NFS_V4_1 is not set
# CONFIG_NFS_FSCACHE is not set
# CONFIG_NFS_USE_LEGACY_DNS is not set CONFIG_NFS_USE_KERNEL_DNS=yCONFIG_NFSD=mCONFIG_NFSD_V2_ACL=yCONFIG_NFSD_V3=yCONFIG_NFSD_V3_ACL=yCONFIG_NFSD_V4=y
# CONFIG_NFSD_BLOCKLAYOUT is not set
# CONFIG_NFSD_SCSILAYOUT is not set
# CONFIG_NFSD_FLEXFILELAYOUT is not set CONFIG_NFSD_V4_SECURITY_LABEL=y CONFIG_GRACE_PERIOD=mCONFIG_LOCKD=mCONFIG_LOCKD_V4=yCONFIG_NFS_ACL_SUPPORT=mCONFIG_NFS_COMMON=yCONFIG_SUNRPC=mCONFIG_SUNRPC_GSS=mCONFIG_SUNRPC_SWAP=y CONFIG_RPCSEC_GSS_KRB5=m
# CONFIG_SUNRPC_DISABLE_INSECURE_ENCTYPES is not set # CONFIG_SUNRPC_DEBUG is not set CONFIG_SUNRPC_XPRT_RDMA=m
# CONFIG_CEPH_FS is not setCONFIG_CIFS=mCONFIG_CIFS_STATS2=y CONFIG_CIFS_ALLOW_INSECURE_LEGACY=y CONFIG_CIFS_WEAK_PW_HASH=y CONFIG_CIFS_UPCALL=yCONFIG_CIFS_XATTR=yCONFIG_CIFS_POSIX=y
# CONFIG_CIFS_DEBUG is not set CONFIG_CIFS_DFS_UPCALL=y
# CONFIG_CIFS_SMB_DIRECT is not set
# CONFIG_CIFS_FSCACHE is not set
# CONFIG_CODA_FS is not set
# CONFIG_AFS_FS is not setCONFIG_NLS=yCONFIG_NLS_DEFAULT="utf8" CONFIG_NLS_CODEPAGE_437=m
# CONFIG_NLS_CODEPAGE_737 is not set
# CONFIG_NLS_CODEPAGE_775 is not set CONFIG_NLS_CODEPAGE_850=m
# CONFIG_NLS_CODEPAGE_852 is not set
# CONFIG_NLS_CODEPAGE_855 is not set
# CONFIG_NLS_CODEPAGE_857 is not set
# CONFIG_NLS_CODEPAGE_860 is not set
# CONFIG_NLS_CODEPAGE_861 is not set
# CONFIG_NLS_CODEPAGE_862 is not set
# CONFIG_NLS_CODEPAGE_863 is not set
# CONFIG_NLS_CODEPAGE_864 is not set
# CONFIG_NLS_CODEPAGE_865 is not set
# CONFIG_NLS_CODEPAGE_866 is not set
# CONFIG_NLS_CODEPAGE_869 is not set
# CONFIG_NLS_CODEPAGE_936 is not set
# CONFIG_NLS_CODEPAGE_950 is not set
# CONFIG_NLS_CODEPAGE_932 is not set
# CONFIG_NLS_CODEPAGE_949 is not set
# CONFIG_NLS_CODEPAGE_874 is not set
# CONFIG_NLS_ISO8859_8 is not set
# CONFIG_NLS_CODEPAGE_1250 is not set
# CONFIG_NLS_CODEPAGE_1251 is not set CONFIG_NLS_ASCII=mCONFIG_NLS_ISO8859_1=m
# CONFIG_NLS_ISO8859_2 is not set
# CONFIG_NLS_ISO8859_3 is not set
# CONFIG_NLS_ISO8859_4 is not set
# CONFIG_NLS_ISO8859_5 is not set
# CONFIG_NLS_ISO8859_6 is not set
# CONFIG_NLS_ISO8859_7 is not set
# CONFIG_NLS_ISO8859_9 is not set
# CONFIG_NLS_ISO8859_13 is not set
# CONFIG_NLS_ISO8859_14 is not set CONFIG_NLS_ISO8859_15=m
# CONFIG_NLS_KOI8_R is not set
# CONFIG_NLS_KOI8_U is not set
# CONFIG_NLS_MAC_ROMAN is not set
# CONFIG_NLS_MAC_CELTIC is not set
# CONFIG_NLS_MAC_CENTEURO is not set
# CONFIG_NLS_MAC_CROATIAN is not set
# CONFIG_NLS_MAC_CYRILLIC is not set
# CONFIG_NLS_MAC_GAELIC is not set
# CONFIG_NLS_MAC_GREEK is not set
# CONFIG_NLS_MAC_ICELAND is not set
# CONFIG_NLS_MAC_INUIT is not set
# CONFIG_NLS_MAC_ROMANIAN is not set
# CONFIG_NLS_MAC_TURKISH is not set CONFIG_NLS_UTF8=mCONFIG_DLM=m
# CONFIG_DLM_DEBUG is not set CONFIG_UNICODE=y
# CONFIG_UNICODE_NORMALIZATION_SELFTEST is not set CONFIG_IO_WQ=y
# end of File systems
#
# Security options
#CONFIG_KEYS=yCONFIG_KEYS_COMPAT=y
# CONFIG_KEYS_REQUEST_CACHE is not set CONFIG_PERSISTENT_KEYRINGS=yCONFIG_BIG_KEYS=y
# CONFIG_TRUSTED_KEYS is not setCONFIG_ENCRYPTED_KEYS=m
# CONFIG_KEY_DH_OPERATIONS is not set
# CONFIG_SECURITY_DMESG_RESTRICT is not setCONFIG_SECURITY=yCONFIG_SECURITY_WRITABLE_HOOKS=yCONFIG_SECURITYFS=yCONFIG_SECURITY_NETWORK=y
# CONFIG_SECURITY_INFINIBAND is not set
# CONFIG_SECURITY_NETWORK_XFRM is not set
# CONFIG_SECURITY_PATH is not set CONFIG_LSM_MMAP_MIN_ADDR=65536 CONFIG_HAVE_HARDENED_USERCOPY_ALLOCATOR=y
# CONFIG_HARDENED_USERCOPY is not set
# CONFIG_FORTIFY_SOURCE is not set
# CONFIG_STATIC_USERMODEHELPER is not set CONFIG_SECURITY_SELINUX=yCONFIG_SECURITY_SELINUX_BOOTPARAM=y CONFIG_SECURITY_SELINUX_DISABLE=y CONFIG_SECURITY_SELINUX_DEVELOP=y CONFIG_SECURITY_SELINUX_AVC_STATS=y CONFIG_SECURITY_SELINUX_CHECKREQPROT_VALUE=0
# CONFIG_SECURITY_SMACK is not set
# CONFIG_SECURITY_TOMOYO is not set
# CONFIG_SECURITY_APPARMOR is not set
# CONFIG_SECURITY_LOADPIN is not set
# CONFIG_SECURITY_YAMA is not set
# CONFIG_SECURITY_SAFESETID is not set CONFIG_SECURITY_LOCKDOWN_LSM=y CONFIG_SECURITY_LOCKDOWN_LSM_EARLY=y CONFIG_LOCK_DOWN_KERNEL_FORCE_NONE=y
# CONFIG_LOCK_DOWN_KERNEL_FORCE_INTEGRITY is not set
# CONFIG_LOCK_DOWN_KERNEL_FORCE_CONFIDENTIALITY is not set CONFIG_INTEGRITY=yCONFIG_INTEGRITY_SIGNATURE=yCONFIG_INTEGRITY_ASYMMETRIC_KEYS=y CONFIG_INTEGRITY_TRUSTED_KEYRING=yCONFIG_INTEGRITY_AUDIT=yCONFIG_IMA=yCONFIG_IMA_MEASURE_PCR_IDX=10CONFIG_IMA_LSM_RULES=y
# CONFIG_IMA_TEMPLATE is not setCONFIG_IMA_NG_TEMPLATE=y
# CONFIG_IMA_SIG_TEMPLATE is not set CONFIG_IMA_DEFAULT_TEMPLATE="ima-ng"
# CONFIG_IMA_DEFAULT_HASH_SHA1 is not set CONFIG_IMA_DEFAULT_HASH_SHA256=y
# CONFIG_IMA_DEFAULT_HASH_SHA512 is not set CONFIG_IMA_DEFAULT_HASH="sha256"CONFIG_IMA_WRITE_POLICY=yCONFIG_IMA_READ_POLICY=yCONFIG_IMA_APPRAISE=y
# CONFIG_IMA_ARCH_POLICY is not set
# CONFIG_IMA_APPRAISE_BUILD_POLICY is not set CONFIG_IMA_APPRAISE_BOOTPARAM=y
# CONFIG_IMA_APPRAISE_MODSIG is not set CONFIG_IMA_TRUSTED_KEYRING=y
# CONFIG_IMA_BLACKLIST_KEYRING is not set
# CONFIG_IMA_LOAD_X509 is not set
# CONFIG_EVM is not setCONFIG_DEFAULT_SECURITY_SELINUX=y
# CONFIG_DEFAULT_SECURITY_DAC is not set CONFIG_LSM="yama,loadpin,safesetid,integrity,selinux,smack,tomoyo,apparmor"
#
# Kernel hardening options
#
#
# Memory initialization
#CONFIG_INIT_STACK_NONE=y
# CONFIG_GCC_PLUGIN_STRUCTLEAK_USER is not set # CONFIG_GCC_PLUGIN_STRUCTLEAK_BYREF is not set # CONFIG_GCC_PLUGIN_STRUCTLEAK_BYREF_ALL is not set # CONFIG_INIT_ON_ALLOC_DEFAULT_ON is not set # CONFIG_INIT_ON_FREE_DEFAULT_ON is not set
# end of Memory initialization # end of Kernel hardening options # end of Security options
CONFIG_XOR_BLOCKS=yCONFIG_ASYNC_CORE=mCONFIG_ASYNC_MEMCPY=mCONFIG_ASYNC_XOR=mCONFIG_ASYNC_PQ=mCONFIG_ASYNC_RAID6_RECOV=mCONFIG_CRYPTO=y
#
# Crypto core or helper
#CONFIG_CRYPTO_FIPS=yCONFIG_CRYPTO_ALGAPI=yCONFIG_CRYPTO_ALGAPI2=yCONFIG_CRYPTO_AEAD=yCONFIG_CRYPTO_AEAD2=yCONFIG_CRYPTO_SKCIPHER=yCONFIG_CRYPTO_SKCIPHER2=yCONFIG_CRYPTO_HASH=yCONFIG_CRYPTO_HASH2=yCONFIG_CRYPTO_RNG=yCONFIG_CRYPTO_RNG2=yCONFIG_CRYPTO_RNG_DEFAULT=yCONFIG_CRYPTO_AKCIPHER2=yCONFIG_CRYPTO_AKCIPHER=yCONFIG_CRYPTO_KPP2=yCONFIG_CRYPTO_KPP=mCONFIG_CRYPTO_ACOMP2=yCONFIG_CRYPTO_MANAGER=yCONFIG_CRYPTO_MANAGER2=yCONFIG_CRYPTO_USER=m
# CONFIG_CRYPTO_MANAGER_DISABLE_TESTS is not set
# CONFIG_CRYPTO_MANAGER_EXTRA_TESTS is not setCONFIG_CRYPTO_GF128MUL=yCONFIG_CRYPTO_NULL=yCONFIG_CRYPTO_NULL2=yCONFIG_CRYPTO_PCRYPT=mCONFIG_CRYPTO_CRYPTD=mCONFIG_CRYPTO_AUTHENC=mCONFIG_CRYPTO_TEST=mCONFIG_CRYPTO_ENGINE=m
#
# Public-key cryptography
#CONFIG_CRYPTO_RSA=yCONFIG_CRYPTO_DH=mCONFIG_CRYPTO_ECC=mCONFIG_CRYPTO_ECDH=mCONFIG_CRYPTO_ECRDSA=m
# CONFIG_CRYPTO_CURVE25519 is not set
#
# Authenticated Encryption with Associated Data
#CONFIG_CRYPTO_CCM=mCONFIG_CRYPTO_GCM=yCONFIG_CRYPTO_CHACHA20POLY1305=mCONFIG_CRYPTO_AEGIS128=mCONFIG_CRYPTO_SEQIV=yCONFIG_CRYPTO_ECHAINIV=m
#
# Block modes
#CONFIG_CRYPTO_CBC=yCONFIG_CRYPTO_CFB=mCONFIG_CRYPTO_CTR=yCONFIG_CRYPTO_CTS=yCONFIG_CRYPTO_ECB=yCONFIG_CRYPTO_LRW=mCONFIG_CRYPTO_OFB=mCONFIG_CRYPTO_PCBC=mCONFIG_CRYPTO_XTS=yCONFIG_CRYPTO_KEYWRAP=mCONFIG_CRYPTO_NHPOLY1305=mCONFIG_CRYPTO_ADIANTUM=mCONFIG_CRYPTO_ESSIV=m
#
# Hash modes
#CONFIG_CRYPTO_CMAC=mCONFIG_CRYPTO_HMAC=yCONFIG_CRYPTO_XCBC=mCONFIG_CRYPTO_VMAC=m
#
# Digest
#CONFIG_CRYPTO_CRC32C=yCONFIG_CRYPTO_CRC32=mCONFIG_CRYPTO_XXHASH=y
# CONFIG_CRYPTO_BLAKE2B is not set
# CONFIG_CRYPTO_BLAKE2S is not setCONFIG_CRYPTO_CRCT10DIF=yCONFIG_CRYPTO_GHASH=yCONFIG_CRYPTO_POLY1305=mCONFIG_CRYPTO_MD4=mCONFIG_CRYPTO_MD5=yCONFIG_CRYPTO_MICHAEL_MIC=mCONFIG_CRYPTO_RMD128=mCONFIG_CRYPTO_RMD160=mCONFIG_CRYPTO_RMD256=mCONFIG_CRYPTO_RMD320=mCONFIG_CRYPTO_SHA1=yCONFIG_CRYPTO_SHA256=yCONFIG_CRYPTO_SHA512=yCONFIG_CRYPTO_SHA3=mCONFIG_CRYPTO_SM3=mCONFIG_CRYPTO_STREEBOG=mCONFIG_CRYPTO_TGR192=mCONFIG_CRYPTO_WP512=m
#
# Ciphers
#CONFIG_CRYPTO_AES=yCONFIG_CRYPTO_AES_TI=mCONFIG_CRYPTO_ANUBIS=mCONFIG_CRYPTO_ARC4=mCONFIG_CRYPTO_BLOWFISH=mCONFIG_CRYPTO_BLOWFISH_COMMON=mCONFIG_CRYPTO_CAMELLIA=mCONFIG_CRYPTO_CAST_COMMON=mCONFIG_CRYPTO_CAST5=mCONFIG_CRYPTO_CAST6=mCONFIG_CRYPTO_DES=mCONFIG_CRYPTO_FCRYPT=mCONFIG_CRYPTO_KHAZAD=mCONFIG_CRYPTO_SALSA20=mCONFIG_CRYPTO_CHACHA20=mCONFIG_CRYPTO_SEED=mCONFIG_CRYPTO_SERPENT=mCONFIG_CRYPTO_SM4=mCONFIG_CRYPTO_TEA=mCONFIG_CRYPTO_TWOFISH=mCONFIG_CRYPTO_TWOFISH_COMMON=m
#
# Compression
#CONFIG_CRYPTO_DEFLATE=mCONFIG_CRYPTO_LZO=yCONFIG_CRYPTO_842=mCONFIG_CRYPTO_LZ4=mCONFIG_CRYPTO_LZ4HC=mCONFIG_CRYPTO_ZSTD=m
#
# Random Number Generation
#CONFIG_CRYPTO_ANSI_CPRNG=mCONFIG_CRYPTO_DRBG_MENU=yCONFIG_CRYPTO_DRBG_HMAC=y
# CONFIG_CRYPTO_DRBG_HASH is not set
# CONFIG_CRYPTO_DRBG_CTR is not setCONFIG_CRYPTO_DRBG=yCONFIG_CRYPTO_JITTERENTROPY=yCONFIG_CRYPTO_USER_API=mCONFIG_CRYPTO_USER_API_HASH=mCONFIG_CRYPTO_USER_API_SKCIPHER=mCONFIG_CRYPTO_USER_API_RNG=mCONFIG_CRYPTO_USER_API_AEAD=mCONFIG_CRYPTO_STATS=yCONFIG_CRYPTO_HASH_INFO=y
#
# Crypto library routines
#CONFIG_CRYPTO_LIB_AES=yCONFIG_CRYPTO_LIB_ARC4=m
# CONFIG_CRYPTO_LIB_BLAKE2S is not setCONFIG_CRYPTO_LIB_CHACHA_GENERIC=m
# CONFIG_CRYPTO_LIB_CHACHA is not set
# CONFIG_CRYPTO_LIB_CURVE25519 is not setCONFIG_CRYPTO_LIB_DES=mCONFIG_CRYPTO_LIB_POLY1305_RSIZE=1CONFIG_CRYPTO_LIB_POLY1305_GENERIC=m
# CONFIG_CRYPTO_LIB_POLY1305 is not set
# CONFIG_CRYPTO_LIB_CHACHA20POLY1305 is not setCONFIG_CRYPTO_LIB_SHA256=yCONFIG_CRYPTO_HW=yCONFIG_ZCRYPT=mCONFIG_ZCRYPT_MULTIDEVNODES=yCONFIG_PKEY=mCONFIG_CRYPTO_PAES_S390=mCONFIG_CRYPTO_SHA1_S390=mCONFIG_CRYPTO_SHA256_S390=mCONFIG_CRYPTO_SHA512_S390=mCONFIG_CRYPTO_SHA3_256_S390=mCONFIG_CRYPTO_SHA3_512_S390=mCONFIG_CRYPTO_DES_S390=mCONFIG_CRYPTO_AES_S390=mCONFIG_S390_PRNG=mCONFIG_CRYPTO_GHASH_S390=mCONFIG_CRYPTO_CRC32_S390=y
# CONFIG_CRYPTO_DEV_NITROX_CNN55XX is not setCONFIG_CRYPTO_DEV_VIRTIO=m
# CONFIG_CRYPTO_DEV_SAFEXCEL is not set
# CONFIG_CRYPTO_DEV_AMLOGIC_GXL is not setCONFIG_ASYMMETRIC_KEY_TYPE=yCONFIG_ASYMMETRIC_PUBLIC_KEY_SUBTYPE=yCONFIG_X509_CERTIFICATE_PARSER=y
# CONFIG_PKCS8_PRIVATE_KEY_PARSER is not setCONFIG_PKCS7_MESSAGE_PARSER=y
# CONFIG_PKCS7_TEST_KEY is not set
# CONFIG_SIGNED_PE_FILE_VERIFICATION is not set
#
# Certificates for signature checking
#CONFIG_MODULE_SIG_KEY="certs/signing_key.pem"CONFIG_SYSTEM_TRUSTED_KEYRING=yCONFIG_SYSTEM_TRUSTED_KEYS=""
# CONFIG_SYSTEM_EXTRA_CERTIFICATE is not set
# CONFIG_SECONDARY_TRUSTED_KEYRING is not set
# CONFIG_SYSTEM_BLACKLIST_KEYRING is not set
# end of Certificates for signature checking
CONFIG_BINARY_PRINTF=y
#
# Library routines
#CONFIG_RAID6_PQ=yCONFIG_RAID6_PQ_BENCHMARK=y
# CONFIG_PACKING is not setCONFIG_BITREVERSE=yCONFIG_GENERIC_NET_UTILS=yCONFIG_GENERIC_FIND_FIRST_BIT=yCONFIG_CORDIC=mCONFIG_ARCH_USE_CMPXCHG_LOCKREF=yCONFIG_CRC_CCITT=mCONFIG_CRC16=yCONFIG_CRC_T10DIF=yCONFIG_CRC_ITU_T=mCONFIG_CRC32=y
# CONFIG_CRC32_SELFTEST is not setCONFIG_CRC32_SLICEBY8=y
# CONFIG_CRC32_SLICEBY4 is not set
# CONFIG_CRC32_SARWATE is not set
# CONFIG_CRC32_BIT is not setCONFIG_CRC64=mCONFIG_CRC4=mCONFIG_CRC7=mCONFIG_LIBCRC32C=yCONFIG_CRC8=mCONFIG_XXHASH=y
# CONFIG_RANDOM32_SELFTEST is not setCONFIG_842_COMPRESS=mCONFIG_842_DECOMPRESS=mCONFIG_ZLIB_INFLATE=yCONFIG_ZLIB_DEFLATE=yCONFIG_LZO_COMPRESS=yCONFIG_LZO_DECOMPRESS=yCONFIG_LZ4_COMPRESS=mCONFIG_LZ4HC_COMPRESS=mCONFIG_LZ4_DECOMPRESS=yCONFIG_ZSTD_COMPRESS=yCONFIG_ZSTD_DECOMPRESS=yCONFIG_XZ_DEC=yCONFIG_XZ_DEC_X86=yCONFIG_XZ_DEC_POWERPC=yCONFIG_XZ_DEC_IA64=yCONFIG_XZ_DEC_ARM=yCONFIG_XZ_DEC_ARMTHUMB=yCONFIG_XZ_DEC_SPARC=yCONFIG_XZ_DEC_BCJ=y
# CONFIG_XZ_DEC_TEST is not setCONFIG_DECOMPRESS_GZIP=yCONFIG_DECOMPRESS_BZIP2=yCONFIG_DECOMPRESS_LZMA=yCONFIG_DECOMPRESS_XZ=yCONFIG_DECOMPRESS_LZO=yCONFIG_DECOMPRESS_LZ4=yCONFIG_GENERIC_ALLOCATOR=yCONFIG_TEXTSEARCH=yCONFIG_TEXTSEARCH_KMP=mCONFIG_TEXTSEARCH_BM=mCONFIG_TEXTSEARCH_FSM=mCONFIG_INTERVAL_TREE=yCONFIG_XARRAY_MULTI=yCONFIG_ASSOCIATIVE_ARRAY=yCONFIG_HAS_DMA=yCONFIG_NEED_SG_DMA_LENGTH=yCONFIG_NEED_DMA_MAP_STATE=yCONFIG_ARCH_DMA_ADDR_T_64BIT=yCONFIG_ARCH_HAS_FORCE_DMA_UNENCRYPTED=yCONFIG_SWIOTLB=yCONFIG_DMA_CMA=y
#
# Default contiguous memory area size:
#CONFIG_CMA_SIZE_MBYTES=0CONFIG_CMA_SIZE_SEL_MBYTES=y
# CONFIG_CMA_SIZE_SEL_PERCENTAGE is not set
# CONFIG_CMA_SIZE_SEL_MIN is not set
# CONFIG_CMA_SIZE_SEL_MAX is not setCONFIG_CMA_ALIGNMENT=8
# CONFIG_DMA_API_DEBUG is not setCONFIG_SGL_ALLOC=yCONFIG_IOMMU_HELPER=yCONFIG_CPU_RMAP=yCONFIG_DQL=yCONFIG_GLOB=y
# CONFIG_GLOB_SELFTEST is not setCONFIG_NLATTR=yCONFIG_LRU_CACHE=mCONFIG_CLZ_TAB=yCONFIG_IRQ_POLL=yCONFIG_MPILIB=yCONFIG_SIGNATURE=yCONFIG_DIMLIB=yCONFIG_OID_REGISTRY=yCONFIG_FONT_SUPPORT=y
# CONFIG_FONTS is not set
CONFIG_FONT_8x8=y
CONFIG_FONT_8x16=yCONFIG_SG_POOL=yCONFIG_ARCH_STACKWALK=yCONFIG_SBITMAP=y
# CONFIG_STRING_SELFTEST is not set
# end of Library routines
#
# Kernel hacking
#
#
# printk and dmesg options # CONFIG_PRINTK_TIME=y # CONFIG_PRINTK_CALLER is not set CONFIG_CONSOLE_LOGLEVEL_DEFAULT=7 CONFIG_CONSOLE_LOGLEVEL_QUIET=4 CONFIG_MESSAGE_LOGLEVEL_DEFAULT=4 # CONFIG_DYNAMIC_DEBUG is not set CONFIG_SYMBOLIC_ERRNAME=y CONFIG_DEBUG_BUGVERBOSE=y # end of printk and dmesg options
#
# Compile-time checks and compiler options
#CONFIG_DEBUG_INFO=y
# CONFIG_DEBUG_INFO_REDUCED is not set
# CONFIG_DEBUG_INFO_SPLIT is not setCONFIG_DEBUG_INFO_DWARF4=y
# CONFIG_DEBUG_INFO_BTF is not setCONFIG_GDB_SCRIPTS=yCONFIG_ENABLE_MUST_CHECK=yCONFIG_FRAME_WARN=1024
# CONFIG_STRIP_ASM_SYMS is not set
# CONFIG_READABLE_ASM is not set
# CONFIG_HEADERS_INSTALL is not setCONFIG_OPTIMIZE_INLINING=yCONFIG_DEBUG_SECTION_MISMATCH=yCONFIG_SECTION_MISMATCH_WARN_ONLY=y
# CONFIG_DEBUG_FORCE_WEAK_PER_CPU is not set
# end of Compile-time checks and compiler options
#
# Generic Kernel Debugging Instruments
#CONFIG_MAGIC_SYSRQ=yCONFIG_MAGIC_SYSRQ_DEFAULT_ENABLE=0x1CONFIG_MAGIC_SYSRQ_SERIAL=yCONFIG_DEBUG_FS=yCONFIG_ARCH_HAS_UBSAN_SANITIZE_ALL=y
# CONFIG_UBSAN is not setCONFIG_UBSAN_ALIGNMENT=y
# end of Generic Kernel Debugging Instruments
CONFIG_DEBUG_KERNEL=yCONFIG_DEBUG_MISC=y
#
# Memory Debugging
#
# CONFIG_PAGE_EXTENSION is not set
# CONFIG_DEBUG_PAGEALLOC is not set
# CONFIG_PAGE_OWNER is not set
# CONFIG_PAGE_POISONING is not set
# CONFIG_DEBUG_PAGE_REF is not set
# CONFIG_DEBUG_RODATA_TEST is not set
# CONFIG_DEBUG_OBJECTS is not set
# CONFIG_SLUB_DEBUG_ON is not set
# CONFIG_SLUB_STATS is not setCONFIG_HAVE_DEBUG_KMEMLEAK=y
# CONFIG_DEBUG_KMEMLEAK is not set
# CONFIG_DEBUG_STACK_USAGE is not set
# CONFIG_SCHED_STACK_END_CHECK is not set
# CONFIG_DEBUG_VM is not setCONFIG_DEBUG_MEMORY_INIT=y
# CONFIG_DEBUG_PER_CPU_MAPS is not setCONFIG_HAVE_ARCH_KASAN=yCONFIG_CC_HAS_KASAN_GENERIC=y
# CONFIG_KASAN is not setCONFIG_KASAN_STACK=1
# end of Memory Debugging
# CONFIG_DEBUG_SHIRQ is not set
#
# Debug Oops, Lockups and Hangs
#CONFIG_PANIC_ON_OOPS=yCONFIG_PANIC_ON_OOPS_VALUE=1CONFIG_PANIC_TIMEOUT=0
# CONFIG_DETECT_HUNG_TASK is not set
# CONFIG_WQ_WATCHDOG is not set
# end of Debug Oops, Lockups and Hangs
#
# Scheduler Debugging
#CONFIG_SCHED_DEBUG=yCONFIG_SCHED_INFO=yCONFIG_SCHEDSTATS=y
# end of Scheduler Debugging
# CONFIG_DEBUG_TIMEKEEPING is not set
#
# Lock Debugging (spinlocks, mutexes, etc...)
#CONFIG_LOCK_DEBUGGING_SUPPORT=y
# CONFIG_PROVE_LOCKING is not set
# CONFIG_LOCK_STAT is not set
# CONFIG_DEBUG_RT_MUTEXES is not set
# CONFIG_DEBUG_SPINLOCK is not set
# CONFIG_DEBUG_MUTEXES is not set
# CONFIG_DEBUG_WW_MUTEX_SLOWPATH is not set
# CONFIG_DEBUG_RWSEMS is not set
# CONFIG_DEBUG_LOCK_ALLOC is not set
# CONFIG_DEBUG_ATOMIC_SLEEP is not set
# CONFIG_DEBUG_LOCKING_API_SELFTESTS is not set
# CONFIG_LOCK_TORTURE_TEST is not set
# CONFIG_WW_MUTEX_SELFTEST is not set
# end of Lock Debugging (spinlocks, mutexes, etc...)
CONFIG_STACKTRACE=y
# CONFIG_WARN_ALL_UNSEEDED_RANDOM is not set
# CONFIG_DEBUG_KOBJECT is not set
#
# Debug kernel data structures
#CONFIG_DEBUG_LIST=y
# CONFIG_DEBUG_PLIST is not set
# CONFIG_DEBUG_SG is not set
# CONFIG_DEBUG_NOTIFIERS is not setCONFIG_BUG_ON_DATA_CORRUPTION=y
# end of Debug kernel data structures
# CONFIG_DEBUG_CREDENTIALS is not set
#
# RCU Debugging
#CONFIG_TORTURE_TEST=m
# CONFIG_RCU_PERF_TEST is not setCONFIG_RCU_TORTURE_TEST=mCONFIG_RCU_CPU_STALL_TIMEOUT=60CONFIG_RCU_TRACE=y
# CONFIG_RCU_EQS_DEBUG is not set
# end of RCU Debugging
# CONFIG_DEBUG_WQ_FORCE_RR_CPU is not set
# CONFIG_DEBUG_BLOCK_EXT_DEVT is not set
# CONFIG_CPU_HOTPLUG_STATE_CONTROL is not setCONFIG_LATENCYTOP=yCONFIG_NOP_TRACER=yCONFIG_HAVE_FUNCTION_TRACER=yCONFIG_HAVE_FUNCTION_GRAPH_TRACER=yCONFIG_HAVE_DYNAMIC_FTRACE=yCONFIG_HAVE_DYNAMIC_FTRACE_WITH_REGS=yCONFIG_HAVE_FTRACE_MCOUNT_RECORD=yCONFIG_HAVE_SYSCALL_TRACEPOINTS=yCONFIG_HAVE_FENTRY=yCONFIG_HAVE_NOP_MCOUNT=yCONFIG_TRACER_MAX_TRACE=yCONFIG_TRACE_CLOCK=yCONFIG_RING_BUFFER=yCONFIG_EVENT_TRACING=yCONFIG_CONTEXT_SWITCH_TRACER=yCONFIG_RING_BUFFER_ALLOW_SWAP=yCONFIG_TRACING=yCONFIG_GENERIC_TRACER=yCONFIG_TRACING_SUPPORT=yCONFIG_FTRACE=yCONFIG_FUNCTION_TRACER=yCONFIG_FUNCTION_GRAPH_TRACER=y
# CONFIG_PREEMPTIRQ_EVENTS is not set
# CONFIG_IRQSOFF_TRACER is not setCONFIG_SCHED_TRACER=y
# CONFIG_HWLAT_TRACER is not setCONFIG_FTRACE_SYSCALLS=yCONFIG_TRACER_SNAPSHOT=y
# CONFIG_TRACER_SNAPSHOT_PER_CPU_SWAP is not setCONFIG_BRANCH_PROFILE_NONE=y
# CONFIG_PROFILE_ANNOTATED_BRANCHES is not set
# CONFIG_PROFILE_ALL_BRANCHES is not setCONFIG_STACK_TRACER=yCONFIG_BLK_DEV_IO_TRACE=yCONFIG_KPROBE_EVENTS=yCONFIG_UPROBE_EVENTS=yCONFIG_BPF_EVENTS=yCONFIG_DYNAMIC_EVENTS=yCONFIG_PROBE_EVENTS=yCONFIG_DYNAMIC_FTRACE=yCONFIG_DYNAMIC_FTRACE_WITH_REGS=yCONFIG_FUNCTION_PROFILER=yCONFIG_FTRACE_MCOUNT_RECORD=y
# CONFIG_FTRACE_STARTUP_TEST is not setCONFIG_TRACING_MAP=yCONFIG_HIST_TRIGGERS=y
# CONFIG_TRACEPOINT_BENCHMARK is not set
# CONFIG_RING_BUFFER_BENCHMARK is not set
# CONFIG_RING_BUFFER_STARTUP_TEST is not set
# CONFIG_PREEMPTIRQ_DELAY_TEST is not set
# CONFIG_TRACE_EVAL_MAP_FILE is not set
# CONFIG_KUNIT is not set
# CONFIG_SAMPLES is not setCONFIG_ARCH_HAS_DEVMEM_IS_ALLOWED=y
# CONFIG_STRICT_DEVMEM is not set
# CONFIG_DEBUG_AID_FOR_SYZBOT is not set
#
# s390 Debugging # CONFIG_TRACE_IRQFLAGS_SUPPORT=y CONFIG_S390_PTDUMP=y CONFIG_EARLY_PRINTK=y # end of s390 Debugging
#
# Kernel Testing and Coverage
#CONFIG_ARCH_HAS_KCOV=yCONFIG_CC_HAS_SANCOV_TRACE_PC=y
# CONFIG_KCOV is not setCONFIG_RUNTIME_TESTING_MENU=yCONFIG_LKDTM=m
# CONFIG_TEST_LIST_SORT is not set
# CONFIG_TEST_SORT is not set
# CONFIG_KPROBES_SANITY_TEST is not set
# CONFIG_BACKTRACE_SELF_TEST is not set
# CONFIG_RBTREE_TEST is not set
# CONFIG_REED_SOLOMON_TEST is not set
# CONFIG_INTERVAL_TREE_TEST is not setCONFIG_PERCPU_TEST=mCONFIG_ATOMIC64_SELFTEST=y
# CONFIG_ASYNC_RAID6_TEST is not set
# CONFIG_TEST_HEXDUMP is not set
# CONFIG_TEST_STRING_HELPERS is not set
# CONFIG_TEST_STRSCPY is not set
# CONFIG_TEST_KSTRTOX is not set
# CONFIG_TEST_PRINTF is not set
# CONFIG_TEST_BITMAP is not set
# CONFIG_TEST_BITFIELD is not set
# CONFIG_TEST_UUID is not set
# CONFIG_TEST_XARRAY is not set
# CONFIG_TEST_OVERFLOW is not set
# CONFIG_TEST_RHASHTABLE is not set
# CONFIG_TEST_HASH is not set
# CONFIG_TEST_IDA is not set
# CONFIG_TEST_LKM is not set
# CONFIG_TEST_VMALLOC is not set
# CONFIG_TEST_USER_COPY is not setCONFIG_TEST_BPF=m
# CONFIG_TEST_BLACKHOLE_DEV is not set
# CONFIG_FIND_BIT_BENCHMARK is not set
# CONFIG_TEST_FIRMWARE is not set
# CONFIG_TEST_SYSCTL is not set
# CONFIG_TEST_UDELAY is not set
# CONFIG_TEST_STATIC_KEYS is not set
# CONFIG_TEST_KMOD is not set
# CONFIG_TEST_MEMCAT_P is not set
# CONFIG_TEST_STACKINIT is not set
# CONFIG_TEST_MEMINIT is not set
# CONFIG_MEMTEST is not set
# CONFIG_NOTIFIER_ERROR_INJECTION is not set
# CONFIG_FAULT_INJECTION is not set
# end of Kernel Testing and Coverage # end of Kernel hacking [ 0.153849] Linux version 5.4.0-rc8-next-20191122 ([email protected]) (gcc version 9.2.1 20190827 (Red Hat 9.2.1-1) (GCC)) #70 SMP Fri Nov 22 08:59:29 CET 2019 [ 0.153851] setup: Linux is running natively in 64-bit mode [ 0.153891] setup: The maximum memory size is 131072MB [ 0.153897] setup: Reserving 1024MB of memory at 130048MB for crashkernel (System RAM: 130048MB) [ 0.153909] numa: NUMA mode: plain [ 0.153975] cpu: 32 configured CPUs, 0 standby CPUs [ 0.154005] cpu: The CPU configuration topology of the machine is: 0 0 4 2 3 8 / 4 [ 0.154735] Write protected kernel read-only data: 13316k [ 0.156243] Zone ranges: [ 0.156244] DMA [mem 0x0000000000000000-0x000000007fffffff] [ 0.156246] Normal [mem 0x0000000080000000-0x0000001fffffffff] [ 0.156248] Movable zone start for each node [ 0.156248] Early memory node ranges [ 0.156250] node 0: [mem 0x0000000000000000-0x0000001fffffffff] [ 0.156257] Initmem setup node 0 [mem 0x0000000000000000-0x0000001fffffffff] [ 0.156258] On node 0 totalpages: 33554432 [ 0.156259] DMA zone: 8192 pages used for memmap [ 0.156260] DMA zone: 0 pages reserved [ 0.156260] DMA zone: 524288 pages, LIFO batch:63 [ 0.172415] Normal zone: 516096 pages used for memmap [ 0.172415] Normal zone: 33030144 pages, LIFO batch:63 [ 0.188681] percpu: Embedded 33 pages/cpu s97024 r8192 d29952 u135168 [ 0.188689] pcpu-alloc: s97024 r8192 d29952 u135168 alloc=33*4096 [ 0.188690] pcpu-alloc: [0] 000 [0] 001 [0] 002 [0] 003 [ 0.188691] pcpu-alloc: [0] 004 [0] 005 [0] 006 [0] 007 [ 0.188693] pcpu-alloc: [0] 008 [0] 009 [0] 010 [0] 011 [ 0.188694] pcpu-alloc: [0] 012 [0] 013 [0] 014 [0] 015 [ 0.188695] pcpu-alloc: [0] 016 [0] 017 [0] 018 [0] 019 [ 0.188696] pcpu-alloc: [0] 020 [0] 021 [0] 022 [0] 023 [ 0.188698] pcpu-alloc: [0] 024 [0] 025 [0] 026 [0] 027 [ 0.188699] pcpu-alloc: [0] 028 [0] 029 [0] 030 [0] 031 [ 0.188700] pcpu-alloc: [0] 032 [0] 033 [0] 034 [0] 035 [ 0.188701] pcpu-alloc: [0] 036 [0] 037 [0] 038 [0] 039 [ 0.188703] pcpu-alloc: [0] 040 [0] 041 [0] 042 [0] 043 [ 0.188704] pcpu-alloc: [0] 044 [0] 045 [0] 046 [0] 047 [ 0.188705] pcpu-alloc: [0] 048 [0] 049 [0] 050 [0] 051 [ 0.188706] pcpu-alloc: [0] 052 [0] 053 [0] 054 [0] 055 [ 0.188707] pcpu-alloc: [0] 056 [0] 057 [0] 058 [0] 059 [ 0.188709] pcpu-alloc: [0] 060 [0] 061 [0] 062 [0] 063 [ 0.188710] pcpu-alloc: [0] 064 [0] 065 [0] 066 [0] 067 [ 0.188711] pcpu-alloc: [0] 068 [0] 069 [0] 070 [0] 071 [ 0.188712] pcpu-alloc: [0] 072 [0] 073 [0] 074 [0] 075 [ 0.188714] pcpu-alloc: [0] 076 [0] 077 [0] 078 [0] 079 [ 0.188715] pcpu-alloc: [0] 080 [0] 081 [0] 082 [0] 083 [ 0.188716] pcpu-alloc: [0] 084 [0] 085 [0] 086 [0] 087 [ 0.188717] pcpu-alloc: [0] 088 [0] 089 [0] 090 [0] 091 [ 0.188718] pcpu-alloc: [0] 092 [0] 093 [0] 094 [0] 095 [ 0.188720] pcpu-alloc: [0] 096 [0] 097 [0] 098 [0] 099 [ 0.188721] pcpu-alloc: [0] 100 [0] 101 [0] 102 [0] 103 [ 0.188722] pcpu-alloc: [0] 104 [0] 105 [0] 106 [0] 107 [ 0.188723] pcpu-alloc: [0] 108 [0] 109 [0] 110 [0] 111 [ 0.188725] pcpu-alloc: [0] 112 [0] 113 [0] 114 [0] 115 [ 0.188726] pcpu-alloc: [0] 116 [0] 117 [0] 118 [0] 119 [ 0.188727] pcpu-alloc: [0] 120 [0] 121 [0] 122 [0] 123 [ 0.188728] pcpu-alloc: [0] 124 [0] 125 [0] 126 [0] 127 [ 0.188729] pcpu-alloc: [0] 128 [0] 129 [0] 130 [0] 131 [ 0.188731] pcpu-alloc: [0] 132 [0] 133 [0] 134 [0] 135 [ 0.188732] pcpu-alloc: [0] 136 [0] 137 [0] 138 [0] 139 [ 0.188733] pcpu-alloc: [0] 140 [0] 141 [0] 142 [0] 143 [ 0.188734] pcpu-alloc: [0] 144 [0] 145 [0] 146 [0] 147 [ 0.188735] pcpu-alloc: [0] 148 [0] 149 [0] 150 [0] 151 [ 0.188737] pcpu-alloc: [0] 152 [0] 153 [0] 154 [0] 155 [ 0.188738] pcpu-alloc: [0] 156 [0] 157 [0] 158 [0] 159 [ 0.188739] pcpu-alloc: [0] 160 [0] 161 [0] 162 [0] 163 [ 0.188740] pcpu-alloc: [0] 164 [0] 165 [0] 166 [0] 167 [ 0.188742] pcpu-alloc: [0] 168 [0] 169 [0] 170 [0] 171 [ 0.188743] pcpu-alloc: [0] 172 [0] 173 [0] 174 [0] 175 [ 0.188744] pcpu-alloc: [0] 176 [0] 177 [0] 178 [0] 179 [ 0.188745] pcpu-alloc: [0] 180 [0] 181 [0] 182 [0] 183 [ 0.188746] pcpu-alloc: [0] 184 [0] 185 [0] 186 [0] 187 [ 0.188748] pcpu-alloc: [0] 188 [0] 189 [0] 190 [0] 191 [ 0.188749] pcpu-alloc: [0] 192 [0] 193 [0] 194 [0] 195 [ 0.188750] pcpu-alloc: [0] 196 [0] 197 [0] 198 [0] 199 [ 0.188751] pcpu-alloc: [0] 200 [0] 201 [0] 202 [0] 203 [ 0.188752] pcpu-alloc: [0] 204 [0] 205 [0] 206 [0] 207 [ 0.188754] pcpu-alloc: [0] 208 [0] 209 [0] 210 [0] 211 [ 0.188755] pcpu-alloc: [0] 212 [0] 213 [0] 214 [0] 215 [ 0.188756] pcpu-alloc: [0] 216 [0] 217 [0] 218 [0] 219 [ 0.188757] pcpu-alloc: [0] 220 [0] 221 [0] 222 [0] 223 [ 0.188759] pcpu-alloc: [0] 224 [0] 225 [0] 226 [0] 227 [ 0.188760] pcpu-alloc: [0] 228 [0] 229 [0] 230 [0] 231 [ 0.188761] pcpu-alloc: [0] 232 [0] 233 [0] 234 [0] 235 [ 0.188762] pcpu-alloc: [0] 236 [0] 237 [0] 238 [0] 239 [ 0.188763] pcpu-alloc: [0] 240 [0] 241 [0] 242 [0] 243 [ 0.188765] pcpu-alloc: [0] 244 [0] 245 [0] 246 [0] 247 [ 0.188766] pcpu-alloc: [0] 248 [0] 249 [0] 250 [0] 251 [ 0.188767] pcpu-alloc: [0] 252 [0] 253 [0] 254 [0] 255 [ 0.188768] pcpu-alloc: [0] 256 [0] 257 [0] 258 [0] 259 [ 0.188769] pcpu-alloc: [0] 260 [0] 261 [0] 262 [0] 263 [ 0.188771] pcpu-alloc: [0] 264 [0] 265 [0] 266 [0] 267 [ 0.188772] pcpu-alloc: [0] 268 [0] 269 [0] 270 [0] 271 [ 0.188773] pcpu-alloc: [0] 272 [0] 273 [0] 274 [0] 275 [ 0.188774] pcpu-alloc: [0] 276 [0] 277 [0] 278 [0] 279 [ 0.188776] pcpu-alloc: [0] 280 [0] 281 [ 0.188796] Built 1 zonelists, mobility grouping on. Total pages: 33030144 [ 0.188797] Policy zone: Normal [ 0.188798] Kernel command line: root=/dev/disk/by-path/ccw-0.0.241c-part1 rd.dasd=0.0.241c rd.dasd=0.0.241d rd.dasd=0.0.241e cio_ignore=all,!condev rd.znet=qeth,0.0.e400,0.0.e401,0.0.e402,layer2=1,portno=0,portname=OSAPORT zfcp.allow_lun_scan=1 crashkernel=1G spectre_v2=off BOOT_IMAGE=0 [ 0.189869] printk: log_buf_len individual max cpu contribution: 4096 bytes [ 0.189869] printk: log_buf_len total cpu_extra contributions: 1150976 bytes [ 0.189870] printk: log_buf_len min size: 131072 bytes [ 0.190164] printk: log_buf_len: 2097152 bytes [ 0.190165] printk: early log buf free: 124672(95%) [ 0.199225] Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes, linear) [ 0.203790] Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.203792] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.240221] Memory: 2314512K/134217728K available (10264K kernel code, 2020K rwdata, 3052K rodata, 3888K init, 856K bss, 3348492K reserved, 0K cma-reserved) [ 0.240611] SLUB: HWalign=256, Order=0-3, MinObjects=0, CPUs=282, Nodes=1 [ 0.240642] ftrace: allocating 31258 entries in 123 pages [ 0.245932] ftrace: allocated 123 pages with 6 groups [ 0.246508] rcu: Hierarchical RCU implementation. [ 0.246509] rcu: RCU event tracing is enabled. [ 0.246510] rcu: RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=282. [ 0.246510] Tasks RCU enabled. [ 0.246511] rcu: RCU calculated value of scheduler-enlistment delay is 11 jiffies. [ 0.246512] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=282 [ 0.249499] NR_IRQS: 3, nr_irqs: 3, preallocated irqs: 3 [ 0.249645] clocksource: tod: mask: 0xffffffffffffffff max_cycles: 0x3b0a9be803b0a9, max_idle_ns: 1805497147909793 ns [ 0.249844] Console: colour dummy device 80x25 [ 0.371333] printk: console [ttyS0] enabled [ 0.526531] Calibrating delay loop (skipped)... 20325.00 BogoMIPS preset [ 0.526532] pid_max: default: 288768 minimum: 2256 [ 0.526656] LSM: Security Framework initializing [ 0.526675] SELinux: Initializing. [ 0.526876] Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) [ 0.526992] Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) [ 0.527686] rcu: Hierarchical SRCU implementation. [ 0.529583] smp: Bringing up secondary CPUs ... [ 0.535016] smp: Brought up 1 node, 32 CPUs [ 1.464986] node 0 initialised, 32138681 pages in 930ms [ 1.490567] devtmpfs: initialized [ 1.492229] random: get_random_u32 called from bucket_table_alloc.isra.0+0x82/0x120 with crng_init=0 [ 1.492699] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns [ 1.493390] futex hash table entries: 131072 (order: 13, 33554432 bytes, vmalloc) [ 1.498838] xor: automatically using best checksumming function xc [ 1.498988] NET: Registered protocol family 16 [ 1.499033] audit: initializing netlink subsys (disabled) [ 1.499093] audit: type=2000 audit(1574427501.087:1): state=initialized audit_enabled=0 res=1 [ 1.502384] HugeTLB registered 1.00 MiB page size, pre-allocated 0 pages [ 1.545283] random: fast init done [ 1.749690] raid6: vx128x8 gen() 20468 MB/s [ 1.919658] raid6: vx128x8 xor() 11713 MB/s [ 1.919660] raid6: using algorithm vx128x8 gen() 20468 MB/s [ 1.919661] raid6: .... xor() 11713 MB/s, rmw enabled [ 1.919662] raid6: using s390xc recovery algorithm [ 1.919882] iommu: Default domain type: Translated [ 1.920037] SCSI subsystem initialized [ 1.926005] PCI host bridge to bus 0000:00 [ 1.926010] pci_bus 0000:00: root bus resource [mem 0x8000000000000000-0x80000000007fffff 64bit pref] [ 1.926013] pci_bus 0000:00: No busn resource found for root bus, will use [bus 00-ff] [ 1.926209] pci 0000:00:00.0: [15b3:1004] type 00 class 0x020000 [ 1.927382] pci 0000:00:00.0: reg 0x18: [mem 0xffffcc0001000000-0xffffcc00017fffff 64bit pref] [ 1.930105] pci 0000:00:00.0: Adding to iommu group 0 [ 1.930114] pci_bus 0000:00: busn_res: [bus 00-ff] end is updated to 00 [ 2.600903] VFS: Disk quotas dquot_6.6.0 [ 2.600958] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.602623] NET: Registered protocol family 2 [ 2.603156] tcp_listen_portaddr_hash hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 2.603731] TCP established hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 2.605808] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 2.606321] TCP: Hash tables configured (established 524288 bind 65536) [ 2.606600] UDP hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 2.607624] UDP-Lite hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 2.608948] NET: Registered protocol family 1 [ 2.609143] Trying to unpack rootfs image as initramfs... [ 3.270624] Freeing initrd memory: 44180K [ 3.271994] alg: No test for crc32be (crc32be-vx) [ 3.275961] Initialise system trusted keyrings [ 3.276005] workingset: timestamp_bits=42 max_order=25 bucket_order=0 [ 3.277201] fuse: init (API version 7.31) [ 3.277264] SGI XFS with ACLs, security attributes, realtime, quota, no debug enabled [ 3.283706] Key type asymmetric registered [ 3.283707] Asymmetric key parser 'x509' registered [ 3.283714] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251) [ 3.283850] io scheduler mq-deadline registered [ 3.283851] io scheduler kyber registered [ 3.283876] io scheduler bfq registered [ 3.284217] atomic64_test: passed [ 3.284329] hvc_iucv: The z/VM IUCV HVC device driver cannot be used without z/VM [ 3.289528] brd: module loaded [ 3.289819] cio: Channel measurement facility initialized using format extended (mode autodetected) [ 3.290048] Discipline DIAG cannot be used without z/VM [ 4.646249] sclp_sd: No data is available for the config data entity [ 4.813487] qeth: loading core functions [ 4.813534] qeth: register layer 2 discipline [ 4.813536] qeth: register layer 3 discipline [ 4.813875] NET: Registered protocol family 10 [ 4.814674] Segment Routing with IPv6 [ 4.814692] NET: Registered protocol family 17 [ 4.814704] Key type dns_resolver registered [ 4.814786] registered taskstats version 1 [ 4.814790] Loading compiled-in X.509 certificates [ 4.814911] alg: No test for pkcs1pad(rsa,sha1) (pkcs1pad(rsa-generic,sha1)) [ 4.816834] Loaded X.509 cert 'Build time autogenerated kernel key: f59e0411a915bdd2e8aa85c3d95a9bbf8eeef38d' [ 4.817510] zswap: default zpool zbud not available [ 4.817512] zswap: pool creation failed [ 4.817805] Key type ._fscrypt registered [ 4.817806] Key type .fscrypt registered [ 4.818116] Btrfs loaded, crc32c=crc32c-vx [ 4.823104] Key type big_key registered [ 4.823111] ima: No TPM chip found, activating TPM-bypass! [ 4.823115] ima: Allocated hash algorithm: sha256 [ 4.823122] ima: No architecture policies found [ 4.824160] Freeing unused kernel memory: 3888K [ 4.889756] Write protected read-only-after-init data: 68k [ 4.889759] Run /init as init process [ 4.947324] systemd[1]: Inserted module 'autofs4' [ 4.949140] systemd[1]: systemd v241-12.git323cdf4.fc30 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid) [ 4.949615] systemd[1]: Detected architecture s390x. [ 4.949617] systemd[1]: Running in initial RAM disk. [ 5.024189] systemd[1]: Set hostname to <s38lp08.lnxne.boe>. [ 5.025147] systemd[1]: Couldn't move remaining userspace processes, ignoring: Input/output error [ 5.058854] random: systemd: uninitialized urandom read (16 bytes read) [ 5.058895] systemd[1]: Listening on Journal Audit Socket. [ 5.058947] random: systemd: uninitialized urandom read (16 bytes read) [ 5.058983] systemd[1]: Listening on Journal Socket (/dev/log). [ 5.059005] random: systemd: uninitialized urandom read (16 bytes read) [ 5.059029] systemd[1]: Listening on udev Kernel Socket. [ 5.059085] systemd[1]: Listening on Journal Socket. [ 5.062310] systemd[1]: Starting Load Kernel Modules... [ 5.300072] audit: type=1130 audit(1574427504.897:2): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-journald comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' [ 5.509734] random: crng init done [ 5.509737] random: 7 urandom warning(s) missed due to ratelimiting [ 7.273226] audit: type=1130 audit(1574427506.867:3): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-cmdline comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' [ 7.316074] device-mapper: uevent: version 1.0.3 [ 7.316158] device-mapper: ioctl: 4.41.0-ioctl (2019-09-16) initialised: [email protected] [ 7.340398] alua: device handler registered [ 7.345145] emc: device handler registered [ 7.350191] rdac: device handler registered [ 7.364131] audit: type=1130 audit(1574427506.957:4): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-pre-udev comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' [ 7.364719] audit: type=1334 audit(1574427506.957:5): auid=4294967295 uid=0 gid=0 ses=4294967295 subj=kernel pid=1 comm="systemd" exe="/usr/lib/systemd/systemd" prog-id=5 event=LOAD [ 7.364776] audit: type=1334 audit(1574427506.957:6): auid=4294967295 uid=0 gid=0 ses=4294967295 subj=kernel pid=1 comm="systemd" exe="/usr/lib/systemd/systemd" prog-id=6 event=LOAD [ 7.592918] audit: type=1130 audit(1574427507.187:7): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-udevd comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' [ 7.597370] qeth 0.0.e400: Priority Queueing not supported [ 7.598076] qeth 0.0.e400: portname is deprecated and is ignored [ 7.600120] dasd-eckd 0.0.241c: A channel path to the device has become operational [ 7.601851] dasd-eckd 0.0.241e: A channel path to the device has become operational [ 7.602230] dasd-eckd 0.0.241d: A channel path to the device has become operational [ 7.603067] dasd-eckd 0.0.241c: New DASD 3390/0C (CU 3990/01) with 30051 cylinders, 15 heads, 224 sectors [ 7.603291] scsi host0: zfcp [ 7.604226] dasd-eckd 0.0.241e: New DASD 3390/0C (CU 3990/01) with 30051 cylinders, 15 heads, 224 sectors [ 7.604557] dasd-eckd 0.0.241d: New DASD 3390/0C (CU 3990/01) with 30051 cylinders, 15 heads, 224 sectors [ 7.604860] qdio: 0.0.e402 OSA on SC 3e6 using AI:1 QEBSM:0 PRI:1 TDD:1 SIGA: W AP [ 7.605810] qdio: 0.0.1900 ZFCP on SC 147 using AI:1 QEBSM:0 PRI:1 TDD:1 SIGA: W AP [ 7.606718] dasd-eckd 0.0.241c: DASD with 4 KB/block, 21636720 KB total size, 48 KB/track, compatible disk layout [ 7.607984] dasda:VOL1/ 0X241C: dasda1 [ 7.608530] dasd-eckd 0.0.241e: DASD with 4 KB/block, 21636720 KB total size, 48 KB/track, compatible disk layout [ 7.608760] dasd-eckd 0.0.241d: DASD with 4 KB/block, 21636720 KB total size, 48 KB/track, compatible disk layout [ 7.609385] scsi host1: zfcp [ 7.609974] dasdb:VOL1/ 0X3333: dasdb1 dasdb2 [ 7.610043] dasdc:VOL1/ 0X241D: dasdc1 [ 7.611359] qdio: 0.0.1940 ZFCP on SC 148 using AI:1 QEBSM:0 PRI:1 TDD:1 SIGA: W AP [ 7.633794] qeth 0.0.e400: QDIO data connection isolation is deactivated [ 7.634345] qeth 0.0.e400: The device represents a Bridge Capable Port [ 7.635362] qeth 0.0.e400: MAC address 56:2b:61:4f:36:50 successfully registered [ 7.635964] qeth 0.0.e400: Device is a OSD Express card (level: 0774) with link type OSD_10GIG. [ 7.639822] audit: type=1130 audit(1574427507.237:8): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-udev-trigger comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' [ 7.646577] qeth 0.0.e400: MAC address 8a:ec:e6:ac:7f:ac successfully registered [ 7.647104] qeth 0.0.e400 ence400: renamed from eth0 [ 7.655531] audit: type=1130 audit(1574427507.247:9): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=plymouth-start comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' [ 7.723280] mlx4_core: Mellanox ConnectX core driver v4.0-0 [ 7.723295] mlx4_core: Initializing 0000:00:00.0 [ 7.723376] mlx4_core 0000:00:00.0: enabling device (0000 -> 0002) [ 7.724446] mlx4_core 0000:00:00.0: Detected virtual function - running in slave mode [ 7.724484] mlx4_core 0000:00:00.0: Sending reset [ 7.725868] mlx4_core 0000:00:00.0: Sending vhcr0 [ 7.731304] mlx4_core 0000:00:00.0: Requested number of MACs is too much for port 1, reducing to 64 [ 7.731305] mlx4_core 0000:00:00.0: Requested number of VLANs is too much for port 1, reducing to 1 [ 7.731498] mlx4_core 0000:00:00.0: HCA minimum page size:512 [ 7.732931] mlx4_core 0000:00:00.0: Timestamping is not supported in slave mode [ 7.827951] dasdconf.sh Warning: 0.0.241d is already online, not configuring [ 7.835698] dasdconf.sh Warning: 0.0.241e is already online, not configuring [ 7.947875] mlx4_en: Mellanox ConnectX HCA Ethernet driver v4.0-0 [ 7.948376] mlx4_en 0000:00:00.0: Activating port:1 [ 7.959194] dasdconf.sh Warning: 0.0.241c is already online, not configuring [ 7.988608] mlx4_en: 0000:00:00.0: Port 1: Using 32 TX rings [ 7.988611] mlx4_en: 0000:00:00.0: Port 1: Using 8 RX rings [ 7.989106] mlx4_en: 0000:00:00.0: Port 1: Initializing port [ 7.989765] mlx4_en 0000:00:00.0: Activating port:2 [ 8.025371] mlx4_en: 0000:00:00.0: Port 2: Using 32 TX rings [ 8.025373] mlx4_en: 0000:00:00.0: Port 2: Using 8 RX rings [ 8.025846] mlx4_en: 0000:00:00.0: Port 2: Initializing port [ 8.030272] mlx4_core 0000:00:00.0 ens12: renamed from eth0 [ 8.119874] mlx4_core 0000:00:00.0 ens12d1: renamed from eth1 [ 8.697897] scsi 0:0:0:1074675840: Direct-Access IBM 2107900 4200 PQ: 0 ANSI: 5 [ 8.698587] scsi 0:0:0:1074675840: alua: supports implicit TPGS [ 8.698593] scsi 0:0:0:1074675840: alua: device naa.6005076305ffc1ae000000000000800e port group 0 rel port 101 [ 8.698830] sd 0:0:0:1074675840: Attached scsi generic sg0 type 0 [ 8.698876] sd 0:0:0:1074675840: Power-on or device reset occurred [ 8.699712] scsi 0:0:0:1074741376: Direct-Access IBM 2107900 4200 PQ: 0 ANSI: 5 [ 8.700310] scsi 0:0:0:1074741376: alua: supports implicit TPGS [ 8.700313] scsi 0:0:0:1074741376: alua: device naa.6005076305ffc1ae000000000000800f port group 0 rel port 101 [ 8.700444] sd 0:0:0:1074741376: Attached scsi generic sg1 type 0 [ 8.700541] sd 0:0:0:1074741376: Power-on or device reset occurred [ 8.701469] scsi 0:0:0:1074675841: Direct-Access IBM 2107900 4200 PQ: 0 ANSI: 5 [ 8.702096] scsi 0:0:0:1074675841: alua: supports implicit TPGS [ 8.702100] scsi 0:0:0:1074675841: alua: device naa.6005076305ffc1ae000000000000810e port group 0 rel port 101 [ 8.702269] sd 0:0:0:1074675841: Attached scsi generic sg2 type 0 [ 8.702362] sd 0:0:0:1074675841: Power-on or device reset occurred [ 8.703072] scsi 0:0:0:1074741377: Direct-Access IBM 2107900 4200 PQ: 0 ANSI: 5 [ 8.703659] scsi 0:0:0:1074741377: alua: supports implicit TPGS [ 8.703662] scsi 0:0:0:1074741377: alua: device naa.6005076305ffc1ae000000000000810f port group 0 rel port 101 [ 8.703759] sd 0:0:0:1074741377: Attached scsi generic sg3 type 0 [ 8.703971] sd 0:0:0:1074741377: Power-on or device reset occurred [ 8.704983] scsi 0:0:1:0: Direct-Access IBM FlashSystem-9840 1510 PQ: 0 ANSI: 5 [ 8.705646] sd 0:0:1:0: Attached scsi generic sg4 type 0 [ 8.705838] sd 0:0:1:0: Power-on or device reset occurred [ 8.706756] scsi 0:0:2:0: Direct-Access IBM FlashSystem-9840 1510 PQ: 0 ANSI: 5 [ 8.706758] sd 0:0:1:0: [sde] 4294967296 512-byte logical blocks: (2.20 TB/2.00 TiB) [ 8.706760] sd 0:0:1:0: [sde] 4096-byte physical blocks [ 8.706925] sd 0:0:1:0: [sde] Write Protect is off [ 8.706930] sd 0:0:1:0: [sde] Mode Sense: a7 00 00 08 [ 8.707149] sd 0:0:1:0: [sde] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA [ 8.707352] sd 0:0:1:0: [sde] Optimal transfer size 65536 bytes [ 8.707424] sd 0:0:2:0: Attached scsi generic sg5 type 0 [ 8.707471] sd 0:0:2:0: Power-on or device reset occurred [ 8.708286] sd 0:0:2:0: [sdf] 4294967296 512-byte logical blocks: (2.20 TB/2.00 TiB) [ 8.708289] sd 0:0:2:0: [sdf] 4096-byte physical blocks [ 8.708423] scsi 0:0:3:0: Direct-Access IBM FlashSystem-9840 1510 PQ: 0 ANSI: 5 [ 8.708448] sd 0:0:2:0: [sdf] Write Protect is off [ 8.708451] sd 0:0:2:0: [sdf] Mode Sense: a7 00 00 08 [ 8.708678] sd 0:0:2:0: [sdf] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA [ 8.708963] sd 0:0:2:0: [sdf] Optimal transfer size 65536 bytes [ 8.709130] sd 0:0:3:0: Attached scsi generic sg6 type 0 [ 8.709383] sd 0:0:3:0: Power-on or device reset occurred [ 8.709899] sd 0:0:0:1074675840: alua: transition timeout set to 60 seconds [ 8.709902] sd 0:0:0:1074675840: alua: port group 00 state A preferred supports tolusnA [ 8.710350] scsi 0:0:4:0: Direct-Access IBM FlashSystem-9840 1510 PQ: 0 ANSI: 5 [ 8.710354] sd 0:0:3:0: [sdg] 4294967296 512-byte logical blocks: (2.20 TB/2.00 TiB) [ 8.710357] sd 0:0:3:0: [sdg] 4096-byte physical blocks [ 8.710533] sd 0:0:3:0: [sdg] Write Protect is off [ 8.710535] sd 0:0:3:0: [sdg] Mode Sense: a7 00 00 08 [ 8.710753] sd 0:0:3:0: [sdg] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA [ 8.710823] sd 0:0:0:1074675840: [sda] 31457280 512-byte logical blocks: (16.1 GB/15.0 GiB) [ 8.710977] sd 0:0:0:1074675840: [sda] Write Protect is off [ 8.710981] sd 0:0:0:1074675840: [sda] Mode Sense: ed 00 00 08 [ 8.711013] sd 0:0:4:0: Attached scsi generic sg7 type 0 [ 8.711024] sd 0:0:3:0: [sdg] Optimal transfer size 65536 bytes [ 8.711116] sd 0:0:4:0: Power-on or device reset occurred [ 8.711308] sd 0:0:0:1074675840: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 8.711915] sd 0:0:4:0: [sdh] 4294967296 512-byte logical blocks: (2.20 TB/2.00 TiB) [ 8.711919] sd 0:0:4:0: [sdh] 4096-byte physical blocks [ 8.711929] scsi 0:0:5:0: Direct-Access IBM FlashSystem-9840 1510 PQ: 0 ANSI: 5 [ 8.712093] sd 0:0:4:0: [sdh] Write Protect is off [ 8.712095] sd 0:0:4:0: [sdh] Mode Sense: a7 00 00 08 [ 8.712329] sd 0:0:4:0: [sdh] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA [ 8.712581] sd 0:0:4:0: [sdh] Optimal transfer size 65536 bytes [ 8.712635] sd 0:0:5:0: Attached scsi generic sg8 type 0 [ 8.712747] sd 0:0:5:0: Power-on or device reset occurred [ 8.713471] sd 0:0:5:0: [sdi] 4294967296 512-byte logical blocks: (2.20 TB/2.00 TiB) [ 8.713473] sd 0:0:5:0: [sdi] 4096-byte physical blocks [ 8.713523] scsi 0:0:6:0: Direct-Access IBM FlashSystem-9840 1510 PQ: 0 ANSI: 5 [ 8.713634] sd 0:0:5:0: [sdi] Write Protect is off [ 8.713636] sd 0:0:5:0: [sdi] Mode Sense: a7 00 00 08 [ 8.713854] sd 0:0:5:0: [sdi] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA [ 8.714111] sd 0:0:5:0: [sdi] Optimal transfer size 65536 bytes [ 8.714165] sd 0:0:6:0: Attached scsi generic sg9 type 0 [ 8.714297] sd 0:0:6:0: Power-on or device reset occurred [ 8.715053] sd 0:0:6:0: [sdj] 4294967296 512-byte logical blocks: (2.20 TB/2.00 TiB) [ 8.715056] sd 0:0:6:0: [sdj] 4096-byte physical blocks [ 8.715120] scsi 0:0:7:0: Direct-Access IBM FlashSystem-9840 1510 PQ: 0 ANSI: 5 [ 8.715220] sd 0:0:6:0: [sdj] Write Protect is off [ 8.715223] sd 0:0:6:0: [sdj] Mode Sense: a7 00 00 08 [ 8.715458] sd 0:0:6:0: [sdj] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA [ 8.715691] sd 0:0:6:0: [sdj] Optimal transfer size 65536 bytes [ 8.715763] sd 0:0:7:0: Attached scsi generic sg10 type 0 [ 8.715856] sd 0:0:7:0: Power-on or device reset occurred [ 8.716630] sd 0:0:7:0: [sdk] 4294967296 512-byte logical blocks: (2.20 TB/2.00 TiB) [ 8.716634] sd 0:0:7:0: [sdk] 4096-byte physical blocks [ 8.716681] scsi 0:0:8:0: Direct-Access IBM FlashSystem-9840 1510 PQ: 0 ANSI: 5 [ 8.716793] sd 0:0:7:0: [sdk] Write Protect is off [ 8.716796] sd 0:0:7:0: [sdk] Mode Sense: a7 00 00 08 [ 8.717034] sd 0:0:7:0: [sdk] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA [ 8.717311] sd 0:0:8:0: Attached scsi generic sg11 type 0 [ 8.717331] sd 0:0:7:0: [sdk] Optimal transfer size 65536 bytes [ 8.717629] sd 0:0:8:0: Power-on or device reset occurred [ 8.718345] sd 0:0:8:0: [sdl] 4294967296 512-byte logical blocks: (2.20 TB/2.00 TiB) [ 8.718349] sd 0:0:8:0: [sdl] 4096-byte physical blocks [ 8.718526] sd 0:0:8:0: [sdl] Write Protect is off [ 8.718528] sd 0:0:8:0: [sdl] Mode Sense: a7 00 00 08 [ 8.718740] sd 0:0:8:0: [sdl] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA [ 8.718999] sd 0:0:8:0: [sdl] Optimal transfer size 65536 bytes [ 8.719890] sd 0:0:0:1074675841: alua: transition timeout set to 60 seconds [ 8.719895] sd 0:0:0:1074675841: alua: port group 00 state A preferred supports tolusnA [ 8.719965] sd 0:0:0:1074741376: alua: transition timeout set to 60 seconds [ 8.719969] sd 0:0:0:1074741376: alua: port group 00 state A preferred supports tolusnA [ 8.720574] sd 0:0:0:1074675841: [sdc] 31457280 512-byte logical blocks: (16.1 GB/15.0 GiB) [ 8.720645] sd 0:0:0:1074741376: [sdb] 31457280 512-byte logical blocks: (16.1 GB/15.0 GiB) [ 8.720709] sd 0:0:0:1074675841: [sdc] Write Protect is off [ 8.720711] sd 0:0:0:1074675841: [sdc] Mode Sense: ed 00 00 08 [ 8.720793] sd 0:0:0:1074741376: [sdb] Write Protect is off [ 8.720795] sd 0:0:0:1074741376: [sdb] Mode Sense: ed 00 00 08 [ 8.721001] sd 0:0:0:1074675841: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 8.721086] sd 0:0:0:1074741376: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 8.739952] sd 0:0:0:1074741377: alua: transition timeout set to 60 seconds [ 8.739957] sd 0:0:0:1074741377: alua: port group 00 state A preferred supports tolusnA [ 8.740654] sd 0:0:0:1074741377: [sdd] 31457280 512-byte logical blocks: (16.1 GB/15.0 GiB) [ 8.740829] sd 0:0:0:1074741377: [sdd] Write Protect is off [ 8.740831] sd 0:0:0:1074741377: [sdd] Mode Sense: ed 00 00 08 [ 8.741125] sd 0:0:0:1074741377: [sdd] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 8.775521] scsi 1:0:0:1074675840: Direct-Access IBM 2107900 4200 PQ: 0 ANSI: 5 [ 8.776156] scsi 1:0:0:1074675840: alua: supports implicit TPGS [ 8.776160] scsi 1:0:0:1074675840: alua: device naa.6005076305ffc1ae000000000000800e port group 0 rel port 31 [ 8.776287] sd 1:0:0:1074675840: Attached scsi generic sg12 type 0 [ 8.776651] sd 1:0:0:1074675840: Power-on or device reset occurred [ 8.777259] scsi 1:0:0:1074741376: Direct-Access IBM 2107900 4200 PQ: 0 ANSI: 5 [ 8.777843] scsi 1:0:0:1074741376: alua: supports implicit TPGS [ 8.777847] scsi 1:0:0:1074741376: alua: device naa.6005076305ffc1ae000000000000800f port group 0 rel port 31 [ 8.777962] sd 1:0:0:1074741376: Attached scsi generic sg13 type 0 [ 8.778061] sd 1:0:0:1074741376: Power-on or device reset occurred [ 8.778842] scsi 1:0:0:1074675841: Direct-Access IBM 2107900 4200 PQ: 0 ANSI: 5 [ 8.779476] scsi 1:0:0:1074675841: alua: supports implicit TPGS [ 8.779479] scsi 1:0:0:1074675841: alua: device naa.6005076305ffc1ae000000000000810e port group 0 rel port 31 [ 8.779558] sd 1:0:0:1074675841: Attached scsi generic sg14 type 0 [ 8.779719] sd 1:0:0:1074675841: Power-on or device reset occurred [ 8.780565] scsi 1:0:0:1074741377: Direct-Access IBM 2107900 4200 PQ: 0 ANSI: 5 [ 8.781230] scsi 1:0:0:1074741377: alua: supports implicit TPGS [ 8.781234] scsi 1:0:0:1074741377: alua: device naa.6005076305ffc1ae000000000000810f port group 0 rel port 31 [ 8.781340] sd 1:0:0:1074741377: Attached scsi generic sg15 type 0 [ 8.781466] sd 1:0:0:1074741377: Power-on or device reset occurred [ 8.782303] scsi 1:0:1:0: Direct-Access IBM FlashSystem-9840 1510 PQ: 0 ANSI: 5 [ 8.782931] sd 1:0:1:0: Attached scsi generic sg16 type 0 [ 8.783074] sd 1:0:1:0: Power-on or device reset occurred [ 8.783859] sd 1:0:1:0: [sdq] 4294967296 512-byte logical blocks: (2.20 TB/2.00 TiB) [ 8.783862] sd 1:0:1:0: [sdq] 4096-byte physical blocks [ 8.784026] sd 1:0:1:0: [sdq] Write Protect is off [ 8.784028] sd 1:0:1:0: [sdq] Mode Sense: a7 00 00 08 [ 8.784035] scsi 1:0:2:0: Direct-Access IBM FlashSystem-9840 1510 PQ: 0 ANSI: 5 [ 8.784281] sd 1:0:1:0: [sdq] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA [ 8.784529] sd 1:0:1:0: [sdq] Optimal transfer size 65536 bytes [ 8.784772] sd 1:0:2:0: Attached scsi generic sg17 type 0 [ 8.784826] sd 1:0:2:0: Power-on or device reset occurred [ 8.785620] sd 1:0:2:0: [sdr] 4294967296 512-byte logical blocks: (2.20 TB/2.00 TiB) [ 8.785623] sd 1:0:2:0: [sdr] 4096-byte physical blocks [ 8.785725] scsi 1:0:3:0: Direct-Access IBM FlashSystem-9840 1510 PQ: 0 ANSI: 5 [ 8.785801] sd 1:0:2:0: [sdr] Write Protect is off [ 8.785805] sd 1:0:2:0: [sdr] Mode Sense: a7 00 00 08 [ 8.786034] sd 1:0:2:0: [sdr] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA [ 8.786283] sd 1:0:2:0: [sdr] Optimal transfer size 65536 bytes [ 8.786467] sd 1:0:3:0: Attached scsi generic sg18 type 0 [ 8.786527] sd 1:0:3:0: Power-on or device reset occurred [ 8.787347] sd 1:0:3:0: [sds] 4294967296 512-byte logical blocks: (2.20 TB/2.00 TiB) [ 8.787351] sd 1:0:3:0: [sds] 4096-byte physical blocks [ 8.787470] scsi 1:0:4:0: Direct-Access IBM FlashSystem-9840 1510 PQ: 0 ANSI: 5 [ 8.787502] sd 1:0:3:0: [sds] Write Protect is off [ 8.787504] sd 1:0:3:0: [sds] Mode Sense: a7 00 00 08 [ 8.787741] sd 1:0:3:0: [sds] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA [ 8.787996] sd 1:0:3:0: [sds] Optimal transfer size 65536 bytes [ 8.788258] sd 1:0:4:0: Attached scsi generic sg19 type 0 [ 8.788301] sd 1:0:4:0: Power-on or device reset occurred [ 8.788602] audit: type=1130 audit(1574427508.377:10): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-udev-settle comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' [ 8.789076] sd 1:0:4:0: [sdt] 4294967296 512-byte logical blocks: (2.20 TB/2.00 TiB) [ 8.789079] sd 1:0:4:0: [sdt] 4096-byte physical blocks [ 8.789265] sd 1:0:4:0: [sdt] Write Protect is off [ 8.789269] sd 1:0:4:0: [sdt] Mode Sense: a7 00 00 08 [ 8.789385] scsi 1:0:5:0: Direct-Access IBM FlashSystem-9840 1510 PQ: 0 ANSI: 5 [ 8.789532] sd 1:0:4:0: [sdt] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA [ 8.789766] sd 1:0:4:0: [sdt] Optimal transfer size 65536 bytes [ 8.789987] sd 1:0:0:1074741376: alua: port group 00 state A preferred supports tolusnA [ 8.790048] sd 1:0:0:1074675840: alua: port group 00 state A preferred supports tolusnA [ 8.790165] sd 1:0:5:0: Attached scsi generic sg20 type 0 [ 8.790332] sd 1:0:5:0: Power-on or device reset occurred [ 8.790644] audit: type=1130 audit(1574427508.387:11): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-initqueue comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' [ 8.790805] sd 1:0:0:1074741376: [sdn] 31457280 512-byte logical blocks: (16.1 GB/15.0 GiB) [ 8.790815] sd 1:0:0:1074675840: [sdm] 31457280 512-byte logical blocks: (16.1 GB/15.0 GiB) [ 8.790972] sd 1:0:0:1074741376: [sdn] Write Protect is off [ 8.790975] sd 1:0:0:1074741376: [sdn] Mode Sense: ed 00 00 08 [ 8.790980] sd 1:0:0:1074675840: [sdm] Write Protect is off [ 8.790983] sd 1:0:0:1074675840: [sdm] Mode Sense: ed 00 00 08 [ 8.791106] sd 1:0:5:0: [sdu] 4294967296 512-byte logical blocks: (2.20 TB/2.00 TiB) [ 8.791109] sd 1:0:5:0: [sdu] 4096-byte physical blocks [ 8.791291] sd 1:0:5:0: [sdu] Write Protect is off [ 8.791293] sd 1:0:5:0: [sdu] Mode Sense: a7 00 00 08 [ 8.791314] sd 1:0:0:1074741376: [sdn] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 8.791315] sd 1:0:0:1074675840: [sdm] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 8.791426] scsi 1:0:6:0: Direct-Access IBM FlashSystem-9840 1510 PQ: 0 ANSI: 5 [ 8.791546] sd 1:0:5:0: [sdu] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA [ 8.791792] sd 1:0:5:0: [sdu] Optimal transfer size 65536 bytes [ 8.792288] sd 1:0:6:0: Power-on or device reset occurred [ 8.792325] sd 1:0:6:0: Attached scsi generic sg21 type 0 [ 8.793031] audit: type=1130 audit(1574427508.387:12): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=multipathd comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' [ 8.793082] sd 1:0:6:0: [sdv] 4294967296 512-byte logical blocks: (2.20 TB/2.00 TiB) [ 8.793086] sd 1:0:6:0: [sdv] 4096-byte physical blocks [ 8.793242] sd 1:0:6:0: [sdv] Write Protect is off [ 8.793248] sd 1:0:6:0: [sdv] Mode Sense: a7 00 00 08 [ 8.793337] scsi 1:0:7:0: Direct-Access IBM FlashSystem-9840 1510 PQ: 0 ANSI: 5 [ 8.793463] sd 1:0:6:0: [sdv] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA [ 8.793691] sd 1:0:6:0: [sdv] Optimal transfer size 65536 bytes [ 8.794072] sd 1:0:7:0: Power-on or device reset occurred [ 8.794086] sd 1:0:7:0: Attached scsi generic sg22 type 0 [ 8.794847] sd 1:0:7:0: [sdw] 4294967296 512-byte logical blocks: (2.20 TB/2.00 TiB) [ 8.794850] sd 1:0:7:0: [sdw] 4096-byte physical blocks [ 8.795018] sd 1:0:7:0: [sdw] Write Protect is off [ 8.795021] sd 1:0:7:0: [sdw] Mode Sense: a7 00 00 08 [ 8.795260] sd 1:0:7:0: [sdw] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA [ 8.795294] scsi 1:0:8:0: Direct-Access IBM FlashSystem-9840 1510 PQ: 0 ANSI: 5 [ 8.795496] sd 1:0:7:0: [sdw] Optimal transfer size 65536 bytes [ 8.795969] sd 1:0:8:0: Attached scsi generic sg23 type 0 [ 8.796209] sd 1:0:8:0: Power-on or device reset occurred [ 8.796930] sd 1:0:8:0: [sdx] 4294967296 512-byte logical blocks: (2.20 TB/2.00 TiB) [ 8.796934] sd 1:0:8:0: [sdx] 4096-byte physical blocks [ 8.797091] sd 1:0:8:0: [sdx] Write Protect is off [ 8.797092] sd 1:0:8:0: [sdx] Mode Sense: a7 00 00 08 [ 8.797324] sd 1:0:8:0: [sdx] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA [ 8.797602] sd 1:0:8:0: [sdx] Optimal transfer size 65536 bytes [ 8.809916] sd 1:0:0:1074741377: alua: port group 00 state A preferred supports tolusnA [ 8.809925] sd 1:0:0:1074675841: alua: port group 00 state A preferred supports tolusnA [ 8.810710] sd 1:0:0:1074675841: [sdo] 31457280 512-byte logical blocks: (16.1 GB/15.0 GiB) [ 8.810715] sd 1:0:0:1074741377: [sdp] 31457280 512-byte logical blocks: (16.1 GB/15.0 GiB) [ 8.810879] sd 1:0:0:1074675841: [sdo] Write Protect is off [ 8.810880] sd 1:0:0:1074675841: [sdo] Mode Sense: ed 00 00 08 [ 8.810894] sd 1:0:0:1074741377: [sdp] Write Protect is off [ 8.810903] sd 1:0:0:1074741377: [sdp] Mode Sense: ed 00 00 08 [ 8.811183] sd 1:0:0:1074675841: [sdo] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 8.811186] sd 1:0:0:1074741377: [sdp] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 8.813873] sdl: sdl1 sdl2 sdl3 [ 8.813882] sde: sde1 sde2 sde3 [ 8.813909] sdj: sdj1 sdj2 sdj3 [ 8.819049] sd 0:0:1:0: [sde] Attached SCSI disk [ 8.820072] sd 0:0:8:0: [sdl] Attached SCSI disk [ 8.820081] sd 0:0:6:0: [sdj] Attached SCSI disk [ 8.823682] sdh: sdh1 sdh2 sdh3 [ 8.823759] sdk: sdk1 sdk2 sdk3 [ 8.823768] sdi: sdi1 sdi2 sdi3 [ 8.823809] sdf: sdf1 sdf2 sdf3 [ 8.827323] EXT4-fs (dasda1): mounted filesystem with ordered data mode. Opts: (null) [ 8.828410] sd 0:0:4:0: [sdh] Attached SCSI disk [ 8.829447] sd 0:0:7:0: [sdk] Attached SCSI disk [ 8.829660] sd 0:0:2:0: [sdf] Attached SCSI disk [ 8.830120] sd 0:0:5:0: [sdi] Attached SCSI disk [ 8.842418] sdn: sdn1 sdn2 [ 8.843310] sdb: sdb1 sdb2 [ 8.843991] sds: sds1 sds2 sds3 [ 8.844254] sdu: sdu1 sdu2 sdu3 [ 8.844288] sdq: sdq1 sdq2 sdq3 [ 8.844982] sdg: sdg1 sdg2 sdg3 [ 8.845138] sdx: sdx1 sdx2 sdx3 [ 8.850072] sd 1:0:0:1074675840: [sdm] Attached SCSI disk [ 8.850352] sd 1:0:0:1074741376: [sdn] Attached SCSI disk [ 8.853228] sd 0:0:0:1074741377: [sdd] Attached SCSI disk [ 8.853374] sd 0:0:0:1074675840: [sda] Attached SCSI disk [ 8.853411] sdr: sdr1 sdr2 sdr3 [ 8.856368] sd 0:0:0:1074741376: [sdb] Attached SCSI disk [ 8.856603] sd 0:0:0:1074675841: [sdc] Attached SCSI disk [ 8.858293] sd 1:0:3:0: [sds] Attached SCSI disk [ 8.858396] sd 0:0:3:0: [sdg] Attached SCSI disk [ 8.858783] sd 1:0:5:0: [sdu] Attached SCSI disk [ 8.858823] sd 1:0:1:0: [sdq] Attached SCSI disk [ 8.858902] sd 1:0:8:0: [sdx] Attached SCSI disk [ 8.860584] sd 1:0:2:0: [sdr] Attached SCSI disk [ 8.874043] sdv: sdv1 sdv2 sdv3 [ 8.876853] sd 1:0:0:1074675841: [sdo] Attached SCSI disk [ 8.880523] sd 1:0:6:0: [sdv] Attached SCSI disk [ 8.883637] sdw: sdw1 sdw2 sdw3 [ 8.883678] sdt: sdt1 sdt2 sdt3 [ 8.887384] sd 1:0:0:1074741377: [sdp] Attached SCSI disk [ 8.890168] sd 1:0:4:0: [sdt] Attached SCSI disk [ 8.890370] sd 1:0:7:0: [sdw] Attached SCSI disk [ 9.452996] systemd-journald[348]: Received SIGTERM from PID 1 (systemd). [ 9.472233] printk: systemd: 20 output lines suppressed due to ratelimiting [ 9.860661] SELinux: Permission watch in class filesystem not defined in policy. [ 9.860668] SELinux: Permission watch in class file not defined in policy. [ 9.860669] SELinux: Permission watch_mount in class file not defined in policy. [ 9.860670] SELinux: Permission watch_sb in class file not defined in policy. [ 9.860671] SELinux: Permission watch_with_perm in class file not defined in policy. [ 9.860672] SELinux: Permission watch_reads in class file not defined in policy. [ 9.860675] SELinux: Permission watch in class dir not defined in policy. [ 9.860676] SELinux: Permission watch_mount in class dir not defined in policy. [ 9.860677] SELinux: Permission watch_sb in class dir not defined in policy. [ 9.860679] SELinux: Permission watch_with_perm in class dir not defined in policy. [ 9.860680] SELinux: Permission watch_reads in class dir not defined in policy. [ 9.860683] SELinux: Permission watch in class lnk_file not defined in policy. [ 9.860684] SELinux: Permission watch_mount in class lnk_file not defined in policy. [ 9.860685] SELinux: Permission watch_sb in class lnk_file not defined in policy. [ 9.860687] SELinux: Permission watch_with_perm in class lnk_file not defined in policy. [ 9.860688] SELinux: Permission watch_reads in class lnk_file not defined in policy. [ 9.860690] SELinux: Permission watch in class chr_file not defined in policy. [ 9.860715] SELinux: Permission watch_mount in class chr_file not defined in policy. [ 9.860717] SELinux: Permission watch_sb in class chr_file not defined in policy. [ 9.860718] SELinux: Permission watch_with_perm in class chr_file not defined in policy. [ 9.860719] SELinux: Permission watch_reads in class chr_file not defined in policy. [ 9.860721] SELinux: Permission watch in class blk_file not defined in policy. [ 9.860722] SELinux: Permission watch_mount in class blk_file not defined in policy. [ 9.860724] SELinux: Permission watch_sb in class blk_file not defined in policy. [ 9.860725] SELinux: Permission watch_with_perm in class blk_file not defined in policy. [ 9.860726] SELinux: Permission watch_reads in class blk_file not defined in policy. [ 9.860729] SELinux: Permission watch in class sock_file not defined in policy. [ 9.860730] SELinux: Permission watch_mount in class sock_file not defined in policy. [ 9.860731] SELinux: Permission watch_sb in class sock_file not defined in policy. [ 9.860732] SELinux: Permission watch_with_perm in class sock_file not defined in policy. [ 9.860733] SELinux: Permission watch_reads in class sock_file not defined in policy. [ 9.860735] SELinux: Permission watch in class fifo_file not defined in policy. [ 9.860737] SELinux: Permission watch_mount in class fifo_file not defined in policy. [ 9.860738] SELinux: Permission watch_sb in class fifo_file not defined in policy. [ 9.860739] SELinux: Permission watch_with_perm in class fifo_file not defined in policy. [ 9.860740] SELinux: Permission watch_reads in class fifo_file not defined in policy. [ 9.860834] SELinux: Class perf_event not defined in policy. [ 9.860835] SELinux: the above unknown classes and permissions will be allowed [ 9.860838] SELinux: policy capability network_peer_controls=1 [ 9.860839] SELinux: policy capability open_perms=1 [ 9.860840] SELinux: policy capability extended_socket_class=1 [ 9.860841] SELinux: policy capability always_check_network=0 [ 9.860842] SELinux: policy capability cgroup_seclabel=1 [ 9.860842] SELinux: policy capability nnp_nosuid_transition=1 [ 9.985323] systemd[1]: Successfully loaded SELinux policy in 349.326ms. [ 10.102452] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 23.805ms. [ 10.104319] systemd[1]: systemd v241-12.git323cdf4.fc30 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid) [ 10.104985] systemd[1]: Detected architecture s390x. [ 10.106198] systemd[1]: Set hostname to <s38lp08.lnxne.boe>. [ 10.108987] systemd[1]: Couldn't move remaining userspace processes, ignoring: Input/output error [ 10.217550] systemd[1]: /usr/lib/systemd/system/gssproxy.service:9: PIDFile= references path below legacy directory /var/run/, updating /var/run/gssproxy.pid → /run/gssproxy.pid; please update the unit file accordingly. [ 10.247504] systemd[1]: /usr/lib/systemd/system/sssd.service:11: PIDFile= references path below legacy directory /var/run/, updating /var/run/sssd.pid → /run/sssd.pid; please update the unit file accordingly. [ 10.251473] systemd[1]: /usr/lib/systemd/system/mdmonitor.service:6: PIDFile= references path below legacy directory /var/run/, updating /var/run/mdadm/mdadm.pid → /run/mdadm/mdadm.pid; please update the unit file accordingly. [ 10.252505] systemd[1]: /usr/lib/systemd/system/iscsid.service:10: PIDFile= references path below legacy directory /var/run/, updating /var/run/iscsid.pid → /run/iscsid.pid; please update the unit file accordingly. [ 10.252747] systemd[1]: /usr/lib/systemd/system/iscsiuio.service:12: PIDFile= references path below legacy directory /var/run/, updating /var/run/iscsiuio.pid → /run/iscsiuio.pid; please update the unit file accordingly. [ 10.327019] systemd[1]: initrd-switch-root.service: Succeeded. [ 10.335802] EXT4-fs (dasda1): re-mounted. Opts: (null) [ 10.529721] Adding 21635084k swap on /dev/dasdc1. Priority:-2 extents:1 across:21635084k SSFS [ 10.598942] systemd-journald[1048]: Received request to flush runtime journal from PID 1 [ 11.130303] VFIO - User Level meta-driver version: 0.3 [ 11.266349] qeth 0.0.e400 enccw0.0.e400: renamed from ence400 [ 11.278773] dasdconf.sh Warning: 0.0.241c is already online, not configuring [ 11.281981] dasdconf.sh Warning: 0.0.241d is already online, not configuring [ 11.282514] dasdconf.sh Warning: 0.0.241e is already online, not configuring [ 11.798179] scsi host2: zfcp [ 11.799357] dasd-eckd 0.0.241f: A channel path to the device has become operational [ 11.800366] qdio: 0.0.3c00 ZFCP on SC 24b using AI:1 QEBSM:0 PRI:1 TDD:1 SIGA: W AP [ 11.801689] dasd-eckd 0.0.241f: New DASD 3390/0C (CU 3990/01) with 30051 cylinders, 15 heads, 224 sectors [ 11.805190] dasd-eckd 0.0.241f: DASD with 4 KB/block, 21636720 KB total size, 48 KB/track, compatible disk layout [ 11.806695] dasdd:VOL1/ 0X3333: dasdd1 dasdd2 [ 11.813044] qdio: 0.0.bd02 OSA on SC 3cb using AI:1 QEBSM:0 PRI:1 TDD:1 SIGA: W AP [ 11.843878] qeth 0.0.bd00: QDIO data connection isolation is deactivated [ 11.844417] qeth 0.0.bd00: The device represents a Bridge Capable Port [ 11.845432] qeth 0.0.bd00: MAC address 3e:a9:e4:18:c1:3b successfully registered [ 11.846045] qeth 0.0.bd00: Device is a OSD Express card (level: 0774) with link type OSD_10GIG. [ 11.848707] qeth 0.0.bd00: MAC address 3a:a4:04:94:65:31 successfully registered [ 11.849429] qeth 0.0.bd00 enccw0.0.bd00: renamed from eth0 [ 12.053175] <mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v4.0-0 [ 12.055871] <mlx4_ib> mlx4_ib_add: counter index 255 for port 1 allocated 1 [ 12.055996] <mlx4_ib> mlx4_ib_add: counter index 255 for port 2 allocated 1 [ 12.070959] mlx4_core 0000:00:00.0: mlx4_ib: multi-function enabled [ 12.070961] mlx4_core 0000:00:00.0: mlx4_ib: operating in qp1 tunnel mode [ 12.832508] RPC: Registered named UNIX socket transport module. [ 12.832512] RPC: Registered udp transport module. [ 12.832513] RPC: Registered tcp transport module. [ 12.832514] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 12.937392] RPC: Registered rdma transport module. [ 12.937394] RPC: Registered rdma backchannel transport module. [ 12.938939] kauditd_printk_skb: 89 callbacks suppressed [ 12.938940] audit: type=1130 audit(1574427512.527:102): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=rdma-load-modules@rdma comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=failed' [ 13.501763] audit: type=1130 audit(1574427513.097:103): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=lvm2-pvscan@94:6 comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' [ 20.761726] audit: type=1130 audit(1574427520.357:104): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=systemd-udev-settle comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' [ 20.838019] audit: type=1130 audit(1574427520.427:105): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=rdma comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' [ 20.906337] device-mapper: multipath service-time: version 0.3.0 loaded [ 21.129899] sd 0:0:0:1074675840: alua: port group 00 state A preferred supports tolusnA [ 21.130078] sd 0:0:0:1074675840: alua: port group 00 state A preferred supports tolusnA [ 21.239701] Adding 15728636k swap on /dev/mapper/mpathk. Priority:1 extents:1 across:15728636k FS [ 21.319910] sd 0:0:0:1074675841: alua: port group 00 state A preferred supports tolusnA [ 21.320092] sd 0:0:0:1074675841: alua: port group 00 state A preferred supports tolusnA [ 21.419737] Adding 15728636k swap on /dev/mapper/mpathl. Priority:1 extents:1 across:15728636k FS [ 21.509927] sd 0:0:0:1074741376: alua: port group 00 state A preferred supports tolusnA [ 21.510104] sd 0:0:0:1074741376: alua: port group 00 state A preferred supports tolusnA [ 21.669922] sd 0:0:0:1074741377: alua: port group 00 state A preferred supports tolusnA [ 21.670100] sd 0:0:0:1074741377: alua: port group 00 state A preferred supports tolusnA [ 21.691123] audit: type=1130 audit(1574427521.287:106): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=lvm2-pvscan@252:9 comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=failed' [ 21.739744] Adding 15728636k swap on /dev/mapper/mpathn. Priority:1 extents:1 across:15728636k FS [ 21.840628] audit: type=1130 audit(1574427521.437:107): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=multipathd comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' [ 21.902512] EXT4-fs (dm-11): mounted filesystem with ordered data mode. Opts: (null) [ 21.904787] EXT4-fs (dm-13): mounted filesystem with ordered data mode. Opts: (null) [ 22.089686] Adding 1027604476k swap on /dev/mapper/mpathae2. Priority:1 extents:1 across:1027604476k SSFS [ 22.106879] audit: type=1130 audit(1574427521.697:108): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=dracut-shutdown comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' [ 22.120853] audit: type=1130 audit(1574427521.717:109): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=plymouth-read-write comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' [ 22.120857] audit: type=1131 audit(1574427521.717:110): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=plymouth-read-write comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' [ 22.122930] audit: type=1130 audit(1574427521.717:111): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=import-state comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' [ 22.162986] audit: type=1130 audit(1574427521.757:112): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=systemd-tmpfiles-setup comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' [ 23.447581] mlx4_en: ens12: Steering Mode 1 [ 23.525866] mlx4_en: ens12: Link Up [ 23.530471] IPv6: ADDRCONF(NETDEV_CHANGE): ens12: link becomes ready [ 23.545351] mlx4_en: ens12d1: Steering Mode 1 [ 23.669616] Ethernet Channel Bonding Driver: v3.7.1 (April 27, 2011) [ 23.707898] qeth 0.0.bd00: MAC address 02:38:08:00:76:00 successfully registered [ 23.709373] qeth 0.0.e400: MAC address 02:38:08:00:98:00 successfully registered [ 23.713864] qeth 0.0.bd00: MAC address 3a:a4:04:94:65:31 successfully registered [ 23.762803] qeth 0.0.bd00: MAC address 02:38:08:00:76:00 successfully registered [ 23.980344] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. [ 24.021545] tun: Universal TUN/TAP device driver, 1.6 [ 24.022460] virbr0: port 1(virbr0-nic) entered blocking state [ 24.022461] virbr0: port 1(virbr0-nic) entered disabled state [ 24.022532] device virbr0-nic entered promiscuous mode [ 24.265330] bond0: (slave enccw0.0.bd00): making interface the new active one [ 24.265435] bond0: (slave enccw0.0.bd00): Enslaving as an active interface with an up link [ 24.265662] IPv6: ADDRCONF(NETDEV_CHANGE): bond0: link becomes ready [ 24.472270] virbr0: port 1(virbr0-nic) entered blocking state [ 24.472273] virbr0: port 1(virbr0-nic) entered listening state [ 24.500413] virbr0: port 1(virbr0-nic) entered disabled state [ 34.272547] ------------[ cut here ]------------ [ 34.272557] WARNING: CPU: 21 PID: 275 at lib/percpu-refcount.c:111 percpu_ref_exit+0x50/0x58 [ 34.272558] Modules linked in: kvm(-) xt_CHECKSUM xt_MASQUERADE xt_tcpudp ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 tun xt_conntrack bridge ip6table_nat ip6table_mangle ip6table_raw stp ip6table_security llc iptable_nat nf_nat iptable_mangle iptable_raw iptable_security bonding nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ip_set nfnetlink ip6table_filter ip6_tables iptable_filter dm_service_time rpcrdma sunrpc rdma_ucm rdma_cm iw_cm ib_cm configfs ghash_s390 mlx4_ib prng des_s390 libdes ib_uverbs ib_core sha512_s390 sha1_s390 vfio_ccw vfio_mdev mdev eadm_sch vfio_iommu_type1 zcrypt_cex4 vfio sch_fq_codel ip_tables x_tables mlx4_en mlx4_core sha256_s390 sha_common dm_multipath scsi_dh_rdac scsi_dh_emc scsi_dh_alua dm_mirror dm_region_hash dm_log dm_mod pkey zcrypt rng_core autofs4 [ 34.272593] CPU: 21 PID: 275 Comm: kworker/21:1 Not tainted 5.4.0-rc8-next-20191122 #70 [ 34.272594] Hardware name: IBM 2964 NC9 712 (LPAR) [ 34.272598] Workqueue: events sysfs_slab_remove_workfn [ 34.272599] Krnl PSW : 0704e00180000000 000000136693a358 (percpu_ref_exit+0x50/0x58) [ 34.272602] R:0 T:1 IO:1 EX:1 Key:0 M:1 W:0 P:0 AS:3 CC:2 PM:0 RI:0 EA:3 [ 34.272603] Krnl GPRS: 00000000fffff008 000000136693a230 000003f320603e68 0000001fa66f7000 [ 34.272604] 0000001f00000000 002c008100000000 0000001f97b406b8 0000000000000000 [ 34.272606] 0000001fbde29200 0000000000000000 00000013670d7828 0000001f97b40700 [ 34.272631] 0000001fb5380000 0000001fbde24700 000003e00cb8fd00 000003e00cb8fcd0 [ 34.272639] Krnl Code: 000000136693a34a: f0a0000407fe srp 4(11,%r0),2046,0 000000136693a350: 47000700 bc 0,1792 #000000136693a354: a7f40001 brc 15,000000136693a356 >000000136693a358: a7f4fff2 brc 15,000000136693a33c 000000136693a35c: 0707 bcr 0,%r7 000000136693a35e: 0707 bcr 0,%r7 000000136693a360: eb8ff0580024 stmg %r8,%r15,88(%r15) 000000136693a366: a738ffff lhi %r3,-1 [ 34.272651] Call Trace: [ 34.272653] ([<000003e00cb8fd00>] 0x3e00cb8fd00) [ 34.272658] [<00000013664e04b0>] slab_kmem_cache_release+0x30/0x58 [ 34.272661] [<0000001366cab9c2>] kobject_put+0xaa/0xe8 [ 34.272663] [<00000013663314d4>] process_one_work+0x1fc/0x440 [ 34.272665] [<0000001366331760>] worker_thread+0x48/0x460 [ 34.272667] [<0000001366338cae>] kthread+0x126/0x160 [ 34.272669] [<0000001366cc9f9c>] ret_from_fork+0x28/0x30 [ 34.272671] [<0000001366cc9fa4>] kernel_thread_starter+0x0/0x10 [ 34.272671] Last Breaking-Event-Address: [ 34.272673] [<000000136693a354>] percpu_ref_exit+0x4c/0x58 [ 34.272674] ---[ end trace 9556bf4ae9878b8f ]---
Re: WARNING bisected (was Re: [PATCH v7 08/10] mm: rework non-root kmem_cache lifecycle management)
In reply to Roman GushchinQuoted 2 lines · Roman Gushchin
I see. Do you know, which
kmem_cacheit is? If not, can you, please, figure it out?
The release function for that ref is kmemcg_cache_shutdown.
Re: WARNING bisected (was Re: [PATCH v7 08/10] mm: rework non-root kmem_cache lifecycle management)
Quoted 6 lines · Christian Borntraeger
Quoted 2 lines · Roman Gushchin
I see. Do you know, which
kmem_cacheit is? If not, can you, please, figure it out?The release function for that ref is
kmemcg_cache_shutdown.
Hi Christian!
Can you, please, test if the following patch resolves the problem?
mm/slab_common.c +9 -0
@@ -888,6 +888,8 @@ static int shutdown_memcg_caches(struct kmem_cache *s)static void flush_memcg_workqueue (struct kmem_cache *s) { +bool wait_for_children; +spin_lock_irq (&memcg_kmem_wq_lock); s->memcg_params.dying = true;spin_unlock_irq (&memcg_kmem_wq_lock);
@@ -904,6 +906,13 @@ static void flush_memcg_workqueue(struct kmem_cache *s)* previous workitems on workqueue are processed. */ flush_workqueue (memcg_kmem_cache_wq); + +mutex_lock (&slab_mutex); + wait_for_children = !list_empty (&s->memcg_params.children); +mutex_unlock (&slab_mutex); + +if (wait_for_children) + rcu_barrier(); }#else static inline int shutdown_memcg_caches (struct kmem_cache *s)
--
Thanks!
Re: WARNING bisected (was Re: [PATCH v7 08/10] mm: rework non-root kmem_cache lifecycle management)
Quoted 11 lines · Roman Gushchin
Quoted 6 lines · Christian Borntraeger
Quoted 2 lines · Roman Gushchin
I see. Do you know, which
kmem_cacheit is? If not, can you, please, figure it out?The release function for that ref is
kmemcg_cache_shutdown.Hi Christian!
Can you, please, test if the following patch resolves the problem?
Yes, it does.
Quoted 15 lines
mm/slab_common.c +2
-0@@ -888,6 +888,8 @@ static int shutdown_memcg_caches(struct kmem_cache *s)static void flush_memcg_workqueue (struct kmem_cache *s) { +bool wait_for_children; +spin_lock_irq (&memcg_kmem_wq_lock); s->memcg_params.dying = true;spin_unlock_irq (&memcg_kmem_wq_lock);
mm/slab_common.c static void flush_memcg_workqueue(struct kmem_cache *s) · line 912
Quoted 7 lines
mm/slab_common.c +4
-0@@ -904,6 +906,13 @@ static void flush_memcg_workqueue(struct kmem_cache *s)* previous workitems on workqueue are processed. */ flush_workqueue (memcg_kmem_cache_wq); + +mutex_lock (&slab_mutex); + wait_for_children = !list_empty (&s->memcg_params.children); +mutex_unlock (&slab_mutex);
Not sure if (for reading) we really need the mutex.
Quoted 11 lines
mm/slab_common.c +3
-1+ +if (wait_for_children) + rcu_barrier(); }#else static inline int shutdown_memcg_caches (struct kmem_cache *s) --Thanks!
Re: WARNING bisected (was Re: [PATCH v7 08/10] mm: rework non-root kmem_cache lifecycle management)
Quoted 8 lines · Christian Borntraeger
Quoted 5 lines · Roman Gushchin
Quoted 4 lines · Christian Borntraeger
Quoted 2 lines · Roman Gushchin
I see. Do you know, which
kmem_cacheit is? If not, can you, please, figure it out?
Quoted 8 lines
Quoted 6 lines
Quoted 2 lines
The release function for that ref is
kmemcg_cache_shutdown.Hi Christian!
Can you, please, test if the following patch resolves the problem?
Yes, it does.
Thanks for testing it!
I'll send the patch shortly.
Quoted 18 lines
Quoted 18 lines
mm/slab_common.c +2
-0@@ -888,6 +888,8 @@ static int shutdown_memcg_caches(struct kmem_cache *s)static void flush_memcg_workqueue (struct kmem_cache *s) { +bool wait_for_children; +spin_lock_irq (&memcg_kmem_wq_lock); s->memcg_params.dying = true;spin_unlock_irq (&memcg_kmem_wq_lock);@@ -904,6 +906,13 @@ static void flush_memcg_workqueue(struct kmem_cache *s)* previous workitems on workqueue are processed.
Quoted 8 lines
mm/slab_common.c static void flush_memcg_workqueue(struct kmem_cache *s) · line 912
Quoted 6 lines
mm/slab_common.c +4
-0*/ flush_workqueue (memcg_kmem_cache_wq); + +mutex_lock (&slab_mutex); + wait_for_children = !list_empty (&s->memcg_params.children); +mutex_unlock (&slab_mutex);Not sure if (for reading) we really need the mutex.
Good point!
At this moment the list of children caches can't grow, only shrink. So if we're reading it without the slab mutex, the worst thing can happen is that we'll make an excessive rcu_barrier() call. Which is fine given that resulting code looks much simpler.
Thanks!
PATCH v7 9/10 mm: stop setting page->mem_cgroup pointer for slab pages
In reply to Roman GushchinEvery slab page charged to a non-root memory cgroup has a pointer to the memory cgroup and holds a reference to it, which protects a non-empty memory cgroup from being released. At the same time the page has a pointer to the corresponding kmem_cache, and also hold a reference to the kmem_cache. And kmem_cache by itself holds a reference to the cgroup.
So there is clearly some redundancy, which allows to stop setting the page->mem_cgroup pointer and rely on getting memcg pointer indirectly via kmem_cache. Further it will allow to change this pointer easier, without a need to go over all charged pages.
So let's stop setting page->mem_cgroup pointer for slab pages, and stop using the css refcounter directly for protecting the memory cgroup from going away. Instead rely on kmem_cache as an intermediate object.
Make sure that vmstats and shrinker lists are working as previously, as well as /proc/kpagecgroup interface.
--- mm/list_lru.c | 3 +- mm/memcontrol.c | 12 ++++---- mm/slab.h | 74 ++++++++++++++++++++++++++++++++++++++++--------- 3 files changed, 70 insertions(+), 19 deletions(-)
mm/list_lru.c +2 -1
@@ -12,6 +12,7 @@#include <linux/slab.h> #include <linux/mutex.h> #include <linux/memcontrol.h> +#include "slab.h" #ifdef CONFIG_MEMCG_KMEM static LIST_HEAD (list_lrus);
@@ -63,7 +64,7 @@ static __always_inline struct mem_cgroup *mem_cgroup_from_kmem(void *ptr)if (!memcg_kmem_enabled ())return NULL ; page =virt_to_head_page (ptr); -return page->mem_cgroup; +return memcg_from_slab_page (page); } static inline struct list_lru_one *
mm/memcontrol.c +7 -5
@@ -486,7 +486,10 @@ ino_t page_cgroup_ino(struct page *page)unsigned long ino =0 ;rcu_read_lock (); - memcg =READ_ONCE (page->mem_cgroup); +if (PageHead (page) &&PageSlab (page)) + memcg =memcg_from_slab_page (page); +else + memcg =READ_ONCE (page->mem_cgroup);while (memcg && !(memcg->css.flags &CSS_ONLINE )) memcg =parent_mem_cgroup (memcg);if (memcg)
@@ -2807,9 +2810,6 @@ int __memcg_kmem_charge_memcg(struct page *page, gfp_t gfp, int order,cancel_charge (memcg, nr_pages);return -ENOMEM ; } - - page->mem_cgroup = memcg; -return 0 ; }
@@ -2832,8 +2832,10 @@ int __memcg_kmem_charge(struct page *page, gfp_t gfp, int order) memcg =get_mem_cgroup_from_current ();if (!mem_cgroup_is_root (memcg)) { ret =__memcg_kmem_charge_memcg (page, gfp, order, memcg); -if (!ret) +if (!ret) { + page->mem_cgroup = memcg;__SetPageKmemcg (page); + } }css_put (&memcg->css);return ret;
mm/slab.h +61 -13
115 lines not on this page · raw message
Signature · 1 line
2.21.0
Re: [PATCH v7 09/10] mm: stop setting page->mem_cgroup pointer for slab pages
Quoted 18 lines · Roman Gushchin
Every slab page charged to a non-root memory cgroup has a pointer to the memory cgroup and holds a reference to it, which protects a non-empty memory cgroup from being released. At the same time the page has a pointer to the corresponding
kmem_cache, and also hold a reference to thekmem_cache. Andkmem_cacheby itself holds a reference to the cgroup.So there is clearly some redundancy, which allows to stop setting the
page->mem_cgrouppointer and rely on getting memcg pointer indirectly viakmem_cache. Further it will allow to change this pointer easier, without a need to go over all charged pages.So let's stop setting
page->mem_cgrouppointer for slab pages, and stop using the css refcounter directly for protecting the memory cgroup from going away. Instead rely onkmem_cacheas an intermediate object.
Quoted 5 lines
Make sure that vmstats and shrinker lists are working as previously, as well as
/proc/kpagecgroupinterface.Signed-off-by Roman Gushchin <[email protected]>Acked-by Vladimir Davydov <[email protected]>
PATCH v7 10/10 mm: reparent memcg kmem_caches on cgroup removal
In reply to Roman GushchinLet's reparent non-root kmem_caches on memcg offlining. This allows us to release the memory cgroup without waiting for the last outstanding kernel object (e.g. dentry used by another application).
Since the parent cgroup is already charged, everything we need to do is to splice the list of kmem_caches to the parent's kmem_caches list, swap the memcg pointer, drop the css refcounter for each kmem_cache and adjust the parent's css refcounter.
Please, note that kmem_cache->memcg_params.memcg isn't a stable pointer anymore. It's safe to read it under rcu_read_lock(), cgroup_mutex held, or any other way that protects the memory cgroup from being released.
We can race with the slab allocation and deallocation paths. It's not a big problem: parent's charge and slab global stats are always correct, and we don't care anymore about the child usage and global stats. The child cgroup is already offline, so we don't use or show it anywhere.
Local slab stats (NR_SLAB_RECLAIMABLE and NR_SLAB_UNRECLAIMABLE) aren't used anywhere except count_shadow_nodes(). But even there it won't break anything: after reparenting "nodes" will be 0 on child level (because we're already reparenting shrinker lists), and on parent level page stats always were 0, and this patch won't change anything.
--- include/linux/slab.h | 2 +- mm/memcontrol.c | 14 ++++++++------ mm/slab.h | 26 ++++++++++++++++++++------ mm/slab_common.c | 19 +++++++++++++++++-- 4 files changed, 46 insertions(+), 15 deletions(-)
include/linux/slab.h +1 -1
@@ -152,7 +152,7 @@ void kmem_cache_destroy(struct kmem_cache *);int kmem_cache_shrink (struct kmem_cache *);void memcg_create_kmem_cache (struct mem_cgroup *,struct kmem_cache *); -void memcg_deactivate_kmem_caches (struct mem_cgroup *); +void memcg_deactivate_kmem_caches (struct mem_cgroup *,struct mem_cgroup *);/* * Please use this macro to create slab caches. Simply specify the
mm/memcontrol.c +8 -6
@@ -3289,15 +3289,15 @@ static void memcg_offline_kmem(struct mem_cgroup *memcg)*/ memcg->kmem_state =KMEM_ALLOCATED ; -memcg_deactivate_kmem_caches (memcg); - - kmemcg_id = memcg->kmemcg_id; -BUG_ON (kmemcg_id <0 ); - parent =parent_mem_cgroup (memcg);if (!parent) parent = root_mem_cgroup; +memcg_deactivate_kmem_caches (memcg, parent); + + kmemcg_id = memcg->kmemcg_id; +BUG_ON (kmemcg_id <0 ); +/* * Change kmemcg_id of this cgroup and all its descendants to the * parent's id, and then move all entries from this cgroup's list_lrus
@@ -3330,7 +3330,6 @@ static void memcg_free_kmem(struct mem_cgroup *memcg)if (memcg->kmem_state ==KMEM_ALLOCATED ) {WARN_ON (!list_empty (&memcg->kmem_caches));static_branch_dec (&memcg_kmem_enabled_key); -WARN_ON (page_counter_read (&memcg->kmem)); } }#else
@@ -4777,6 +4776,9 @@ mem_cgroup_css_alloc(struct cgroup_subsys_state *parent_css)/* The following stuff does not apply to the root */ if (!parent) { +#ifdef CONFIG_MEMCG_KMEM +INIT_LIST_HEAD (&memcg->kmem_caches); +#endif root_mem_cgroup = memcg;return &memcg->css; }
mm/slab.h +20 -6
@@ -261,6 +261,9 @@ static inline struct kmem_cache *memcg_root_cache(struct kmem_cache *s)* which do not have slab_cache pointer set. * So this function assumes that the page can pass PageHead() and PageSlab() * checks. +* +* The kmem_cache can be reparented asynchronously. The caller must ensure +* the memcg lifetime, e.g. by taking rcu_read_lock() or cgroup_mutex. */ static inline struct mem_cgroup *memcg_from_slab_page (struct page *page) {
@@ -268,7 +271,7 @@ static inline struct mem_cgroup *memcg_from_slab_page(struct page *page) s =READ_ONCE (page->slab_cache);if (s && !is_root_cache (s)) -return s->memcg_params.memcg; +return READ_ONCE (s->memcg_params.memcg);return NULL ; }
@@ -285,10 +288,18 @@ static __always_inline int memcg_charge_slab(struct page *page,struct lruvec *lruvec;int ret; - memcg = s->memcg_params.memcg; +rcu_read_lock (); + memcg =READ_ONCE (s->memcg_params.memcg); +while (memcg && !css_tryget_online (&memcg->css)) + memcg =parent_mem_cgroup (memcg); +rcu_read_unlock (); + +if (unlikely (!memcg)) +return true; + ret =memcg_kmem_charge_memcg (page, gfp, order, memcg);if (ret) -return ret; + goto out; lruvec =mem_cgroup_lruvec (page_pgdat (page), memcg);mod_lruvec_state (lruvec,cache_vmstat_idx (s),1 << order);
@@ -296,8 +307,9 @@ static __always_inline int memcg_charge_slab(struct page *page,/* transer try_charge() page references to kmem_cache */ percpu_ref_get_many (&s->memcg_params.refcnt,1 << order);css_put_many (&memcg->css,1 << order); - -return 0 ; +out: +css_put (&memcg->css); +return ret; }/*
@@ -310,10 +322,12 @@ static __always_inline void memcg_uncharge_slab(struct page *page, int order,struct mem_cgroup *memcg;struct lruvec *lruvec; - memcg = s->memcg_params.memcg; +rcu_read_lock (); + memcg =READ_ONCE (s->memcg_params.memcg); lruvec =mem_cgroup_lruvec (page_pgdat (page), memcg);mod_lruvec_state (lruvec,cache_vmstat_idx (s), -(1 << order));memcg_kmem_uncharge_memcg (page, order, memcg); +rcu_read_unlock ();percpu_ref_put_many (&s->memcg_params.refcnt,1 << order); }
mm/slab_common.c +17 -2
@@ -252,7 +252,8 @@ static void memcg_unlink_cache(struct kmem_cache *s) } else {list_del (&s->memcg_params.children_node);list_del (&s->memcg_params.kmem_caches_node); -css_put (&s->memcg_params.memcg->css); +mem_cgroup_put (s->memcg_params.memcg); +WRITE_ONCE (s->memcg_params.memcg,NULL ); } }#else
@@ -790,11 +791,13 @@ static void kmemcg_cache_deactivate(struct kmem_cache *s)spin_unlock_irq (&memcg_kmem_wq_lock); } -void memcg_deactivate_kmem_caches (struct mem_cgroup *memcg) +void memcg_deactivate_kmem_caches (struct mem_cgroup *memcg, +struct mem_cgroup *parent) {int idx;struct memcg_cache_array *arr;struct kmem_cache *s, *c; +unsigned int nr_reparented; idx =memcg_cache_id (memcg);
@@ -812,6 +815,18 @@ void memcg_deactivate_kmem_caches(struct mem_cgroup *memcg)kmemcg_cache_deactivate (c); arr->entries[idx] =NULL ; } + nr_reparented =0 ; +list_for_each_entry (s, &memcg->kmem_caches, + memcg_params.kmem_caches_node) { +WRITE_ONCE (s->memcg_params.memcg, parent); +css_put (&memcg->css); + nr_reparented++; + } +if (nr_reparented) { +list_splice_init (&memcg->kmem_caches, + &parent->kmem_caches); +css_get_many (&parent->css, nr_reparented); + }mutex_unlock (&slab_mutex);put_online_mems ();
Signature · 1 line
2.21.0
Re: [PATCH v7 10/10] mm: reparent memcg kmem_caches on cgroup removal
Quoted 20 lines · Roman Gushchin
Let's reparent non-root
kmem_cacheson memcg offlining. This allows us to release the memory cgroup without waiting for the last outstanding kernel object (e.g. dentry used by another application).Since the parent cgroup is already charged, everything we need to do is to splice the list of
kmem_cachesto the parent'skmem_cacheslist, swap the memcg pointer, drop the css refcounter for eachkmem_cacheand adjust the parent's css refcounter.Please, note that
kmem_cache->memcg_params.memcgisn't a stable pointer anymore. It's safe to read it underrcu_read_lock(),cgroup_mutexheld, or any other way that protects the memory cgroup from being released.We can race with the slab allocation and deallocation paths. It's not a big problem: parent's charge and slab global stats are always correct, and we don't care anymore about the child usage and global stats. The child cgroup is already offline, so we don't use or show it anywhere.
Quoted 8 lines
Local slab stats (
NR_SLAB_RECLAIMABLEandNR_SLAB_UNRECLAIMABLE) aren't used anywhere exceptcount_shadow_nodes(). But even there it won't break anything: after reparenting "nodes" will be 0 on child level (because we're already reparenting shrinker lists), and on parent level page stats always were 0, and this patch won't change anything.Signed-off-by Roman Gushchin <[email protected]>
Re: [PATCH v7 10/10] mm: reparent memcg kmem_caches on cgroup removal
In reply to Roman GushchinQuoted 21 lines · Roman Gushchin
Let's reparent non-root
kmem_cacheson memcg offlining. This allows us to release the memory cgroup without waiting for the last outstanding kernel object (e.g. dentry used by another application).Since the parent cgroup is already charged, everything we need to do is to splice the list of
kmem_cachesto the parent'skmem_cacheslist, swap the memcg pointer, drop the css refcounter for eachkmem_cacheand adjust the parent's css refcounter.Please, note that
kmem_cache->memcg_params.memcgisn't a stable pointer anymore. It's safe to read it underrcu_read_lock(),cgroup_mutexheld, or any other way that protects the memory cgroup from being released.We can race with the slab allocation and deallocation paths. It's not a big problem: parent's charge and slab global stats are always correct, and we don't care anymore about the child usage and global stats. The child cgroup is already offline, so we don't use or show it anywhere.
Quoted 8 lines
Local slab stats (
NR_SLAB_RECLAIMABLEandNR_SLAB_UNRECLAIMABLE) aren't used anywhere exceptcount_shadow_nodes(). But even there it won't break anything: after reparenting "nodes" will be 0 on child level (because we're already reparenting shrinker lists), and on parent level page stats always were 0, and this patch won't change anything.Signed-off-by Roman Gushchin <[email protected]>
The reparenting of top level memcg and "return true" is fixed in the later patch.