Skip to contentSkip to conversation

HMM status upstream user what's next, mmu_notifier

LSF/MM TOPIC Jerome Glisse 6 participants 8 messages Jan 16, 2018 – Feb 14, 2018 Memory management

lore
Share & tools
lore
#0 lore raw

I want to talk about status of HMM and respective upstream user for it and also talk about what's next in term of features/improvement plan (generic page write protection, mmu_notifier, ...). Most likely short 15-30minutes if mmu_notifier is split into its own topic.

I want to talk about mmu_notifier, specificaly adding more context information to mmu_notifier callback (why a notification is happening reclaim, munmap, migrate, ...). Maybe we can grow this into its own topic and talk about mmu_notifier and issue with it like OOM or being able to sleep/take lock ... and improving mitigation.

People (mmu_notifier probably interest a larger set):
"Anshuman Khandual" <[email protected]> "Balbir Singh" <[email protected]> "David Rientjes" <[email protected]> "John Hubbard" <[email protected]> "Michal Hocko" <[email protected]>

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>

#1 lore raw
Quoted 3 lines · Jerome Glisse

I want to talk about status of HMM and respective upstream user for it and also talk about what's next in term of features/improvement plan (generic page write protection, mmu_notifier, ...). Most likely

I don't think we should consider to push more code to upstream for a nobody-use feature.

AFAIR, Michal also mentioned that HMM need a real user/driver before upstream. But I haven't seen a workable user/driver version.

Looks like HMM is a custom framework for Nvidia, and Nvidia would not like to open source its driver. Even if nvidia really use HMM and open sourced its driver, it's probably the only user. But the HMM framework touched too much core mm code.

Cheers,
Liubo

Quoted 8 lines

short 15-30minutes if mmu_notifier is split into its own topic.

I want to talk about mmu_notifier, specificaly adding more context information to mmu_notifier callback (why a notification is happening reclaim, munmap, migrate, ...). Maybe we can grow this into its own topic and talk about mmu_notifier and issue with it like OOM or being able to sleep/take lock ... and improving mitigation.

Quoted 7 lines

People (mmu_notifier probably interest a larger set):
"Anshuman Khandual" <[email protected]> "Balbir Singh" <[email protected]> "David Rientjes" <[email protected]> "John Hubbard" <[email protected]> "Michal Hocko" <[email protected]>

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>

#2 lore raw

2018-01-17 9:19 GMT+08:00 Liubo(OS Lab) <[email protected]>:

Quoted 12 lines · Jerome Glisse
Quoted 3 lines

I want to talk about status of HMM and respective upstream user for it and also talk about what's next in term of features/improvement plan (generic page write protection, mmu_notifier, ...). Most likely

I don't think we should consider to push more code to upstream for a nobody-use feature.

AFAIR, Michal also mentioned that HMM need a real user/driver before upstream.
But I haven't seen a workable user/driver version.

Quoted 6 lines

Looks like HMM is a custom framework for Nvidia, and Nvidia would not like to open source its driver.
Even if nvidia really use HMM and open sourced its driver, it's probably the only user.
But the HMM framework touched too much core mm code.

HMM looks suitable for FPGA user case, FPGA and CPU need coherency. ~_~

Quoted 27 lines

Cheers,
Liubo

Quoted 8 lines

short 15-30minutes if mmu_notifier is split into its own topic.

I want to talk about mmu_notifier, specificaly adding more context information to mmu_notifier callback (why a notification is happening reclaim, munmap, migrate, ...). Maybe we can grow this into its own topic and talk about mmu_notifier and issue with it like OOM or being able to sleep/take lock ... and improving mitigation.

Quoted 7 lines

People (mmu_notifier probably interest a larger set):
"Anshuman Khandual" <[email protected]> "Balbir Singh" <[email protected]> "David Rientjes" <[email protected]> "John Hubbard" <[email protected]> "Michal Hocko" <[email protected]>

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>

#3 lore raw
In reply to Liubo(OS Lab)
Quoted 5 lines · Liubo(OS Lab)
Quoted 3 lines · Jerome Glisse

I want to talk about status of HMM and respective upstream user for it and also talk about what's next in term of features/improvement plan (generic page write protection, mmu_notifier, ...). Most likely

Quoted 8 lines

I don't think we should consider to push more code to upstream for a nobody-use feature.

AFAIR, Michal also mentioned that HMM need a real user/driver before upstream. But I haven't seen a workable user/driver version.

Looks like HMM is a custom framework for Nvidia, and Nvidia would not like to open source its driver. Even if nvidia really use HMM and open sourced its driver, it's probably the only user. But the HMM framework touched too much core mm code.

So it is not NVidia only, they are other GPU from different company that intend to use HMM, i can't comment any further on timeline.

Regarding NVidia hardware i intend to have the patchset to use HMM inside nouveau ready before summit and post as RFC. Per drm sub-system guideline we can not upstream it until we also have a functional userspace stack and we are also working on that.

Cheers,
Jerome

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>

#5 lore raw
In reply to Jerome Glisse
Quoted 11 lines · Jerome Glisse

I want to talk about status of HMM and respective upstream user for it and also talk about what's next in term of features/improvement plan (generic page write protection, mmu_notifier, ...). Most likely short 15-30minutes if mmu_notifier is split into its own topic.

I want to talk about mmu_notifier, specificaly adding more context information to mmu_notifier callback (why a notification is happening reclaim, munmap, migrate, ...). Maybe we can grow this into its own topic and talk about mmu_notifier and issue with it like OOM or being able to sleep/take lock ... and improving mitigation.

Quoted 7 lines

People (mmu_notifier probably interest a larger set):
"Anshuman Khandual" <[email protected]> "Balbir Singh" <[email protected]> "David Rientjes" <[email protected]> "John Hubbard" <[email protected]> "Michal Hocko" <[email protected]>

Hi Jerome,

Thanks again for including me here. I am very interesting in discussing this, seeing as how we're busy adding HMM support to our driver(s).

The teardown cases still concern us, as you know (today's HMM lacks a callback for when the struct mm disappears, for example), but that's really just a subset of the mmu_notifier discussion that you list above.

Hope to see you there.

thanks,

Signature · 8 lines
John Hubbard
NVIDIA

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to [email protected].  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>
#4 lore raw
In reply to Jerome Glisse
Quoted 15 lines · Jerome Glisse
Quoted 5 lines · Liubo(OS Lab)
Quoted 3 lines · Jerome Glisse

I want to talk about status of HMM and respective upstream user for it and also talk about what's next in term of features/improvement plan (generic page write protection, mmu_notifier, ...). Most likely

Quoted 8 lines

I don't think we should consider to push more code to upstream for a nobody-use feature.

AFAIR, Michal also mentioned that HMM need a real user/driver before upstream. But I haven't seen a workable user/driver version.

Looks like HMM is a custom framework for Nvidia, and Nvidia would not like to open source its driver. Even if nvidia really use HMM and open sourced its driver, it's probably the only user. But the HMM framework touched too much core mm code.

Quoted 7 lines

So it is not NVidia only, they are other GPU from different company that intend to use HMM, i can't comment any further on timeline.

Regarding NVidia hardware i intend to have the patchset to use HMM inside nouveau ready before summit and post as RFC. Per drm sub-system guideline we can not upstream it until we also have a functional userspace stack and we are also working on that.

I would really appreciate to at least see some form of RFC work. It would be a pity to have a HMM discussion anniversary without an actual user in sight.

Signature · 8 lines
Michal Hocko
SUSE Labs

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to [email protected].  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>
#6 lore raw
In reply to Jerome Glisse
Quoted 11 lines · Jerome Glisse

I want to talk about status of HMM and respective upstream user for it and also talk about what's next in term of features/improvement plan (generic page write protection, mmu_notifier, ...). Most likely short 15-30minutes if mmu_notifier is split into its own topic.

I want to talk about mmu_notifier, specificaly adding more context information to mmu_notifier callback (why a notification is happening reclaim, munmap, migrate, ...). Maybe we can grow this into its own topic and talk about mmu_notifier and issue with it like OOM or being able to sleep/take lock ... and improving mitigation.

Quoted 6 lines

People (mmu_notifier probably interest a larger set):
"Anshuman Khandual" <[email protected]> "Balbir Singh" <[email protected]> "David Rientjes" <[email protected]> "John Hubbard" <[email protected]> "Michal Hocko" <[email protected]>

I am definitely interested.

Signature · 8 lines
Michal Hocko
SUSE Labs

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to [email protected].  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>
#7 lore raw
Quoted 12 lines · Michal Hocko
Quoted 11 lines · Jerome Glisse

I want to talk about status of HMM and respective upstream user for it and also talk about what's next in term of features/improvement plan (generic page write protection, mmu_notifier, ...). Most likely short 15-30minutes if mmu_notifier is split into its own topic.

I want to talk about mmu_notifier, specificaly adding more context information to mmu_notifier callback (why a notification is happening reclaim, munmap, migrate, ...). Maybe we can grow this into its own topic and talk about mmu_notifier and issue with it like OOM or being able to sleep/take lock ... and improving mitigation.

Quoted 8 lines
Quoted 6 lines

People (mmu_notifier probably interest a larger set):
"Anshuman Khandual" <[email protected]> "Balbir Singh" <[email protected]> "David Rientjes" <[email protected]> "John Hubbard" <[email protected]> "Michal Hocko" <[email protected]>

I am definitely interested.

me too and as I said in the previous email, we may have other examples of coherent memory like openCAPI and lots of experience with both NUMA and HMM/HMM-CDM. I'd like to share them and discuss the path forward

Balbir Singh.

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>