linux.git/mm/memory.c, branch v6.7-rc2

mm: use folio_xchg_last_cpupid() in wp_page_reuse()

2023-10-25T23:47:13+00:00

Convert to use folio_xchg_last_cpupid() in wp_page_reuse(), and remove
page variable. Since now only normal and PMD-mapped page is handled by
numa balancing, it's enough to only update the entire folio's last cpupid.

Link: https://lkml.kernel.org/r/20231018140806.2783514-19-wangkefeng.wang@huawei.com
Signed-off-by: Kefeng Wang 
Cc: David Hildenbrand 
Cc: Huang Ying 
Cc: Ingo Molnar 
Cc: Juri Lelli 
Cc: Matthew Wilcox (Oracle) 
Cc: Peter Zijlstra 
Cc: Vincent Guittot 
Cc: Zi Yan 
Signed-off-by: Andrew Morton

mm: convert wp_page_reuse() and finish_mkwrite_fault() to take a folio

2023-10-25T23:47:13+00:00

Saves one compound_head() call, also in preparation for
page_cpupid_xchg_last() conversion.

Link: https://lkml.kernel.org/r/20231018140806.2783514-18-wangkefeng.wang@huawei.com
Signed-off-by: Kefeng Wang 
Cc: David Hildenbrand 
Cc: Huang Ying 
Cc: Ingo Molnar 
Cc: Juri Lelli 
Cc: Matthew Wilcox (Oracle) 
Cc: Peter Zijlstra 
Cc: Vincent Guittot 
Cc: Zi Yan 
Signed-off-by: Andrew Morton

mm: make finish_mkwrite_fault() static

2023-10-25T23:47:12+00:00

Make finish_mkwrite_fault static since it is not used outside of
memory.c.

Link: https://lkml.kernel.org/r/20231018140806.2783514-17-wangkefeng.wang@huawei.com
Signed-off-by: Kefeng Wang 
Cc: David Hildenbrand 
Cc: Huang Ying 
Cc: Ingo Molnar 
Cc: Juri Lelli 
Cc: Matthew Wilcox (Oracle) 
Cc: Peter Zijlstra 
Cc: Vincent Guittot 
Cc: Zi Yan 
Signed-off-by: Andrew Morton

mm: memory: use folio_last_cpupid() in do_numa_page()

2023-10-25T23:47:11+00:00

Convert to use folio_last_cpupid() in do_numa_page().

Link: https://lkml.kernel.org/r/20231018140806.2783514-4-wangkefeng.wang@huawei.com
Signed-off-by: Kefeng Wang 
Cc: David Hildenbrand 
Cc: Huang Ying 
Cc: Ingo Molnar 
Cc: Juri Lelli 
Cc: Matthew Wilcox (Oracle) 
Cc: Peter Zijlstra 
Cc: Vincent Guittot 
Cc: Zi Yan 
Signed-off-by: Andrew Morton

mm/gup: adapt get_user_page_vma_remote() to never return NULL

2023-10-18T21:34:15+00:00

get_user_pages_remote() will never return 0 except in the case of
FOLL_NOWAIT being specified, which we explicitly disallow.

This simplifies error handling for the caller and avoids the awkwardness
of dealing with both errors and failing to pin.  Failing to pin here is an
error.

Link: https://lkml.kernel.org/r/00319ce292d27b3aae76a0eb220ce3f528187508.1696288092.git.lstoakes@gmail.com
Signed-off-by: Lorenzo Stoakes 
Suggested-by: Arnd Bergmann 
Reviewed-by: Arnd Bergmann 
Acked-by: Catalin Marinas 
Reviewed-by: David Hildenbrand 
Reviewed-by: Jason Gunthorpe 
Cc: Adrian Hunter 
Cc: Alexander Shishkin 
Cc: Arnaldo Carvalho de Melo 
Cc: Ian Rogers 
Cc: Ingo Molnar 
Cc: Jiri Olsa 
Cc: John Hubbard 
Cc: Mark Rutland 
Cc: Namhyung Kim 
Cc: Oleg Nesterov 
Cc: Peter Zijlstra 
Cc: Richard Cochran 
Cc: Will Deacon 
Signed-off-by: Andrew Morton

mm: make __access_remote_vm() static

2023-10-18T21:34:15+00:00

Patch series "various improvements to the GUP interface", v2.

A series of fixes to simplify and improve the GUP interface with an eye to
providing groundwork to future improvements:-

* __access_remote_vm() and access_remote_vm() are functionally identical,
  so make the former static such that in future we can potentially change
  the external-facing implementation details of this function.

* Extend is_valid_gup_args() to cover the missing FOLL_TOUCH case, and
  simplify things by defining INTERNAL_GUP_FLAGS to check against.

* Adjust __get_user_pages_locked() to explicitly treat a failure to pin any
  pages as an error in all circumstances other than FOLL_NOWAIT being
  specified, bringing it in line with the nommu implementation of this
  function.

* (With many thanks to Arnd who suggested this in the first instance)
  Update get_user_page_vma_remote() to explicitly only return a page or an
  error, simplifying the interface and avoiding the questionable
  IS_ERR_OR_NULL() pattern.


This patch (of 4):

access_remote_vm() passes through parameters to __access_remote_vm()
directly, so remove the __access_remote_vm() function from mm.h and use
access_remote_vm() in the one caller that needs it (ptrace_access_vm()).

This allows future adjustments to the GUP-internal __access_remote_vm()
function while keeping the access_remote_vm() function stable.

Link: https://lkml.kernel.org/r/cover.1696288092.git.lstoakes@gmail.com
Link: https://lkml.kernel.org/r/f7877c5039ce1c202a514a8aeeefc5cdd5e32d19.1696288092.git.lstoakes@gmail.com
Signed-off-by: Lorenzo Stoakes 
Reviewed-by: Arnd Bergmann 
Reviewed-by: David Hildenbrand 
Reviewed-by: Jason Gunthorpe 
Cc: Adrian Hunter 
Cc: Alexander Shishkin 
Cc: Arnaldo Carvalho de Melo 
Cc: Catalin Marinas 
Cc: Ian Rogers 
Cc: Ingo Molnar 
Cc: Jiri Olsa 
Cc: John Hubbard 
Cc: Mark Rutland 
Cc: Namhyung Kim 
Cc: Oleg Nesterov 
Cc: Peter Zijlstra 
Cc: Richard Cochran 
Cc: Will Deacon 
Signed-off-by: Andrew Morton

memory: move exclusivity detection in do_wp_page() into wp_can_reuse_anon_folio()

2023-10-18T21:34:14+00:00

Let's clean up do_wp_page() a bit, removing two labels and making it a
easier to read.

wp_can_reuse_anon_folio() now only operates on the whole folio.  Move the
SetPageAnonExclusive() out into do_wp_page().  No need to do this under
page lock -- the page table lock is sufficient.

Link: https://lkml.kernel.org/r/20231002142949.235104-4-david@redhat.com
Signed-off-by: David Hildenbrand 
Cc: Mike Kravetz 
Cc: Muchun Song 
Cc: Suren Baghdasaryan 
Cc: Matthew Wilcox 
Signed-off-by: Andrew Morton

mm/rmap: convert page_move_anon_rmap() to folio_move_anon_rmap()

2023-10-18T21:34:14+00:00

Let's convert it to consume a folio.

[akpm@linux-foundation.org: fix kerneldoc]
Link: https://lkml.kernel.org/r/20231002142949.235104-3-david@redhat.com
Signed-off-by: David Hildenbrand 
Reviewed-by: Suren Baghdasaryan 
Reviewed-by: Vishal Moola (Oracle) 
Cc: Mike Kravetz 
Cc: Muchun Song 
Cc: Matthew Wilcox 
Signed-off-by: Andrew Morton

mm/rmap: move SetPageAnonExclusive() out of page_move_anon_rmap()

2023-10-18T21:34:14+00:00

Patch series "mm/rmap: convert page_move_anon_rmap() to
folio_move_anon_rmap()".

Convert page_move_anon_rmap() to folio_move_anon_rmap(), letting the
callers handle PageAnonExclusive.  I'm including cleanup patch #3 because
it fits into the picture and can be done cleaner by the conversion.


This patch (of 3):

Let's move it into the caller: there is a difference between whether an
anon folio can only be mapped by one process (e.g., into one VMA), and
whether it is truly exclusive (e.g., no references -- including GUP --
from other processes).

Further, for large folios the page might not actually be pointing at the
head page of the folio, so it better be handled in the caller.  This is a
preparation for converting page_move_anon_rmap() to consume a folio.

Link: https://lkml.kernel.org/r/20231002142949.235104-1-david@redhat.com
Link: https://lkml.kernel.org/r/20231002142949.235104-2-david@redhat.com
Signed-off-by: David Hildenbrand 
Reviewed-by: Suren Baghdasaryan 
Reviewed-by: Vishal Moola (Oracle) 
Cc: Mike Kravetz 
Cc: Muchun Song 
Cc: Matthew Wilcox 
Signed-off-by: Andrew Morton

mm: handle write faults to RO pages under the VMA lock

2023-10-18T21:34:14+00:00

I think this is a pretty rare occurrence, but for consistency handle
faults with the VMA lock held the same way that we handle other faults
with the VMA lock held.

Link: https://lkml.kernel.org/r/20231006195318.4087158-7-willy@infradead.org
Signed-off-by: Matthew Wilcox (Oracle) 
Reviewed-by: Suren Baghdasaryan 
Signed-off-by: Andrew Morton