linux.git/include/asm-x86/pgtable-3level.h, branch v2.6.27

x86: rename PTE_MASK to PTE_PFN_MASK

2008-07-22T08:43:44+00:00

Rusty, in his peevish way, complained that macros defining constants
should have a name which somewhat accurately reflects the actual
purpose of the constant.

Aside from the fact that PTE_MASK gives no clue as to what's actually
being masked, and is misleadingly similar to the functionally entirely
different PMD_MASK, PUD_MASK and PGD_MASK, I don't really see what the
problem is.

But if this patch silences the incessent noise, then it will have
achieved its goal (TODO: write test-case).

Signed-off-by: Jeremy Fitzhardinge 
Cc: Rusty Russell 
Signed-off-by: Ingo Molnar

x86: use PTE_MASK in 32-bit PAE

2008-05-20T14:51:21+00:00

Use PTE_MASK in 3-level pagetables (ie, 32-bit PAE).

Signed-off-by: Jeremy Fitzhardinge 
Tested-by: Hugh Dickins 
Signed-off-by: Linus Torvalds

include/asm-x86/pgtable-3level.h: checkpatch cleanups - formatting only

2008-04-17T15:41:26+00:00

Signed-off-by: Joe Perches 
Signed-off-by: Ingo Molnar

x86: update reference for PAE tlb flushing

2008-02-04T15:48:02+00:00

Remove bogus reference to "Pentium-II erratum A13" and point to the
actual canonical source of information about what requirements x86
processors have for PAE pagetable updates.

Signed-off-by: Jeremy Fitzhardinge 
Signed-off-by: Ingo Molnar 
Signed-off-by: Thomas Gleixner

x86: pud_clear: only reload cr3 if necessary

2008-02-04T15:48:02+00:00

Rather than unconditionally reloading cr3, only do so if the pud we're
updating is within the active pgd.

This eliminates TLB flushes most of the time.  The
performance-critical uses of pud_clear are during execve and exit, but
in those cases cr3 is referring to some other pagetable.  The only
other use of pud_clear is during a large (1Gbyte+) munmap, and those
are sufficiently rare that a couple of cr3 reloads won't hurt.

Signed-off-by: Jeremy Fitzhardinge 
Signed-off-by: Ingo Molnar 
Signed-off-by: Thomas Gleixner

x86: revert "defer cr3 reload when doing pud_clear()"

2008-02-04T15:48:02+00:00

Revert "defer cr3 reload when doing pud_clear()" since I'm going to
replace it.

Signed-off-by: Jeremy Fitzhardinge 
Signed-off-by: Ingo Molnar 
Signed-off-by: Thomas Gleixner

x86: defer cr3 reload when doing pud_clear()

2008-01-30T12:34:11+00:00

PAE mode requires that we reload cr3 in order to guarantee that
changes to the pgd will be noticed by the processor.  This means that
in principle pud_clear needs to reload cr3 every time.  However,
because reloading cr3 implies a tlb flush, we want to avoid it where
possible.

pud_clear() is only used in a couple of places:
 - in free_pmd_range(), when pulling down a range of process address space, and
 - huge_pmd_unshare()

In both cases, the calling code will do a a tlb flush anyway, so
there's no need to do it within pud_clear().

In free_pmd_range(), the pud_clear is immediately followed by
pmd_free_tlb(); we can hook that to make the mmu_gather do an
unconditional full flush to make sure cr3 gets reloaded.

In huge_pmd_unshare, it is followed by flush_tlb_range, which always
results in a full cr3-reload tlb flush.

Signed-off-by: Jeremy Fitzhardinge 
Cc: Andi Kleen 
Cc: Linus Torvalds 
Cc: H. Peter Anvin 
Cc: William Irwin 
Signed-off-by: Ingo Molnar 
Signed-off-by: Thomas Gleixner

x86: don't special-case pmd allocations as much

2008-01-30T12:34:11+00:00

In x86 PAE mode, stop treating pmds as a special case.  Previously
they were always allocated and freed with the pgd.  The modifies the
code to be the same as 64-bit mode, where they are allocated on
demand.

This is a step on the way to unifying 32/64-bit pagetable allocation
as much as possible.

There is a complicating wart, however.  When you install a new
reference to a pmd in the pgd, the processor isn't guaranteed to see
it unless you reload cr3.  Since reloading cr3 also has the
side-effect of flushing the tlb, this is an expense that we want to
avoid whereever possible.

This patch simply avoids reloading cr3 unless the update is to the
current pagetable.  Later patches will optimise this further.

Signed-off-by: Jeremy Fitzhardinge 
Cc: Andi Kleen 
Cc: Linus Torvalds 
Cc: H. Peter Anvin 
Cc: William Irwin 
Signed-off-by: Ingo Molnar 
Signed-off-by: Thomas Gleixner

x86: clean up pte_exec

2008-01-30T12:33:42+00:00

- Rename it to pte_exec() from pte_exec_kernel(). There is nothing
kernel specific in there.
- Move it into the common file because _PAGE_NX is 0 on !PAE and then
pte_exec() will be always evaluate to true.

Signed-off-by: Andi Kleen 
Signed-off-by: Harvey Harrison 
Signed-off-by: Ingo Molnar 
Signed-off-by: Thomas Gleixner

x86: demacro asm-x86/pgalloc_32.h

2008-01-30T12:33:39+00:00

Convert macros into inline functions, for better type-checking.

This patch required a little bit of fiddling with headers in order to
make __(pte|pmd)_free_tlb inline rather than macros.
asm-generic/tlb.h includes asm/pgalloc.h, though it doesn't directly
use any pgalloc definitions.  I removed this include to avoid an
include cycle, but it may cause secondary compile failures by things
depending on the indirect inclusion; arch/x86/mm/hugetlbpage.c was one
such place; there may be others.

Signed-off-by: Jeremy Fitzhardinge 
Signed-off-by: Ingo Molnar 
Signed-off-by: Thomas Gleixner