9a242f16d9
fix some typos
...
Signed-off-by: cuishuang <imcusg@gmail.com >
2022-04-25 11:29:00 -07:00
deb8e62a83
Implement guard pages.
...
Adding guarded extents, which are regular extents surrounded by guard pages
(mprotected). To reduce syscalls, small guarded extents are cached as a
separate eset in ecache, and decay through the dirty / muzzy / retained pipeline
as usual.
2021-09-26 16:30:15 -07:00
8229cc77c5
Wake up background threads on demand
...
This change allows every allocator conforming to PAI communicate that it
deferred some work for the future. Without it if a background thread goes into
indefinite sleep, there is no way to notify it about upcoming deferred work.
2021-09-17 16:56:41 -07:00
b8b8027f19
Allow PAI to calculate time until deferred work
...
Previously the calculation of sleep time between wakeups was implemented within
background_thread. This resulted in some parts of decay and hpa specific
logic mixing with background thread implementation. In this change, background
thread delegates this calculation to arena and it, in turn, delegates it to PAI.
The next step is to implement the actual calculation of time until deferred work
in HPA.
2021-09-17 16:56:41 -07:00
d93eef2f40
HPA: Introduce a redesigned hpa_central_t.
...
For now, this only handles allocating virtual address space to shards, with no
reuse. This is framework, though; it will change over time.
2021-07-23 21:59:59 -07:00
113938b6f4
HPA: Pull out a hooks type.
...
For now, this is a no-op change. In a subsequent commit, it will be useful for
testing.
2021-07-12 17:59:18 -07:00
1d4a7666d5
HPA: Do deferred operations on background threads.
2021-07-12 17:59:18 -07:00
36c6bfb963
SEC: Allow arbitrarily many shards, cached sizes.
2021-05-22 08:17:41 -07:00
fb327368db
SEC: Expand option configurability.
...
This change pulls the SEC options into a struct, which simplifies their handling
across various modules (e.g. PA needs to forward on SEC options from the
malloc_conf string, but it doesn't really need to know their names). While
we're here, make some of the fixed constants configurable, and unify naming from
the configuration options to the internals.
2021-02-19 15:10:54 -08:00
b3df80bc79
Pull HPA options into a containing struct.
...
Currently that just means max_alloc, but we're about to add more. While we're
touching these lines anyways, tweak things to be more in line with testing.
2021-02-04 20:58:31 -08:00
43af63fff4
HPA: Manage whole hugepages at a time.
...
This redesigns the HPA implementation to allow us to manage hugepages all at
once, locally, without relying on a global fallback.
2020-12-07 06:21:08 -08:00
cf2549a149
Add a per-arena oversize_threshold.
...
This can let manual arenas trade off memory and CPU the way auto arenas do.
2020-11-13 13:45:35 -08:00
6599651aee
PA: Use an SEC in fron of the HPA shard.
2020-10-23 11:14:34 -07:00
1964b08394
HPA: Add stats for the hpa_shard.
2020-10-23 11:14:34 -07:00
534504d4a7
HPA: add size-exclusion functionality.
...
I.e. only allowing allocations under or over certain sizes.
2020-10-23 11:14:34 -07:00
bf025d2ec8
HPA: Make slab sizes and maxes configurable.
...
This allows easy experimentation with them as tuning parameters.
2020-10-23 11:14:34 -07:00
1c7da33317
HPA: Tie components into a PAI implementation.
2020-10-23 11:14:34 -07:00
6107857b7b
PA->PAC: Move in PAI implementation.
2020-07-09 13:41:04 -07:00
6041aaba97
PA -> PAC: Move in destruction functions.
2020-07-09 13:41:04 -07:00
471eb5913c
PAC: Move in decay rate setting.
2020-07-09 13:41:04 -07:00
6a2774719f
PA->PAC: Move in decay functions.
2020-07-09 13:41:04 -07:00
4ee75be3a3
PA -> PAC: Move in decay_purge enum.
2020-07-09 13:41:04 -07:00
72435b0aba
PA->PAC: Make extent.c forget about PA.
2020-07-09 13:41:04 -07:00
dee5d1c42d
PA->PAC: Move in extent_sn.
2020-07-09 13:41:04 -07:00
7391382349
PA->PAC: Move in stats.
2020-07-09 13:41:04 -07:00
db211eefbf
PAC: Move in decay.
2020-07-09 13:41:04 -07:00
c81e389996
PAC: Move in ecache_grow.
2020-07-09 13:41:04 -07:00
777b0ba965
Add PAC: Page allocator classic.
...
For now, this is just a stub containing the ecaches, with no surrounding code
changed. Eventually all the core allocator bits will be moved in, in the
subsequent stack of commits.
2020-07-09 13:41:04 -07:00
1b5f632e0f
Introduce PAI: Page allocator interface
2020-07-09 13:41:04 -07:00
50289750b3
Extent: Remove szind/slab knowledge.
2020-04-10 13:12:47 -07:00
1a1124462e
PA: Take zero as a bool rather than as a bool *.
...
Now that we've moved junking to a higher level of the allocation stack, we don't
care about this performance optimization (which only occurred in debug modes).
2020-04-10 13:12:47 -07:00
294b276fc7
PA: Parameterize emap. Move emap_global to arena.
...
This lets us test the PA module without interfering with the global emap used by
the real allocator (the one not under test).
2020-04-10 13:12:47 -07:00
faec7219b2
PA: Move in decay initialization.
2020-04-10 13:12:47 -07:00
45671e4a27
PA: Move in retain growth limit setting.
2020-04-10 13:12:47 -07:00
daefde88fe
PA: Move in mutex stats reading.
2020-04-10 13:12:47 -07:00
07675840a5
PA: Move in some more internals accesses.
2020-04-10 13:12:47 -07:00
238f3c7430
PA: Move in full stats merging.
2020-04-10 13:12:47 -07:00
81c6027592
Arena stats: Give it its own "mapped".
...
This distinguishes it from the PA mapped stat, which is now named "pa_mapped" to
avoid confusion. The (derived) arena stat includes base memory, and the PA stat
is no longer partially derived.
2020-04-10 13:12:47 -07:00
506d907e40
PA: Move in basic stats merging.
2020-04-10 13:12:47 -07:00
f29f6090f5
PA: Add pa_extra.c and put PA forking there.
2020-04-10 13:12:47 -07:00
d0c43217b5
Arena stats: Move retained to PA, use plain ints.
...
Retained is a property of the allocated pages. The derived fields no longer
require any locking; they're computed on demand.
2020-04-10 13:12:47 -07:00
e2cf3fb1a3
PA: Move in all modifications of mapped.
2020-04-10 13:12:47 -07:00
436789ad96
PA: Make mapped stat atomic.
...
We always have atomic_zu_t, and mapped/unmapped transitions are always expensive
enough that trying to piggyback on a lock is a waste of time.
2020-04-10 13:12:47 -07:00
3c28aa6f17
PA: Move edata_avail stat in, make it non-atomic.
2020-04-10 13:12:47 -07:00
f6bfa3dcca
Move extent stats to the PA module.
...
While we're at it, make them non-atomic -- they are purely derived statistics
(and in fact aren't even in the arena_t or pa_shard_t).
2020-04-10 13:12:47 -07:00
527dd4cdb8
PA: Move in nactive counter.
2020-04-10 13:12:47 -07:00
c075fd0bcb
PA: Minor cleanups and comment fixes.
2020-04-10 13:12:47 -07:00
46a9d7fc0b
PA: Move in rest of purging.
2020-04-10 13:12:47 -07:00
2d6eec7b5c
PA: Move in decay-all pathway.
2020-04-10 13:12:47 -07:00
65698b7f2e
PA: Remove public visibility of some internals.
2020-04-10 13:12:47 -07:00
cuishuang