40e7aed59e
TSD: Move in some of the tcache fields.
...
We had put these in the tcache for cache optimization reasons. After the
previous diff, these no longer apply.
2020-04-14 15:20:19 -07:00
58a00df238
TSD: Put all fast-path data together.
2020-04-14 15:20:19 -07:00
877af247a8
QL, QR: Add documentation.
2020-04-11 10:32:11 -07:00
79ae7f9211
Rtree: Remove the per-field accessors.
...
We instead split things into "edata" and "metadata".
2020-04-10 13:12:47 -07:00
bb6a418523
Emap: Drop szind/slab splitting parameters.
...
After the previous diff, these are constants.
2020-04-10 13:12:47 -07:00
50289750b3
Extent: Remove szind/slab knowledge.
2020-04-10 13:12:47 -07:00
dc26b30094
Rtree: Clean up compact/non-compact split.
2020-04-10 13:12:47 -07:00
93b99dd140
Extent: Stop passing an edata_cache everywhere.
...
We already pass the pa_shard_t around everywhere; we can just use that.
2020-04-10 13:12:47 -07:00
11c47cb133
Extent: Take "bool zero" over "bool *zero".
2020-04-10 13:12:47 -07:00
1a1124462e
PA: Take zero as a bool rather than as a bool *.
...
Now that we've moved junking to a higher level of the allocation stack, we don't
care about this performance optimization (which only occurred in debug modes).
2020-04-10 13:12:47 -07:00
294b276fc7
PA: Parameterize emap. Move emap_global to arena.
...
This lets us test the PA module without interfering with the global emap used by
the real allocator (the one not under test).
2020-04-10 13:12:47 -07:00
f730577277
Eset: Parameterize last globals accesses.
...
I.e. opt_retain and maps_coalesce.
2020-04-10 13:12:47 -07:00
7bb6e2dc0d
Eset: take opt_lg_max_active_fit as a parameter.
...
This breaks its dependence on the global.
2020-04-10 13:12:47 -07:00
883ab327cc
Emap: Move out last edata state touching.
2020-04-10 13:12:47 -07:00
12eb888e54
Edata: Add a ranged bit.
...
We steal the dumpable bit, which we ended up not needing.
2020-04-10 13:12:47 -07:00
bd4fdf295e
Rtree: Pull leaf contents into their own struct.
2020-04-10 13:12:47 -07:00
faec7219b2
PA: Move in decay initialization.
2020-04-10 13:12:47 -07:00
45671e4a27
PA: Move in retain growth limit setting.
2020-04-10 13:12:47 -07:00
daefde88fe
PA: Move in mutex stats reading.
2020-04-10 13:12:47 -07:00
07675840a5
PA: Move in some more internals accesses.
2020-04-10 13:12:47 -07:00
238f3c7430
PA: Move in full stats merging.
2020-04-10 13:12:47 -07:00
81c6027592
Arena stats: Give it its own "mapped".
...
This distinguishes it from the PA mapped stat, which is now named "pa_mapped" to
avoid confusion. The (derived) arena stat includes base memory, and the PA stat
is no longer partially derived.
2020-04-10 13:12:47 -07:00
506d907e40
PA: Move in basic stats merging.
2020-04-10 13:12:47 -07:00
f29f6090f5
PA: Add pa_extra.c and put PA forking there.
2020-04-10 13:12:47 -07:00
565045ef71
Arena: Make more derived stats non-atomic/locked.
2020-04-10 13:12:47 -07:00
d0c43217b5
Arena stats: Move retained to PA, use plain ints.
...
Retained is a property of the allocated pages. The derived fields no longer
require any locking; they're computed on demand.
2020-04-10 13:12:47 -07:00
e2cf3fb1a3
PA: Move in all modifications of mapped.
2020-04-10 13:12:47 -07:00
436789ad96
PA: Make mapped stat atomic.
...
We always have atomic_zu_t, and mapped/unmapped transitions are always expensive
enough that trying to piggyback on a lock is a waste of time.
2020-04-10 13:12:47 -07:00
3c28aa6f17
PA: Move edata_avail stat in, make it non-atomic.
2020-04-10 13:12:47 -07:00
f6bfa3dcca
Move extent stats to the PA module.
...
While we're at it, make them non-atomic -- they are purely derived statistics
(and in fact aren't even in the arena_t or pa_shard_t).
2020-04-10 13:12:47 -07:00
527dd4cdb8
PA: Move in nactive counter.
2020-04-10 13:12:47 -07:00
c075fd0bcb
PA: Minor cleanups and comment fixes.
2020-04-10 13:12:47 -07:00
46a9d7fc0b
PA: Move in rest of purging.
2020-04-10 13:12:47 -07:00
2d6eec7b5c
PA: Move in decay-all pathway.
2020-04-10 13:12:47 -07:00
65698b7f2e
PA: Remove public visibility of some internals.
2020-04-10 13:12:47 -07:00
f012c43be0
PA: Move in decay_to_limit
2020-04-10 13:12:47 -07:00
3034f4a508
PA: Move in decay_stashed.
2020-04-10 13:12:47 -07:00
aef28b2f8f
PA: Move in stash_decayed.
2020-04-10 13:12:47 -07:00
71fc0dc968
PA: Move in remaining page allocation functions.
2020-04-10 13:12:47 -07:00
74958567a4
PA: have expand take sizes instead of new usize.
...
This avoids involving usize, which makes some of the stats modifications more
intuitively correct.
2020-04-10 13:12:47 -07:00
5bcc2c2ab9
PA: Have expand take szind and slab.
...
This isn't really necessary, but having a uniform API will help us later.
2020-04-10 13:12:47 -07:00
0880c2ab97
PA: Have large expands use it.
2020-04-10 13:12:47 -07:00
9f93625c14
PA: Move in arena large allocation functionality.
2020-04-10 13:12:47 -07:00
7624043a41
PA: Add ehook-getting support.
2020-04-10 13:12:47 -07:00
eba35e2e48
Remove extent knowledge of arena.
2020-04-10 13:12:47 -07:00
e77f47a85a
Move arena decay getters to PA.
2020-04-10 13:12:47 -07:00
f77cec311e
Decay: Take current time as an argument.
...
This better facilitates testing.
2020-04-10 13:12:47 -07:00
d1d7e1076b
Decay: move in some background_thread accesses.
2020-04-10 13:12:47 -07:00
cdb916ed3f
Decay: Add comments for the public API.
2020-04-10 13:12:47 -07:00
8f2193dc8d
Decay: Move in arena decay functions.
2020-04-10 13:12:47 -07:00
David Goldblatt