5e90fd006e
Geom_grow: Don't keep the mutex internal.
...
We're about to use it in ways that will have external synchronization.
2020-08-19 16:53:21 -07:00
c57494879f
Geom_grow: Don't take tsdn at init.
...
It's never used.
2020-08-19 16:53:21 -07:00
ffe552223c
Geom_grow: Move in advancing logic.
2020-08-19 16:53:21 -07:00
131b1b5338
Rename ecache_grow -> geom_grow.
...
We're about to start using it outside of the ecaches, in the HPA central
allocator.
2020-08-19 16:53:21 -07:00
9e18ae639f
Config: safety checks don't imply size checks.
...
The commit introducing size checks accidentally enabled them whenever any safety
checks were on. This ends up causing the regression that splitting up the
features was intended to avoid. Fix the issue.
2020-08-12 13:00:19 -07:00
eaed1e39be
Add sized-delete size-checking functionality.
...
The existing checks are good at finding such issues (on tcache flush), but not
so good at pinpointing them. Debug mode can find them, but sometimes debug mode
slows down a program so much that hard-to-hit bugs can take a long time to
crash.
This commit adds functionality to keep programs mostly on their fast paths,
while also checking every sized delete argument they get.
2020-08-05 19:34:05 -07:00
60993697d8
Prof: Add prof_unbias.
...
This gives more accurate attribution of bytes and counts to stack traces,
without introducing backwards incompatibilities in heap-profile parsing tools.
We track the ideal reported (to the end user) number of bytes more carefully
inside core jemalloc. When dumping heap profiles, insteading of outputting our
counts directly, we output counts that will cause parsing tools to give a result
close to the value we want.
We retain the old version as an opt setting, to let users who are tracking
values on a per-component basis to keep their metrics stable until they decide
to switch.
2020-08-05 18:33:55 -07:00
81c2f841e5
Add a simple utility to detect profiling bias.
2020-08-05 18:33:55 -07:00
978f830ee3
Add batch allocation API
2020-07-31 09:16:50 -07:00
c6f59e9bb4
Add surplus reading API for thread event lookahead
2020-07-31 09:16:50 -07:00
f805468957
Add zero option to arena batch allocation
2020-07-31 09:16:50 -07:00
49e5c2fe7d
Add batch allocation from fresh slabs
2020-07-31 09:16:50 -07:00
2bb8060d57
Add empty test and concat for typed list
2020-07-31 09:16:50 -07:00
f28cc2bc87
Extract bin shard selection out of bin locking
2020-07-31 09:16:50 -07:00
ddb8dc4ad0
FB: Add range iteration support.
2020-07-30 15:25:23 -07:00
ceee823519
Add flat_bitmap.
...
The flat_bitmap module offers an extended API, at the cost of decreased
performance in the case of very large bitmaps.
2020-07-30 15:25:23 -07:00
22da836094
bit_util: Add fls_ functions; "find last set".
...
These simplify a lot of the bit_util module, which had grown bits and pieces of
this functionality across a variety of places over the years.
While we're here, kill off BIT_UTIL_INLINE and don't do reentrancy testing for
bit_util.
2020-07-30 15:25:23 -07:00
1ed0288d9c
bit_util: Change ffs functions indexing.
...
Making these 0-based instead of 1-based makes calling code simpler and will be
more consistent with functions introduced in subsequent diffs.
2020-07-30 15:25:23 -07:00
6107857b7b
PA->PAC: Move in PAI implementation.
2020-07-09 13:41:04 -07:00
6041aaba97
PA -> PAC: Move in destruction functions.
2020-07-09 13:41:04 -07:00
471eb5913c
PAC: Move in decay rate setting.
2020-07-09 13:41:04 -07:00
6a2774719f
PA->PAC: Move in decay functions.
2020-07-09 13:41:04 -07:00
4ee75be3a3
PA -> PAC: Move in decay_purge enum.
2020-07-09 13:41:04 -07:00
72435b0aba
PA->PAC: Make extent.c forget about PA.
2020-07-09 13:41:04 -07:00
dee5d1c42d
PA->PAC: Move in extent_sn.
2020-07-09 13:41:04 -07:00
7391382349
PA->PAC: Move in stats.
2020-07-09 13:41:04 -07:00
db211eefbf
PAC: Move in decay.
2020-07-09 13:41:04 -07:00
c81e389996
PAC: Move in ecache_grow.
2020-07-09 13:41:04 -07:00
65803171a7
PAC: move in emap
2020-07-09 13:41:04 -07:00
7efcb946c4
PAC: Add an init function.
2020-07-09 13:41:04 -07:00
722652222a
PAC: Move in edata_cache accesses.
2020-07-09 13:41:04 -07:00
777b0ba965
Add PAC: Page allocator classic.
...
For now, this is just a stub containing the ecaches, with no surrounding code
changed. Eventually all the core allocator bits will be moved in, in the
subsequent stack of commits.
2020-07-09 13:41:04 -07:00
1b5f632e0f
Introduce PAI: Page allocator interface
2020-07-09 13:41:04 -07:00
3cf19c6e5e
atomic: add atomic_load_sub_store
2020-07-09 13:41:04 -07:00
ae541d3fab
Edata: Reserve some space for hugepages.
2020-07-08 13:20:59 -07:00
392f645f4d
Edata: split up different list linkage uses.
2020-07-08 13:20:59 -07:00
129b727058
Add typed-list module.
...
This gives some named convenience wrappers.
2020-07-08 13:20:59 -07:00
00f06c9beb
enabling mpss on solaris/illumos.
...
reusing slighty linux configuration as possible, aligning the
address range to HUGEPAGE.
2020-07-06 09:59:10 -07:00
c2e7a06392
No need to intercept prof_dump_header() in tests
2020-06-29 14:27:50 -07:00
f58ebdff7a
Generalize prof_cnt_all() for testing
2020-06-29 14:27:50 -07:00
d4259ea53b
Simplify signatures for prof dump functions
2020-06-29 14:27:50 -07:00
1f5fe3a3e3
Pass write callback explicitly in prof_data
2020-06-29 14:27:50 -07:00
dad821bb22
Move unwind to prof_sys
2020-06-29 14:27:50 -07:00
d128efcb6a
Relocate a few prof utilities to the right modules
2020-06-29 14:27:50 -07:00
4736fb4fc9
Move file handling logic in prof_data to prof_sys
2020-06-29 14:27:50 -07:00
767a2e1790
Move file handling logic in prof to prof_sys
2020-06-29 14:27:50 -07:00
03ae509f32
Create prof_sys module for reading system thread name
2020-06-29 14:27:50 -07:00
adfd9d7b1d
Change tsdn to tsd for thread name allocation
2020-06-29 14:27:50 -07:00
841af2b426
Move thread name handling to prof_data module
2020-06-29 14:27:50 -07:00
8118056c03
Expose prof_data testing internals only in prof tests
2020-06-29 14:27:50 -07:00
David Goldblatt