c7a87e0e0b
Rename hooks module to test_hooks.
...
"Hooks" is really the best name for the module that will contain the publicly
exposed hooks. So lets rename the current "hooks" module (that hook external
dependencies, for reentrancy testing) to "test_hooks".
2018-05-18 11:43:03 -07:00
e870829e64
TSD: Add the ability to enter a global slow path.
...
This gives any thread the ability to send other threads down slow paths the next
time they fetch tsd.
2018-05-18 11:43:03 -07:00
982c10de35
TSD: Make all state access happen through a function.
...
Shortly, tsd state will be atomic and have some complicated enough logic down
the state-setting path that we should be aware of it.
2018-05-18 11:43:03 -07:00
09edea3f5c
Tweak the format of the per arena summary section.
...
Increase the width to ensure enough space for long running programs.
2018-05-17 12:58:56 -07:00
312352faa8
Fix background thread index issues with max_background_threads.
2018-05-15 12:25:23 -07:00
e8a63b87c3
Fix an incorrect assertion.
...
When configured with --with-lg-page, it's possible for the configured page size
to be greater than the system page size, in which case the page address may only
be aligned with the system page size.
2018-05-09 23:52:56 -07:00
a32b7bd567
Mallctl: Add arenas.lookup
...
Implement a new mallctl operation that allows looking up the arena a
region of memory belongs to.
2018-05-01 13:14:36 -07:00
b8f4c730ef
Remove an incorrect assertion.
...
Background threads are created without holding the global background_thread
lock, which mean paused state is possible (and fine).
2018-04-18 14:17:08 -07:00
dedfeecc4e
Invoke dlsym() on demand.
...
If no lazy lock or background thread is enabled, avoid dlsym pthread_create on
boot.
2018-04-18 11:20:21 -07:00
c95284df1a
Avoid a resource leak down extent split failure paths.
...
Previously, we would leak the extent and memory associated with a salvageable
portion of an extent that we were trying to split in three, in the case where
the first split attempt succeeded and the second failed.
2018-04-18 08:19:41 -07:00
e40b2f75bd
Fix abort_conf processing.
...
When abort_conf is set, make sure we always error out at the end of the options
processing loop.
2018-04-17 18:23:53 -07:00
0fadf4a2e3
Add UNUSED to avoid compiler warnings.
2018-04-16 13:50:21 -07:00
3f0dc64c6b
Allow setting extent hooks on uninitialized auto arenas.
...
Setting extent hooks can result in initializing an unused auto arena. This is
useful to install extent hooks on auto arenas from the beginning.
2018-04-11 21:21:54 -07:00
4937309620
Silence a compiler warning.
2018-04-10 17:59:00 -07:00
8b14f3abc0
background_thread: add max thread count config
...
Looking at the thread counts in our services, jemalloc's background thread
is useful, but mostly idle. Add a config option to tune down the number of threads.
2018-04-10 14:01:45 -07:00
5f51882a0a
Stack address should not be used for ordering mutexes
2018-04-10 10:16:57 -07:00
d3e0976a2c
Fix type warning on Windows.
...
Add cast since read / write has unsigned return type on windows.
2018-04-09 16:50:30 -07:00
4df483f0fd
Fix arguments passed to extent_init.
2018-04-09 16:35:58 -07:00
2dccf45640
Control idump and gdump with prof_active.
2018-04-09 16:35:14 -07:00
6d02421730
extents: Remove preserve_lru feature.
...
preserve_lru feature adds lots of complication, for little value.
Removing it means merged extents are re-added to the lru list, and may
take longer to madvise away than they otherwise would.
Canaries after removal seem flat for several services (no change).
2018-04-02 12:40:28 -07:00
21eb0d15a6
Fix a background_thread shutdown issue.
...
1) make sure background thread 0 is always created; and 2) fix synchronization
between thread 0 and the control thread.
2018-04-02 10:03:47 -07:00
956c4ad6b5
Change mutable option output in stats to avoid stringify issues.
2018-03-15 14:42:48 -07:00
baffeb1d0a
Fix a typo in stats.
2018-03-15 14:42:48 -07:00
4c36cd2cc5
Stats printing: Convert arena large stats to use emitter.
...
This completes the conversion; we now have only structured text output.
2018-03-09 11:47:17 -08:00
4eed989bbf
Stats printing: convert arena bin stats to use emitter.
2018-03-09 11:47:17 -08:00
a9f3cedc6e
Stats printing: remove a spurious newline.
...
This was left over from a previous emitter conversion. It didn't affect the
correctness of the output.
2018-03-09 11:47:17 -08:00
a1738f4efd
Stats printing: Make arena mutex stats use the emitter.
2018-03-09 11:47:17 -08:00
07fb707623
Stats printing: convert most per-arena stats to use the emitter.
2018-03-09 11:47:17 -08:00
8fc850695d
Stats printing: convert paging and alloc counts to use the emitter.
2018-03-09 11:47:17 -08:00
bc6620f73e
Stats printing: convert decay stats to use the emitter.
2018-03-09 11:47:17 -08:00
a6ef061c43
Stats printing: Move emitter cutoff point into stats_arena_print.
2018-03-09 11:47:17 -08:00
cbde666d9a
Stats printing: move stats_print_helper to use emitter.
2018-03-09 11:47:17 -08:00
86c61d4a57
Stats printing: Move global mutex stats to use emitter.
2018-03-09 11:47:17 -08:00
9e1846b004
Stats printing: move non-mutex arena stats to the emitter.
...
Another step in the conversion process. The mutex is a little different,
because we we want to emit it as an array.
2018-03-09 11:47:17 -08:00
8076b28721
Stats printing: Remove explicit callback passing to stats_print_helper.
...
This makes the emitter the only source of callback information, which is a step
towards where we want to be.
2018-03-09 11:47:17 -08:00
0d20eda127
Stats printing: Move emitter -> manual cutoff point.
...
This makes it so that the "general" portion of the stats code is completely
agnostic to emitter type.
2018-03-09 11:47:17 -08:00
ec31d476ff
Stats printing: Convert profiling stats to use the emitter.
...
While we're at it, print them in table form, too.
2018-03-09 11:47:17 -08:00
e5acc35400
Stats printing: Convert general arena stats to use the emitter.
2018-03-09 11:47:17 -08:00
4a335e0c6f
Stats printing: convert config and opt output to use emitter.
...
This is a step along the path towards using the emitter for all stats output.
2018-03-09 11:47:17 -08:00
b646f89173
Stats printing: Convert header and footer to use emitter.
2018-03-09 11:47:17 -08:00
e4f090e8df
Add opt.thp which allows explicit hugepage usage.
...
"always" marks all user mappings as MADV_HUGEPAGE; while "never" marks all
mappings as MADV_NOHUGEPAGE. The default setting "default" does not change any
settings. Note that all the madvise calls are part of the default extent hooks
by design, so that customized extent hooks have complete control over the
mappings including hugepage settings.
2018-03-08 13:08:06 -08:00
efa40532dc
Remove config.thp which wasn't in use.
2018-03-08 13:08:06 -08:00
26b1c13982
Background threads: fix an indexing bug.
...
We have a buffer overrun that manifests in the case where arena indices higher
than the number of CPUs are accessed before arena indices lower than the number
of CPUs. This fixes the bug and adds a test.
2018-02-27 19:43:05 -08:00
f78d4ca3fb
Modify configure to determine return value of strerror_r.
...
On glibc and Android's bionic, strerror_r returns char* when
_GNU_SOURCE is defined.
Add a configure check for this rather than assume glibc is the
only libc that behaves this way.
2018-01-10 21:01:18 -08:00
ba5992fe9a
Improve the fit for aligned allocation.
...
We compute the max size required to satisfy an alignment. However this can be
quite pessimistic, especially with frequent reuse (and combined with state-based
fragmentation). This commit adds one more fit step specific to aligned
allocations, searching in all potential fit size classes.
2018-01-05 14:27:58 -08:00
f47e39d11a
handle 32 bit mutex counters
2018-01-04 11:08:17 -08:00
d41b19f9c7
Implement arena regind computation using div_info_t.
...
This eliminates the need to generate an enormous switch statement in
arena_slab_regind.
2017-12-21 14:25:43 -08:00
21f7c13d0b
Add the div module, which allows fast division by dynamic values.
2017-12-21 14:25:43 -08:00
7f1b02e3fa
Split up and standardize naming of stats code.
...
The arena-associated stats are now all prefixed with arena_stats_, and live in
their own file. Likewise, malloc_bin_stats_t -> bin_stats_t, also in its own
file.
2017-12-18 16:29:10 -08:00
901d94a2b0
Rename cache_alloc_easy to cache_bin_alloc_easy.
...
This lives in the cache_bin module; just a typo.
2017-12-18 16:29:10 -08:00
David Goldblatt