Bin Liu be2de8ccd8 Introduce pinned extents to contain unpurgeable pages ...

Some pages (e.g., hugetlb pages) cannot be purged, and should be
prioritized for reuse.  A custom extent_alloc hook signals this by
OR'ing EXTENT_ALLOC_FLAG_PINNED into the low bits of the returned
pointer; jemalloc strips the flag bits and caches pinned extents in
a dedicated ecache_pinned, separate from the dirty/muzzy decay
pipeline.

Pinned extents do not coalesce eagerly, except for ones larger than
SC_LARGE_MINCLASS.  A prefer-small policy reuses the smallest fitting
pinned extent, to avoid unnecessary split/fragmentation.

2026-05-05 10:44:28 -07:00

..

arena_externs.h

Improve const correctness in the repo

2026-05-04 11:56:17 -07:00

arena_inlines_a.h

Improve const correctness in the repo

2026-05-04 11:56:17 -07:00

arena_inlines_b.h

Extract arena state and management from jemalloc.c into arenas_management module

2026-04-30 15:17:18 -04:00

arena_stats.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

arena_structs.h

Revert PR #2608: Manually revert commits 70c94d..f9c0b5

2026-03-10 18:14:33 -07:00

arena_types.h

move fill/flush pointer array out of tcache.c

2026-03-10 18:14:33 -07:00

arenas_management.h

Extract arena state and management from jemalloc.c into arenas_management module

2026-04-30 15:17:18 -04:00

assert.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

atomic_c11.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

atomic_gcc_atomic.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

atomic_gcc_sync.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

atomic_msvc.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

atomic.h

[process_madvise] Make init lazy so that python tests pass. Reset the pidfd on fork

2026-03-10 18:14:33 -07:00

background_thread_externs.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

background_thread_inlines.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

background_thread_structs.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

base.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

bin_info.h

Revert PR #2608: Manually revert commits 70c94d..f9c0b5

2026-03-10 18:14:33 -07:00

bin_inlines.h

Improve const correctness in the repo

2026-05-04 11:56:17 -07:00

bin_stats.h

Revert PR #2608: Manually revert commits 70c94d..f9c0b5

2026-03-10 18:14:33 -07:00

bin_types.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

bin.h

Move bin functions from arena.c to bin.c

2026-03-10 18:14:33 -07:00

bit_util.h

Fix several typos in the comments

2026-04-22 13:35:18 -04:00

bitmap.h

Improve const correctness in the repo

2026-05-04 11:56:17 -07:00

buf_writer.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

cache_bin.h

move fill/flush pointer array out of tcache.c

2026-03-10 18:14:33 -07:00

ckh.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

conf.h

Fix conf_handle_char_p zero-sized dest and remove unused conf_handle_unsigned

2026-04-01 23:15:19 -04:00

counter.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

ctl.h

Introduce pinned extents to contain unpurgeable pages

2026-05-05 10:44:28 -07:00

decay.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

div.h

Improve const correctness in the repo

2026-05-04 11:56:17 -07:00

ecache.h

Improve const correctness in the repo

2026-05-04 11:56:17 -07:00

edata_cache.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

edata.h

Introduce pinned extents to contain unpurgeable pages

2026-05-05 10:44:28 -07:00

ehooks.h

Introduce pinned extents to contain unpurgeable pages

2026-05-05 10:44:28 -07:00

emap.h

Introduce pinned extents to contain unpurgeable pages

2026-05-05 10:44:28 -07:00

emitter.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

eset.h

Introduce pinned extents to contain unpurgeable pages

2026-05-05 10:44:28 -07:00

exp_grow.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

extent_dss.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

extent_mmap.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

extent.h

Introduce pinned extents to contain unpurgeable pages

2026-05-05 10:44:28 -07:00

fb.h

Improve const correctness in the repo

2026-05-04 11:56:17 -07:00

fxp.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

hash.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

hook.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

hpa_central.h

[EASY] Extract hpa_central component from hpa source file

2026-03-10 18:14:33 -07:00

hpa_hooks.h

Revert "Do not dehugify when purging"

2026-03-10 18:14:33 -07:00

hpa_opts.h

[HPA] Add ability to start page as huge and more flexibility for purging

2026-03-10 18:14:33 -07:00

hpa_utils.h

[EASY] Encapsulate better, do not pass hpa_shard when hooks are enough, move shard independent actions to hpa_utils

2026-03-10 18:14:33 -07:00

hpa.h

Fix several typos in the comments

2026-04-22 13:35:18 -04:00

hpdata.h

Improve const correctness in the repo

2026-05-04 11:56:17 -07:00

inspect.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

jemalloc_fork.h

Extract fork orchestration into jemalloc_fork module

2026-04-30 15:17:18 -04:00

jemalloc_init.h

Extract initialization logic from jemalloc.c into jemalloc_init module

2026-04-30 15:17:18 -04:00

jemalloc_internal_decls.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

jemalloc_internal_defs.h.in

Replace std::__throw_bad_alloc call with standard C++ (#2900)

2026-04-27 11:50:27 -07:00

jemalloc_internal_externs.h

Extract fork orchestration into jemalloc_fork module

2026-04-30 15:17:18 -04:00

jemalloc_internal_includes.h

fix some typos

2022-04-25 11:29:00 -07:00

jemalloc_internal_inlines_a.h

Extract arena state and management from jemalloc.c into arenas_management module

2026-04-30 15:17:18 -04:00

jemalloc_internal_inlines_b.h

Improve const correctness in the repo

2026-05-04 11:56:17 -07:00

jemalloc_internal_inlines_c.h

Extract initialization logic from jemalloc.c into jemalloc_init module

2026-04-30 15:17:18 -04:00

jemalloc_internal_macros.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

jemalloc_internal_overrides.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

jemalloc_internal_types.h

Extract initialization logic from jemalloc.c into jemalloc_init module

2026-04-30 15:17:18 -04:00

jemalloc_preamble.h.in

Remove build-time configuration 'config_limit_usize_gap'

2025-05-06 14:47:35 -07:00

jemalloc_probe_custom.h

Add experimental support for usdt systemtap probes

2026-03-10 18:14:33 -07:00

jemalloc_probe_stap.h

Add experimental support for usdt systemtap probes

2026-03-10 18:14:33 -07:00

jemalloc_probe.h

Add experimental support for usdt systemtap probes

2026-03-10 18:14:33 -07:00

large_externs.h

Remove dead code: extent_commit_wrapper, large_salloc, tcache_gc_dalloc event waits

2026-04-01 17:48:19 -04:00

lockedint.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

log.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

malloc_io.h

Define malloc_{write,read}_fd as non-inline global functions

2026-03-10 18:14:33 -07:00

mpsc_queue.h

Turn clang-format off for codes with multi-line commands in macros

2025-05-28 19:22:21 -07:00

mutex_prof.h

Introduce pinned extents to contain unpurgeable pages

2026-05-05 10:44:28 -07:00

mutex.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

nstime.h

[HPA] Add ability to start page as huge and more flexibility for purging

2026-03-10 18:14:33 -07:00

pa.h

Improve const correctness in the repo

2026-05-04 11:56:17 -07:00

pac.h

Introduce pinned extents to contain unpurgeable pages

2026-05-05 10:44:28 -07:00

pages.h

Refactor init_system_thp_mode and print it in malloc stats.

2026-03-10 18:14:33 -07:00

pai.h

[SEC] Make SEC owned by hpa_shard, simplify the code, add stats, lock per bin

2026-03-10 18:14:33 -07:00

peak_event.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

peak.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

ph.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

private_namespace.sh

Automatically generate private symbol name mangling macros.

2017-05-11 23:06:54 -07:00

private_symbols.sh

Automatically generate private symbol name mangling macros.

2017-05-11 23:06:54 -07:00

prng.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

prof_data.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

prof_externs.h

Remove prof_threshold built-in event. It is trivial to implement it as user event if needed

2026-03-10 18:14:33 -07:00

prof_hook.h

Remove prof_threshold built-in event. It is trivial to implement it as user event if needed

2026-03-10 18:14:33 -07:00

prof_inlines.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

prof_log.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

prof_recent.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

prof_stats.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

prof_structs.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

prof_sys.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

prof_types.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

psset.h

Improve const correctness in the repo

2026-05-04 11:56:17 -07:00

public_namespace.sh

Replace tabs following #define with spaces.

2017-01-20 21:45:53 -08:00

public_unnamespace.sh

Fix name mangling for stress tests.

2014-01-16 17:38:01 -08:00

ql.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

qr.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

quantum.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

rb.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

rtree_tsd.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

rtree.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

safety_check.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

san_bump.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

san.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

sc.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

sec_opts.h

[SEC] Make SEC owned by hpa_shard, simplify the code, add stats, lock per bin

2026-03-10 18:14:33 -07:00

sec.h

[SEC] Make SEC owned by hpa_shard, simplify the code, add stats, lock per bin

2026-03-10 18:14:33 -07:00

seq.h

Turn clang-format off for codes with multi-line commands in macros

2025-05-28 19:22:21 -07:00

slab_data.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

smoothstep.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

smoothstep.sh

Cleanup smoothstep.sh / .h.

2017-05-25 16:52:10 -07:00

spin.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

stats.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

sz.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

tcache_externs.h

Handle tcache init failures gracefully

2026-03-10 18:14:33 -07:00

tcache_inlines.h

Improve const correctness in the repo

2026-05-04 11:56:17 -07:00

tcache_structs.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

tcache_types.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

test_hooks.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

thread_event_registry.h

Remove prof_threshold built-in event. It is trivial to implement it as user event if needed

2026-03-10 18:14:33 -07:00

thread_event.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

ticker.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

tsd_generic.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

tsd_internals.h

Remove experimental.thread.activity_callback

2026-04-01 16:23:41 -07:00

tsd_malloc_thread_cleanup.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

tsd_tls.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

tsd_types.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

tsd_win.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

tsd.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

typed_list.h

Reformat the codebase with the clang-format 18.

2026-03-10 18:14:33 -07:00

util.h

Fix missing negation in large_ralloc_no_move usize_min fallback

2026-04-01 23:15:19 -04:00

witness.h

[SEC] Make SEC owned by hpa_shard, simplify the code, add stats, lock per bin

2026-03-10 18:14:33 -07:00