Dmitry Ilvokhin 6092c980a6 Expose psset state stats ...

When evaluating changes in HPA logic, it is useful to know internal
`hpa_shard` state. Great deal of this state is `psset`. Some of the
`psset` stats was available, but in disaggregated form, which is not
very convenient. This commit exposed `psset` counters to `mallctl`
and malloc stats dumps.

Example of how malloc stats dump will look like after the change.

HPA shard stats:
  Pageslabs: 14899 (4354 huge, 10545 nonhuge)
  Active pages: 6708166 (2228917 huge, 4479249 nonhuge)
  Dirty pages: 233816 (331 huge, 233485 nonhuge)
  Retained pages: 686306
  Purge passes: 8730 (10 / sec)
  Purges: 127501 (146 / sec)
  Hugeifies: 4358 (5 / sec)
  Dehugifies: 4 (0 / sec)

Pageslabs, active pages, dirty pages and retained pages are rows added
by this change.

2024-11-21 09:23:32 -08:00

..

activity_callback.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

arena_externs.h

Allow a range for the nfill passed to arena_cache_bin_fill_small

2024-08-29 10:50:33 -07:00

arena_inlines_a.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

arena_inlines_b.h

Bin batching: add some stats.

2024-05-22 10:30:31 -07:00

arena_stats.h

metadata usage breakdowns: tracking edata and rtree usages

2023-10-11 11:56:01 -07:00

arena_structs.h

Tcache batching: Plumbing

2024-05-22 10:30:31 -07:00

arena_types.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

assert.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

atomic_c11.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

atomic_gcc_atomic.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

atomic_gcc_sync.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

atomic_msvc.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

atomic.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

background_thread_externs.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

background_thread_inlines.h

Fix the lock owner sanity checking during background thread boot.

2024-09-23 18:06:07 -07:00

background_thread_structs.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

base.h

Fix the VM over-reservation on aarch64 w/ larger pages.

2024-09-04 15:43:59 -07:00

batcher.h

Bin batching: add some stats.

2024-05-22 10:30:31 -07:00

bin_info.h

Add batching to arena bins.

2024-05-22 10:30:31 -07:00

bin_stats.h

Bin batching: add some stats.

2024-05-22 10:30:31 -07:00

bin_types.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

bin.h

Bin batching: add some stats.

2024-05-22 10:30:31 -07:00

bit_util.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

bitmap.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

buf_writer.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

cache_bin.h

Better handle burst allocation on tcache_alloc_small_hard

2024-08-29 10:50:33 -07:00

ckh.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

counter.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

ctl.h

Add mallctl to set and get ncached_max of each cache_bin.

2023-10-17 14:53:23 -07:00

decay.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

div.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

ecache.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

edata_cache.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

edata.h

Optimize edata_cmp_summary_compare when __uint128_t is available

2024-09-23 16:23:42 -07:00

ehooks.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

emap.h

Set dependent as false for all rtree reads without ownership

2024-06-24 10:50:20 -07:00

emitter.h

Emit long string values without truncation

2024-07-29 13:58:31 -07:00

eset.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

exp_grow.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

extent_dss.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

extent_mmap.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

extent.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

fb.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

fxp.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

hash.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

hook.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

hpa_hooks.h

Add opt hpa_hugify_sync to hugify synchronously

2024-11-20 10:52:52 -08:00

hpa_opts.h

Add opt hpa_hugify_sync to hugify synchronously

2024-11-20 10:52:52 -08:00

hpa.h

Add opt hpa_hugify_sync to hugify synchronously

2024-11-20 10:52:52 -08:00

hpdata.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

inspect.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

jemalloc_internal_decls.h

Fix all optimization-inhibiting integer-to-pointer casts

2023-07-24 14:40:42 -07:00

jemalloc_internal_defs.h.in

Add opt hpa_hugify_sync to hugify synchronously

2024-11-20 10:52:52 -08:00

jemalloc_internal_externs.h

Add a runtime option opt_experimental_tcache_gc to guard the new design

2024-08-29 10:50:33 -07:00

jemalloc_internal_includes.h

fix some typos

2022-04-25 11:29:00 -07:00

jemalloc_internal_inlines_a.h

Fix reading CPU id using rdtscp.

2023-08-28 11:46:39 -07:00

jemalloc_internal_inlines_b.h

Enable per-tcache tcache_max

2023-09-06 10:47:14 -07:00

jemalloc_internal_inlines_c.h

Fix the sized-dealloc safety check abort msg.

2024-10-14 10:34:15 -07:00

jemalloc_internal_macros.h

Add clang static analyzer suppression macro.

2024-05-22 10:30:31 -07:00

jemalloc_internal_overrides.h

Add an override for the compile-time malloc_conf to jemalloc_internal_overrides.h

2023-07-31 14:53:15 -07:00

jemalloc_internal_types.h

add a size check when declare a stack array to be less than 2048 bytes

2024-08-06 13:16:09 -07:00

jemalloc_preamble.h.in

Add opt hpa_hugify_sync to hugify synchronously

2024-11-20 10:52:52 -08:00

large_externs.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

lockedint.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

log.h

Fix comments about malloc_conf to enable logging.

2023-10-04 11:49:10 -07:00

malloc_io.h

Add safe frame-pointer backtrace unwinder

2024-10-01 11:01:56 -07:00

mpsc_queue.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

mutex_prof.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

mutex.h

Assert the mutex is locked within malloc_mutex_assert_owner().

2024-09-23 18:06:07 -07:00

nstime.h

Add nstime_ms_since to get time since in ms

2024-11-08 10:37:28 -08:00

pa.h

Introduce getters for page allocator shard stats

2024-04-04 12:17:30 -07:00

pac.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

pages.h

Add opt hpa_hugify_sync to hugify synchronously

2024-11-20 10:52:52 -08:00

pai.h

HPA: Allow frequent reused alloc to bypass the slab_max_alloc limit, as long as

2024-01-18 14:51:04 -08:00

peak_event.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

peak.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

ph.h

Reduce nesting in phn_merge_siblings using an early return.

2024-03-14 13:08:17 -07:00

private_namespace.sh

Automatically generate private symbol name mangling macros.

2017-05-11 23:06:54 -07:00

private_symbols.sh

Automatically generate private symbol name mangling macros.

2017-05-11 23:06:54 -07:00

prng.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

prof_data.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

prof_externs.h

Add support for namespace pids in heap profile names

2024-04-09 10:27:52 -07:00

prof_hook.h

Add usize to prof_sample_hook_t

2024-07-30 10:29:30 -07:00

prof_inlines.h

Define PROF_TCTX_SENTINEL instead of using magic numbers

2023-07-24 14:40:42 -07:00

prof_log.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

prof_recent.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

prof_stats.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

prof_structs.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

prof_sys.h

Add safe frame-pointer backtrace unwinder

2024-10-01 11:01:56 -07:00

prof_types.h

Fix all optimization-inhibiting integer-to-pointer casts

2023-07-24 14:40:42 -07:00

psset.h

Expose psset state stats

2024-11-21 09:23:32 -08:00

public_namespace.sh

Replace tabs following #define with spaces.

2017-01-20 21:45:53 -08:00

public_unnamespace.sh

Fix name mangling for stress tests.

2014-01-16 17:38:01 -08:00

ql.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

qr.h

QL, QR: Add documentation.

2020-04-11 10:32:11 -07:00

quantum.h

Leverage new Windows API TlsGetValue2 for performance

2024-08-28 16:50:33 -07:00

rb.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

rtree_tsd.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

rtree.h

Fix all optimization-inhibiting integer-to-pointer casts

2023-07-24 14:40:42 -07:00

safety_check.h

Fix all optimization-inhibiting integer-to-pointer casts

2023-07-24 14:40:42 -07:00

san_bump.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

san.h

Fix all optimization-inhibiting integer-to-pointer casts

2023-07-24 14:40:42 -07:00

sc.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

sec_opts.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

sec.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

seq.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

slab_data.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

smoothstep.h

Cleanup smoothstep.sh / .h.

2017-05-25 16:52:10 -07:00

smoothstep.sh

Cleanup smoothstep.sh / .h.

2017-05-25 16:52:10 -07:00

spin.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

stats.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

sz.h

Optimize fast path to allow static size class computation.

2024-09-12 11:34:09 -07:00

tcache_externs.h

Refactor the tcache initiailization

2023-10-18 14:11:46 -07:00

tcache_inlines.h

Cleanup cache_bin_info_t* info input args

2023-10-25 10:27:31 -07:00

tcache_structs.h

Better handle burst allocation on tcache_alloc_small_hard

2024-08-29 10:50:33 -07:00

tcache_types.h

Regulate GC frequency by requiring a time interval between two consecutive GCs

2024-08-29 10:50:33 -07:00

test_hooks.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

thread_event.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

ticker.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

tsd_generic.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

tsd_internals.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

tsd_malloc_thread_cleanup.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

tsd_tls.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

tsd_types.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

tsd_win.h

Use MSVC __declspec(thread) for TSD on Windows

2024-09-30 11:33:44 -07:00

tsd.h

Make headers self-contained by fixing #includes

2023-07-14 09:06:32 -07:00

typed_list.h

Add empty test and concat for typed list

2020-07-31 09:16:50 -07:00

util.h

Optimize fast path to allow static size class computation.

2024-09-12 11:34:09 -07:00

witness.h

Add batcher module.

2024-05-22 10:30:31 -07:00