Commit Graph

  • 112dc36dd5 Handle log_mtx during forking Yinan Zhang 2019-12-20 10:38:05 -08:00
  • ea42174d07 Refactor profiling headers Yinan Zhang 2019-12-18 15:15:31 -08:00
  • 6342da0970 Ehooks: Further optimize default merge case. David Goldblatt 2019-12-19 17:53:52 -08:00
  • f2f2084e79 Ehooks: Assert alloc isn't NULL David Goldblatt 2019-12-19 17:15:57 -08:00
  • e210ccc57e Move extent2 -> extent. David Goldblatt 2019-12-16 11:05:07 -08:00
  • 2f4fa80414 Rename extents -> ecache. David Goldblatt 2019-12-16 11:01:34 -08:00
  • 56cc56b692 Break extent split dependence on arena. David Goldblatt 2019-12-13 13:52:34 -08:00
  • 0aa9769fb0 Break commit functions' arena dependence David Goldblatt 2019-12-13 13:46:25 -08:00
  • 48ec5d4355 Break extent_coalesce arena dependence David Goldblatt 2019-12-13 13:37:00 -08:00
  • 282a382326 Extent: Break [de]activation's arena dependence. David Goldblatt 2019-12-13 13:34:35 -08:00
  • 576d7047ab Ecache: Should know its arena_ind. David Goldblatt 2019-12-13 11:33:03 -08:00
  • 372042a082 Remove merge dependence on the arena. David Goldblatt 2019-12-13 11:16:58 -08:00
  • 439219be7e Remove extent_can_coalesce arena dependency. David Goldblatt 2019-12-13 10:52:51 -08:00
  • 9cad5639ff Ehooks: remove arena_ind parameter. David Goldblatt 2019-12-13 10:44:03 -08:00
  • 57fe99d4be Move relevant index into the ehooks_t itself. David Goldblatt 2019-12-13 10:09:57 -08:00
  • c792f3e4ab edata_cache: Remember the associated base_t. David Goldblatt 2019-12-12 18:28:37 -08:00
  • ae23e5f426 Unify extent_alloc_wrapper with the other wrappers. David Goldblatt 2019-12-12 17:30:28 -08:00
  • d8b0b66c6c Put extent_state_t into ecache as well as eset. David Goldblatt 2019-12-12 16:44:49 -08:00
  • 98eb40e563 Move delay_coalesce from the eset to the ecache. David Goldblatt 2019-12-12 16:33:19 -08:00
  • bb70df8e5b Extent refactor: Introduce ecache module. David Goldblatt 2019-12-12 16:25:24 -08:00
  • 0704516245 Ehooks: Add head tracking. David Goldblatt 2019-12-11 17:23:24 -08:00
  • 09475bf8ac extent_may_dalloc -> ehooks_dalloc_will_fail David Goldblatt 2019-12-11 13:35:43 -08:00
  • 7859184179 Pull out edata_t caching into its own module. David Goldblatt 2019-12-11 11:17:19 -08:00
  • a7862df616 Rename extent_t to edata_t. David Goldblatt 2019-12-09 14:36:45 -08:00
  • 865debda22 Rename extent.h -> edata.h. David Goldblatt 2019-12-09 10:41:25 -08:00
  • a738a66b5c Ehooks: Add some debug zero and addr checks. David Goldblatt 2019-12-05 17:09:44 -08:00
  • 4b2e5ee8b9 Ehooks: Add a "zero" ehook. David Goldblatt 2019-12-04 17:55:24 -08:00
  • d0f187ad3b Arena: Loosen arena_may_have_muzzy restrictions. David Goldblatt 2019-12-04 14:42:10 -08:00
  • ebbb973271 Base: Remove some unnecessary reentrancy guards. David Goldblatt 2019-12-04 14:05:14 -08:00
  • 403f2d1664 Extents: Split out introspection functionality. David Goldblatt 2019-12-04 09:44:59 -08:00
  • 92a511d385 Make extent module hermetic. David Goldblatt 2019-12-03 18:31:47 -08:00
  • e08c581cf1 Extent: Get rid of extent-specific pre/post reentrancy calls. David Goldblatt 2019-12-03 17:43:53 -08:00
  • 39fdc690a0 Ehooks comments and cleanup. David Goldblatt 2019-12-03 17:03:31 -08:00
  • c8dae890c8 Extent -> Ehooks: Move over default hooks. David Goldblatt 2019-12-03 14:23:40 -08:00
  • 2fe5108263 Extent -> Ehooks: Move merge hook. David Goldblatt 2019-12-03 14:03:38 -08:00
  • 1fff4d2ee3 Extent -> Ehooks: Move split hook. David Goldblatt 2019-12-03 13:48:18 -08:00
  • a5b42a1a10 Extent -> Ehooks: Move purge_forced hook. David Goldblatt 2019-12-03 13:11:54 -08:00
  • 368baa42ef Extent -> Ehooks: Move purge_lazy hook. David Goldblatt 2019-12-03 12:59:46 -08:00
  • f83fdf5336 Extent: Clean up a comma David Goldblatt 2019-12-03 12:26:45 -08:00
  • d78fe241ac Extent -> Ehooks: Move commit and decommit hooks. David Goldblatt 2019-12-03 12:25:00 -08:00
  • 5459ec9dae Extent -> Ehooks: Move destroy hook. David Goldblatt 2019-12-03 12:05:18 -08:00
  • bac8e2e5a6 Extent -> Ehooks: Move dalloc hook. David Goldblatt 2019-12-03 10:47:28 -08:00
  • dc8b4e6e13 Extent -> Ehooks: Move alloc hook. David Goldblatt 2019-12-02 16:42:44 -08:00
  • 703fbc0ff5 Introduce unsafe reentrancy guards. David Goldblatt 2019-12-02 16:45:40 -08:00
  • ae0d8e8591 Move extent ehook calls into ehooks David Goldblatt 2019-12-02 14:19:22 -08:00
  • ba8b9ecbcb Add ehooks module David Goldblatt 2019-12-02 10:44:09 -08:00
  • 837119a948 base_structs.h: Remove some mid-line tabs. David Goldblatt 2019-11-18 14:43:48 -08:00
  • 9f6eb09585 Extents: Eagerly initialize extent hooks. David Goldblatt 2019-11-18 14:03:22 -08:00
  • 4278f84603 Move extent hook getters/setters to arena.c David Goldblatt 2019-11-18 12:59:34 -08:00
  • 9226e1f0d8 fix opt.thp:never still use THP with base_new Wenbo Zhang 2019-12-15 07:26:45 -05:00
  • d5031ea824 Allow dallocx and sdallocx after tsd destruction. Qi Wang 2019-12-17 11:57:08 -08:00
  • 4afd709d1f Restructure setters for profiling info Yinan Zhang 2019-12-13 16:48:03 -08:00
  • 1d01e4c770 Initialization utilities for nstime Yinan Zhang 2019-12-16 12:41:06 -08:00
  • dd649c9485 Optimize away the tsd_fast() check on fastpath. Qi Wang 2019-11-11 16:34:48 -08:00
  • 1decf958d1 Fix incorrect usage of cassert. Qi Wang 2019-11-21 14:10:03 -08:00
  • 45836d7fd3 Pass nstime_t pointer for profiling Yinan Zhang 2019-12-10 17:07:41 -08:00
  • 7d2bac5a38 Refactor destroy code path for prof_tctx Yinan Zhang 2019-12-10 10:46:31 -08:00
  • 055478cca8 Threshold is no longer updated before prof_realloc() Yinan Zhang 2019-12-10 10:03:54 -08:00
  • 7e3671911f Get rid of old indentation style for prof Yinan Zhang 2019-12-06 09:45:40 -08:00
  • dfdd46f6c1 Refactor prof_tctx_t creation Yinan Zhang 2019-12-05 15:52:54 -08:00
  • aa1d71fb7a Rename prof_tctx to alloc_tctx in prof_info_t Yinan Zhang 2019-12-05 15:35:12 -08:00
  • 5e0b090992 No need to pass usize to prof_tctx_set() Yinan Zhang 2019-12-05 15:15:36 -08:00
  • 1b1e76acfe Disable some spuriously-triggering warnings David Goldblatt 2019-12-04 10:16:44 -08:00
  • a70909b130 Test on all supported release of FreeBSD Li-Wen Hsu 2019-12-03 02:18:27 +08:00
  • 5c47a30227 Guard C++ aligned APIs Yinan Zhang 2019-11-25 15:27:52 -08:00
  • 6945371778 Change tsdn to tsd for profiling code path Yinan Zhang 2019-11-22 11:42:01 -08:00
  • b55419f9b9 Restructure profiling Yinan Zhang 2019-11-19 16:24:57 -08:00
  • 8b2c2a596d Support C++17 over-aligned allocation Mark Santaniello 2019-10-26 23:28:42 -07:00
  • 9a3c738009 Refactor arena_bin_malloc_hard(). Qi Wang 2019-11-05 13:22:54 -08:00
  • 9a7ae3c97f Reduce footprint of bin_t. Qi Wang 2019-11-05 20:43:59 -08:00
  • cb1a1f4ada Remove the unnecessary alloc_ctx on free_fastpath. Qi Wang 2019-11-15 22:54:15 -08:00
  • 7160617107 Add branch hints to free_fastpath. Qi Wang 2019-11-15 22:47:49 -08:00
  • a787d2f5b3 Prefer getaffinity() to detect number of CPUs. Qi Wang 2019-11-08 13:05:43 -08:00
  • 04cb7d4d6b Bail out early for muzzy decay. Qi Wang 2019-11-06 23:09:20 -08:00
  • 73510dfd15 Revert "Fix bug in prof_realloc" Yinan Zhang 2019-11-15 14:20:31 -08:00
  • 3b5eecf102 Fix bug in prof_realloc Yinan Zhang 2019-11-15 11:43:25 -08:00
  • e4c36a6f30 Emphasize no modification through thread.allocatedp allowed. Qi Wang 2019-11-12 23:44:01 -08:00
  • c462753cc8 Use __forceinline for JEMALLOC_ALWAYS_INLINE on msvc Leonardo Santagada 2019-10-23 15:00:49 +02:00
  • 836d7a7e69 Check for large size first in the uncommon case of malloc. Qi Wang 2019-11-04 18:24:39 -08:00
  • 9c59abe42a Fix a typo in Makefile. Qi Wang 2019-11-11 12:13:48 -08:00
  • da50d8ce87 Refactor and optimize prof sampling initialization. Qi Wang 2019-11-04 17:22:25 -08:00
  • bc774a3519 Rename tsd->offset_state to tsd->prng_state. Qi Wang 2019-11-04 16:48:12 -08:00
  • 19a51abf33 Avoid arena->offset_state when tsd not available for prng. Qi Wang 2019-11-04 16:44:37 -08:00
  • d01b425e5d Add -Wimplicit-fallthrough checks if supported Nick Desaulniers 2019-10-29 13:03:41 -07:00
  • a8b578d538 Remove mallctl test for zero_realloc Yinan Zhang 2019-11-05 06:46:52 -08:00
  • 43f0ce92d8 Define general purpose tsd_thread_event_init() Yinan Zhang 2019-11-01 14:11:59 -07:00
  • 97f93fa0f2 Pull tcache GC events into thread event handler Yinan Zhang 2019-10-24 16:41:45 -07:00
  • 198f02e797 Pull prof_accumbytes into thread event handler Yinan Zhang 2019-10-14 09:35:51 -07:00
  • 152c0ef954 Build a general purpose thread event handler Yinan Zhang 2019-09-03 15:04:48 -07:00
  • 6924f83cb2 use SYS_openat when available RingsC 2019-10-13 23:11:23 +08:00
  • de81a4eada Add stats counters for number of zero reallocs David T. Goldblatt 2019-10-26 11:04:46 -07:00
  • 9cfa805947 Realloc: Make behavior of realloc(ptr, 0) configurable. David T. Goldblatt 2019-09-23 17:56:19 -07:00
  • ee961c2310 Merge realloc and rallocx pathways. David T. Goldblatt 2019-10-21 18:44:42 -07:00
  • bd6e28d6a3 Guard slabcur fetching in extent_util Yinan Zhang 2019-10-28 09:24:42 -07:00
  • 4786099a3a Increase column width for global malloc/free rate Yinan Zhang 2019-10-24 13:16:09 -07:00
  • 05681e387a Optimize cache_bin_alloc_easy for malloc fast path Yinan Zhang 2019-10-08 11:33:55 -07:00
  • 4fe50bc7d0 Fix amd64 MSVC warning Yinan Zhang 2019-10-17 16:46:45 -07:00
  • 4fbbc817c1 Simplify time setting and getting for prof log Yinan Zhang 2019-07-15 10:37:09 -07:00
  • 4094b7c03f Limit # of iters of test_bitmap_xfu. Qi Wang 2019-09-11 10:21:46 -07:00
  • 66e07f986d Suppress tdata creation in reentrancy Yinan Zhang 2019-10-03 13:01:12 -07:00