Commit Graph

18246 Commits

Author SHA1 Message Date
Hendrik 44831711fc Fix out of bounds read and write in IO.select
Added error handling for file descriptors larger than FD_SETSIZE in mrb_hal_io_fdset_set and mrb_hal_io_fdset_isset functions, for posix hal.

I actually don't know how to fix this on windows, or if it needs fixing.
2026-01-25 15:42:17 +01:00
Yukihiro "Matz" Matsumoto c25b562256 Merge pull request #6706 from Asmod4n/patch-4 2026-01-20 13:28:25 +09:00
Yukihiro "Matz" Matsumoto aadd23cc70 Merge pull request #6699 from hasumikin/fix/mruby-task 2026-01-20 12:37:29 +09:00
Yukihiro "Matz" Matsumoto 26c38bd8ba Merge pull request #6708 from dearblue/private-methods 2026-01-19 18:08:28 +09:00
dearblue 8a8e2ddad9 Define the initialize_copy and respond_to_missing? methods as private
It is preferable for them to be private even when defined via `mrb_define_method()`.
This mimics CRuby's behavior.

ref: https://github.com/ruby/ruby/blob/v4.0.0/vm_method.c#L1329-L1336
2026-01-18 20:56:51 +09:00
Hendrik 3d5bb929ab Refactor task class to use symbol IDs 2026-01-17 19:31:24 +01:00
Yukihiro "Matz" Matsumoto 3a1b771cc6 class.h: add mrb_class_outer() API to get the outer class/module
expose the previously internal outer_class() function as a public API
for mrbgems to retrieve the enclosing class/module of a given class.
closes #6705.

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-17 14:17:29 +09:00
Yukihiro "Matz" Matsumoto 0ba48a2a5b mruby-set: fix memory leak in khash rebuild using mrb_protect_error()
wrap hash and eql callbacks with mrb_protect_error() to catch exceptions
during khash table rebuild. when an exception occurs (e.g., SystemStackError
from infinite recursion), return a safe default value and store the exception
in mrb->exc for later processing. this prevents memory leaks from orphaned
allocations when exceptions propagate through khash rebuild.

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-17 13:00:45 +09:00
Yukihiro "Matz" Matsumoto 27c9356f99 Revert "mruby-set: fix memory leak caused by recursive hash computation"
This reverts commit c9e3af60e1.
2026-01-17 12:55:50 +09:00
Yukihiro "Matz" Matsumoto a9f02eb6a4 bigint.c: add inline to limb_popcount()
Small helper called in a loop from mpz_popcount().

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-17 11:13:59 +09:00
Yukihiro "Matz" Matsumoto 8d15caec14 bigint.c: add inline to mpn_add_n() and mpn_sub_n()
Both functions are small helpers called only from mpn_add()
and mpn_sub() respectively.

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-17 11:07:14 +09:00
Yukihiro "Matz" Matsumoto 632391fba2 bigint.c: add inline to mpn_div_batch()
Co-authored-by: Claude <noreply@anthropic.com>
2026-01-16 18:06:46 +09:00
Yukihiro "Matz" Matsumoto 6ebb6f3f4e bigint.c: use mpn_cmp() in ucmp()
Move mpn_cmp() before ucmp() and simplify ucmp() to use it
instead of duplicating the comparison loop.

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-16 17:17:18 +09:00
Yukihiro "Matz" Matsumoto 2a415f1640 bigint.c: remove unused mpn_submul_1()
Co-authored-by: Claude <noreply@anthropic.com>
2026-01-16 17:14:43 +09:00
Yukihiro "Matz" Matsumoto 8089fdadf0 bigint.c: inline usub_inplace() at call site
Function was only called once and contained just 2 lines of code.
Inlining directly reduces code size and improves clarity.

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-16 17:11:43 +09:00
Yukihiro "Matz" Matsumoto ad1254e3cc bigint.c: optimize decimal string parsing with chunked conversion
Add CPython-style parsing for base-10 string to integer conversion:
- Parse 9 digits at a time into decimal-base array
- Convert decimal-base to binary in single pass
- Use memory pool for temporary decimal buffer
- Use realloc for result buffer to reduce allocations

Also add digit_pairs lookup table for faster to_s output.

Performance: 2-5x faster for to_i, 60% fewer allocations.

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-16 16:59:27 +09:00
HASUMI Hitoshi 219588091b Improve task.c code clarity and fix potential GC issue
- Add mrb_gc_protect() after arena_restore to prevent result from being collected before returning to caller
- Add comment to suspend_task_internal explaining why WAITING and DORMANT tasks can also be suspended
- Move argc/argv cast at the beginning of function with comment
2026-01-16 08:56:49 +09:00
Yukihiro "Matz" Matsumoto 9e6f2809ce bigint.c: optimize decimal string conversion with base conversion algorithm
Replace the repeated-division approach with Knuth's base conversion
algorithm for decimal string conversion. This processes each input
limb once (MSB to LSB) and builds the decimal representation
incrementally, which is faster than dividing the entire number
repeatedly.

Performance improvement for to_s on numbers under D&C threshold:
- 128 bits:  2.5x faster (0.80 -> 0.32 us)
- 256 bits:  3.6x faster (1.47 -> 0.41 us)
- 512 bits:  5.0x faster (3.47 -> 0.69 us)
- 1024 bits: 6.1x faster (9.37 -> 1.55 us)
- 2048 bits: 6.4x faster (31.0 -> 4.82 us)

Also includes:
- Montgomery reduction for modular exponentiation (powm)
- Adjusted Barrett reduction threshold to >= 4 limbs

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-16 08:46:11 +09:00
Yukihiro "Matz" Matsumoto 27816e7482 bigint.c: lower DC_GET_STR_THRESHOLD from 1000 to 700
This improves to_s performance for medium-sized bigints (40-50 limbs,
~800-1000 digits) by approximately 5x by enabling the divide-and-conquer
algorithm earlier.

Benchmark results:
  40 limbs (772 digits): 88 us -> 18 us (5x faster)
  50 limbs (964 digits): 134 us -> 25 us (5.4x faster)

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-15 16:52:57 +09:00
Yukihiro "Matz" Matsumoto 85e81072cf mruby-bigint: add Karatsuba multiplication for medium-sized numbers
Implement Karatsuba algorithm for operands with 32-99 limbs, providing
~10-25% speedup over schoolbook multiplication in this range.

Algorithm hierarchy is now:
  - Schoolbook: < 32 limbs
  - Karatsuba:  32-99 limbs
  - Toom-3:     >= 100 limbs

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-15 16:12:45 +09:00
Yukihiro "Matz" Matsumoto b0c1a31961 mruby-bigint: raise Toom-3 threshold from 50 to 100 limbs
Benchmarks show the previous threshold of 50 was too low, causing
Toom-3's setup overhead to outweigh its asymptotic benefits for
medium-sized numbers. Raising to 100 limbs provides:

- 2x faster at 300 limbs (192 -> 96 us)
- 2.5x faster at 120 limbs (42 -> 17 us)
- 2.6x faster at 80 limbs (31 -> 12 us)

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-15 14:46:00 +09:00
Yukihiro "Matz" Matsumoto 0220ec2b62 mruby-bigint: add balance multiplication for asymmetric operands
When multiplying numbers where one is significantly larger than the other
(at least 2x size difference), split the larger number into chunks matching
the smaller number's size, multiply each chunk, and combine results. This
avoids pathological performance when Toom-3 pads asymmetric operands with
zeros.

Benchmarks show 6-16x speedup for size ratios from 10:1 to 40:1, with no
regression for symmetric cases.

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-15 14:37:18 +09:00
Yukihiro "Matz" Matsumoto 1fd4cd989b bigint.c: remove redundant mpz_realloc() calls after mpz_init_heap()
mpz_init_heap() already allocates the requested size, so immediately
calling mpz_realloc() with the same size is a no-op. Remove these
redundant calls from mpz_and, mpz_or, mpz_xor, mpz_mod_2exp, and
mpz_abs.

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-15 11:51:17 +09:00
Yukihiro "Matz" Matsumoto 8566a996dd mruby-bigint: add in-place optimizations for mpz_neg, mpz_abs, ulshift
When the output and input are the same variable, avoid unnecessary
heap allocations by modifying in place:
- mpz_neg: just flip the sign
- mpz_abs: just make sign positive
- ulshift: use mpn_lshift in-place (safe since it processes high-to-low)

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-15 09:49:28 +09:00
Yukihiro "Matz" Matsumoto bb146b4a31 mruby-bigint: add specialized Toom-3 squaring
Add mpz_sqr_toom3() that performs Toom-3 squaring with reduced memory
and computation:

- Only evaluates x (not y), reducing evaluation buffer from 6 to 3
- Uses recursive squaring instead of multiplication for all 5 products
- Simplifies interpolation since squared values are always positive

The specialized squaring uses the same Toom-3 structure but avoids
redundant computation when both operands are the same number.

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-15 09:21:48 +09:00
Yukihiro "Matz" Matsumoto 334e242cbf mruby-bigint: fix in-place aliasing bug in mpn_divexact_3
The mpn_divexact_3 function used ap[i] in the borrow computation after
writing to rp[i]. When rp == ap (in-place operation), this read the
modified value instead of the original input, causing incorrect borrow
propagation.

This bug caused Toom-3 multiplication to produce wrong results for
certain input patterns where t6 - t5 had non-zero values followed by
zeros. The corrupted r3 coefficient then propagated errors to the final
result.

Fix by saving the original ap[i] value before writing rp[i].

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-15 09:20:15 +09:00
Yukihiro "Matz" Matsumoto 3b41d66299 mruby-bigint: inline in-place subtraction into mpz_sub
move in-place optimization directly into mpz_sub() so callers
just use mpz_sub(ctx, x, x, y) and get automatic optimization.
remove separate mpz_sub_inplace() function.

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-15 08:34:32 +09:00
Yukihiro "Matz" Matsumoto c048ccc88a mruby-bigint: add in-place right shift optimization
when destination equals source in mpz_div_2exp(), use memmove
and mpn_rshift in-place instead of allocating a temporary.
reduces sqrt allocations by 49% since Newton iteration uses
in-place division by 2 on each iteration.

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-15 08:03:56 +09:00
Yukihiro "Matz" Matsumoto 6baa9b7119 mruby-bigint: add in-place subtraction to reduce allocations
add usub_inplace() and mpz_sub_inplace() for allocation-free
subtraction when the minuend is larger than the subtrahend.
apply to Mersenne multiplication which reduces allocations by
17% and improves performance by 7-9% for small numbers.

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-15 07:56:37 +09:00
Yukihiro "Matz" Matsumoto a7b7885e69 mruby-bigint: add fast path for bitwise ops with positive operands
skip two's complement conversion in mpz_and, mpz_or, mpz_xor when both
operands are positive. this avoids the per-limb make_2comp overhead and
provides up to 1.6x speedup for large bigints.

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-14 16:57:14 +09:00
Yukihiro "Matz" Matsumoto 3e695f24d9 mruby-bigint: use mpz_init_temp in div_limb for pool allocation
convert mpz_init_heap to mpz_init_temp for temporary quotient and
remainder variables in div_limb. these variables are now allocated
from the memory pool when possible, reducing heap allocation overhead.

the div_limb function already uses pool_save/pool_restore, so these
temporary variables are proper candidates for pool allocation.

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-14 16:12:23 +09:00
HASUMI Hitoshi e7d6def808 Refactor Task#suspend,terminate,resume
- Fix inconsistency of MRB_API functions and Ruby methods
- Get rid of duplication
- Adjust error handling
2026-01-14 15:48:36 +09:00
HASUMI Hitoshi 5c6771eb78 Remove unnecessary code 2026-01-14 14:56:50 +09:00
Yukihiro "Matz" Matsumoto 907b4b99d1 variable.c: use realloc in iv_rehash to avoid malloc+free
when the allocator can extend the block in place, realloc avoids
the overhead of malloc+memcpy+free. the keys are moved to their
new position with memmove and extended regions are cleared.

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-14 14:43:32 +09:00
Yukihiro "Matz" Matsumoto 6bd1f51f20 variable.c: reduce IV_INITIAL_SIZE from 4 to 2
saves 40% memory (60 -> 36 bytes) for objects with 1-2 instance
variables, which is common for simple value objects like Point(@x, @y).

the trade-off is one extra reallocation when growing from 2 to 4 IVs,
but this is negligible since reallocations are rare compared to lookups.

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-14 14:35:02 +09:00
HASUMI Hitoshi 63dd1832bc Improve memory management of mrb_execute_proc_synchronously
Wrap sync task by mrb_gc_arena_save/restore to release objects from arena
that a sync task allocated so that they can be freed in GC cycle
2026-01-14 14:12:51 +09:00
Yukihiro "Matz" Matsumoto 99620804c3 mruby-bigint: replace Karatsuba with Toom-3 multiplication
Replace Karatsuba multiplication (O(n^1.585)) with Toom-3 (O(n^1.465))
for large number multiplication. Toom-3 splits numbers into thirds and
evaluates at 5 points, providing better asymptotic performance.

Threshold is 50 limbs (~1600 bits). For operands below threshold or
highly asymmetric sizes, schoolbook multiplication is used.

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-14 13:18:53 +09:00
Yukihiro "Matz" Matsumoto 1d898fc7d3 mruby-bigint: rename DC_TO_S_* to DC_GET_STR_* for consistency
- DC_TO_S_THRESHOLD -> DC_GET_STR_THRESHOLD
- dc_to_s_scratch_t -> dc_get_str_scratch_t

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-14 10:12:24 +09:00
Yukihiro "Matz" Matsumoto c747c77f40 mruby-bigint: always use 32-bit limbs by default
Remove automatic downgrade to 16-bit limbs on 32-bit Windows.
Modern compilers (including MSVC) have supported uint64_t for decades.
MRB_NO_MPZ64BIT remains available for constrained platforms.

Adjust BATCH_DIVISOR and BATCH_DIGITS for 16-bit limb compatibility:
- 32-bit limbs: 10^9 (9 digits per batch)
- 16-bit limbs: 10^4 (4 digits per batch)

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-14 10:12:23 +09:00
Yukihiro "Matz" Matsumoto 86c6048767 mruby-bigint: rename internal functions for consistency
- mpn_div10_9 -> mpn_div_batch
- mpz_to_s_dc -> mpz_get_str_dc (and related)

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-14 10:12:00 +09:00
Yukihiro "Matz" Matsumoto 9ef3362f92 mruby-bigint: consolidate mpn layer for low-level limb operations
Rename limb_* functions to follow GMP-style mpn_* naming convention:
- limb_zero -> mpn_zero
- limb_copy -> mpn_copyi
- limb_addmul_1 -> mpn_addmul_1

Add new mpn functions for future optimization work:
- mpn_submul_1: multiply-and-subtract (r -= s * limb)
- mpn_cmp: compare two same-length limb arrays

The mpn layer provides direct limb array operations without mpz memory
management overhead, which is essential for implementing advanced
algorithms like Newton-Raphson division.

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-14 08:19:23 +09:00
Yukihiro "Matz" Matsumoto b4af2afd31 mruby-bigint: fix heap-buffer-overflow from inflated sz in mpz_set copies
Add trim() after mpz_set in early return paths to prevent propagation
of inflated sz values. When an mpz_t has sz larger than actual allocated
limbs, copying it without trim causes subsequent operations to read
beyond allocated memory.

Fixed functions:
- mpz_add: when one operand is zero
- mpz_neg: when copying operand
- mpz_mod_2exp: when x < 2^e

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-14 00:58:40 +09:00
Yukihiro "Matz" Matsumoto d9a7d1a6b0 throw.h: add warning about internal-only usage; ref #6702
Document that this header is for mruby core internal use only and
should not be included in user code or mrbgems. When MRB_USE_CXX_EXCEPTION
is defined, C source files including this header fail to compile.
Add example showing mrb_protect_error() as the recommended alternative.

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-13 21:21:08 +09:00
Yukihiro "Matz" Matsumoto 6b9e477cc0 mruby-bigint: use mrb_protect_error for exception-safe cleanup
Use mrb_protect_error API instead of direct MRB_TRY/MRB_CATCH to handle
exceptions in mpz_mul_all_ones and mpz_to_s_dc. This maintains C++
compatibility (issue #6702) while ensuring temporary mpz_t allocations
are properly freed even when exceptions occur.

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-13 21:16:48 +09:00
Yukihiro "Matz" Matsumoto c7ae1561b0 mruby-bigint: remove throw.h dependency for C++ compatibility
Remove MRB_TRY/MRB_CATCH exception handling from bigint.c to fix
compilation errors when using mruby-bigint in C++ projects with
MRB_USE_CXX_EXCEPTION enabled.

The exception handling was added for cleanup on error, but it requires
throw.h which doesn't work when a C file is compiled in a C++ context
with C++ exceptions enabled. Accepting potential memory leaks on
exception (rare) is preferable to breaking C++ builds.

Fixes #6702

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-13 16:30:22 +09:00
Yukihiro "Matz" Matsumoto 45d483df2f mruby-bigint: remove unused mpn_add_1 and mpn_sub_1 functions
Co-authored-by: Claude <noreply@anthropic.com>
2026-01-13 16:12:29 +09:00
Yukihiro "Matz" Matsumoto e50f15c1c6 mruby-compiler: fix bytecode corruption in pattern matching optimization
The JMPNOT-to-JMPIF optimization assumed fail_pos always came from a
4-byte JMPNOT instruction. When a pinned variable is undefined,
NODE_PAT_PIN generates a 3-byte OP_JMP instead, causing fail_pos - 2
to point into the previous instruction and corrupt its operand.

Add a check to verify the instruction at fail_pos - 2 is actually
OP_JMPNOT before modifying it.

Fixes #6701

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-13 16:12:17 +09:00
Yukihiro "Matz" Matsumoto cda2567c36 mruby-bigint: add mpn_div10_9 for in-place base case division
Replace the two-buffer swap pattern in D&C to_s base case with
in-place division using new mpn_div10_9 function. This eliminates
the q_base scratch buffer and reduces per-iteration overhead.

Compilers optimize the constant division by 10^9 to multiplication
and shift operations for better performance.

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-13 12:47:47 +09:00
Yukihiro "Matz" Matsumoto 1f74884128 mruby-bigint: use depth-indexed lo buffers in D&C to_s
Replace per-call lo allocation with depth-indexed lo_stack buffers
that are reused across recursion levels. Each buffer is allocated
on first use at that depth with appropriate size.

This reduces 493 malloc/free calls (5%) and 580KB of memory (2%)
for large number to_s conversions while maintaining performance.

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-13 12:47:47 +09:00
Yukihiro "Matz" Matsumoto 1eea99b858 mruby-bigint: reuse q5 as hi in D&C to_s to reduce allocation
Instead of allocating a separate hi buffer for the upper part of the
split, reuse q5 by shifting it in place after extracting the lower
bits to q5_low.

This eliminates one mpz_t allocation per recursive call:
- Extract q5_low = q5 mod 2^k first (copy lower bits)
- Shift q5 right in place (memmove + mpn_rshift) to get hi
- q5 now serves as hi for the recursive call

Benchmark results (2.4M bit number):
- Memory: -3.5% (5.58MB -> 5.38MB peak heap)
- Instructions: -16.5%
- Speed: unchanged (within measurement noise)

Co-authored-by: Claude <noreply@anthropic.com>
2026-01-13 12:47:47 +09:00