Commit Graph

151 Commits

Author SHA1 Message Date
Yukihiro "Matz" Matsumoto 6e84066a42 mruby-pack: optimize float formats with union and lookup tables
- Replace nested endianness branching with lookup table approach
- Use union for safe float/double type punning
- Eliminate byte-by-byte loops in favor of direct indexing
- Consistent optimization patterns aligned with integer formats
- Achieve significant performance improvements: ~440K float ops/sec,
  ~249K double ops/sec

Co-authored-by: Claude <noreply@anthropic.com>
2025-08-14 10:53:12 +09:00
Yukihiro "Matz" Matsumoto ef5b39a5cc mruby-pack: optimize integer formats with lookup tables
- Eliminate branching in endianness handling using lookup tables
- Replace 8-iteration loop in unpack_quad with direct bit operations
- Fix endianness mapping for correct big/little-endian byte order
- Maintain consistent optimization patterns across all integer sizes
- Achieve significant performance improvements while preserving compatibility

Co-authored-by: Claude <noreply@anthropic.com>
2025-08-14 10:53:11 +09:00
Yukihiro "Matz" Matsumoto fdc0695944 mruby-pack: integer format optimization
optimize integer packing and unpacking algorithms:
- replace division/modulo with bit shifts in pack_short
- replace multiplication with bit shifts in unpack functions
- eliminate 8-iteration loop in unpack_quad with direct bit operations
- improve variable declarations following mruby patterns
- maintain full backward compatibility

performance improvements:
- short format packing: +21% (49k -> 59k ops/sec)
- long format packing: +43% (37k -> 53k ops/sec)
- consistent bit manipulation patterns across all integer sizes
- reduced branching and CPU-intensive operations

Co-authored-by: Claude <noreply@anthropic.com>
2025-08-14 10:53:11 +09:00
Yukihiro "Matz" Matsumoto a09c0f3b7d mruby-pack: optimize hex format encoding and decoding
- add lookup table for hex2int conversion to eliminate branches
- improve variable declarations following mruby patterns
- optimize pack_hex algorithm with better loop structure
- optimize unpack_hex algorithm with reduced conditionals
- improve buffer allocation precision
- maintain full backward compatibility

performance improvements:
- pack operations: ~224k ops/sec for 1600-char strings
- unpack operations: ~306k ops/sec for binary data
- eliminated function call overhead with lookup table
- reduced bounds checking and conditional branches

Co-authored-by: Claude <noreply@anthropic.com>
2025-08-14 10:53:11 +09:00
Yukihiro "Matz" Matsumoto 7a98bd3da0 mruby-pack: optimize BER decoding overflow checking
- calculate maximum safe bytes upfront to reduce checking frequency
- only check overflow when approaching byte limits or value limits
- maintain same overflow detection accuracy with better performance
- reduces per-iteration overhead for common BER decoding cases

Co-authored-by: Claude <noreply@anthropic.com>
2025-08-14 10:53:11 +09:00
Yukihiro "Matz" Matsumoto 9051c48431 mruby-pack: add fast paths for BER encoding optimization
- add fast path for 1-byte values (0-127): direct encoding
- add fast path for 2-byte values (128-16383): simple bit operations
- fallback to original algorithm for larger values (16384+)
- eliminates expensive bit mask calculation loop for ~95% of typical usage
- maintains full backward compatibility and correctness

Co-authored-by: Claude <noreply@anthropic.com>
2025-08-14 10:53:11 +09:00
Yukihiro "Matz" Matsumoto 42033352b9 mruby-pack: improve BER encoding variable declarations
- move variable declarations to initialization points in pack_BER
- move variable declarations to initialization points in unpack_BER
- improve code readability with better variable scoping
- maintain exact same algorithm and performance

Co-authored-by: Claude <noreply@anthropic.com>
2025-08-14 10:53:11 +09:00
Yukihiro "Matz" Matsumoto 32ad871f5d mruby-pack: document BER format ('w') template directive
- add 'w' directive to supported template table
- provide BER encoding/decoding usage example
- describe as variable length encoding (no endianness concept)

Co-authored-by: Claude <noreply@anthropic.com>
2025-08-14 10:53:11 +09:00
Yukihiro "Matz" Matsumoto 57d37fdfc1 mruby-pack: improve base64 decoding code organization
- move variable declarations to initialization points for cleaner code
- improve code readability with better variable scoping
- maintain exact same algorithm and performance characteristics

Co-authored-by: Claude <noreply@anthropic.com>
2025-08-14 10:53:10 +09:00
Yukihiro "Matz" Matsumoto 2639e9d8cd mruby-pack: optimize base64 encoding for memory efficiency
- add fast path for no line wrapping (count=0) to avoid column tracking
- use precise buffer size calculation to prevent reallocations
- move variable declarations to initialization points for cleaner code
- maintain full backward compatibility

Co-authored-by: Claude <noreply@anthropic.com>
2025-08-14 10:53:10 +09:00
Yukihiro "Matz" Matsumoto e7c7b400a1 mruby-pack: add comprehensive call-seq documentation for all methods
Added complete call-seq documentation for all 3 public methods in the
pack gem, improving documentation coverage from 0% to 100%.

Documentation added:
- Array#pack: Pack array elements into binary string using template
- String#unpack: Unpack binary string into array using template
- String#unpack1: Unpack first value from binary string using template

Each method now includes:
- Clear method signatures with parameter and return types
- Comprehensive template directive reference table covering all supported formats
- Detailed descriptions of binary data packing/unpacking behavior
- Practical examples showing common usage patterns for different data types
- Notes about endianness, data type sizes, and string handling
- Cross-references between related methods

Template directives documented include:
- Integer types: C, c, S, s, L, l, Q, q (various sizes and signedness)
- Network/endian specific: n, N, v, V (network and little endian)
- Floating point: f, d (single and double precision)
- String types: A, a, Z (ASCII with different padding)
- Hex and binary: H, h (hex strings with nibble order)
- Special: x, X, @ (null bytes, positioning)

Co-authored-by: Atlassian Rovo Dev
2025-07-16 10:09:54 +09:00
Yukihiro "Matz" Matsumoto 67dbaf856f mruby-pack: add README.md
The document is written by Google Jules.
2025-06-16 12:45:18 +09:00
Yukihiro "Matz" Matsumoto 07d7aa6fdb mruby-pack: fix int and mrb_int mixture 2025-04-02 16:45:11 +09:00
Yukihiro "Matz" Matsumoto b88680ee9e mruby-pack (pack_unpack): use mrb_bool instead of int 2025-04-02 16:44:06 +09:00
Yukihiro "Matz" Matsumoto 6bcaeb5a93 mruby-pack: use presym for initialization 2024-06-14 00:19:21 +09:00
dearblue 6c2f570d79 Fixed base64 decoding in mruby-pack
Previously `\x80` was incorrectly mapped to `0`.

```ruby
"\x80\x80\x80\x80".unpack("m*")
# before => "\x00\x00\x00"
# after  => ""
```

The reason is that the C string terminator is placed in `base64_dec_tab[128]` and the array length is obtained by `sizeof`.
Therefore, the length of `base64_dec_tab[]` is strictly specified and replaced with element-by-element initialization.

Also, similar changes are made to `base64chars[]`.
2024-04-20 09:56:08 +09:00
Yukihiro "Matz" Matsumoto 87b358a342 Including header files in include/* by <> 2024-03-26 13:59:59 +09:00
Yukihiro "Matz" Matsumoto 0fe95d6c81 mruby-pack (mrb_pack_pack): avoid integer overflow
`int` (32bit integer) may be too small on 64bit platforms.
2024-02-05 21:28:11 +09:00
Yukihiro "Matz" Matsumoto 39f48d732a mruby-pack: update README.md
'X' and '@' directives are not listed
2023-12-30 16:02:20 +09:00
Yukihiro "Matz" Matsumoto 56b67f8613 mruby-pack (u64tostr): reimplement the function
- direct conversion of single digit numbers
- remove unnecessary update of `line` variable
- simplify the body according to the assertion
2023-12-30 15:35:55 +09:00
Yukihiro "Matz" Matsumoto 8cbd4638f4 mruby-pack (u64tostr): len should always be positive
Add `mrb_assert()` instead of just skipping the function.
2023-12-30 15:33:57 +09:00
Yukihiro "Matz" Matsumoto 1871ff14db mruby-pack (pack_unpack): skip continuous extraction from unpack1
Ref #6134
2023-12-30 15:31:44 +09:00
Yukihiro "Matz" Matsumoto 7765c23f69 mruby-pack (pack_hex): the scope of variables a and b can be reduced 2023-12-30 15:12:17 +09:00
Yukihiro "Matz" Matsumoto fca2bbdcca mruby-pack (unpack_str): the scope of the variable cp can be reduced 2023-12-30 15:12:10 +09:00
Yukihiro "Matz" Matsumoto 159687bef3 mruby-pack: add tests for unpack1 method; ref #6134 2023-12-29 15:05:16 +09:00
Yukihiro "Matz" Matsumoto 6d8323f3c7 mruby-pack (pack_unpack): unpack1 did not return single data; fix #6134
For following unpack directives:

- PACK_DIR_HEX (h)
- PACK_DIR_BSTR (b)
- PACK_DIR_STR (a,A,Z)
- PACK_DIR_BASE64 (m)
- PACK_DIR_QENC (M)
2023-12-29 13:09:14 +09:00
Yukihiro "Matz" Matsumoto 097681b4d4 mruby-pack: unpack "b/B" should limit result size 2023-10-09 22:39:44 +09:00
Yukihiro "Matz" Matsumoto 393aaada64 mruby-pack/pack.c (read_tmpl): fix out-of-bound access with templates 2023-09-20 09:51:22 +09:00
Yukihiro "Matz" Matsumoto 1e1184f62d mruby-pack/pack.c (read_tmpl): should consume skips in the function 2023-07-28 17:05:49 +09:00
Yukihiro "Matz" Matsumoto 1535e031df mruby-pack/pack.c (read_tmpl): direct return from skipping directives
We used to read counts after spaces, for example `pack("j 4")` read `4`
as counts after a space.
2023-07-24 18:03:39 +09:00
Yukihiro "Matz" Matsumoto a5a13ad35f mruby-pack/pack.c (read_tmpl): read_tmpl to return dir
Use return value for directives information.
2023-07-24 18:03:39 +09:00
Yukihiro "Matz" Matsumoto 8a3d52f494 mruby-pack/pack.c (read_tmpl): rename PACK_DIR_INVALID
The value is used for spaces and comments, so the term "skip" is more
appropriate than "invalid".
2023-07-24 18:03:38 +09:00
Yukihiro "Matz" Matsumoto e17f3256c6 mruby-pack/pack.c (read_tmpl): support comments in derectives 2023-07-24 18:03:38 +09:00
Yukihiro "Matz" Matsumoto 0eceadd037 mruby-pack/test/pack.rb: test B/b directives 2023-07-24 18:03:38 +09:00
Yukihiro "Matz" Matsumoto e7021f190a mruby-pack/pack.c (pack_bstr): support B/b directives 2023-07-24 18:03:38 +09:00
Yukihiro "Matz" Matsumoto 05549410d9 mruby-pack/pack.c (read_tmpl): check unknown directives 2023-07-24 18:03:38 +09:00
Yukihiro "Matz" Matsumoto 2a1e3a572c mruby-pack/pack.c (read_tmpl): support J/j template in pack
J/j is available since Ruby 2.3.
2023-07-24 18:03:37 +09:00
Yukihiro "Matz" Matsumoto ea649e70b8 mruby-pack/pack.c (mrb_pack_pack): use direct array buffer access
We don't need index wrap-around not boundary check here, so we can use
faster direct array access.
2023-06-29 22:54:58 +09:00
Yukihiro "Matz" Matsumoto c32f7915fb reformat else clause indentation style 2023-05-20 00:21:01 +09:00
Yukihiro "Matz" Matsumoto eea72ec84a fix spaces in the type cast expressions (cosmetic changes) 2023-05-18 23:29:16 +09:00
Yukihiro "Matz" Matsumoto 9c5dc42e59 small cosmetic changes.
I prefer `i++` style unless absolutely necessary.
This commit is an addition to 41e4148.
2022-11-19 17:11:56 +09:00
Yukihiro "Matz" Matsumoto 9fcfd01f20 mruby-pack/pack.c (read_tmpl): check integer overflow before casting. 2022-11-10 22:21:12 +09:00
Yukihiro "Matz" Matsumoto 4a888a34bb readfloat.c (mrb_read_float): a new function.
We no longer use `mrb_float_read()` that depends on `errno`.
2022-11-07 16:09:31 +09:00
Yukihiro "Matz" Matsumoto 4e9773ae3d readint.c (mrb_int_read): new function.
We no longer use `mrb_read_int` which is kinda compatible with `strtol`.
2022-11-07 16:09:31 +09:00
Yukihiro "Matz" Matsumoto 5ee42ff1dd Merge pull request #5833 from jbampton/remove-coding-utf-8-ruby
Remove `# coding: utf-8` from Ruby files
2022-10-27 18:11:54 +09:00
Yukihiro "Matz" Matsumoto 8a67a26104 mruby-pack/pack.c (unpack): check if the given length is positive.
To avoid out-of-bound array access.
2022-10-27 16:32:05 +09:00
John Bampton 44db4f18d3 Remove # coding: utf-8 from Ruby files
The default script encoding is Encoding::UTF-8 after v2.0.

https://ruby-doc.org/core-2.1.2/Encoding.html#class-Encoding-label-Script+encoding
2022-10-27 04:43:13 +10:00
Yukihiro "Matz" Matsumoto 4f0679bb86 pack.c (pack_unpack): small refactoring. 2022-08-31 23:29:12 +09:00
Yukihiro "Matz" Matsumoto 15e9b09bef pack.c (hex2int): should return signed integer. 2022-08-30 18:08:05 +09:00
Yukihiro "Matz" Matsumoto f587edd849 pack.c: need extra space for the terminal NULL. 2022-08-23 15:05:27 +09:00