Daniel Lemire
f03a6ab5a4
Tweaking.
2020-06-21 17:39:24 -04:00
Daniel Lemire
5dc07ed295
It builds.
2020-06-21 17:20:33 -04:00
Daniel Lemire
064d4255d5
Ok.
2020-06-21 17:09:06 -04:00
Daniel Lemire
04139eb82e
Ok.
2020-06-21 17:05:55 -04:00
John Keiser
76c9f4f5a6
Merge pull request #941 from simdjson/jkeiser/forgot
...
Remove unnecessary functions
2020-06-17 09:09:28 -07:00
Daniel Lemire
942ef3b7f2
Merge pull request #939 from simdjson/dlemire/lookup3
...
Introducing lookup3 (UTF-8 validation).
2020-06-17 11:19:09 -04:00
John Keiser
f8f36c085c
Remove unnecessary functions
2020-06-17 07:11:53 -07:00
John Keiser
7339f67dd7
Merge pull request #462 from simdjson/jkeiser/if-backslash
...
Wrap backslash processing in a branch
2020-06-17 07:07:58 -07:00
Daniel Lemire
71a889ed73
Introducing lookup3 (UTF-8 validation).
2020-06-16 19:08:25 -04:00
John Keiser
610c79fbf3
Don't use backslash branch on ARM
2020-06-13 07:51:28 -07:00
John Keiser
fd44c2a2ff
Merge pull request #927 from simdjson/dlemire/exposingthestringminifier
...
Exposing the string minifier.
2020-06-13 07:47:20 -07:00
John Keiser
a86a82b39c
Rename minify class to minifier so the minify() method is cleared up
2020-06-12 17:05:25 -07:00
Daniel Lemire
bd2d0f769f
One unlikely too many ( #930 )
2020-06-12 17:58:10 -04:00
John Keiser
664b03bb13
Short circuit find escapes if there is a backslash
2020-06-12 10:10:35 -07:00
John Keiser
bbd61eb13f
Let tape writing be put in a register
2020-06-12 09:18:20 -07:00
John Keiser
e15e1e253d
peek_char -> peek_next_char
2020-06-12 09:10:16 -07:00
Daniel Lemire
a6e4933d93
Exposing the string minifier.
2020-06-11 13:07:18 -04:00
John Keiser
ea08e7d192
Remove unused extra copy of find_next_document_index
2020-06-09 17:52:13 -07:00
John Keiser
d178e089a6
Stop caching current structural, keep current index around instead of
...
next
2020-06-08 15:21:54 -07:00
John Keiser
5f00b37e21
Stop caching the buffer index
2020-06-08 15:21:54 -07:00
John Keiser
8a8792d47f
Remove most uses of current_char()
2020-06-08 15:21:54 -07:00
John Keiser
59d9bc9e48
Store the pointer to the next structural instead of base
...
structural_indexes and an index
2020-06-08 15:21:54 -07:00
John Keiser
8793dd3ceb
Don't store len locally
2020-06-08 15:21:54 -07:00
John Keiser
48062380fa
Move parser to structural_iterator
2020-06-08 15:21:54 -07:00
John Keiser
3636aa5522
Extend structural_parser from structural_iterator
2020-06-08 15:21:54 -07:00
John Keiser
a1aea4588f
Move document stream state to implementation
2020-06-08 15:21:54 -07:00
John Keiser
1d4fffb799
Fix fallback implementation
2020-06-08 15:21:52 -07:00
John Keiser
6f90f5dc5f
Remove templating from finish() method
2020-06-08 15:20:56 -07:00
John Keiser
9dd6972d26
Remove impossible checks, add EMPTY check to normal parser
2020-06-08 15:20:56 -07:00
John Keiser
d731a7d52c
Privatize structural_parser
2020-06-08 15:20:56 -07:00
John Keiser
059468b74e
Eliminate streaming_structural_parser subclass with templates
2020-06-08 15:20:56 -07:00
John Keiser
5e69fb782a
Call a function to parse structurals
2020-06-08 15:20:56 -07:00
John Keiser
a5beffda78
Remove streaming_structural_parser.h
2020-06-08 15:20:56 -07:00
John Keiser
7de7ce5fdc
Move document stream state to implementation
2020-06-08 15:20:56 -07:00
John Keiser
0dbda65e44
Fix fallback implementation
2020-06-08 14:52:23 -07:00
John Keiser
d43a4e9df9
Remove SUCCESS_AND_HAS_MORE (internal only value)
2020-06-07 16:20:55 -07:00
John Keiser
ef63a84a3e
Move document stream state to implementation
2020-06-07 16:20:44 -07:00
John Keiser
8c16ba372e
Acknowledge that we always have a remainder
2020-06-06 16:46:38 -07:00
John Keiser
9be4a17687
Separate definition from declaration, arrange top down
2020-06-06 16:46:38 -07:00
John Keiser
ed0c815735
Move unclosed array check to stage 2
2020-06-05 12:39:13 -07:00
Daniel Lemire
7a69da16e4
Fixing issue 906 ( #912 )
...
* Fixing issue 906
* Safe patching.
* Now with explanations.
* Bumping up memory allocation.
* Putting the patch back.
* fallback fixes.
Co-authored-by: Daniel Lemire <lemire@gmai.com >
2020-06-05 15:37:09 -04:00
Daniel Lemire
52f44de257
This introduces a tiny simplification in number parsing. ( #910 )
...
* This introduces a tiny simplification in number parsing.
* Removing unnecessary function.
Co-authored-by: Daniel Lemire <lemire@gmai.com >
2020-06-04 17:13:02 -04:00
John Keiser
b75fa26dc1
Move containing_scope and ret_address to .cpp
2020-06-01 12:15:55 -07:00
John Keiser
3d22a2d845
One weird trick: set a bogus error value in the parser impl
...
This makes us faster under both gcc and clang somehow.
2020-06-01 12:15:55 -07:00
John Keiser
1aab4752e2
Store all parser state in the implementation
2020-06-01 12:15:54 -07:00
John Keiser
86f8a4a9d2
Don't set parser.valid or parser.error
...
This regresses performance and is ONLY here because the next
two commits are here; this lets us see the impact of removing
parser.error separately from the impact of the next commit.
2020-06-01 12:14:09 -07:00
John Keiser
db2cb061cb
Remove on_error function
...
Solely here to make the next patch smaller and more isolatable
2020-06-01 12:14:09 -07:00
John Keiser
6a71b24495
Reuse stored buf and len from parser
2020-06-01 12:14:09 -07:00
John Keiser
84712a8bbc
Store buf and len in parser implementation
2020-06-01 12:14:09 -07:00
John Keiser
b86fb95306
Rename doc_parser -> parser
2020-06-01 12:14:09 -07:00