Commit Graph
1492 Commits
Author SHA1 Message Date
Nigel Tao 4f1d24c070 Add names to "typedef struct { ... } foo" types 2020-09-23 22:02:53 +10:00
Nigel Tao aa46859ea4 wuffs gen -version=0.3.0-alpha.15 2020-09-23 16:23:25 +10:00
Nigel Tao afe7f27ab7 Trim Eisel-Lemire powers-of-10 tables
This tracks the upstream github.com/lemire/fast_double_parser

On a mid-range x86_64 laptop, processing the 181 MiB citylots.json file
from github.com/zemirco/sf-city-lots-json:

$ g++ -O3 script/process-json-numbers.c
$ time ./a.out -parse-number-f64 < citylots.json
Before/After:
real    0m1.035s
real    0m1.003s

Binary size, before:
29544 gen/lib/c/clang-9-dynamic/wuffs-base-floatconv.lo
29648 gen/lib/c/clang-9-static/wuffs-base-floatconv.o
31192 gen/lib/c/gcc-dynamic/wuffs-base-floatconv.lo
31160 gen/lib/c/gcc-static/wuffs-base-floatconv.o

After:
27160 gen/lib/c/clang-9-dynamic/wuffs-base-floatconv.lo
27264 gen/lib/c/clang-9-static/wuffs-base-floatconv.o
28760 gen/lib/c/gcc-dynamic/wuffs-base-floatconv.lo
28760 gen/lib/c/gcc-static/wuffs-base-floatconv.o
2020-09-23 16:18:27 +10:00
Nigel Tao b6d855210c Use a formula to calculate Eisel-Lemire power-of-2
On a mid-range x86_64 laptop, processing the 181 MiB citylots.json file
from github.com/zemirco/sf-city-lots-json:

$ g++ -O3 script/process-json-numbers.c
$ time ./a.out -parse-number-f64 < citylots.json
Before/After:
real    0m0.992s
real    0m1.035s
2020-09-23 15:23:12 +10:00
Nigel Tao cd4cbc9102 Tweak JSON trailing comment/new-line quirks 2020-09-22 23:03:49 +10:00
Nigel Tao 3e8cb4ebf8 wuffs gen -version=0.3.0-alpha.14 2020-09-21 11:24:39 +10:00
Nigel Tao fa50f4de67 Add json QUIRK_ALLOW_TRAILING_COMMENT 2020-09-21 11:24:22 +10:00
Nigel Tao 2912ea8e28 Re-assign JSON quirk numbers 2020-09-21 10:30:46 +10:00
Nigel Tao 0987296352 Fix parse_number_f64_eisel_lemire comment typos 2020-09-15 22:25:33 +10:00
Nigel Tao f2be4dd7cf Trim private_implementation__powers_of_10 array
Binary size, before:
30344 gen/lib/c/clang-9-dynamic/wuffs-base-floatconv.lo
30488 gen/lib/c/clang-9-static/wuffs-base-floatconv.o
31992 gen/lib/c/gcc-dynamic/wuffs-base-floatconv.lo
31992 gen/lib/c/gcc-static/wuffs-base-floatconv.o

After:
29512 gen/lib/c/clang-9-dynamic/wuffs-base-floatconv.lo
29656 gen/lib/c/clang-9-static/wuffs-base-floatconv.o
31160 gen/lib/c/gcc-dynamic/wuffs-base-floatconv.lo
31160 gen/lib/c/gcc-static/wuffs-base-floatconv.o
2020-09-15 22:14:30 +10:00
Nigel Tao 8b45db0120 Narrow parse_number_f64_eisel_lemire's exp10 arg
On a mid-range x86_64 laptop, processing the 181 MiB citylots.json file
from github.com/zemirco/sf-city-lots-json:

$ g++ -O3 script/process-json-numbers.c
$ time ./a.out -parse-number-f64 < citylots.json
Before/After:
real    0m0.995s
real    0m0.968s
2020-09-15 21:58:57 +10:00
Nigel Tao 339119a5c1 Simplify parse_number_f64's use of __uint128_t 2020-09-14 12:43:29 +10:00
Nigel Tao 9f22b5ebf7 Fix wuffs_base__parse_number_f64 fast path comment 2020-09-11 09:10:08 +10:00
Nigel Tao b55d539d94 Add links to jsonptr blog post 2020-09-11 08:11:02 +10:00
Nigel Tao 1710c81f13 Let wuffs_base__multiply_u64 use __uint128_t 2020-09-10 21:23:25 +10:00
Nigel Tao 0a141a7f1a Put multiply_u64__output in little-endian order 2020-09-10 21:12:45 +10:00
Nigel Tao ba75ce9c5f wuffs gen -version=0.3.0-alpha.13 2020-09-08 16:49:24 +10:00
Nigel Tao 57d47c633c Fix etc__high_prec_dec__to_f64 shift amount
Shifting 0.299 left by 2 doesn't put us in [½ .. 1].
2020-09-08 16:43:31 +10:00
Nigel Tao a325d7860f wuffs gen -version=0.3.0-alpha.12 2020-08-30 21:15:40 +10:00
Nigel Tao 6c13877688 Drop WUFFS_JSON__QUIRK_ALLOW_BACKSLASH_X_AS_BYTES
We can always add it back later if there's demand for it.
2020-08-30 16:15:35 +10:00
Nigel Tao 6bc3f5716d Add "#json: bad new-line in a string" 2020-08-29 23:23:15 +10:00
Nigel Tao 6069ebd619 Rename {read,writ}er_io_position 2020-08-27 23:32:53 +10:00
Nigel Tao 3832b04c93 Tweak wuffs_base__io_buffer_meta.pos comment 2020-08-26 10:29:17 +10:00
Nigel Tao 63e6796896 Add "4Ki tokens is 32KiB" comment 2020-08-26 00:00:32 +10:00
Nigel Tao 75e1efcc4a Fix std/cbor src.meta.ri for too much recursion
Updates https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=25145
2020-08-24 00:39:54 +10:00
Nigel Tao 1f3912aadf Fix std/cbor decoding multi-byte 0-length strings
Updates https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=25041
2020-08-20 11:41:23 +10:00
Nigel Tao fc304139af Add WUFFS_BASE__TOKEN__VBD__FILLER__COMMENT_ANY 2020-08-19 09:40:02 +10:00
Nigel Tao 4284369bb8 Add TOKEN__VBD__FILLER__PUNCTUATION 2020-08-17 16:48:30 +10:00
Nigel Tao 67503b5bda wuffs gen -version=0.3.0-alpha.11 2020-08-17 10:02:41 +10:00
Nigel Tao ca1113620b Let wuffs_aux's MemoryInput take a char* ptr 2020-08-17 10:00:19 +10:00
Nigel Tao 2742a4f4be Have wuffs_aux take lvalue (not rvalue) references 2020-08-17 00:02:49 +10:00
Nigel Tao d384e1e458 Avoid wuffs_aux macro's unused variable token_ptr 2020-08-13 00:13:12 +10:00
Nigel Tao b21a82bbcd Add some section breaks to auxiliary/json.cc 2020-08-13 00:09:28 +10:00
Nigel Tao b3438434ca Add json QUIRK_JSON_POINTER_ALLOW_TILDE_R_TILDE_N 2020-08-13 00:06:56 +10:00
Nigel Tao 16fadb25cf Fix std/cbor meta.ri decoding F8XX for small XX
Updates https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=24819
2020-08-12 23:45:44 +10:00
Nigel Tao 8aac6767bb Add example/jsonfindptrs -query=STR flag 2020-08-12 23:18:37 +10:00
Nigel Tao ab6f895007 Extract WUFFS_AUX__DECODE_JSON__GET_THE_NEXT_TOKEN 2020-08-11 22:10:46 +10:00
Nigel Tao da3504833e Have Decode{Cbor,Json} quirks default to empty 2020-08-11 13:46:50 +10:00
Nigel Tao 28ef6a7862 Add fuzz/c/std/cbor_fuzzer.c 2020-08-10 22:29:08 +10:00
Nigel Tao 2397d02997 Fix std/cbor UTF-8 strings aren't always ASCII 2020-08-10 22:27:40 +10:00
Nigel Tao 0091a2132d Have std/cbor reject tags before an 0xFF stop code 2020-08-10 21:39:37 +10:00
Nigel Tao 62c4feb268 Let wuffs_aux::DecodeJson use BACKSLASH_X_AS_BYTES 2020-08-10 15:22:05 +10:00
Nigel Tao 6d81764e14 Tweak wuffs_aux::DecodeJsonCallbacks 2020-08-09 23:15:41 +10:00
Nigel Tao 0b7eaf291b Add example/cbor-to-json 2020-08-09 23:03:42 +10:00
Nigel Tao 7a5e89115d Fix -Werror=conversion in std/json decode_tokens 2020-08-06 23:55:03 +10:00
Nigel Tao 934136b09c Add token_buffer.{read,writ}er_slice methods 2020-08-06 23:51:13 +10:00
Nigel Tao 82a96cb139 Rename token_buffer.{read,writ}er_available 2020-08-06 23:41:36 +10:00
Nigel Tao 1adbc9547f Split std/json's QUIRK_ALLOW_BACKSLASH_X in two 2020-08-06 23:28:07 +10:00
Nigel Tao 6ea09e0de4 Remove #ifdef MODULE_ETC guards for aux headers 2020-08-05 22:54:53 +10:00
Nigel Tao cf6c578973 Add aux library 2020-08-04 23:43:38 +10:00