Nigel Tao
d3c7d103ca
Update script/*.go module dependencies
2021-08-22 10:49:18 +10:00
Nigel Tao
17b624c038
Bump go.mod from "go 1.13" to "go 1.16"
2021-08-22 09:58:58 +10:00
Nigel Tao
786fc74b92
wuffs gen -version=0.3.0-beta.9
v0.3.0-beta.9
2021-08-15 13:49:26 +10:00
Nigel Tao
a86fd7fa79
Fix -Werror=sign-conversion in intconv-submodule.c
2021-08-15 13:48:04 +10:00
Nigel Tao
341dd50800
Add more internal errors to wuffs_aux Cbor, Json
2021-08-15 13:40:17 +10:00
Nigel Tao
a83b5cabaf
Fix "-(int64_t)0x8000000000000000" undef behavior
...
Updates https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=37191
2021-08-15 12:39:01 +10:00
Nigel Tao
8a4f61501b
Add NULL-check for io_{read,writ}er.position()
2021-08-15 11:13:26 +10:00
Nigel Tao
592bc14ed1
Have std/deflate allow non-compact dst history
...
Fixes #52
On a mid-range x86_64 laptop (2016, Skylake):
name old speed new speed delta
wuffs_deflate_decode_1k_full_init/clang9 101MB/s ± 1% 100MB/s ± 1% -1.22% (p=0.000 n=9+9)
wuffs_deflate_decode_1k_part_init/clang9 119MB/s ± 1% 119MB/s ± 1% ~ (p=0.139 n=8+9)
wuffs_deflate_decode_10k_full_init/clang9 221MB/s ± 1% 210MB/s ± 1% -4.94% (p=0.000 n=9+9)
wuffs_deflate_decode_10k_part_init/clang9 225MB/s ± 3% 215MB/s ± 1% -4.33% (p=0.000 n=10+8)
wuffs_deflate_decode_100k_just_one_read/clang9 290MB/s ± 0% 284MB/s ± 1% -2.26% (p=0.000 n=8+9)
wuffs_deflate_decode_100k_many_big_reads/clang9 188MB/s ± 3% 177MB/s ± 1% -5.78% (p=0.000 n=9+10)
wuffs_deflate_decode_1k_full_init/gcc10 101MB/s ± 0% 97MB/s ± 1% -3.65% (p=0.000 n=8+9)
wuffs_deflate_decode_1k_part_init/gcc10 119MB/s ± 1% 113MB/s ± 2% -4.65% (p=0.000 n=9+9)
wuffs_deflate_decode_10k_full_init/gcc10 214MB/s ± 3% 224MB/s ± 1% +4.83% (p=0.000 n=10+10)
wuffs_deflate_decode_10k_part_init/gcc10 222MB/s ± 1% 231MB/s ± 1% +4.03% (p=0.000 n=9+10)
wuffs_deflate_decode_100k_just_one_read/gcc10 281MB/s ± 2% 297MB/s ± 0% +5.78% (p=0.000 n=9+9)
wuffs_deflate_decode_100k_many_big_reads/gcc10 184MB/s ± 0% 194MB/s ± 0% +5.85% (p=0.000 n=10+8)
mimic_deflate_decode_1k_full_init 138MB/s ± 1% 138MB/s ± 0% ~ (p=0.546 n=9+9)
mimic_deflate_decode_10k_full_init 156MB/s ± 2% 156MB/s ± 0% ~ (p=0.387 n=9+9)
mimic_deflate_decode_100k_just_one_read 191MB/s ± 1% 190MB/s ± 2% -0.94% (p=0.004 n=9+10)
mimic_deflate_decode_100k_many_big_reads 147MB/s ± 1% 147MB/s ± 1% ~ (p=0.356 n=9+10)
wuffs_gzip_decode_10k/clang9 220MB/s ± 1% 209MB/s ± 1% -5.29% (p=0.000 n=10+9)
wuffs_gzip_decode_100k/clang9 283MB/s ± 2% 279MB/s ± 1% -1.47% (p=0.002 n=10+10)
wuffs_gzip_decode_10k/gcc10 218MB/s ± 1% 214MB/s ± 2% -1.76% (p=0.000 n=9+10)
wuffs_gzip_decode_100k/gcc10 274MB/s ± 0% 264MB/s ± 2% -3.61% (p=0.000 n=7+10)
mimic_gzip_decode_10k 131MB/s ± 2% 132MB/s ± 0% +0.81% (p=0.000 n=10+8)
mimic_gzip_decode_100k 156MB/s ± 0% 156MB/s ± 1% ~ (p=0.423 n=8+9)
wuffs_zlib_decode_10k/clang9 223MB/s ± 2% 209MB/s ± 2% -6.41% (p=0.000 n=10+10)
wuffs_zlib_decode_100k/clang9 285MB/s ± 0% 280MB/s ± 0% -1.87% (p=0.000 n=8+9)
wuffs_zlib_decode_10k/gcc10 235MB/s ± 0% 215MB/s ± 1% -8.22% (p=0.000 n=10+9)
wuffs_zlib_decode_100k/gcc10 293MB/s ± 0% 268MB/s ± 1% -8.38% (p=0.000 n=8+10)
mimic_zlib_decode_10k 145MB/s ± 1% 145MB/s ± 1% -0.45% (p=0.004 n=9+9)
mimic_zlib_decode_100k 175MB/s ± 1% 174MB/s ± 0% ~ (p=0.055 n=10+8)
wuffs_png_decode_image_19k_8bpp/clang9 142MB/s ± 1% 152MB/s ± 1% +6.98% (p=0.000 n=9+9)
wuffs_png_decode_image_40k_24bpp/clang9 172MB/s ± 0% 170MB/s ± 0% -1.63% (p=0.000 n=8+9)
wuffs_png_decode_image_77k_8bpp/clang9 504MB/s ± 2% 540MB/s ± 1% +7.28% (p=0.000 n=9+10)
wuffs_png_decode_image_552k_32bpp_ignore_checksum/clang9 462MB/s ± 1% 470MB/s ± 0% +1.57% (p=0.000 n=9+10)
wuffs_png_decode_image_552k_32bpp_verify_checksum/clang9 445MB/s ± 1% 451MB/s ± 0% +1.49% (p=0.000 n=8+10)
wuffs_png_decode_image_4002k_24bpp/clang9 175MB/s ± 3% 175MB/s ± 1% ~ (p=0.356 n=9+10)
wuffs_png_decode_image_19k_8bpp/gcc10 150MB/s ± 0% 153MB/s ± 1% +2.03% (p=0.000 n=10+10)
wuffs_png_decode_image_40k_24bpp/gcc10 186MB/s ± 0% 186MB/s ± 0% ~ (p=0.408 n=10+8)
wuffs_png_decode_image_77k_8bpp/gcc10 543MB/s ± 0% 542MB/s ± 0% -0.23% (p=0.019 n=9+9)
wuffs_png_decode_image_552k_32bpp_ignore_checksum/gcc10 478MB/s ± 1% 498MB/s ± 0% +4.12% (p=0.000 n=10+9)
wuffs_png_decode_image_552k_32bpp_verify_checksum/gcc10 451MB/s ± 4% 476MB/s ± 0% +5.37% (p=0.000 n=10+9)
wuffs_png_decode_image_4002k_24bpp/gcc10 185MB/s ± 2% 190MB/s ± 1% +2.78% (p=0.000 n=10+9)
mimic_png_decode_image_19k_8bpp 63.0MB/s ± 0% 62.9MB/s ± 1% ~ (p=0.673 n=8+9)
mimic_png_decode_image_40k_24bpp 78.7MB/s ± 0% 78.9MB/s ± 0% ~ (p=0.059 n=9+8)
mimic_png_decode_image_77k_8bpp 192MB/s ± 1% 193MB/s ± 3% +0.44% (p=0.028 n=10+9)
mimic_png_decode_image_552k_32bpp_verify_checksum 157MB/s ± 0% 158MB/s ± 1% ~ (p=0.053 n=10+9)
mimic_png_decode_image_4002k_24bpp 113MB/s ± 1% 113MB/s ± 1% ~ (p=0.053 n=10+9)
2021-08-15 10:50:41 +10:00
Nigel Tao
f73f95b698
Rename from ast.IOBind to ast.IOManip
2021-08-15 08:40:05 +10:00
Nigel Tao
28a54baa19
Add io_bind history_position arg
2021-08-15 08:36:14 +10:00
Nigel Tao
b60a2cacd9
Add io_writer.history_position
2021-08-15 08:19:40 +10:00
Nigel Tao
f7b1b87c70
Fix "-Wnarrowing -m32" warning for some fuzzers
2021-08-14 12:49:04 +10:00
Nigel Tao
13f2e44aca
Have JSON fuzzer segfault on internal errors
2021-08-13 17:45:23 +10:00
Nigel Tao
128d0386bd
Fuzz wuffs_aux::DecodeJson
2021-08-12 23:07:26 +10:00
Nigel Tao
1b9a6cb85b
wuffs gen -version=0.3.0-beta.8
v0.3.0-beta.8
2021-07-20 14:21:21 +10:00
Nigel Tao
77f855206d
Have JSON line-comment tokens exclude the "\n"
...
Before this commit, line-comment token chains included the final "\n"
the way block-comments included the final "*/". The "\n" was mandatory.
However, when parsing with both QUIRK_ALLOW_COMMENT_LINE and
QUIRK_ALLOW_TRAILING_FILLER, input like "123//xyz" (without a "\n"
before the EOF) was rejected before and accepted after this commit.
So that line-comments are consistent, in that they either always or
never include the final "\n", they now never include the final "\n".
An input fragment (parsed with QUIRK_ALLOW_COMMENT_LINE) like
"//abc\n\t\t" was, before this commit, parsed as a 6 byte comment token
and a 2 byte other-filler token. That split is now 5+3.
2021-07-20 14:17:09 +10:00
Nigel Tao
40ffa334ee
Add more json allow_trailing_comments test cases
2021-07-18 23:27:56 +10:00
Nigel Tao
e88e28259e
wuffs gen -version=0.3.0-beta.7
v0.3.0-beta.7
2021-07-18 11:36:39 +10:00
Nigel Tao
6a30c1ede0
Inline wuffs_aux::DecodeJson work_buf variable
2021-07-18 11:25:46 +10:00
Nigel Tao
9c07523a84
Have wuffs_aux::DecodeJson consume trailing filler
...
Prior to this commit, wuffs_aux::DecodeJson would almost always consume
(optional) trailing filler, but in rare coincidences, it might not if a
wuffs_base__suspension__short_write coroutine suspension was needed
between the last token of the actual JSON value and the first token of
the filler after that JSON value.
This commit should change behavior only if the wuffs_aux::DecodeJson
caller had opted into WUFFS_JSON__QUIRK_ALLOW_TRAILING_FILLER or
WUFFS_JSON__QUIRK_EXPECT_TRAILING_NEW_LINE_OR_EOF.
Also remove an unnecessary std::move on a size_t typed value.
2021-07-18 11:12:41 +10:00
Nigel Tao
816475b285
Add "b" (for "binary") to fopen calls
...
Updates #50
2021-07-07 20:28:35 +10:00
Nigel Tao
d0451190ca
wuffs gen -version=0.3.0-beta.6
v0.3.0-beta.6
2021-07-05 21:51:37 +10:00
Nigel Tao
3842c519c9
Delete the WUFFS_BASE__FALLTHROUGH macro
...
Getting it to work on various compilers has been more trouble than it's
worth. The previous commit ignores "-Wimplicit-fallthrough" instead.
2021-07-05 21:40:25 +10:00
Nigel Tao
ea50956b5a
Ignore "-Wimplicit-fallthrough"
2021-07-05 21:40:25 +10:00
Nigel Tao
fd90553a8f
Tweak the WUFFS_BASE__FALLTHROUGH macro
...
When compiling with "-Werror,-Wimplicit-fallthrough", commit c90cc7b6
tweaked WUFFS_BASE__FALLTHROUGH to work with newer clang compilers, when
defined(__cplusplus) is false, but inadvertently broke older clang
compilers, when __has_attribute(fallthrough) is false.
This commit reverts some of c90cc7b6 to handle more cases. The next two
commits will delete the WUFFS_BASE__FALLTHROUGH macro entirely and
render this commit redundant, as the whole business is proving more
trouble than it's worth. But it's checked into the commit history in
case somebody in the future wants to revive WUFFS_BASE__FALLTHROUGH.
2021-07-05 21:40:18 +10:00
Nigel Tao
963a574f7d
wuffs gen -version=0.3.0-beta.5
v0.3.0-beta.5
2021-07-02 13:44:55 +10:00
Nigel Tao
edd87f0eda
Merge pull request #49 from pkasting/main
...
Fix -Wunreachable-code-aggressive.
2021-06-30 10:10:05 +10:00
Peter Kasting
56d5aa0907
Fix -Wunreachable-code-aggressive.
...
Bug: chromium:1066980
2021-06-29 12:00:03 -07:00
Nigel Tao
6bfaf0f008
wuffs gen -version=0.3.0-beta.4
v0.3.0-beta.4
2021-06-28 10:11:25 +10:00
Nigel Tao
b9a10d051a
Fix -Werror=conversion in fundamental-public.h
2021-06-28 10:10:13 +10:00
Nigel Tao
7f93a94e7a
Tweak WUFFS_BASE__FALLTHROUGH comment
2021-06-28 10:07:01 +10:00
Nigel Tao
a0698fc1a2
Add Peter Kasting to CONTRIBUTORS
...
"Google Inc." is already in AUTHORS.
2021-06-28 10:00:13 +10:00
Nigel Tao
d8796aa6d9
Add wuffs_base__uxx__rotate_etc functions
2021-06-28 09:59:32 +10:00
Nigel Tao
a12771373e
Merge pull request #48 from pkasting/main
...
Fix -Wimplicit-fallthrough for Clang.
2021-06-28 09:58:23 +10:00
Peter Kasting
c90cc7b657
Fix -Wimplicit-fallthrough for Clang.
...
WUFFS_BASE__FALLTHROUGH was not defined because the generated output is
C (so __cplusplus is never defined) and Clang was explicitly excluded
from the __attribute__ case (though it would have worked).
Instead test for the availability of the fallthrough attribute directly,
which should be more portable.
Bug: chromium:995993
2021-06-26 17:12:56 -07:00
Nigel Tao
b2b8961126
wuffs gen -version=0.3.0-beta.3
v0.3.0-beta.3
2021-06-25 15:36:54 +10:00
Nigel Tao
f6945c0612
Remove unnecessary "goto ok;" in generated C code
2021-06-25 14:47:10 +10:00
Nigel Tao
76e6872498
Have clang-cl ignore unused-function etc warnings
2021-06-25 13:51:27 +10:00
Nigel Tao
98c66ef761
wuffs gen -version=0.3.0-beta.2
v0.3.0-beta.2
2021-06-24 22:43:15 +10:00
Nigel Tao
91857f4c4b
Disable cpu_arch specific code for Native Client
2021-06-24 22:40:54 +10:00
Nigel Tao
08797bc713
Have "x86_avx2" require PCLMUL, POPCNT and SSE4.2
...
The std/crc32 benchmark numbers get worse. The benches still run AVX2
code, but it runs slower for an unknown reason. The std/gzip and std/png
benchmark numbers are mixed.
Still, it's cleaner for Wuffs' "x86_avx2" to be a superset of
"x86_sse42" (and apart from PCLMUL, they're now similar to Clang 12 and
GCC 11's "x86-64-v3" and "x86-64-v2" micro-architecture feature levels).
Maybe future compiler versions can claw back the std/crc32 performance.
On a mid-range x86_64 laptop (2016, Skylake):
name old speed new speed delta
wuffs_crc32_ieee_10k/clang9 8.07GB/s ± 0% 7.61GB/s ± 1% -5.72% (p=0.000 n=8+8)
wuffs_crc32_ieee_100k/clang9 11.0GB/s ± 1% 9.7GB/s ± 3% -11.45% (p=0.000 n=7+8)
wuffs_crc32_ieee_10k/gcc10 9.77GB/s ± 1% 7.72GB/s ± 1% -21.00% (p=0.000 n=10+9)
wuffs_crc32_ieee_100k/gcc10 12.7GB/s ± 2% 11.9GB/s ± 2% -5.84% (p=0.000 n=9+9)
wuffs_gzip_decode_10k/clang9 217MB/s ± 2% 221MB/s ± 0% +1.80% (p=0.000 n=10+8)
wuffs_gzip_decode_100k/clang9 280MB/s ± 1% 283MB/s ± 0% +1.38% (p=0.000 n=9+8)
wuffs_gzip_decode_10k/gcc10 215MB/s ± 1% 220MB/s ± 1% +2.52% (p=0.000 n=10+9)
wuffs_gzip_decode_100k/gcc10 272MB/s ± 0% 274MB/s ± 1% +0.74% (p=0.000 n=9+10)
wuffs_png_decode_image_19k_8bpp/clang9 136MB/s ± 0% 142MB/s ± 0% +3.95% (p=0.000 n=8+8)
wuffs_png_decode_image_40k_24bpp/clang9 171MB/s ± 1% 172MB/s ± 0% +0.84% (p=0.000 n=10+8)
wuffs_png_decode_image_77k_8bpp/clang9 492MB/s ± 3% 501MB/s ± 2% +1.88% (p=0.009 n=10+10)
wuffs_png_decode_image_552k_32bpp_ignore_checksum/clang9 456MB/s ± 1% 461MB/s ± 1% +1.04% (p=0.000 n=9+9)
wuffs_png_decode_image_552k_32bpp_verify_checksum/clang9 439MB/s ± 1% 440MB/s ± 3% ~ (p=0.173 n=8+10)
wuffs_png_decode_image_4002k_24bpp/clang9 172MB/s ± 1% 174MB/s ± 1% +1.29% (p=0.005 n=10+10)
wuffs_png_decode_image_19k_8bpp/gcc10 152MB/s ± 0% 149MB/s ± 1% -1.92% (p=0.000 n=9+9)
wuffs_png_decode_image_40k_24bpp/gcc10 184MB/s ± 0% 186MB/s ± 1% +1.37% (p=0.000 n=8+9)
wuffs_png_decode_image_77k_8bpp/gcc10 550MB/s ± 1% 542MB/s ± 2% -1.46% (p=0.000 n=10+10)
wuffs_png_decode_image_552k_32bpp_ignore_checksum/gcc10 473MB/s ± 1% 478MB/s ± 1% +1.23% (p=0.000 n=9+10)
wuffs_png_decode_image_552k_32bpp_verify_checksum/gcc10 453MB/s ± 1% 458MB/s ± 1% +0.91% (p=0.000 n=9+10)
wuffs_png_decode_image_4002k_24bpp/gcc10 185MB/s ± 2% 188MB/s ± 0% +1.82% (p=0.000 n=9+8)
2021-06-22 13:27:25 +10:00
Nigel Tao
ec32eb3eb7
Add fuzz/c/std/gif_fuzzer.c quirks
2021-06-18 22:37:29 +10:00
Nigel Tao
a51867dc63
Fix "forseen" typo
2021-05-19 21:34:09 +10:00
Nigel Tao
3358730f6f
Have std/png reject zero width or height
2021-05-11 12:34:19 +10:00
Nigel Tao
97f5bec0e3
Fix doc/spec/rac-related-work.md typo
2021-05-04 13:29:22 +10:00
Nigel Tao
b0826d2ab7
Add test/data/archive.*
...
$ 7z a archive.7z \
artificial/0.bytes github-tags.json hello.sh non-ascii/αβ.txt \
non-ascii/😻 .txt pjw-thumbnail.png romeo.txt romeo.txt.gz
$ zip archive.zip etc etc
$ rar a archive.rar etc etc
$ tar cvf archive.tar etc etc
$ tar cvjf archive.tar.bz2 etc etc
$ tar cvzf archive.tar.gz etc etc
$ lcab etc etc archive.cab
And after curating a data/ directory (without non-ascii/😻 .txt):
$ genisoimage -v -J -r -V WUFFS_TEST_DATA_SUBSET -o archive.iso data/
2021-05-03 22:25:35 +10:00
Nigel Tao
a0984dcdd3
Limit the number of coroutines per type to 0x7FFF
2021-05-02 16:50:29 +10:00
Nigel Tao
b8f87debe3
Tweak wuffs_base__cpu_arch__have_foo_bar impl
2021-04-29 17:52:10 +10:00
Nigel Tao
e77d73e3ce
Add std/adler32 bench comment for the roll back
2021-04-28 22:38:10 +10:00
Nigel Tao
0a6cce5e0e
Tweak some adler32 hasher.up_x86_sse42 var names
2021-04-28 00:32:32 +10:00