Commit Graph
815 Commits
Author SHA1 Message Date
Nigel Tao 9cc6964c30 Stub out a new std/gzip package 2018-03-28 10:22:46 +11:00
Nigel Tao 061729f7b2 Remove redundant crc32 benchmarks 2018-03-25 22:02:13 +11:00
Nigel Tao a2949fe28d Add Adler32 and CRC32/IEEE tests for pi's digits 2018-03-25 21:54:07 +11:00
Nigel Tao 56a767ede3 Update doc/changelog.md 2018-03-25 18:12:04 +11:00
Nigel Tao 3a7ccfe9b4 Implement crc32's ieee.update 2018-03-25 18:09:51 +11:00
Nigel Tao 0ebfb75699 Add crc32 ieee test cases 2018-03-25 17:20:31 +11:00
Nigel Tao 008bce65f2 Have crc32's ieee.update return u32 2018-03-25 17:04:14 +11:00
Nigel Tao 917737ec97 Stub out a new std/crc32 package 2018-03-25 16:58:23 +11:00
Nigel Tao 26445adcdf Rename deflate's "distance minus 1" variable 2018-03-23 12:54:46 +11:00
Nigel Tao 4675efdcc5 Fix deflate decode when the distance is 32768 2018-03-23 12:49:42 +11:00
Nigel Tao 7de631fb96 Tighten copy_from_history32__bco preconditions 2018-03-23 11:42:41 +11:00
Nigel Tao 4806f6160d Run clang-format-5.0 2018-03-23 09:51:13 +11:00
Nigel Tao abdf46045f Upgrade to clang 5.0
The spurious changes to gen/ will hopefully be fixed by a clang-format
5.x revision.
2018-03-21 13:08:16 +11:00
Nigel Tao f11e1f97c6 Add deflate-distance-32768 test case 2018-03-21 12:32:51 +11:00
Nigel Tao d1399fac19 Rename test/testdata to test/data 2018-03-16 10:48:33 +11:00
Nigel Tao bbc3d34e1b Check distance > 0 for decode_huffman_slow
decode_huffman_fast already does this. The slow flavor should too.

Updates https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=6524
2018-02-24 11:31:12 +11:00
Nigel Tao b059480f66 Update doc/related-work.md 2018-02-23 15:38:10 +11:00
Nigel Tao 39bc8688f6 Mask Huffman bits faster, for hand-written C
Benchmark numbers are better for gcc and worse for clang, but clang 3.8
is also relatively old. Given gcc's speeds, it's arguably a clang
codegen bug, or at least it should be clang's aspirational target.

name                             old speed     new speed     delta
wuffs_deflate_decode_1k/clang    142MB/s ± 1%  135MB/s ± 1%  -4.54%  (p=0.008 n=5+5)
wuffs_deflate_decode_10k/clang   295MB/s ± 0%  291MB/s ± 0%  -1.09%  (p=0.008 n=5+5)
wuffs_deflate_decode_100k/clang  354MB/s ± 1%  342MB/s ± 0%  -3.48%  (p=0.008 n=5+5)
wuffs_deflate_decode_1k/gcc      153MB/s ± 1%  156MB/s ± 1%  +1.51%  (p=0.008 n=5+5)
wuffs_deflate_decode_10k/gcc     354MB/s ± 1%  371MB/s ± 0%  +4.92%  (p=0.008 n=5+5)
wuffs_deflate_decode_100k/gcc    468MB/s ± 2%  499MB/s ± 1%  +6.64%  (p=0.008 n=5+5)

Note that these are benchmark numbers for an 'ideal', hand-written C
implementation, not for Wuffs' generated C code.
2018-02-22 15:53:42 +11:00
Nigel Tao 68e972c551 Load Huffman bits faster, for hand-written C
Benchmark numbers are better for gcc and worse for clang, but clang 3.8
is also relatively old. Given gcc's speeds, it's arguably a clang
codegen bug, or at least it should be clang's aspirational target.

name                             old speed     new speed     delta
wuffs_deflate_decode_1k/clang    157MB/s ± 1%  142MB/s ± 1%   -9.47%  (p=0.008 n=5+5)
wuffs_deflate_decode_10k/clang   313MB/s ± 0%  295MB/s ± 0%   -5.98%  (p=0.008 n=5+5)
wuffs_deflate_decode_100k/clang  403MB/s ± 1%  354MB/s ± 1%  -12.12%  (p=0.008 n=5+5)
wuffs_deflate_decode_1k/gcc      165MB/s ± 1%  153MB/s ± 1%   -6.93%  (p=0.008 n=5+5)
wuffs_deflate_decode_10k/gcc     337MB/s ± 0%  354MB/s ± 1%   +4.90%  (p=0.008 n=5+5)
wuffs_deflate_decode_100k/gcc    440MB/s ± 0%  468MB/s ± 2%   +6.24%  (p=0.008 n=5+5)

Note that these are benchmark numbers for an 'ideal', hand-written C
implementation, not for Wuffs' generated C code.
2018-02-22 15:12:08 +11:00
Nigel Tao ea2dec09df Test read_uxxbe across an I/O short read 2018-02-22 12:23:52 +11:00
Nigel Tao eb05139fcd Add comment on the performance of resuming locals 2018-02-22 11:30:21 +11:00
Nigel Tao 5a927d6905 Roll back 'unconditionally resume local vars'
See the previous commit for the rationale.
2018-02-22 11:23:58 +11:00
Nigel Tao 2b6b0acb4f Unconditionally resume local vars
This commit will immediately be followed by a rollback, but it is
committed anyway so that we can refer to these numbers in the git log.

name                             old speed      new speed      delta
wuffs_deflate_decode_1k/clang     145MB/s ± 1%   141MB/s ± 1%   -2.28%  (p=0.000 n=19+19)
wuffs_deflate_decode_10k/clang    222MB/s ± 0%   202MB/s ± 1%   -9.39%  (p=0.000 n=16+18)
wuffs_deflate_decode_100k/clang   256MB/s ± 0%   237MB/s ± 1%   -7.64%  (p=0.000 n=20+20)
wuffs_deflate_decode_1k/gcc       157MB/s ± 2%   158MB/s ± 1%   +0.73%  (p=0.001 n=20+19)
wuffs_deflate_decode_10k/gcc      247MB/s ± 1%   251MB/s ± 0%   +1.72%  (p=0.000 n=19+18)
wuffs_deflate_decode_100k/gcc     289MB/s ± 0%   286MB/s ± 0%   -0.86%  (p=0.000 n=17+18)
wuffs_lzw_decode_20k/clang        121MB/s ± 1%   122MB/s ± 1%   +1.04%  (p=0.000 n=17+19)
wuffs_lzw_decode_100k/clang       163MB/s ± 1%   164MB/s ± 1%   +0.33%  (p=0.010 n=19+18)
wuffs_gif_decode_1k/clang         348MB/s ± 1%   361MB/s ± 2%   +3.62%  (p=0.000 n=20+20)
wuffs_gif_decode_10k/clang        132MB/s ± 1%   130MB/s ± 1%   -1.49%  (p=0.000 n=20+19)
wuffs_gif_decode_100k/clang       114MB/s ± 0%   116MB/s ± 1%   +1.24%  (p=0.000 n=19+20)
wuffs_gif_decode_1000k/clang      117MB/s ± 0%   118MB/s ± 1%   +1.16%  (p=0.000 n=17+20)
wuffs_lzw_decode_20k/gcc          153MB/s ± 1%   162MB/s ± 1%   +6.05%  (p=0.000 n=18+19)
wuffs_lzw_decode_100k/gcc         216MB/s ± 1%   228MB/s ± 0%   +5.29%  (p=0.000 n=20+19)
wuffs_gif_decode_1k/gcc           444MB/s ± 1%   388MB/s ± 1%  -12.62%  (p=0.000 n=19+18)
wuffs_gif_decode_10k/gcc          148MB/s ± 0%   126MB/s ± 0%  -14.50%  (p=0.000 n=19+19)
wuffs_gif_decode_100k/gcc         137MB/s ± 0%   114MB/s ± 1%  -16.69%  (p=0.000 n=19+18)
wuffs_gif_decode_1000k/gcc        139MB/s ± 1%   117MB/s ± 0%  -16.02%  (p=0.000 n=20+17)
wuffs_adler32_10k/clang          2.44GB/s ± 0%  2.44GB/s ± 1%     ~     (p=0.258 n=18+17)
wuffs_adler32_100k/clang         2.45GB/s ± 0%  2.44GB/s ± 0%   -0.11%  (p=0.005 n=17+16)
wuffs_zlib_decode_10k/clang       204MB/s ± 0%   188MB/s ± 0%   -7.82%  (p=0.000 n=17+18)
wuffs_zlib_decode_100k/clang      232MB/s ± 0%   218MB/s ± 0%   -5.90%  (p=0.000 n=19+17)
wuffs_adler32_10k/gcc            3.22GB/s ± 1%  3.25GB/s ± 0%   +1.01%  (p=0.000 n=19+20)
wuffs_adler32_100k/gcc           3.22GB/s ± 0%  3.25GB/s ± 0%   +0.95%  (p=0.000 n=16+18)
wuffs_zlib_decode_10k/gcc         229MB/s ± 1%   233MB/s ± 0%   +1.71%  (p=0.000 n=18+19)
wuffs_zlib_decode_100k/gcc        262MB/s ± 0%   265MB/s ± 0%   +1.04%  (p=0.000 n=17+18)
2018-02-22 11:18:16 +11:00
Nigel Tao e93a750ccf Remove intentional OSS-Fuzz segfault
Updates https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=6474
2018-02-21 16:17:31 +11:00
Nigel Tao 0ad23714c6 Fix read_uxxbe across an I/O short read
Updates https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=6473
2018-02-21 16:14:19 +11:00
Nigel Tao 11ad47af86 Zero-initialize bool-typed coro local variables
Updates https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=6470
2018-02-21 16:00:25 +11:00
Nigel Tao fbdc648b1a Update note on OSS-Fuzz' Wuffs configuration 2018-02-21 12:19:16 +11:00
Nigel Tao 85bcd1f17d Add test/testdata/gifplayer-muybridge.gif 2018-02-21 12:10:11 +11:00
Nigel Tao a62abbe613 Update doc/changelog.md 2018-02-18 14:06:23 +11:00
Nigel Tao 830e82a1f6 Add example/gifplayer 2018-02-18 11:47:06 +11:00
Nigel Tao af647eb719 Add a fuzzing README 2018-02-18 09:56:56 +11:00
Nigel Tao ee846ca7ff Rename foo.cc to foo_fuzzer.cc 2018-02-17 15:54:49 +11:00
Nigel Tao b182db372a Make fuzzers C++ programs, not C
Using https://github.com/google/oss-fuzz on .c files says:

clang-7.0: warning: treating 'c' input as 'c++' when in C++ mode, this
behavior is deprecated [-Wdeprecated]
2018-02-17 15:41:21 +11:00
Nigel Tao b23c235067 Add fuzz tests 2018-02-17 14:14:38 +11:00
Nigel Tao 446d4662db Let the zlib decoder ignore the checksum 2018-02-16 08:51:28 +11:00
Nigel Tao fdceee4bd0 Denote intentional fallthroughs 2018-02-15 20:36:20 +11:00
Nigel Tao 98ccfedc96 Avoid "goto exit" bypassing variable init'n 2018-02-15 16:18:50 +11:00
Nigel Tao f82c33db2f Recognize a GIF "ANIMEXTS1.0" extension 2018-02-15 14:35:01 +11:00
Nigel Tao fb2430e765 Add some GIF per-frame fields 2018-02-15 12:41:13 +11:00
Nigel Tao b65526cdcd Add comment about renaming initialize 2018-02-11 15:31:06 +11:00
Nigel Tao 0d33d3ef3a Decode a GIF local color table 2018-02-11 15:30:18 +11:00
Nigel Tao 584fc631a8 Decode a GIF's loop count 2018-02-10 17:14:49 +11:00
Nigel Tao ded38a043a Add testdata/animated-red-blue.gif 2018-02-10 15:09:29 +11:00
Nigel Tao d3770b9972 Add an end of data concept 2018-02-10 12:13:26 +11:00
Nigel Tao bde5a6d39e Add testdata/muybridge.gif
Starting with the source image at:
https://en.wikipedia.org/wiki/File:Muybridge_race_horse_animated.gif

It was resized via:
gifsicle --use-colormap gray --resize 30x20 <etc >etc

The transparency-using frames were made stand-alone via:
convert etc -coalesce etc

A custom program re-mapped the palette indexes to the canonical
grayscale palette, so that palette index i means RGB (i, i, i), and
re-encoded the final GIF image. This program also generated the
*.indexes files.
2018-02-10 11:12:04 +11:00
Nigel Tao abca796192 Fix a comment typo 2018-02-09 17:24:19 +11:00
Nigel Tao 8fb56491c6 Fix set_literal_width effect 2018-02-09 16:19:55 +11:00
Nigel Tao 7e90967717 Fill in a GIF image_config 2018-02-09 16:05:04 +11:00
Nigel Tao d750ea7653 Add an image_config concept 2018-02-09 14:46:37 +11:00
Nigel Tao de9000cc70 Add a call sequence concept 2018-02-08 09:06:19 +11:00