Commit Graph
242 Commits
Author SHA1 Message Date
Nigel Tao 9cc6964c30 Stub out a new std/gzip package 2018-03-28 10:22:46 +11:00
Nigel Tao 3a7ccfe9b4 Implement crc32's ieee.update 2018-03-25 18:09:51 +11:00
Nigel Tao 008bce65f2 Have crc32's ieee.update return u32 2018-03-25 17:04:14 +11:00
Nigel Tao 917737ec97 Stub out a new std/crc32 package 2018-03-25 16:58:23 +11:00
Nigel Tao 26445adcdf Rename deflate's "distance minus 1" variable 2018-03-23 12:54:46 +11:00
Nigel Tao 4675efdcc5 Fix deflate decode when the distance is 32768 2018-03-23 12:49:42 +11:00
Nigel Tao d1399fac19 Rename test/testdata to test/data 2018-03-16 10:48:33 +11:00
Nigel Tao bbc3d34e1b Check distance > 0 for decode_huffman_slow
decode_huffman_fast already does this. The slow flavor should too.

Updates https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=6524
2018-02-24 11:31:12 +11:00
Nigel Tao 446d4662db Let the zlib decoder ignore the checksum 2018-02-16 08:51:28 +11:00
Nigel Tao f82c33db2f Recognize a GIF "ANIMEXTS1.0" extension 2018-02-15 14:35:01 +11:00
Nigel Tao fb2430e765 Add some GIF per-frame fields 2018-02-15 12:41:13 +11:00
Nigel Tao b65526cdcd Add comment about renaming initialize 2018-02-11 15:31:06 +11:00
Nigel Tao 0d33d3ef3a Decode a GIF local color table 2018-02-11 15:30:18 +11:00
Nigel Tao 584fc631a8 Decode a GIF's loop count 2018-02-10 17:14:49 +11:00
Nigel Tao d3770b9972 Add an end of data concept 2018-02-10 12:13:26 +11:00
Nigel Tao abca796192 Fix a comment typo 2018-02-09 17:24:19 +11:00
Nigel Tao 8fb56491c6 Fix set_literal_width effect 2018-02-09 16:19:55 +11:00
Nigel Tao 7e90967717 Fill in a GIF image_config 2018-02-09 16:05:04 +11:00
Nigel Tao d750ea7653 Add an image_config concept 2018-02-09 14:46:37 +11:00
Nigel Tao de9000cc70 Add a call sequence concept 2018-02-08 09:06:19 +11:00
Nigel Tao fecd7b631c Re-organize some status codes 2017-12-27 13:15:37 +11:00
Nigel Tao 7012d2fef7 Mark some internal status codes as private 2017-12-27 13:14:46 +11:00
Nigel Tao d14b56ea39 Type check built-in functions more thoroughly 2017-12-16 13:25:26 +11:00
Nigel Tao 2e12a41414 Make std/gif's LZW decoder private 2017-12-08 16:18:35 +11:00
Nigel Tao be997b110a Update some more docs for the std/flate rename 2017-12-04 11:01:40 +11:00
Nigel Tao 802b9d8bfd Rename deflate-related scripts 2017-12-04 10:43:32 +11:00
Nigel Tao 8e2255916e Drop the "flate_" in "deflate.flate_decoder" 2017-12-04 10:35:08 +11:00
Nigel Tao 2755a61ae9 Rename std/deflate's packageid 2017-12-04 10:29:17 +11:00
Nigel Tao 1388f84e5c Rename std/flate to std/deflate 2017-12-04 10:27:48 +11:00
Nigel Tao 530605a16b Delete std/flate's zlib code (moved to std/zlib) 2017-12-03 14:31:35 +11:00
Nigel Tao 6913a1ff00 Copy/paste zlib code from std/flate to std/zlib 2017-12-03 13:32:42 +11:00
Nigel Tao 0a32c01014 Allow referring to types from used packages 2017-12-03 13:21:23 +11:00
Nigel Tao 404b149a9a Have "wuffs gen" follow use "foo" dependencies 2017-12-02 12:18:16 +11:00
Nigel Tao dd3f0b9ed4 Add a placeholder std/zlib package 2017-12-02 11:21:30 +11:00
Nigel Tao 906bca4e39 Drop volatile facts after a yield statement 2017-12-01 16:24:54 +11:00
Nigel Tao 65dcf6a5b9 Add a yield keyword 2017-12-01 15:24:48 +11:00
Nigel Tao 3c708dfe59 Rename PUFFS to WUFFS, part 7 of N 2017-11-30 18:02:59 +11:00
Nigel Tao 79a94558be Rename PUFFS to WUFFS, part 5 of N 2017-11-30 16:37:20 +11:00
Nigel Tao 456e620d02 Rename PUFFS to WUFFS, part 4 of N 2017-11-30 16:28:28 +11:00
Nigel Tao 03acc15782 Add some more length and distance checks. 2017-11-09 13:21:19 +11:00
Nigel Tao 30b54616a8 Check copy_from_history32's distance. 2017-11-09 12:53:19 +11:00
Nigel Tao 3bdd515e47 Allow "assert foo", not just "assert foo < bar". 2017-11-09 10:53:37 +11:00
Nigel Tao e2ce9f1b1d Add a writer1.is_marked method. 2017-11-09 10:38:24 +11:00
Nigel Tao 545f043d94 Don't read extra bits if there's no extra bits.
name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.45GB/s ± 0%  2.45GB/s ± 0%    ~     (p=0.548 n=5+5)
puffs_adler32_100k/clang       2.45GB/s ± 0%  2.45GB/s ± 0%    ~     (p=0.056 n=5+5)
puffs_flate_decode_1k/clang     142MB/s ± 0%   143MB/s ± 0%  +0.63%  (p=0.008 n=5+5)
puffs_flate_decode_10k/clang    190MB/s ± 0%   201MB/s ± 0%  +5.54%  (p=0.008 n=5+5)
puffs_flate_decode_100k/clang   225MB/s ± 0%   235MB/s ± 0%  +4.27%  (p=0.008 n=5+5)
puffs_zlib_decode_10k/clang     176MB/s ± 0%   186MB/s ± 0%  +5.16%  (p=0.008 n=5+5)
puffs_zlib_decode_100k/clang    207MB/s ± 1%   214MB/s ± 0%  +3.56%  (p=0.008 n=5+5)

puffs_adler32_10k/gcc          3.21GB/s ± 1%  3.26GB/s ± 0%  +1.55%  (p=0.008 n=5+5)
puffs_adler32_100k/gcc         3.21GB/s ± 2%  3.27GB/s ± 0%  +1.66%  (p=0.008 n=5+5)
puffs_flate_decode_1k/gcc       139MB/s ± 1%   146MB/s ± 0%  +5.09%  (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc      232MB/s ± 0%   244MB/s ± 0%  +5.42%  (p=0.008 n=5+5)
puffs_flate_decode_100k/gcc     257MB/s ± 1%   280MB/s ± 0%  +9.10%  (p=0.008 n=5+5)
puffs_zlib_decode_10k/gcc       215MB/s ± 1%   227MB/s ± 0%  +5.82%  (p=0.008 n=5+5)
puffs_zlib_decode_100k/gcc      235MB/s ± 1%   257MB/s ± 0%  +9.67%  (p=0.008 n=5+5)
2017-11-08 17:19:58 +11:00
Nigel Tao 989614df88 Remove some redundant decode_huffman_xxx code.
name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.40GB/s ± 1%  2.45GB/s ± 0%  +2.08%  (p=0.008 n=5+5)
puffs_adler32_100k/clang       2.41GB/s ± 1%  2.45GB/s ± 0%  +1.54%  (p=0.008 n=5+5)
puffs_flate_decode_1k/clang     140MB/s ± 0%   142MB/s ± 0%  +1.64%  (p=0.016 n=4+5)
puffs_flate_decode_10k/clang    186MB/s ± 1%   190MB/s ± 0%  +2.32%  (p=0.008 n=5+5)
puffs_flate_decode_100k/clang   209MB/s ± 1%   225MB/s ± 0%  +7.60%  (p=0.008 n=5+5)
puffs_zlib_decode_10k/clang     173MB/s ± 1%   176MB/s ± 0%  +2.04%  (p=0.008 n=5+5)
puffs_zlib_decode_100k/clang    193MB/s ± 0%   207MB/s ± 1%  +7.43%  (p=0.008 n=5+5)

puffs_adler32_10k/gcc          3.26GB/s ± 0%  3.21GB/s ± 1%  -1.48%  (p=0.008 n=5+5)
puffs_adler32_100k/gcc         3.25GB/s ± 0%  3.21GB/s ± 2%  -1.24%  (p=0.008 n=5+5)
puffs_flate_decode_1k/gcc       142MB/s ± 0%   139MB/s ± 1%  -2.27%  (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc      232MB/s ± 1%   232MB/s ± 0%    ~     (p=0.548 n=5+5)
puffs_flate_decode_100k/gcc     259MB/s ± 2%   257MB/s ± 1%    ~     (p=0.151 n=5+5)
puffs_zlib_decode_10k/gcc       216MB/s ± 2%   215MB/s ± 1%    ~     (p=0.222 n=5+5)
puffs_zlib_decode_100k/gcc      241MB/s ± 1%   235MB/s ± 1%  -2.50%  (p=0.008 n=5+5)
2017-11-08 17:08:36 +11:00
Nigel Tao 848d66ffdf Tighten the Huffman n_bits invariant. 2017-11-07 09:30:16 +11:00
Nigel Tao ccdd74a17f Remove some suspensions from decode_huffman_fast.
name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.45GB/s ± 0%  2.45GB/s ± 0%   -0.08%  (p=0.006 n=10+9)
puffs_adler32_100k/clang       2.46GB/s ± 0%  2.45GB/s ± 0%   -0.12%  (p=0.000 n=10+9)
puffs_flate_decode_1k/clang     137MB/s ± 0%   133MB/s ± 0%   -2.71%  (p=0.000 n=9+9)
puffs_flate_decode_10k/clang    177MB/s ± 0%   181MB/s ± 0%   +2.22%  (p=0.000 n=10+9)
puffs_flate_decode_100k/clang   198MB/s ± 0%   204MB/s ± 0%   +3.04%  (p=0.000 n=10+10)
puffs_zlib_decode_10k/clang     163MB/s ± 0%   168MB/s ± 0%   +3.23%  (p=0.000 n=9+10)
puffs_zlib_decode_100k/clang    182MB/s ± 0%   189MB/s ± 0%   +3.56%  (p=0.000 n=9+10)

puffs_adler32_10k/gcc          3.26GB/s ± 0%  3.26GB/s ± 0%     ~     (p=0.280 n=10+10)
puffs_adler32_100k/gcc         3.27GB/s ± 0%  3.27GB/s ± 0%     ~     (p=0.075 n=10+10)
puffs_flate_decode_1k/gcc       111MB/s ± 1%   130MB/s ± 0%  +17.19%  (p=0.000 n=10+10)
puffs_flate_decode_10k/gcc      142MB/s ± 0%   203MB/s ± 0%  +43.11%  (p=0.000 n=10+9)
puffs_flate_decode_100k/gcc     153MB/s ± 0%   241MB/s ± 0%  +57.62%  (p=0.000 n=9+8)
puffs_zlib_decode_10k/gcc       142MB/s ± 0%   188MB/s ± 0%  +32.47%  (p=0.000 n=9+9)
puffs_zlib_decode_100k/gcc      149MB/s ± 0%   223MB/s ± 0%  +50.03%  (p=0.000 n=8+9)
2017-11-06 14:03:11 +11:00
Nigel Tao bf50d268ae Remove some suspensions from decode_huffman_fast.
name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.40GB/s ± 3%  2.45GB/s ± 0%   +2.21%  (p=0.000 n=10+10)
puffs_adler32_100k/clang       2.41GB/s ± 1%  2.46GB/s ± 0%   +2.05%  (p=0.000 n=9+10)
puffs_flate_decode_1k/clang     127MB/s ± 1%   137MB/s ± 0%   +7.94%  (p=0.000 n=9+9)
puffs_flate_decode_10k/clang    177MB/s ± 1%   177MB/s ± 0%     ~     (p=0.234 n=9+10)
puffs_flate_decode_100k/clang   205MB/s ± 1%   198MB/s ± 0%   -3.06%  (p=0.000 n=9+10)
puffs_zlib_decode_10k/clang     165MB/s ± 1%   163MB/s ± 0%   -1.12%  (p=0.000 n=9+9)
puffs_zlib_decode_100k/clang    189MB/s ± 0%   182MB/s ± 0%   -3.42%  (p=0.000 n=9+9)

puffs_adler32_10k/gcc          3.26GB/s ± 0%  3.26GB/s ± 0%     ~     (p=0.065 n=9+10)
puffs_adler32_100k/gcc         3.27GB/s ± 0%  3.27GB/s ± 0%     ~     (p=0.173 n=8+10)
puffs_flate_decode_1k/gcc       111MB/s ± 0%   111MB/s ± 1%     ~     (p=0.971 n=10+10)
puffs_flate_decode_10k/gcc      149MB/s ± 0%   142MB/s ± 0%   -4.67%  (p=0.000 n=9+10)
puffs_flate_decode_100k/gcc     160MB/s ± 0%   153MB/s ± 0%   -4.46%  (p=0.000 n=9+9)
puffs_zlib_decode_10k/gcc       128MB/s ± 0%   142MB/s ± 0%  +11.21%  (p=0.000 n=9+9)
puffs_zlib_decode_100k/gcc      137MB/s ± 0%   149MB/s ± 0%   +8.47%  (p=0.000 n=8+8)
2017-11-06 08:31:03 +11:00
Nigel Tao 5520340d7c Remove some suspensions from decode_huffman_fast.
name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.45GB/s ± 2%  2.40GB/s ± 3%   -1.87%  (p=0.001 n=9+10)
puffs_adler32_100k/clang       2.46GB/s ± 0%  2.41GB/s ± 1%   -2.08%  (p=0.000 n=8+9)
puffs_flate_decode_1k/clang     125MB/s ± 0%   127MB/s ± 1%   +1.53%  (p=0.000 n=9+9)
puffs_flate_decode_10k/clang    168MB/s ± 0%   177MB/s ± 1%   +5.59%  (p=0.000 n=10+9)
puffs_flate_decode_100k/clang   193MB/s ± 0%   205MB/s ± 1%   +6.20%  (p=0.000 n=9+9)
puffs_zlib_decode_10k/clang     157MB/s ± 0%   165MB/s ± 1%   +5.00%  (p=0.000 n=9+9)
puffs_zlib_decode_100k/clang    179MB/s ± 0%   189MB/s ± 0%   +5.69%  (p=0.000 n=8+9)

puffs_adler32_10k/gcc          3.26GB/s ± 0%  3.26GB/s ± 0%   -0.14%  (p=0.000 n=10+9)
puffs_adler32_100k/gcc         3.27GB/s ± 0%  3.27GB/s ± 0%   -0.09%  (p=0.000 n=9+8)
puffs_flate_decode_1k/gcc       122MB/s ± 0%   111MB/s ± 0%   -9.40%  (p=0.000 n=10+10)
puffs_flate_decode_10k/gcc      176MB/s ± 0%   149MB/s ± 0%  -15.45%  (p=0.000 n=10+9)
puffs_flate_decode_100k/gcc     199MB/s ± 0%   160MB/s ± 0%  -19.51%  (p=0.000 n=10+9)
puffs_zlib_decode_10k/gcc       168MB/s ± 0%   128MB/s ± 0%  -24.01%  (p=0.000 n=10+9)
puffs_zlib_decode_100k/gcc      187MB/s ± 0%   137MB/s ± 0%  -26.84%  (p=0.000 n=9+8)
2017-11-05 23:02:19 +11:00
Nigel Tao e7c14dfe63 Remove some suspensions from decode_huffman_fast.
name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.46GB/s ± 0%  2.45GB/s ± 2%     ~     (p=0.352 n=9+9)
puffs_adler32_100k/clang       2.46GB/s ± 0%  2.46GB/s ± 0%     ~     (p=0.673 n=9+8)
puffs_flate_decode_1k/clang     124MB/s ± 0%   125MB/s ± 0%   +0.39%  (p=0.000 n=8+9)
puffs_flate_decode_10k/clang    165MB/s ± 0%   168MB/s ± 0%   +1.81%  (p=0.000 n=8+10)
puffs_flate_decode_100k/clang   195MB/s ± 0%   193MB/s ± 0%   -1.30%  (p=0.000 n=9+9)
puffs_zlib_decode_10k/clang     154MB/s ± 1%   157MB/s ± 0%   +1.96%  (p=0.000 n=9+9)
puffs_zlib_decode_100k/clang    181MB/s ± 0%   179MB/s ± 0%   -1.19%  (p=0.000 n=10+8)

puffs_adler32_10k/gcc          3.26GB/s ± 0%  3.26GB/s ± 0%     ~     (p=0.549 n=9+10)
puffs_adler32_100k/gcc         3.27GB/s ± 0%  3.27GB/s ± 0%     ~     (p=0.450 n=9+9)
puffs_flate_decode_1k/gcc       112MB/s ± 0%   122MB/s ± 0%   +9.10%  (p=0.000 n=10+10)
puffs_flate_decode_10k/gcc      155MB/s ± 0%   176MB/s ± 0%  +13.63%  (p=0.000 n=10+10)
puffs_flate_decode_100k/gcc     176MB/s ± 0%   199MB/s ± 0%  +12.74%  (p=0.000 n=9+10)
puffs_zlib_decode_10k/gcc       137MB/s ± 0%   168MB/s ± 0%  +22.54%  (p=0.000 n=9+10)
puffs_zlib_decode_100k/gcc      158MB/s ± 0%   187MB/s ± 0%  +18.87%  (p=0.000 n=9+9)
2017-11-05 22:40:18 +11:00