Commit Graph
144 Commits
Author SHA1 Message Date
Nigel Tao 0d33d3ef3a Decode a GIF local color table 2018-02-11 15:30:18 +11:00
Nigel Tao 584fc631a8 Decode a GIF's loop count 2018-02-10 17:14:49 +11:00
Nigel Tao d3770b9972 Add an end of data concept 2018-02-10 12:13:26 +11:00
Nigel Tao d750ea7653 Add an image_config concept 2018-02-09 14:46:37 +11:00
Nigel Tao de9000cc70 Add a call sequence concept 2018-02-08 09:06:19 +11:00
Nigel Tao fecd7b631c Re-organize some status codes 2017-12-27 13:15:37 +11:00
Nigel Tao 2e12a41414 Make std/gif's LZW decoder private 2017-12-08 16:18:35 +11:00
Nigel Tao 8e2255916e Drop the "flate_" in "deflate.flate_decoder" 2017-12-04 10:35:08 +11:00
Nigel Tao 2755a61ae9 Rename std/deflate's packageid 2017-12-04 10:29:17 +11:00
Nigel Tao 1388f84e5c Rename std/flate to std/deflate 2017-12-04 10:27:48 +11:00
Nigel Tao 530605a16b Delete std/flate's zlib code (moved to std/zlib) 2017-12-03 14:31:35 +11:00
Nigel Tao 6913a1ff00 Copy/paste zlib code from std/flate to std/zlib 2017-12-03 13:32:42 +11:00
Nigel Tao 0a32c01014 Allow referring to types from used packages 2017-12-03 13:21:23 +11:00
Nigel Tao 9867cd5e3a Generate inline headers for use declarations 2017-12-02 14:54:58 +11:00
Nigel Tao c5b5efd7c8 Prepare for generating use declarations 2017-12-02 14:17:24 +11:00
Nigel Tao dd3f0b9ed4 Add a placeholder std/zlib package 2017-12-02 11:21:30 +11:00
Nigel Tao 849db0faa2 Make C hex constants' capitalization consistent 2017-12-01 15:35:41 +11:00
Nigel Tao 65dcf6a5b9 Add a yield keyword 2017-12-01 15:24:48 +11:00
Nigel Tao 3c708dfe59 Rename PUFFS to WUFFS, part 7 of N 2017-11-30 18:02:59 +11:00
Nigel Tao eda3130628 Rename PUFFS to WUFFS, part 6 of N 2017-11-30 16:43:39 +11:00
Nigel Tao 30b54616a8 Check copy_from_history32's distance. 2017-11-09 12:53:19 +11:00
Nigel Tao 0bc6f792fb Remove some suspensions from decode_huffman_fast.
name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.41GB/s ± 1%  2.39GB/s ± 2%  -0.88%  (p=0.022 n=9+10)
puffs_adler32_100k/clang       2.41GB/s ± 1%  2.39GB/s ± 2%    ~     (p=0.095 n=10+9)
puffs_flate_decode_1k/clang     136MB/s ± 2%   134MB/s ± 1%  -0.86%  (p=0.036 n=9+8)
puffs_flate_decode_10k/clang    172MB/s ± 0%   175MB/s ± 0%  +1.96%  (p=0.000 n=8+9)
puffs_flate_decode_100k/clang   206MB/s ± 0%   209MB/s ± 1%  +1.38%  (p=0.000 n=8+9)
puffs_zlib_decode_10k/clang     160MB/s ± 1%   163MB/s ± 2%  +1.73%  (p=0.001 n=9+9)
puffs_zlib_decode_100k/clang    189MB/s ± 1%   188MB/s ± 6%    ~     (p=0.143 n=10+10)

puffs_adler32_10k/gcc          3.27GB/s ± 0%  3.20GB/s ± 2%  -2.03%  (p=0.000 n=8+10)
puffs_adler32_100k/gcc         3.27GB/s ± 0%  3.21GB/s ± 1%  -1.89%  (p=0.000 n=8+10)
puffs_flate_decode_1k/gcc       141MB/s ± 1%   139MB/s ± 1%  -1.66%  (p=0.000 n=9+10)
puffs_flate_decode_10k/gcc      200MB/s ± 0%   209MB/s ± 1%  +4.73%  (p=0.000 n=10+10)
puffs_flate_decode_100k/gcc     242MB/s ± 0%   237MB/s ± 0%  -2.19%  (p=0.000 n=9+10)
puffs_zlib_decode_10k/gcc       188MB/s ± 0%   195MB/s ± 1%  +3.71%  (p=0.000 n=10+10)
puffs_zlib_decode_100k/gcc      225MB/s ± 0%   221MB/s ± 0%  -1.84%  (p=0.000 n=8+9)
2017-11-06 16:59:27 +11:00
Nigel Tao 3099991d7f Add an "invalid I/O operation" error code. 2017-11-05 13:53:35 +11:00
Nigel Tao aa1f0078db Add decode_huffman_fast.
It's not fast yet, and the immediate impact is indeed a significant
performance loss, but follow-up commits should make it faster.

name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.41GB/s ± 0%  2.40GB/s ± 1%     ~     (p=0.222 n=5+5)
puffs_adler32_100k/clang       2.41GB/s ± 1%  2.39GB/s ± 1%   -0.97%  (p=0.016 n=5+5)
puffs_flate_decode_1k/clang     116MB/s ± 5%   115MB/s ± 0%     ~     (p=0.310 n=5+5)
puffs_flate_decode_10k/clang    145MB/s ± 0%   139MB/s ± 0%   -4.18%  (p=0.016 n=4+5)
puffs_flate_decode_100k/clang   164MB/s ± 5%   158MB/s ± 1%     ~     (p=0.151 n=5+5)
puffs_zlib_decode_10k/clang     135MB/s ± 2%   131MB/s ± 0%   -2.84%  (p=0.008 n=5+5)
puffs_zlib_decode_100k/clang    154MB/s ± 1%   148MB/s ± 2%   -4.09%  (p=0.016 n=4+5)

puffs_adler32_10k/gcc          3.13GB/s ± 4%  3.19GB/s ± 0%   +1.94%  (p=0.032 n=5+5)
puffs_adler32_100k/gcc         3.14GB/s ± 3%  3.20GB/s ± 3%     ~     (p=0.056 n=5+5)
puffs_flate_decode_1k/gcc       122MB/s ± 1%    94MB/s ± 1%  -22.84%  (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc      143MB/s ± 0%   110MB/s ± 0%  -23.24%  (p=0.008 n=5+5)
puffs_flate_decode_100k/gcc     158MB/s ± 0%   118MB/s ± 0%  -24.98%  (p=0.008 n=5+5)
puffs_zlib_decode_10k/gcc       136MB/s ± 0%   119MB/s ± 1%  -12.63%  (p=0.008 n=5+5)
puffs_zlib_decode_100k/gcc      150MB/s ± 1%   124MB/s ± 2%  -17.17%  (p=0.008 n=5+5)
2017-11-04 14:45:11 +11:00
Nigel Tao ded044da41 Add a flate end_of_block field. 2017-11-04 14:12:38 +11:00
Nigel Tao 4810db3994 Rename decode_huffman to decode_huffman_slow. 2017-11-04 13:38:24 +11:00
Nigel Tao c3420dd138 Refactor std/flate/*.puffs code. 2017-11-04 13:31:39 +11:00
Nigel Tao f8146cf1c6 Remove more PUFFS_USE_NO_OP_PERFORMANCE_HACKS. 2017-11-03 10:15:43 +11:00
Nigel Tao e3822f9951 Re-introduce puffs_base__limit1.
It's not immediately obvious why this data structure performs differently, but
on net, the benchmark numbers seem better. It also won't require any
PUFFS_USE_NO_OP_PERFORMANCE_HACKS or "redundant but mysteriously performant"
use_limit fields.

name                             old speed      new speed      delta

puffs_adler32_10k/clang          2.46GB/s ± 0%  2.43GB/s ± 3%     ~     (p=0.513 n=5+10)
puffs_adler32_100k/clang         2.46GB/s ± 0%  2.44GB/s ± 2%     ~     (p=0.241 n=5+10)
puffs_flate_decode_1k/clang       122MB/s ± 1%   119MB/s ± 2%   -1.86%  (p=0.013 n=5+10)
puffs_flate_decode_10k/clang      147MB/s ± 0%   142MB/s ± 2%   -3.47%  (p=0.001 n=5+10)
puffs_flate_decode_100k/clang     161MB/s ± 0%   161MB/s ± 4%     ~     (p=0.635 n=4+10)
puffs_zlib_decode_10k/clang       139MB/s ± 0%   135MB/s ± 1%   -2.69%  (p=0.001 n=5+10)
puffs_zlib_decode_100k/clang      151MB/s ± 0%   152MB/s ± 3%     ~     (p=1.000 n=5+10)

puffs_adler32_10k/gcc            3.21GB/s ± 1%  3.18GB/s ± 2%     ~     (p=0.310 n=5+10)
puffs_adler32_100k/gcc           3.22GB/s ± 0%  3.19GB/s ± 2%     ~     (p=0.075 n=5+10)
puffs_flate_decode_1k/gcc         121MB/s ± 4%   126MB/s ± 1%   +4.54%  (p=0.002 n=5+8)
puffs_flate_decode_10k/gcc        144MB/s ± 1%   141MB/s ± 1%   -2.52%  (p=0.001 n=5+9)
puffs_flate_decode_100k/gcc       154MB/s ± 1%   158MB/s ± 0%   +2.39%  (p=0.001 n=5+9)
puffs_zlib_decode_10k/gcc         137MB/s ± 2%   135MB/s ± 1%     ~     (p=0.055 n=5+10)
puffs_zlib_decode_100k/gcc        146MB/s ± 2%   150MB/s ± 0%   +2.87%  (p=0.001 n=5+10)

puffs_gif_lzw_decode_20k/clang    132MB/s ± 0%   125MB/s ± 0%   -5.24%  (p=0.001 n=5+10)
puffs_gif_lzw_decode_100k/clang   176MB/s ± 0%   164MB/s ± 0%   -6.82%  (p=0.001 n=5+9)
puffs_gif_decode_1k/clang         363MB/s ± 0%   339MB/s ± 1%   -6.58%  (p=0.002 n=4+10)
puffs_gif_decode_10k/clang        138MB/s ± 0%   133MB/s ± 1%   -3.77%  (p=0.001 n=5+10)
puffs_gif_decode_100k/clang       125MB/s ± 0%   119MB/s ± 0%   -4.79%  (p=0.001 n=5+10)
puffs_gif_decode_1000k/clang      127MB/s ± 0%   121MB/s ± 0%   -5.04%  (p=0.001 n=5+10)

puffs_gif_lzw_decode_20k/gcc      141MB/s ± 0%   140MB/s ± 2%     ~     (p=1.000 n=5+10)
puffs_gif_lzw_decode_100k/gcc     182MB/s ± 0%   180MB/s ± 2%   -1.56%  (p=0.001 n=5+10)
puffs_gif_decode_1k/gcc           363MB/s ± 0%   409MB/s ± 3%  +12.71%  (p=0.001 n=5+10)
puffs_gif_decode_10k/gcc          127MB/s ± 0%   161MB/s ± 3%  +26.15%  (p=0.001 n=5+10)
puffs_gif_decode_100k/gcc         112MB/s ± 0%   136MB/s ± 2%  +21.95%  (p=0.001 n=5+10)
puffs_gif_decode_1000k/gcc        114MB/s ± 0%   140MB/s ± 2%  +22.78%  (p=0.001 n=5+10)
2017-11-03 10:09:57 +11:00
Nigel Tao e5db8233fc Re-introduce writer1.use_limit.
Nobody uses it yet, as we only decode and not encode, but it's there for
symmetry.

No benchmark changes, as nobody uses it yet.
2017-11-02 16:46:03 +11:00
Nigel Tao 7d8085f891 Re-introduce reader1.use_limit.
The std/flate benchmarks get better. The std/gif benchmarks get worse,
but that's possibly because the PUFFS_USE_NO_OP_PERFORMANCE_HACKS hacks
are fragile.

name                             old speed      new speed      delta

puffs_adler32_10k/clang          2.45GB/s ± 0%  2.45GB/s ± 0%     ~     (p=0.310 n=5+5)
puffs_adler32_100k/clang         2.46GB/s ± 0%  2.46GB/s ± 0%     ~     (p=0.690 n=5+5)
puffs_flate_decode_1k/clang       113MB/s ± 0%   113MB/s ± 0%     ~     (p=0.690 n=5+5)
puffs_flate_decode_10k/clang      140MB/s ± 0%   140MB/s ± 0%     ~     (p=0.222 n=5+5)
puffs_flate_decode_100k/clang     151MB/s ± 0%   151MB/s ± 0%     ~     (p=0.095 n=5+5)
puffs_zlib_decode_10k/clang       132MB/s ± 1%   132MB/s ± 0%     ~     (p=0.548 n=5+5)
puffs_zlib_decode_100k/clang      143MB/s ± 0%   143MB/s ± 0%     ~     (p=0.730 n=5+4)

puffs_adler32_10k/gcc            3.26GB/s ± 0%  3.26GB/s ± 0%     ~     (p=0.548 n=5+5)
puffs_adler32_100k/gcc           3.27GB/s ± 0%  3.27GB/s ± 0%     ~     (p=0.841 n=5+5)
puffs_flate_decode_1k/gcc         108MB/s ± 0%   125MB/s ± 0%  +14.97%  (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc        128MB/s ± 0%   148MB/s ± 0%  +15.48%  (p=0.016 n=4+5)
puffs_flate_decode_100k/gcc       136MB/s ± 0%   158MB/s ± 0%  +16.40%  (p=0.008 n=5+5)
puffs_zlib_decode_10k/gcc         123MB/s ± 0%   141MB/s ± 0%  +14.70%  (p=0.016 n=4+5)
puffs_zlib_decode_100k/gcc        131MB/s ± 0%   151MB/s ± 0%  +15.60%  (p=0.016 n=5+4)

puffs_gif_lzw_decode_20k/clang    131MB/s ± 1%   128MB/s ± 3%   -2.04%  (p=0.032 n=5+5)
puffs_gif_lzw_decode_100k/clang   172MB/s ± 1%   173MB/s ± 1%     ~     (p=0.151 n=5+5)
puffs_gif_decode_1k/clang         351MB/s ± 3%   341MB/s ± 5%     ~     (p=0.310 n=5+5)
puffs_gif_decode_10k/clang        138MB/s ± 1%   134MB/s ± 3%   -3.34%  (p=0.008 n=5+5)
puffs_gif_decode_100k/clang       122MB/s ± 2%   122MB/s ± 2%     ~     (p=1.000 n=5+5)
puffs_gif_decode_1000k/clang      126MB/s ± 1%   122MB/s ± 4%   -3.07%  (p=0.016 n=5+5)

puffs_gif_lzw_decode_20k/gcc      140MB/s ± 3%   140MB/s ± 3%     ~     (p=0.421 n=5+5)
puffs_gif_lzw_decode_100k/gcc     187MB/s ± 2%   184MB/s ± 1%     ~     (p=0.056 n=5+5)
puffs_gif_decode_1k/gcc           401MB/s ± 1%   357MB/s ± 1%  -10.88%  (p=0.008 n=5+5)
puffs_gif_decode_10k/gcc          154MB/s ± 1%   126MB/s ± 1%  -18.42%  (p=0.008 n=5+5)
puffs_gif_decode_100k/gcc         131MB/s ± 2%   109MB/s ± 0%  -17.37%  (p=0.008 n=5+5)
puffs_gif_decode_1000k/gcc        135MB/s ± 1%   111MB/s ± 1%  -17.65%  (p=0.008 n=5+5)
2017-11-02 16:35:15 +11:00
Nigel Tao ed6ce6fd54 Add PUFFS_USE_NO_OP_PERFORMANCE_HACKS.
name                             old speed      new speed      delta

puffs_adler32_10k/gcc            3.26GB/s ± 0%  3.26GB/s ± 0%     ~     (p=0.222 n=5+5)
puffs_adler32_100k/gcc           3.27GB/s ± 0%  3.27GB/s ± 0%   -0.12%  (p=0.032 n=5+5)
puffs_flate_decode_1k/gcc         108MB/s ± 0%   108MB/s ± 0%     ~     (p=0.841 n=5+5)
puffs_flate_decode_10k/gcc        128MB/s ± 0%   128MB/s ± 0%     ~     (p=0.057 n=4+4)
puffs_flate_decode_100k/gcc       136MB/s ± 0%   136MB/s ± 0%     ~     (p=0.222 n=5+5)
puffs_zlib_decode_10k/gcc         123MB/s ± 0%   123MB/s ± 0%     ~     (p=0.730 n=5+4)
puffs_zlib_decode_100k/gcc        130MB/s ± 0%   131MB/s ± 0%     ~     (p=1.000 n=5+5)

puffs_gif_lzw_decode_20k/gcc      137MB/s ± 4%   140MB/s ± 3%     ~     (p=0.095 n=5+5)
puffs_gif_lzw_decode_100k/gcc     177MB/s ± 3%   187MB/s ± 2%   +5.75%  (p=0.008 n=5+5)
puffs_gif_decode_1k/gcc           348MB/s ± 0%   401MB/s ± 1%  +15.34%  (p=0.016 n=4+5)
puffs_gif_decode_10k/gcc          121MB/s ± 5%   154MB/s ± 1%  +27.90%  (p=0.008 n=5+5)
puffs_gif_decode_100k/gcc         106MB/s ± 4%   131MB/s ± 2%  +24.35%  (p=0.008 n=5+5)
puffs_gif_decode_1000k/gcc        109MB/s ± 2%   135MB/s ± 1%  +24.03%  (p=0.008 n=5+5)
2017-11-02 14:51:29 +11:00
Nigel Tao aa396e7992 Change cgen's limit from a count to a pointer. 2017-10-27 10:28:35 +11:00
Nigel Tao 3485950a3f Remove the obsolete puffs_base__limit1 concept. 2017-10-27 07:51:57 +11:00
Nigel Tao 8ff453c752 Re-do how limits work. 2017-10-26 16:59:03 +11:00
Nigel Tao b886e3a1ea Add reader1.mark and reader1.since_mark methods. 2017-10-26 14:39:38 +11:00
Nigel Tao 51012a0cca Change flate block_size from u8 to u64. 2017-10-26 14:05:02 +11:00
Nigel Tao 21bbbd422f Generate code for "mark in.dst".
The generated code is ugly and the language design is not finalized, but
the flate_backref_crosses_blocks test (testing a correctness bug) now
passes. We can fix the ugliness in subsequent commits.
2017-10-22 14:44:53 +11:00
Nigel Tao f29c4e278f Follow the pkg__type__method convention for base. 2017-10-21 15:59:08 +11:00
Nigel Tao 6815375de5 Generate double '_'s for pkg__type__method names. 2017-10-21 15:10:25 +11:00
Nigel Tao 2639f8f46a Rename std/flate's decoder to flate_decoder. 2017-10-21 13:05:19 +11:00
Nigel Tao 1c75edb32e Calculate the zlib checksum. 2017-10-21 12:38:23 +11:00
Nigel Tao 62935c41d7 Prepare for calculating the zlib checksum. 2017-10-21 11:55:58 +11:00
Nigel Tao 74f3b76b09 Rename the adler struct to adler32. 2017-10-19 20:49:20 +11:00
Nigel Tao 5b0d6f6f3e Add a skeleton of an Adler checksummer. 2017-10-19 18:09:14 +11:00
Nigel Tao c1789e0065 Rename some variables for clarity. 2017-10-14 11:24:40 +11:00
Nigel Tao c99fdaf63d Actually copy from the flate decoder's history. 2017-10-13 14:50:34 +11:00
Nigel Tao a33f744da5 Drop the "?" from "writer1.copy_from_slice?". 2017-10-13 11:44:53 +11:00
Nigel Tao 36ba4b866c Calculate the length-distance for a history copy. 2017-10-12 16:06:28 +11:00
Nigel Tao d4372cb5b8 Change license to Apache 2.
Also remove explicit PATENTS file. The new LICENSE file already
discusses patents.

Note that the Puffs project has not yet been publicly released.
2017-10-12 11:17:41 +11:00