Commit Graph
607 Commits
Author SHA1 Message Date
Nigel Tao aa1f0078db Add decode_huffman_fast.
It's not fast yet, and the immediate impact is indeed a significant
performance loss, but follow-up commits should make it faster.

name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.41GB/s ± 0%  2.40GB/s ± 1%     ~     (p=0.222 n=5+5)
puffs_adler32_100k/clang       2.41GB/s ± 1%  2.39GB/s ± 1%   -0.97%  (p=0.016 n=5+5)
puffs_flate_decode_1k/clang     116MB/s ± 5%   115MB/s ± 0%     ~     (p=0.310 n=5+5)
puffs_flate_decode_10k/clang    145MB/s ± 0%   139MB/s ± 0%   -4.18%  (p=0.016 n=4+5)
puffs_flate_decode_100k/clang   164MB/s ± 5%   158MB/s ± 1%     ~     (p=0.151 n=5+5)
puffs_zlib_decode_10k/clang     135MB/s ± 2%   131MB/s ± 0%   -2.84%  (p=0.008 n=5+5)
puffs_zlib_decode_100k/clang    154MB/s ± 1%   148MB/s ± 2%   -4.09%  (p=0.016 n=4+5)

puffs_adler32_10k/gcc          3.13GB/s ± 4%  3.19GB/s ± 0%   +1.94%  (p=0.032 n=5+5)
puffs_adler32_100k/gcc         3.14GB/s ± 3%  3.20GB/s ± 3%     ~     (p=0.056 n=5+5)
puffs_flate_decode_1k/gcc       122MB/s ± 1%    94MB/s ± 1%  -22.84%  (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc      143MB/s ± 0%   110MB/s ± 0%  -23.24%  (p=0.008 n=5+5)
puffs_flate_decode_100k/gcc     158MB/s ± 0%   118MB/s ± 0%  -24.98%  (p=0.008 n=5+5)
puffs_zlib_decode_10k/gcc       136MB/s ± 0%   119MB/s ± 1%  -12.63%  (p=0.008 n=5+5)
puffs_zlib_decode_100k/gcc      150MB/s ± 1%   124MB/s ± 2%  -17.17%  (p=0.008 n=5+5)
2017-11-04 14:45:11 +11:00
Nigel Tao c550ad9bda Add redundant but clearer continue/break labels. 2017-11-04 14:14:07 +11:00
Nigel Tao ded044da41 Add a flate end_of_block field. 2017-11-04 14:12:38 +11:00
Nigel Tao 4810db3994 Rename decode_huffman to decode_huffman_slow. 2017-11-04 13:38:24 +11:00
Nigel Tao c3420dd138 Refactor std/flate/*.puffs code. 2017-11-04 13:31:39 +11:00
Nigel Tao a36535ec6d Generate "static" for private functions. 2017-11-04 11:43:48 +11:00
Nigel Tao 9ebcd54d43 Discuss "puffs bench" in doc/benchmarks.md. 2017-11-04 11:33:49 +11:00
Nigel Tao a0fd42f6d4 Add a puffs/cmd/commonflags package. 2017-11-04 11:09:14 +11:00
Nigel Tao 66047db6d8 Be more paranoid about calling strncmp. 2017-11-04 10:49:23 +11:00
Nigel Tao 6602dea7be Make focus's "/gcc" suffix optional. 2017-11-04 10:40:43 +11:00
Nigel Tao 4729170678 Make focus's "Benchmark" prefix optional. 2017-11-04 10:25:24 +11:00
Nigel Tao 0230a65c7b Let focus have a trailing comma. 2017-11-04 10:21:32 +11:00
Nigel Tao c62aa518a5 Make focus's "test_" or "bench_" prefix optional. 2017-11-04 10:05:37 +11:00
Nigel Tao 7e654ba652 Note that -focus specifies a prefix. 2017-11-04 09:55:42 +11:00
Nigel Tao 1487da7af8 Add a -focus flag. 2017-11-03 17:54:29 +11:00
Nigel Tao e3643574d7 Fix script/inline-c-relative-includes.go. 2017-11-03 15:33:23 +11:00
Nigel Tao aec5715f12 Declare proc_filename exactly once. 2017-11-03 15:09:22 +11:00
Nigel Tao e57c8d77db Add script/inline-c-relative-includes.go. 2017-11-03 15:05:19 +11:00
Nigel Tao 558d8ddbbd Restrict tPrefix temporary variables's scope. 2017-11-03 14:00:35 +11:00
Nigel Tao acec19e969 Add genFilenameLineComments. 2017-11-03 12:28:15 +11:00
Nigel Tao d7c910fd1b Avoid "array decl needs an explicit size". 2017-11-03 12:11:21 +11:00
Nigel Tao eefe590e04 Remove unreachable coroutine suspension code. 2017-11-03 11:57:07 +11:00
Nigel Tao 346b3d4107 Avoid a -Wc++11-narrowing warning. 2017-11-03 11:44:35 +11:00
Nigel Tao 94eba81892 Have mimiclib accept both giflib v4 and v5. 2017-11-03 11:35:16 +11:00
Nigel Tao 0e136f59af Use an explicitly typed tc_neither. 2017-11-03 11:18:38 +11:00
Nigel Tao b7f347d406 Fix a "return false as char*" typo. 2017-11-03 11:15:38 +11:00
Nigel Tao 7f47f19d4a Don't hard-code the printf signature. 2017-11-03 11:14:05 +11:00
Nigel Tao f8146cf1c6 Remove more PUFFS_USE_NO_OP_PERFORMANCE_HACKS. 2017-11-03 10:15:43 +11:00
Nigel Tao e3822f9951 Re-introduce puffs_base__limit1.
It's not immediately obvious why this data structure performs differently, but
on net, the benchmark numbers seem better. It also won't require any
PUFFS_USE_NO_OP_PERFORMANCE_HACKS or "redundant but mysteriously performant"
use_limit fields.

name                             old speed      new speed      delta

puffs_adler32_10k/clang          2.46GB/s ± 0%  2.43GB/s ± 3%     ~     (p=0.513 n=5+10)
puffs_adler32_100k/clang         2.46GB/s ± 0%  2.44GB/s ± 2%     ~     (p=0.241 n=5+10)
puffs_flate_decode_1k/clang       122MB/s ± 1%   119MB/s ± 2%   -1.86%  (p=0.013 n=5+10)
puffs_flate_decode_10k/clang      147MB/s ± 0%   142MB/s ± 2%   -3.47%  (p=0.001 n=5+10)
puffs_flate_decode_100k/clang     161MB/s ± 0%   161MB/s ± 4%     ~     (p=0.635 n=4+10)
puffs_zlib_decode_10k/clang       139MB/s ± 0%   135MB/s ± 1%   -2.69%  (p=0.001 n=5+10)
puffs_zlib_decode_100k/clang      151MB/s ± 0%   152MB/s ± 3%     ~     (p=1.000 n=5+10)

puffs_adler32_10k/gcc            3.21GB/s ± 1%  3.18GB/s ± 2%     ~     (p=0.310 n=5+10)
puffs_adler32_100k/gcc           3.22GB/s ± 0%  3.19GB/s ± 2%     ~     (p=0.075 n=5+10)
puffs_flate_decode_1k/gcc         121MB/s ± 4%   126MB/s ± 1%   +4.54%  (p=0.002 n=5+8)
puffs_flate_decode_10k/gcc        144MB/s ± 1%   141MB/s ± 1%   -2.52%  (p=0.001 n=5+9)
puffs_flate_decode_100k/gcc       154MB/s ± 1%   158MB/s ± 0%   +2.39%  (p=0.001 n=5+9)
puffs_zlib_decode_10k/gcc         137MB/s ± 2%   135MB/s ± 1%     ~     (p=0.055 n=5+10)
puffs_zlib_decode_100k/gcc        146MB/s ± 2%   150MB/s ± 0%   +2.87%  (p=0.001 n=5+10)

puffs_gif_lzw_decode_20k/clang    132MB/s ± 0%   125MB/s ± 0%   -5.24%  (p=0.001 n=5+10)
puffs_gif_lzw_decode_100k/clang   176MB/s ± 0%   164MB/s ± 0%   -6.82%  (p=0.001 n=5+9)
puffs_gif_decode_1k/clang         363MB/s ± 0%   339MB/s ± 1%   -6.58%  (p=0.002 n=4+10)
puffs_gif_decode_10k/clang        138MB/s ± 0%   133MB/s ± 1%   -3.77%  (p=0.001 n=5+10)
puffs_gif_decode_100k/clang       125MB/s ± 0%   119MB/s ± 0%   -4.79%  (p=0.001 n=5+10)
puffs_gif_decode_1000k/clang      127MB/s ± 0%   121MB/s ± 0%   -5.04%  (p=0.001 n=5+10)

puffs_gif_lzw_decode_20k/gcc      141MB/s ± 0%   140MB/s ± 2%     ~     (p=1.000 n=5+10)
puffs_gif_lzw_decode_100k/gcc     182MB/s ± 0%   180MB/s ± 2%   -1.56%  (p=0.001 n=5+10)
puffs_gif_decode_1k/gcc           363MB/s ± 0%   409MB/s ± 3%  +12.71%  (p=0.001 n=5+10)
puffs_gif_decode_10k/gcc          127MB/s ± 0%   161MB/s ± 3%  +26.15%  (p=0.001 n=5+10)
puffs_gif_decode_100k/gcc         112MB/s ± 0%   136MB/s ± 2%  +21.95%  (p=0.001 n=5+10)
puffs_gif_decode_1000k/gcc        114MB/s ± 0%   140MB/s ± 2%  +22.78%  (p=0.001 n=5+10)
2017-11-03 10:09:57 +11:00
Nigel Tao 4158d7eae7 Avoid redundantly setting end ptrs after resume.
No significant benchmark changes.
2017-11-02 18:29:37 +11:00
Nigel Tao 0a7382cfac Remove some PUFFS_USE_NO_OP_PERFORMANCE_HACKS.
They don't seem to actually help the benchmark numbers in a robust way.
2017-11-02 18:23:03 +11:00
Nigel Tao e5db8233fc Re-introduce writer1.use_limit.
Nobody uses it yet, as we only decode and not encode, but it's there for
symmetry.

No benchmark changes, as nobody uses it yet.
2017-11-02 16:46:03 +11:00
Nigel Tao 7d8085f891 Re-introduce reader1.use_limit.
The std/flate benchmarks get better. The std/gif benchmarks get worse,
but that's possibly because the PUFFS_USE_NO_OP_PERFORMANCE_HACKS hacks
are fragile.

name                             old speed      new speed      delta

puffs_adler32_10k/clang          2.45GB/s ± 0%  2.45GB/s ± 0%     ~     (p=0.310 n=5+5)
puffs_adler32_100k/clang         2.46GB/s ± 0%  2.46GB/s ± 0%     ~     (p=0.690 n=5+5)
puffs_flate_decode_1k/clang       113MB/s ± 0%   113MB/s ± 0%     ~     (p=0.690 n=5+5)
puffs_flate_decode_10k/clang      140MB/s ± 0%   140MB/s ± 0%     ~     (p=0.222 n=5+5)
puffs_flate_decode_100k/clang     151MB/s ± 0%   151MB/s ± 0%     ~     (p=0.095 n=5+5)
puffs_zlib_decode_10k/clang       132MB/s ± 1%   132MB/s ± 0%     ~     (p=0.548 n=5+5)
puffs_zlib_decode_100k/clang      143MB/s ± 0%   143MB/s ± 0%     ~     (p=0.730 n=5+4)

puffs_adler32_10k/gcc            3.26GB/s ± 0%  3.26GB/s ± 0%     ~     (p=0.548 n=5+5)
puffs_adler32_100k/gcc           3.27GB/s ± 0%  3.27GB/s ± 0%     ~     (p=0.841 n=5+5)
puffs_flate_decode_1k/gcc         108MB/s ± 0%   125MB/s ± 0%  +14.97%  (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc        128MB/s ± 0%   148MB/s ± 0%  +15.48%  (p=0.016 n=4+5)
puffs_flate_decode_100k/gcc       136MB/s ± 0%   158MB/s ± 0%  +16.40%  (p=0.008 n=5+5)
puffs_zlib_decode_10k/gcc         123MB/s ± 0%   141MB/s ± 0%  +14.70%  (p=0.016 n=4+5)
puffs_zlib_decode_100k/gcc        131MB/s ± 0%   151MB/s ± 0%  +15.60%  (p=0.016 n=5+4)

puffs_gif_lzw_decode_20k/clang    131MB/s ± 1%   128MB/s ± 3%   -2.04%  (p=0.032 n=5+5)
puffs_gif_lzw_decode_100k/clang   172MB/s ± 1%   173MB/s ± 1%     ~     (p=0.151 n=5+5)
puffs_gif_decode_1k/clang         351MB/s ± 3%   341MB/s ± 5%     ~     (p=0.310 n=5+5)
puffs_gif_decode_10k/clang        138MB/s ± 1%   134MB/s ± 3%   -3.34%  (p=0.008 n=5+5)
puffs_gif_decode_100k/clang       122MB/s ± 2%   122MB/s ± 2%     ~     (p=1.000 n=5+5)
puffs_gif_decode_1000k/clang      126MB/s ± 1%   122MB/s ± 4%   -3.07%  (p=0.016 n=5+5)

puffs_gif_lzw_decode_20k/gcc      140MB/s ± 3%   140MB/s ± 3%     ~     (p=0.421 n=5+5)
puffs_gif_lzw_decode_100k/gcc     187MB/s ± 2%   184MB/s ± 1%     ~     (p=0.056 n=5+5)
puffs_gif_decode_1k/gcc           401MB/s ± 1%   357MB/s ± 1%  -10.88%  (p=0.008 n=5+5)
puffs_gif_decode_10k/gcc          154MB/s ± 1%   126MB/s ± 1%  -18.42%  (p=0.008 n=5+5)
puffs_gif_decode_100k/gcc         131MB/s ± 2%   109MB/s ± 0%  -17.37%  (p=0.008 n=5+5)
puffs_gif_decode_1000k/gcc        135MB/s ± 1%   111MB/s ± 1%  -17.65%  (p=0.008 n=5+5)
2017-11-02 16:35:15 +11:00
Nigel Tao ed6ce6fd54 Add PUFFS_USE_NO_OP_PERFORMANCE_HACKS.
name                             old speed      new speed      delta

puffs_adler32_10k/gcc            3.26GB/s ± 0%  3.26GB/s ± 0%     ~     (p=0.222 n=5+5)
puffs_adler32_100k/gcc           3.27GB/s ± 0%  3.27GB/s ± 0%   -0.12%  (p=0.032 n=5+5)
puffs_flate_decode_1k/gcc         108MB/s ± 0%   108MB/s ± 0%     ~     (p=0.841 n=5+5)
puffs_flate_decode_10k/gcc        128MB/s ± 0%   128MB/s ± 0%     ~     (p=0.057 n=4+4)
puffs_flate_decode_100k/gcc       136MB/s ± 0%   136MB/s ± 0%     ~     (p=0.222 n=5+5)
puffs_zlib_decode_10k/gcc         123MB/s ± 0%   123MB/s ± 0%     ~     (p=0.730 n=5+4)
puffs_zlib_decode_100k/gcc        130MB/s ± 0%   131MB/s ± 0%     ~     (p=1.000 n=5+5)

puffs_gif_lzw_decode_20k/gcc      137MB/s ± 4%   140MB/s ± 3%     ~     (p=0.095 n=5+5)
puffs_gif_lzw_decode_100k/gcc     177MB/s ± 3%   187MB/s ± 2%   +5.75%  (p=0.008 n=5+5)
puffs_gif_decode_1k/gcc           348MB/s ± 0%   401MB/s ± 1%  +15.34%  (p=0.016 n=4+5)
puffs_gif_decode_10k/gcc          121MB/s ± 5%   154MB/s ± 1%  +27.90%  (p=0.008 n=5+5)
puffs_gif_decode_100k/gcc         106MB/s ± 4%   131MB/s ± 2%  +24.35%  (p=0.008 n=5+5)
puffs_gif_decode_1000k/gcc        109MB/s ± 2%   135MB/s ± 1%  +24.03%  (p=0.008 n=5+5)
2017-11-02 14:51:29 +11:00
Nigel Tao 4b572702f9 Remove the return error "foo" special case. 2017-10-27 14:39:48 +11:00
Nigel Tao 7cefcccc98 Make error "foo" an expression. 2017-10-27 13:00:13 +11:00
Nigel Tao 9a8508857f Fix the "limitt" typo. 2017-10-27 11:10:25 +11:00
Nigel Tao cbc8c39375 Delete old limit- and mark-related code. 2017-10-27 10:57:32 +11:00
Nigel Tao aa396e7992 Change cgen's limit from a count to a pointer. 2017-10-27 10:28:35 +11:00
Nigel Tao 3485950a3f Remove the obsolete puffs_base__limit1 concept. 2017-10-27 07:51:57 +11:00
Nigel Tao e0836d73a8 Migrate tests to use new limit mechanism. 2017-10-27 07:49:08 +11:00
Nigel Tao 8ff453c752 Re-do how limits work. 2017-10-26 16:59:03 +11:00
Nigel Tao a382101a9c Remove an obsolete TODO. 2017-10-26 15:43:46 +11:00
Nigel Tao a9ba7e85ac Add reader1.limitt and writer1.limitt methods.
The "limitt" typo will be renamed to "limit" once we remove the keyword
named "limit".
2017-10-26 15:06:59 +11:00
Nigel Tao b886e3a1ea Add reader1.mark and reader1.since_mark methods. 2017-10-26 14:39:38 +11:00
Nigel Tao 15ded0a6d0 Add while/break in anticipation of adding try. 2017-10-26 14:09:31 +11:00
Nigel Tao 51012a0cca Change flate block_size from u8 to u64. 2017-10-26 14:05:02 +11:00
Nigel Tao c0c023e1cf Remove the writer1.length method. 2017-10-26 13:15:24 +11:00
Nigel Tao 5052b16f2d Rename writer1.slice to writer1.since_mark. 2017-10-26 13:03:19 +11:00
Nigel Tao bdfe4abbd3 Remove codegen for b_wstart_dst. 2017-10-26 12:55:52 +11:00