Commit Graph
665 Commits
Author SHA1 Message Date
Andrew Dassonville 8d0852e051 Beautify diffs in README 2017-11-16 18:56:59 -08:00
Nigel Tao f604194ba4 We have moved to github. v0.1.0 2017-11-16 05:53:45 +11:00
Nigel Tao 34cd0661f3 We are moving to github. 2017-11-16 05:52:07 +11:00
Nigel Tao 20417f8368 Update doc/benchmarks.md. 2017-11-15 21:43:20 +11:00
Nigel Tao 21881f9f45 Update doc/related-work.md. 2017-11-15 11:13:55 +11:00
Nigel Tao bea8b1e695 Update README.md. 2017-11-15 10:54:20 +11:00
Nigel Tao 1e10dad59e Update doc/related-work.md. 2017-11-15 10:46:17 +11:00
Nigel Tao 6748370c56 Update doc/related-work.md. 2017-11-14 12:46:21 +11:00
Nigel Tao ca99003bd2 Update doc/benchmarks.md. 2017-11-14 09:01:09 +11:00
Nigel Tao 02c5194078 Update doc/binary-size.md. 2017-11-10 10:10:30 +11:00
Nigel Tao 1cee9c6ea2 Add note to consider a read_u8_fast method. 2017-11-10 09:56:27 +11:00
Nigel Tao 417ecef784 Omit needless words. 2017-11-10 09:48:53 +11:00
Nigel Tao f4e4381a3b Update dod/benchmarks.md.
Note that these benchmarks were measured on Debian Testing, which uses
different clang and gcc versions than the Ubuntu Trusty system used for
benchstat numbers reported in recent git commits.
2017-11-09 20:37:16 +11:00
Nigel Tao 693af478d6 Rename some bcheckOptimizeXxx methods. 2017-11-09 15:15:30 +11:00
Nigel Tao d2a01dd938 Refactor lang/check/bounds.go. 2017-11-09 15:11:45 +11:00
Nigel Tao 9b4cc179c4 Use puffs_base__writer1__copy_from_history32__bco.
name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.45GB/s ± 0%  2.45GB/s ± 0%    ~     (p=0.063 n=5+5)
puffs_adler32_100k/clang       2.45GB/s ± 0%  2.45GB/s ± 0%    ~     (p=0.905 n=5+4)
puffs_flate_decode_1k/clang     144MB/s ± 1%   146MB/s ± 0%  +1.41%  (p=0.016 n=5+5)
puffs_flate_decode_10k/clang    186MB/s ± 0%   204MB/s ± 0%  +9.39%  (p=0.008 n=5+5)
puffs_flate_decode_100k/clang   228MB/s ± 0%   240MB/s ± 0%  +5.24%  (p=0.008 n=5+5)
puffs_zlib_decode_10k/clang     173MB/s ± 0%   188MB/s ± 0%  +8.69%  (p=0.008 n=5+5)
puffs_zlib_decode_100k/clang    209MB/s ± 0%   219MB/s ± 0%  +4.81%  (p=0.008 n=5+5)

puffs_adler32_10k/gcc          3.26GB/s ± 0%  3.26GB/s ± 0%    ~     (p=0.286 n=5+4)
puffs_adler32_100k/gcc         3.26GB/s ± 0%  3.26GB/s ± 0%    ~     (p=0.190 n=5+4)
puffs_flate_decode_1k/gcc       148MB/s ± 0%   148MB/s ± 0%  +0.27%  (p=0.016 n=5+4)
puffs_flate_decode_10k/gcc      245MB/s ± 0%   254MB/s ± 0%  +3.73%  (p=0.008 n=5+5)
puffs_flate_decode_100k/gcc     284MB/s ± 0%   298MB/s ± 0%  +4.90%  (p=0.008 n=5+5)
puffs_zlib_decode_10k/gcc       228MB/s ± 0%   236MB/s ± 0%  +3.33%  (p=0.008 n=5+5)
puffs_zlib_decode_100k/gcc      261MB/s ± 0%   273MB/s ± 0%  +4.46%  (p=0.016 n=5+4)
2017-11-09 15:08:28 +11:00
Nigel Tao 744b5fcc31 Add puffs_base__writer1__copy_from_history32__bco. 2017-11-09 14:02:10 +11:00
Nigel Tao 82e5734778 Fix puffs_base__writer1__copy_from_history32. 2017-11-09 13:35:45 +11:00
Nigel Tao c69e256b0c Add a note about CPU Scaling and benchmarks. 2017-11-09 13:26:20 +11:00
Nigel Tao 03acc15782 Add some more length and distance checks. 2017-11-09 13:21:19 +11:00
Nigel Tao 30b54616a8 Check copy_from_history32's distance. 2017-11-09 12:53:19 +11:00
Nigel Tao 67fb7bf1dc Prepare to optimize w.since_mark.
It's not obvious why the benchmark numbers don't improve, so the
intuitively-better codegen is disabled for now. I'm also having trouble
exactly reproducing the numbers from yesterdays' commits. While I'm
investigating, land this commit and move on.
2017-11-09 12:03:38 +11:00
Nigel Tao 3bdd515e47 Allow "assert foo", not just "assert foo < bar". 2017-11-09 10:53:37 +11:00
Nigel Tao e2ce9f1b1d Add a writer1.is_marked method. 2017-11-09 10:38:24 +11:00
Nigel Tao 545f043d94 Don't read extra bits if there's no extra bits.
name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.45GB/s ± 0%  2.45GB/s ± 0%    ~     (p=0.548 n=5+5)
puffs_adler32_100k/clang       2.45GB/s ± 0%  2.45GB/s ± 0%    ~     (p=0.056 n=5+5)
puffs_flate_decode_1k/clang     142MB/s ± 0%   143MB/s ± 0%  +0.63%  (p=0.008 n=5+5)
puffs_flate_decode_10k/clang    190MB/s ± 0%   201MB/s ± 0%  +5.54%  (p=0.008 n=5+5)
puffs_flate_decode_100k/clang   225MB/s ± 0%   235MB/s ± 0%  +4.27%  (p=0.008 n=5+5)
puffs_zlib_decode_10k/clang     176MB/s ± 0%   186MB/s ± 0%  +5.16%  (p=0.008 n=5+5)
puffs_zlib_decode_100k/clang    207MB/s ± 1%   214MB/s ± 0%  +3.56%  (p=0.008 n=5+5)

puffs_adler32_10k/gcc          3.21GB/s ± 1%  3.26GB/s ± 0%  +1.55%  (p=0.008 n=5+5)
puffs_adler32_100k/gcc         3.21GB/s ± 2%  3.27GB/s ± 0%  +1.66%  (p=0.008 n=5+5)
puffs_flate_decode_1k/gcc       139MB/s ± 1%   146MB/s ± 0%  +5.09%  (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc      232MB/s ± 0%   244MB/s ± 0%  +5.42%  (p=0.008 n=5+5)
puffs_flate_decode_100k/gcc     257MB/s ± 1%   280MB/s ± 0%  +9.10%  (p=0.008 n=5+5)
puffs_zlib_decode_10k/gcc       215MB/s ± 1%   227MB/s ± 0%  +5.82%  (p=0.008 n=5+5)
puffs_zlib_decode_100k/gcc      235MB/s ± 1%   257MB/s ± 0%  +9.67%  (p=0.008 n=5+5)
2017-11-08 17:19:58 +11:00
Nigel Tao 989614df88 Remove some redundant decode_huffman_xxx code.
name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.40GB/s ± 1%  2.45GB/s ± 0%  +2.08%  (p=0.008 n=5+5)
puffs_adler32_100k/clang       2.41GB/s ± 1%  2.45GB/s ± 0%  +1.54%  (p=0.008 n=5+5)
puffs_flate_decode_1k/clang     140MB/s ± 0%   142MB/s ± 0%  +1.64%  (p=0.016 n=4+5)
puffs_flate_decode_10k/clang    186MB/s ± 1%   190MB/s ± 0%  +2.32%  (p=0.008 n=5+5)
puffs_flate_decode_100k/clang   209MB/s ± 1%   225MB/s ± 0%  +7.60%  (p=0.008 n=5+5)
puffs_zlib_decode_10k/clang     173MB/s ± 1%   176MB/s ± 0%  +2.04%  (p=0.008 n=5+5)
puffs_zlib_decode_100k/clang    193MB/s ± 0%   207MB/s ± 1%  +7.43%  (p=0.008 n=5+5)

puffs_adler32_10k/gcc          3.26GB/s ± 0%  3.21GB/s ± 1%  -1.48%  (p=0.008 n=5+5)
puffs_adler32_100k/gcc         3.25GB/s ± 0%  3.21GB/s ± 2%  -1.24%  (p=0.008 n=5+5)
puffs_flate_decode_1k/gcc       142MB/s ± 0%   139MB/s ± 1%  -2.27%  (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc      232MB/s ± 1%   232MB/s ± 0%    ~     (p=0.548 n=5+5)
puffs_flate_decode_100k/gcc     259MB/s ± 2%   257MB/s ± 1%    ~     (p=0.151 n=5+5)
puffs_zlib_decode_10k/gcc       216MB/s ± 2%   215MB/s ± 1%    ~     (p=0.222 n=5+5)
puffs_zlib_decode_100k/gcc      241MB/s ± 1%   235MB/s ± 1%  -2.50%  (p=0.008 n=5+5)
2017-11-08 17:08:36 +11:00
Nigel Tao becd1a6b25 Fix a comment typo. 2017-11-08 16:56:22 +11:00
Nigel Tao 1910ca31cf Run the mimic checksum benchmarks for longer. 2017-11-08 12:46:57 +11:00
Nigel Tao 39952faca1 Tweak the copy_from_history32 unroll count.
name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.42GB/s ± 1%  2.43GB/s ± 1%     ~     (p=0.720 n=10+9)
puffs_adler32_100k/clang       2.43GB/s ± 0%  2.42GB/s ± 1%   -0.41%  (p=0.004 n=8+10)
puffs_flate_decode_1k/clang     138MB/s ± 1%   139MB/s ± 1%   +1.20%  (p=0.000 n=10+10)
puffs_flate_decode_10k/clang    189MB/s ± 1%   187MB/s ± 1%   -1.27%  (p=0.000 n=9+9)
puffs_flate_decode_100k/clang   211MB/s ± 1%   210MB/s ± 1%   -0.72%  (p=0.001 n=10+9)
puffs_zlib_decode_10k/clang     175MB/s ± 1%   173MB/s ± 1%   -1.23%  (p=0.000 n=10+10)
puffs_zlib_decode_100k/clang    194MB/s ± 1%   193MB/s ± 0%   -0.50%  (p=0.018 n=10+9)

puffs_adler32_10k/gcc          3.26GB/s ± 0%  3.22GB/s ± 1%   -1.00%  (p=0.000 n=9+10)
puffs_adler32_100k/gcc         3.27GB/s ± 0%  3.23GB/s ± 1%   -1.05%  (p=0.000 n=8+9)
puffs_flate_decode_1k/gcc       139MB/s ± 0%   141MB/s ± 1%   +1.27%  (p=0.000 n=9+10)
puffs_flate_decode_10k/gcc      203MB/s ± 0%   231MB/s ± 0%  +13.87%  (p=0.000 n=10+9)
puffs_flate_decode_100k/gcc     229MB/s ± 0%   258MB/s ± 0%  +12.63%  (p=0.000 n=9+9)
puffs_zlib_decode_10k/gcc       201MB/s ± 0%   215MB/s ± 1%   +6.86%  (p=0.000 n=10+9)
puffs_zlib_decode_100k/gcc      224MB/s ± 0%   239MB/s ± 0%   +6.89%  (p=0.000 n=9+9)
2017-11-08 11:40:09 +11:00
Nigel Tao 7ccb9234a4 Fix hand-written decode_huffman_fast C impl. 2017-11-08 10:12:47 +11:00
Nigel Tao 848d66ffdf Tighten the Huffman n_bits invariant. 2017-11-07 09:30:16 +11:00
Nigel Tao 30ce73ad26 Remove some superfluous braces. 2017-11-06 17:01:34 +11:00
Nigel Tao 0bc6f792fb Remove some suspensions from decode_huffman_fast.
name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.41GB/s ± 1%  2.39GB/s ± 2%  -0.88%  (p=0.022 n=9+10)
puffs_adler32_100k/clang       2.41GB/s ± 1%  2.39GB/s ± 2%    ~     (p=0.095 n=10+9)
puffs_flate_decode_1k/clang     136MB/s ± 2%   134MB/s ± 1%  -0.86%  (p=0.036 n=9+8)
puffs_flate_decode_10k/clang    172MB/s ± 0%   175MB/s ± 0%  +1.96%  (p=0.000 n=8+9)
puffs_flate_decode_100k/clang   206MB/s ± 0%   209MB/s ± 1%  +1.38%  (p=0.000 n=8+9)
puffs_zlib_decode_10k/clang     160MB/s ± 1%   163MB/s ± 2%  +1.73%  (p=0.001 n=9+9)
puffs_zlib_decode_100k/clang    189MB/s ± 1%   188MB/s ± 6%    ~     (p=0.143 n=10+10)

puffs_adler32_10k/gcc          3.27GB/s ± 0%  3.20GB/s ± 2%  -2.03%  (p=0.000 n=8+10)
puffs_adler32_100k/gcc         3.27GB/s ± 0%  3.21GB/s ± 1%  -1.89%  (p=0.000 n=8+10)
puffs_flate_decode_1k/gcc       141MB/s ± 1%   139MB/s ± 1%  -1.66%  (p=0.000 n=9+10)
puffs_flate_decode_10k/gcc      200MB/s ± 0%   209MB/s ± 1%  +4.73%  (p=0.000 n=10+10)
puffs_flate_decode_100k/gcc     242MB/s ± 0%   237MB/s ± 0%  -2.19%  (p=0.000 n=9+10)
puffs_zlib_decode_10k/gcc       188MB/s ± 0%   195MB/s ± 1%  +3.71%  (p=0.000 n=10+10)
puffs_zlib_decode_100k/gcc      225MB/s ± 0%   221MB/s ± 0%  -1.84%  (p=0.000 n=8+9)
2017-11-06 16:59:27 +11:00
Nigel Tao 058938006a Remove some suspensions from decode_huffman_fast.
name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.45GB/s ± 0%  2.41GB/s ± 1%  -1.82%  (p=0.000 n=9+9)
puffs_adler32_100k/clang       2.45GB/s ± 0%  2.41GB/s ± 1%  -1.74%  (p=0.000 n=9+10)
puffs_flate_decode_1k/clang     133MB/s ± 0%   136MB/s ± 2%  +1.93%  (p=0.003 n=9+9)
puffs_flate_decode_10k/clang    181MB/s ± 0%   172MB/s ± 0%  -5.18%  (p=0.000 n=9+8)
puffs_flate_decode_100k/clang   204MB/s ± 0%   206MB/s ± 0%  +0.63%  (p=0.000 n=10+8)
puffs_zlib_decode_10k/clang     168MB/s ± 0%   160MB/s ± 1%  -4.82%  (p=0.000 n=10+9)
puffs_zlib_decode_100k/clang    189MB/s ± 0%   189MB/s ± 1%    ~     (p=0.143 n=10+10)

puffs_adler32_10k/gcc          3.26GB/s ± 0%  3.27GB/s ± 0%  +0.12%  (p=0.000 n=10+8)
puffs_adler32_100k/gcc         3.27GB/s ± 0%  3.27GB/s ± 0%  +0.18%  (p=0.000 n=10+8)
puffs_flate_decode_1k/gcc       130MB/s ± 0%   141MB/s ± 1%  +8.71%  (p=0.000 n=10+9)
puffs_flate_decode_10k/gcc      203MB/s ± 0%   200MB/s ± 0%  -1.72%  (p=0.000 n=9+10)
puffs_flate_decode_100k/gcc     241MB/s ± 0%   242MB/s ± 0%  +0.54%  (p=0.000 n=8+9)
puffs_zlib_decode_10k/gcc       188MB/s ± 0%   188MB/s ± 0%  +0.26%  (p=0.000 n=9+10)
puffs_zlib_decode_100k/gcc      223MB/s ± 0%   225MB/s ± 0%  +0.93%  (p=0.000 n=9+8)
2017-11-06 15:25:19 +11:00
Nigel Tao ccdd74a17f Remove some suspensions from decode_huffman_fast.
name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.45GB/s ± 0%  2.45GB/s ± 0%   -0.08%  (p=0.006 n=10+9)
puffs_adler32_100k/clang       2.46GB/s ± 0%  2.45GB/s ± 0%   -0.12%  (p=0.000 n=10+9)
puffs_flate_decode_1k/clang     137MB/s ± 0%   133MB/s ± 0%   -2.71%  (p=0.000 n=9+9)
puffs_flate_decode_10k/clang    177MB/s ± 0%   181MB/s ± 0%   +2.22%  (p=0.000 n=10+9)
puffs_flate_decode_100k/clang   198MB/s ± 0%   204MB/s ± 0%   +3.04%  (p=0.000 n=10+10)
puffs_zlib_decode_10k/clang     163MB/s ± 0%   168MB/s ± 0%   +3.23%  (p=0.000 n=9+10)
puffs_zlib_decode_100k/clang    182MB/s ± 0%   189MB/s ± 0%   +3.56%  (p=0.000 n=9+10)

puffs_adler32_10k/gcc          3.26GB/s ± 0%  3.26GB/s ± 0%     ~     (p=0.280 n=10+10)
puffs_adler32_100k/gcc         3.27GB/s ± 0%  3.27GB/s ± 0%     ~     (p=0.075 n=10+10)
puffs_flate_decode_1k/gcc       111MB/s ± 1%   130MB/s ± 0%  +17.19%  (p=0.000 n=10+10)
puffs_flate_decode_10k/gcc      142MB/s ± 0%   203MB/s ± 0%  +43.11%  (p=0.000 n=10+9)
puffs_flate_decode_100k/gcc     153MB/s ± 0%   241MB/s ± 0%  +57.62%  (p=0.000 n=9+8)
puffs_zlib_decode_10k/gcc       142MB/s ± 0%   188MB/s ± 0%  +32.47%  (p=0.000 n=9+9)
puffs_zlib_decode_100k/gcc      149MB/s ± 0%   223MB/s ± 0%  +50.03%  (p=0.000 n=8+9)
2017-11-06 14:03:11 +11:00
Nigel Tao bf50d268ae Remove some suspensions from decode_huffman_fast.
name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.40GB/s ± 3%  2.45GB/s ± 0%   +2.21%  (p=0.000 n=10+10)
puffs_adler32_100k/clang       2.41GB/s ± 1%  2.46GB/s ± 0%   +2.05%  (p=0.000 n=9+10)
puffs_flate_decode_1k/clang     127MB/s ± 1%   137MB/s ± 0%   +7.94%  (p=0.000 n=9+9)
puffs_flate_decode_10k/clang    177MB/s ± 1%   177MB/s ± 0%     ~     (p=0.234 n=9+10)
puffs_flate_decode_100k/clang   205MB/s ± 1%   198MB/s ± 0%   -3.06%  (p=0.000 n=9+10)
puffs_zlib_decode_10k/clang     165MB/s ± 1%   163MB/s ± 0%   -1.12%  (p=0.000 n=9+9)
puffs_zlib_decode_100k/clang    189MB/s ± 0%   182MB/s ± 0%   -3.42%  (p=0.000 n=9+9)

puffs_adler32_10k/gcc          3.26GB/s ± 0%  3.26GB/s ± 0%     ~     (p=0.065 n=9+10)
puffs_adler32_100k/gcc         3.27GB/s ± 0%  3.27GB/s ± 0%     ~     (p=0.173 n=8+10)
puffs_flate_decode_1k/gcc       111MB/s ± 0%   111MB/s ± 1%     ~     (p=0.971 n=10+10)
puffs_flate_decode_10k/gcc      149MB/s ± 0%   142MB/s ± 0%   -4.67%  (p=0.000 n=9+10)
puffs_flate_decode_100k/gcc     160MB/s ± 0%   153MB/s ± 0%   -4.46%  (p=0.000 n=9+9)
puffs_zlib_decode_10k/gcc       128MB/s ± 0%   142MB/s ± 0%  +11.21%  (p=0.000 n=9+9)
puffs_zlib_decode_100k/gcc      137MB/s ± 0%   149MB/s ± 0%   +8.47%  (p=0.000 n=8+8)
2017-11-06 08:31:03 +11:00
Nigel Tao 5520340d7c Remove some suspensions from decode_huffman_fast.
name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.45GB/s ± 2%  2.40GB/s ± 3%   -1.87%  (p=0.001 n=9+10)
puffs_adler32_100k/clang       2.46GB/s ± 0%  2.41GB/s ± 1%   -2.08%  (p=0.000 n=8+9)
puffs_flate_decode_1k/clang     125MB/s ± 0%   127MB/s ± 1%   +1.53%  (p=0.000 n=9+9)
puffs_flate_decode_10k/clang    168MB/s ± 0%   177MB/s ± 1%   +5.59%  (p=0.000 n=10+9)
puffs_flate_decode_100k/clang   193MB/s ± 0%   205MB/s ± 1%   +6.20%  (p=0.000 n=9+9)
puffs_zlib_decode_10k/clang     157MB/s ± 0%   165MB/s ± 1%   +5.00%  (p=0.000 n=9+9)
puffs_zlib_decode_100k/clang    179MB/s ± 0%   189MB/s ± 0%   +5.69%  (p=0.000 n=8+9)

puffs_adler32_10k/gcc          3.26GB/s ± 0%  3.26GB/s ± 0%   -0.14%  (p=0.000 n=10+9)
puffs_adler32_100k/gcc         3.27GB/s ± 0%  3.27GB/s ± 0%   -0.09%  (p=0.000 n=9+8)
puffs_flate_decode_1k/gcc       122MB/s ± 0%   111MB/s ± 0%   -9.40%  (p=0.000 n=10+10)
puffs_flate_decode_10k/gcc      176MB/s ± 0%   149MB/s ± 0%  -15.45%  (p=0.000 n=10+9)
puffs_flate_decode_100k/gcc     199MB/s ± 0%   160MB/s ± 0%  -19.51%  (p=0.000 n=10+9)
puffs_zlib_decode_10k/gcc       168MB/s ± 0%   128MB/s ± 0%  -24.01%  (p=0.000 n=10+9)
puffs_zlib_decode_100k/gcc      187MB/s ± 0%   137MB/s ± 0%  -26.84%  (p=0.000 n=9+8)
2017-11-05 23:02:19 +11:00
Nigel Tao e7c14dfe63 Remove some suspensions from decode_huffman_fast.
name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.46GB/s ± 0%  2.45GB/s ± 2%     ~     (p=0.352 n=9+9)
puffs_adler32_100k/clang       2.46GB/s ± 0%  2.46GB/s ± 0%     ~     (p=0.673 n=9+8)
puffs_flate_decode_1k/clang     124MB/s ± 0%   125MB/s ± 0%   +0.39%  (p=0.000 n=8+9)
puffs_flate_decode_10k/clang    165MB/s ± 0%   168MB/s ± 0%   +1.81%  (p=0.000 n=8+10)
puffs_flate_decode_100k/clang   195MB/s ± 0%   193MB/s ± 0%   -1.30%  (p=0.000 n=9+9)
puffs_zlib_decode_10k/clang     154MB/s ± 1%   157MB/s ± 0%   +1.96%  (p=0.000 n=9+9)
puffs_zlib_decode_100k/clang    181MB/s ± 0%   179MB/s ± 0%   -1.19%  (p=0.000 n=10+8)

puffs_adler32_10k/gcc          3.26GB/s ± 0%  3.26GB/s ± 0%     ~     (p=0.549 n=9+10)
puffs_adler32_100k/gcc         3.27GB/s ± 0%  3.27GB/s ± 0%     ~     (p=0.450 n=9+9)
puffs_flate_decode_1k/gcc       112MB/s ± 0%   122MB/s ± 0%   +9.10%  (p=0.000 n=10+10)
puffs_flate_decode_10k/gcc      155MB/s ± 0%   176MB/s ± 0%  +13.63%  (p=0.000 n=10+10)
puffs_flate_decode_100k/gcc     176MB/s ± 0%   199MB/s ± 0%  +12.74%  (p=0.000 n=9+10)
puffs_zlib_decode_10k/gcc       137MB/s ± 0%   168MB/s ± 0%  +22.54%  (p=0.000 n=9+10)
puffs_zlib_decode_100k/gcc      158MB/s ± 0%   187MB/s ± 0%  +18.87%  (p=0.000 n=9+9)
2017-11-05 22:40:18 +11:00
Nigel Tao 934705a6e1 Remove some suspensions from decode_huffman_fast.
name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.46GB/s ± 0%  2.46GB/s ± 0%     ~     (p=0.243 n=10+9)
puffs_adler32_100k/clang       2.46GB/s ± 0%  2.46GB/s ± 0%   +0.07%  (p=0.002 n=10+9)
puffs_flate_decode_1k/clang     125MB/s ± 0%   124MB/s ± 0%   -0.58%  (p=0.000 n=10+8)
puffs_flate_decode_10k/clang    168MB/s ± 0%   165MB/s ± 0%   -2.07%  (p=0.000 n=9+8)
puffs_flate_decode_100k/clang   203MB/s ± 0%   195MB/s ± 0%   -3.85%  (p=0.000 n=9+9)
puffs_zlib_decode_10k/clang     157MB/s ± 0%   154MB/s ± 1%   -2.07%  (p=0.000 n=9+9)
puffs_zlib_decode_100k/clang    187MB/s ± 0%   181MB/s ± 0%   -3.50%  (p=0.000 n=10+10)

puffs_adler32_10k/gcc          3.20GB/s ± 1%  3.26GB/s ± 0%   +2.07%  (p=0.000 n=10+9)
puffs_adler32_100k/gcc         3.21GB/s ± 1%  3.27GB/s ± 0%   +1.71%  (p=0.000 n=9+9)
puffs_flate_decode_1k/gcc       128MB/s ± 2%   112MB/s ± 0%  -12.35%  (p=0.000 n=10+10)
puffs_flate_decode_10k/gcc      181MB/s ± 1%   155MB/s ± 0%  -14.07%  (p=0.000 n=10+10)
puffs_flate_decode_100k/gcc     208MB/s ± 0%   176MB/s ± 0%  -15.23%  (p=0.000 n=9+9)
puffs_zlib_decode_10k/gcc       172MB/s ± 1%   137MB/s ± 0%  -20.14%  (p=0.000 n=10+9)
puffs_zlib_decode_100k/gcc      195MB/s ± 1%   158MB/s ± 0%  -18.97%  (p=0.000 n=10+9)
2017-11-05 21:59:59 +11:00
Nigel Tao 44323f95ad Remove some suspensions from decode_huffman_fast.
name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.46GB/s ± 0%  2.46GB/s ± 0%    ~     (p=0.968 n=9+10)
puffs_adler32_100k/clang       2.46GB/s ± 0%  2.46GB/s ± 0%    ~     (p=0.579 n=10+10)
puffs_flate_decode_1k/clang     132MB/s ± 0%   125MB/s ± 0%  -5.22%  (p=0.000 n=10+10)
puffs_flate_decode_10k/clang    167MB/s ± 0%   168MB/s ± 0%  +0.80%  (p=0.000 n=8+9)
puffs_flate_decode_100k/clang   205MB/s ± 0%   203MB/s ± 0%  -0.91%  (p=0.000 n=9+9)
puffs_zlib_decode_10k/clang     156MB/s ± 0%   157MB/s ± 0%  +0.91%  (p=0.000 n=9+9)
puffs_zlib_decode_100k/clang    189MB/s ± 0%   187MB/s ± 0%  -0.92%  (p=0.000 n=8+10)

puffs_adler32_10k/gcc          3.18GB/s ± 3%  3.20GB/s ± 1%    ~     (p=0.796 n=10+10)
puffs_adler32_100k/gcc         3.22GB/s ± 1%  3.21GB/s ± 1%    ~     (p=0.730 n=9+9)
puffs_flate_decode_1k/gcc       125MB/s ± 1%   128MB/s ± 2%  +2.20%  (p=0.000 n=9+10)
puffs_flate_decode_10k/gcc      177MB/s ± 1%   181MB/s ± 1%  +1.82%  (p=0.000 n=9+10)
puffs_flate_decode_100k/gcc     203MB/s ± 1%   208MB/s ± 0%  +2.67%  (p=0.000 n=10+9)
puffs_zlib_decode_10k/gcc       168MB/s ± 0%   172MB/s ± 1%  +2.11%  (p=0.000 n=10+10)
puffs_zlib_decode_100k/gcc      190MB/s ± 1%   195MB/s ± 1%  +2.36%  (p=0.000 n=9+10)
2017-11-05 21:33:44 +11:00
Nigel Tao 7e33a2cc14 Remove some suspensions from decode_huffman_fast.
name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.39GB/s ± 1%  2.46GB/s ± 0%  +2.88%  (p=0.000 n=8+9)
puffs_adler32_100k/clang       2.40GB/s ± 1%  2.46GB/s ± 0%  +2.18%  (p=0.000 n=9+10)
puffs_flate_decode_1k/clang     129MB/s ± 4%   132MB/s ± 0%  +2.31%  (p=0.000 n=10+10)
puffs_flate_decode_10k/clang    164MB/s ± 1%   167MB/s ± 0%  +1.89%  (p=0.000 n=10+8)
puffs_flate_decode_100k/clang   194MB/s ± 1%   205MB/s ± 0%  +5.49%  (p=0.000 n=9+9)
puffs_zlib_decode_10k/clang     153MB/s ± 1%   156MB/s ± 0%  +1.73%  (p=0.000 n=9+9)
puffs_zlib_decode_100k/clang    180MB/s ± 1%   189MB/s ± 0%  +5.09%  (p=0.000 n=8+8)

puffs_adler32_10k/gcc          3.21GB/s ± 1%  3.18GB/s ± 3%    ~     (p=0.203 n=8+10)
puffs_adler32_100k/gcc         3.22GB/s ± 0%  3.22GB/s ± 1%    ~     (p=0.931 n=9+9)
puffs_flate_decode_1k/gcc       124MB/s ± 1%   125MB/s ± 1%  +1.41%  (p=0.001 n=9+9)
puffs_flate_decode_10k/gcc      179MB/s ± 1%   177MB/s ± 1%  -0.77%  (p=0.006 n=10+9)
puffs_flate_decode_100k/gcc     192MB/s ± 0%   203MB/s ± 1%  +5.57%  (p=0.000 n=10+10)
puffs_zlib_decode_10k/gcc       169MB/s ± 1%   168MB/s ± 0%  -0.45%  (p=0.011 n=10+10)
puffs_zlib_decode_100k/gcc      180MB/s ± 1%   190MB/s ± 1%  +5.37%  (p=0.000 n=10+9)
2017-11-05 21:11:24 +11:00
Nigel Tao 465b4e1815 Remove some suspensions from decode_huffman_fast.
name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.45GB/s ± 0%  2.39GB/s ± 1%   -2.74%  (p=0.000 n=10+8)
puffs_adler32_100k/clang       2.46GB/s ± 0%  2.40GB/s ± 1%   -2.13%  (p=0.000 n=10+9)
puffs_flate_decode_1k/clang     132MB/s ± 0%   129MB/s ± 4%   -2.25%  (p=0.000 n=10+10)
puffs_flate_decode_10k/clang    174MB/s ± 0%   164MB/s ± 1%   -5.78%  (p=0.000 n=10+10)
puffs_flate_decode_100k/clang   208MB/s ± 0%   194MB/s ± 1%   -6.45%  (p=0.000 n=10+9)
puffs_zlib_decode_10k/clang     162MB/s ± 0%   153MB/s ± 1%   -5.46%  (p=0.000 n=9+9)
puffs_zlib_decode_100k/clang    192MB/s ± 0%   180MB/s ± 1%   -6.02%  (p=0.000 n=9+8)

puffs_adler32_10k/gcc          3.26GB/s ± 0%  3.21GB/s ± 1%   -1.58%  (p=0.000 n=10+8)
puffs_adler32_100k/gcc         3.27GB/s ± 0%  3.22GB/s ± 0%   -1.42%  (p=0.000 n=8+9)
puffs_flate_decode_1k/gcc       106MB/s ± 0%   124MB/s ± 1%  +17.14%  (p=0.000 n=10+9)
puffs_flate_decode_10k/gcc      140MB/s ± 0%   179MB/s ± 1%  +27.45%  (p=0.000 n=9+10)
puffs_flate_decode_100k/gcc     150MB/s ± 0%   192MB/s ± 0%  +27.77%  (p=0.000 n=10+10)
puffs_zlib_decode_10k/gcc       120MB/s ± 0%   169MB/s ± 1%  +40.32%  (p=0.000 n=9+10)
puffs_zlib_decode_100k/gcc      134MB/s ± 0%   180MB/s ± 1%  +34.56%  (p=0.000 n=8+10)
2017-11-05 20:50:58 +11:00
Nigel Tao 73778b0767 Re-pack token keys' numeric values. 2017-11-05 20:07:30 +11:00
Nigel Tao 13731f989f Add a reader1.unread_u8 method.
Also re-enable a number of std/flate tests and benchmarks.

It's not an optimization per se, but as a data point, here are some
benchmark numbers between 36a93fa and this commit. 36a93fa is "36a93fa
Add a TODO about impure functions", which is one commit before "f968950
Read bits up front in decode_huffman_fast", and f968950 was the commit
that made decode_huffman_fast read more than one byte at a time.

name                             old speed      new speed       delta

puffs_adler32_10k/clang          2.45GB/s ± 0%   2.45GB/s ± 0%     ~     (p=0.684 n=10+10)
puffs_adler32_100k/clang         2.45GB/s ± 0%   2.46GB/s ± 0%   +0.07%  (p=0.019 n=10+10)
puffs_flate_decode_1k/clang       124MB/s ± 0%    132MB/s ± 0%   +6.06%  (p=0.000 n=10+10)
puffs_flate_decode_10k/clang      145MB/s ± 0%    174MB/s ± 0%  +20.19%  (p=0.000 n=9+10)
puffs_flate_decode_100k/clang     168MB/s ± 0%    208MB/s ± 0%  +23.31%  (p=0.000 n=10+10)
puffs_zlib_decode_10k/clang       136MB/s ± 0%    162MB/s ± 0%  +18.94%  (p=0.000 n=10+9)
puffs_zlib_decode_100k/clang      158MB/s ± 0%    192MB/s ± 0%  +21.58%  (p=0.000 n=10+9)

puffs_adler32_10k/gcc            3.26GB/s ± 0%   3.26GB/s ± 0%     ~     (p=0.631 n=10+10)
puffs_adler32_100k/gcc           3.27GB/s ± 0%   3.27GB/s ± 0%     ~     (p=0.237 n=10+8)
puffs_flate_decode_1k/gcc        95.3MB/s ± 0%  105.5MB/s ± 0%  +10.67%  (p=0.000 n=10+10)
puffs_flate_decode_10k/gcc        110MB/s ± 0%    140MB/s ± 0%  +27.32%  (p=0.000 n=9+9)
puffs_flate_decode_100k/gcc       121MB/s ± 0%    150MB/s ± 0%  +24.02%  (p=0.000 n=8+10)
puffs_zlib_decode_10k/gcc         112MB/s ± 0%    120MB/s ± 0%   +6.96%  (p=0.000 n=10+9)
puffs_zlib_decode_100k/gcc        123MB/s ± 0%    134MB/s ± 0%   +8.93%  (p=0.000 n=9+8)
2017-11-05 15:59:02 +11:00
Nigel Tao 6621526a2c Re-introduce codegen for b_wstart_dst. 2017-11-05 14:24:33 +11:00
Nigel Tao 586413dbd3 Run "go generate".
I previously forgot to do this after a trivial edit to the cgen package.
2017-11-05 14:21:02 +11:00
Nigel Tao 325c36314a Prepare decode_huffman_fast to rewind in.src. 2017-11-05 14:13:27 +11:00
Nigel Tao 3099991d7f Add an "invalid I/O operation" error code. 2017-11-05 13:53:35 +11:00
Nigel Tao b6a079fd3e Tweak the decode_huffman_fast loop condition more. 2017-11-05 13:47:28 +11:00
Nigel Tao f6e072fe77 Add some more "inconsistent n_bits" checks.
This uncovered a bug in the decode_huffman_fast function. A follow up commit
will actually fix the bug.

For what it's worth, some benchmark numbers are below, but they're
possibly bogus, as we might be decoding incorrect (and truncated) output
for some inputs. Everything since "f968950 Read bits up front in
decode_huffman_fast" landed possibly has bogus numbers too.

name                           old speed     new speed     delta
puffs_flate_decode_100k/clang  194MB/s ± 0%  204MB/s ± 1%   +5.02%  (p=0.008 n=5+5)
puffs_flate_decode_100k/gcc    180MB/s ± 3%  202MB/s ± 1%  +12.09%  (p=0.008 n=5+5)
2017-11-05 09:23:49 +11:00