Commit Graph
456 Commits
Author SHA1 Message Date
Nigel Tao 2fb9972bb9 Add a slice.suffix method. 2017-09-22 14:12:54 +10:00
Nigel Tao 51f2b183a2 Add a slice.length method. 2017-09-22 12:37:07 +10:00
Nigel Tao fda696bf95 Add PUFFS_IGNORE_POTENTIALLY_UNUSED_VARIABLE. 2017-09-22 12:00:14 +10:00
Nigel Tao 18e32d61e5 Add a writer1.slice method. 2017-09-22 11:54:24 +10:00
Nigel Tao 519ec373f2 First cut at a "[] u8" slice type. 2017-09-08 16:53:59 +10:00
Nigel Tao ceedd8c3b9 Add some more docs on related work. 2017-09-07 16:55:45 +10:00
Nigel Tao 1180498f72 Factor out cgen/{statement,var}.go. 2017-09-02 10:03:59 +10:00
Nigel Tao dd12b469a3 Factor out cgen/expr.go. 2017-09-02 09:54:31 +10:00
Nigel Tao 0f86add17e Add a status.is_suspension method. 2017-09-02 09:40:39 +10:00
Nigel Tao 935cd73686 Add a "status" type and "try" keyword. 2017-09-01 16:41:42 +10:00
Nigel Tao 363dcbe714 Make the scratch field per-func, not per-struct. 2017-09-01 14:10:47 +10:00
Nigel Tao 209178a2c6 Add a std/flate decode_blocks method. 2017-08-31 11:16:23 +10:00
Nigel Tao b328529e00 Remove unnecessary {}s. 2017-08-26 17:30:04 +10:00
Nigel Tao 018d8d1893 Don't have suspend state if we don't suspend. 2017-08-26 17:27:01 +10:00
Nigel Tao a8423cee70 Refactor the jumpTarget method. 2017-08-26 17:16:23 +10:00
Nigel Tao 6937d7f815 Use multiple cgen buffers per function. 2017-08-26 17:15:16 +10:00
Nigel Tao 7faed8d7fd Rename the perFunc.funk field. 2017-08-26 16:55:27 +10:00
Nigel Tao c7fe1fd8c1 Allow multiple cgen buffers. 2017-08-26 16:51:53 +10:00
Nigel Tao f839603198 Rename a 'b' variable. 2017-08-26 15:07:21 +10:00
Nigel Tao f3970d6670 Add cgen templates. 2017-08-26 12:52:25 +10:00
Nigel Tao 38bfebf204 Don't have "puffs gen" run type checking twice.
"puffs-c gen" already runs type checking, as type information is needed
for code generation. Accordingly, there's no need for "puffs gen" to
also run type checking beforehand.
2017-08-26 11:14:05 +10:00
Nigel Tao 218e22be35 Refactor the top-level README.md. 2017-08-25 16:16:25 +10:00
Nigel Tao fdddcc8e1d Merge multiple puffs-xxx-c binaries into one. 2017-08-24 09:43:57 +10:00
Nigel Tao 7ccefa1b40 Factor out doc/benchmarks.md. 2017-08-10 16:48:48 +10:00
Nigel Tao 8488ab0d86 Add a "puffs genlib" command. 2017-08-10 16:48:14 +10:00
Nigel Tao b3710e583f Add a zlib decoder to std/flate. 2017-08-05 16:34:03 +10:00
Nigel Tao 2e6b364dcc Do 8- instead of 1-byte back-copies.
name                           old speed     new speed     delta
puffs_flate_decode_1k/clang    191MB/s ± 1%  171MB/s ±12%     ~     (p=0.095 n=5+5)
puffs_flate_decode_10k/clang   277MB/s ± 1%  325MB/s ± 7%  +17.47%  (p=0.008 n=5+5)
puffs_flate_decode_100k/clang  315MB/s ± 1%  416MB/s ± 1%  +31.88%  (p=0.008 n=5+5)
puffs_flate_decode_1k/gcc      194MB/s ± 2%  197MB/s ± 0%   +1.98%  (p=0.016 n=5+4)
puffs_flate_decode_10k/gcc     279MB/s ± 1%  361MB/s ± 1%  +29.19%  (p=0.016 n=4+5)
puffs_flate_decode_100k/gcc    315MB/s ± 0%  437MB/s ± 0%  +38.77%  (p=0.008 n=5+5)

Note that these are benchmark numbers for an 'ideal', hand-written C
implementation, not for Puffs' generated C code.
2017-08-03 17:45:47 +10:00
Nigel Tao c3aa366c66 Clean up #ifdef style; remove unnecessary ()s. 2017-08-03 11:05:33 +10:00
Nigel Tao 6af3852fa8 Change the back-copy unroll count from 8 to 3.
We're possibly overfitting now on the very small benchmark corpus (3
files), but we can test on larger corpuses later. Algorithmically, it
does match what zlib does.

name                           old speed     new speed     delta
puffs_flate_decode_1k/clang    188MB/s ± 0%  191MB/s ± 1%   +1.55%  (p=0.008 n=5+5)
puffs_flate_decode_10k/clang   242MB/s ± 2%  277MB/s ± 1%  +14.72%  (p=0.008 n=5+5)
puffs_flate_decode_100k/clang  273MB/s ± 1%  315MB/s ± 1%  +15.63%  (p=0.008 n=5+5)
puffs_flate_decode_1k/gcc      187MB/s ± 0%  194MB/s ± 2%   +3.56%  (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc     242MB/s ± 0%  279MB/s ± 1%  +15.29%  (p=0.016 n=5+4)
puffs_flate_decode_100k/gcc    288MB/s ± 1%  315MB/s ± 0%   +9.29%  (p=0.008 n=5+5)

Note that these are benchmark numbers for an 'ideal', hand-written C
implementation, not for Puffs' generated C code.
2017-08-03 10:53:41 +10:00
Nigel Tao fa89c397b0 Do one 8-byte load instead of six 1-byte loads.
name                           old speed     new speed     delta
puffs_flate_decode_1k/clang    178MB/s ± 2%  188MB/s ± 0%  +5.98%  (p=0.008 n=5+5)
puffs_flate_decode_10k/clang   235MB/s ± 1%  242MB/s ± 2%  +2.69%  (p=0.032 n=5+5)
puffs_flate_decode_100k/clang  274MB/s ± 0%  273MB/s ± 1%    ~     (p=0.690 n=5+5)
puffs_flate_decode_1k/gcc      177MB/s ± 0%  187MB/s ± 0%  +5.44%  (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc     234MB/s ± 0%  242MB/s ± 0%  +3.64%  (p=0.008 n=5+5)
puffs_flate_decode_100k/gcc    275MB/s ± 0%  288MB/s ± 1%  +4.68%  (p=0.008 n=5+5)

Note that these are benchmark numbers for an 'ideal', hand-written C
implementation, not for Puffs' generated C code.
2017-08-03 10:47:44 +10:00
Nigel Tao bc92bf4ff8 Fix C decode_huffman's exit with excess high bits. 2017-08-03 10:34:37 +10:00
Nigel Tao 61c5b40bf6 Unroll the copy_history32 loop.
name                             old speed      new speed      delta
puffs_flate_decode_1k/clang       127MB/s ± 2%   140MB/s ± 0%  +10.13%  (p=0.000 n=83+95)
puffs_flate_decode_10k/clang      151MB/s ± 1%   166MB/s ± 0%  +10.38%  (p=0.000 n=82+97)
puffs_flate_decode_100k/clang     165MB/s ± 1%   177MB/s ± 0%   +7.42%  (p=0.000 n=89+94)
puffs_flate_decode_1k/gcc         155MB/s ± 2%   153MB/s ± 1%   -1.67%  (p=0.000 n=91+89)
puffs_flate_decode_10k/gcc        146MB/s ± 2%   147MB/s ± 0%   +0.41%  (p=0.000 n=86+83)
puffs_flate_decode_100k/gcc       166MB/s ± 1%   170MB/s ± 0%   +2.34%  (p=0.000 n=88+84)
2017-07-30 13:36:32 +10:00
Nigel Tao df8772dadf Remove hand-written edit to generated C code. 2017-07-30 11:30:32 +10:00
Nigel Tao 265d3a5a1a Add a hand-written C impl of decode_huffman.
This gives a rough upper bound on how fast Puffs' generated C code can
be, with a sufficiently smart Puffs compiler.

A comparison of the 'old', safe, generated C code and the 'new', unsafe,
hand-written C code:

name                           old speed     new speed     delta
puffs_flate_decode_1k/clang    127MB/s ± 2%  181MB/s ± 2%  +42.27%  (p=0.000 n=83+5)
puffs_flate_decode_10k/clang   151MB/s ± 1%  235MB/s ± 2%  +56.04%  (p=0.000 n=82+5)
puffs_flate_decode_100k/clang  165MB/s ± 1%  275MB/s ± 3%  +66.69%  (p=0.000 n=89+5)
puffs_flate_decode_1k/gcc      155MB/s ± 2%  181MB/s ± 1%  +16.96%  (p=0.000 n=91+5)
puffs_flate_decode_10k/gcc     146MB/s ± 2%  241MB/s ± 2%  +64.78%  (p=0.000 n=86+5)
puffs_flate_decode_100k/gcc    166MB/s ± 1%  277MB/s ± 3%  +66.78%  (p=0.000 n=88+5)

While we're discussing benchmark numbers, below is an overall snapshot.

std/flate

puffs_flate_decode_1k/clang       127MB/s ± 2%
puffs_flate_decode_10k/clang      151MB/s ± 1%
puffs_flate_decode_100k/clang     165MB/s ± 1%

puffs_flate_decode_1k/gcc         155MB/s ± 2%
puffs_flate_decode_10k/gcc        146MB/s ± 2%
puffs_flate_decode_100k/gcc       166MB/s ± 1%

mimic_adler32_10k                2.98GB/s ± 1%
mimic_adler32_100k               2.93GB/s ± 1%
mimic_crc32_10k                  1.38GB/s ± 1%
mimic_crc32_100k                 1.37GB/s ± 1%

mimic_flate_decode_1k             220MB/s ± 2%
mimic_flate_decode_10k            262MB/s ± 1%
mimic_flate_decode_100k           281MB/s ± 1%
mimic_gzip_decode_10k             221MB/s ± 1%
mimic_gzip_decode_100k            259MB/s ± 1%
mimic_zlib_decode_10k             242MB/s ± 2%
mimic_zlib_decode_100k            289MB/s ± 1%

std/gif

puffs_gif_lzw_decode_20k/clang    125MB/s ± 1%
puffs_gif_lzw_decode_100k/clang   173MB/s ± 1%
puffs_gif_decode_1k/clang         376MB/s ± 3%
puffs_gif_decode_10k/clang        128MB/s ± 2%
puffs_gif_decode_100k/clang       120MB/s ± 2%
puffs_gif_decode_1000k/clang      121MB/s ± 3%

puffs_gif_lzw_decode_20k/gcc      153MB/s ± 1%
puffs_gif_lzw_decode_100k/gcc     208MB/s ± 1%
puffs_gif_decode_1k/gcc           429MB/s ± 1%
puffs_gif_decode_10k/gcc          161MB/s ± 1%
puffs_gif_decode_100k/gcc         140MB/s ± 1%
puffs_gif_decode_1000k/gcc        143MB/s ± 1%

mimic_gif_decode_1k               158MB/s ± 1%
mimic_gif_decode_10k             93.9MB/s ± 1%
mimic_gif_decode_100k             100MB/s ± 1%
mimic_gif_decode_1000k            102MB/s ± 1%
2017-07-30 11:13:40 +10:00
Nigel Tao e0f87fb2a7 Add a -reps=N flag to "puffs bench". 2017-07-30 08:27:52 +10:00
Nigel Tao 0a45eee9d0 Fix some comment grammar. 2017-07-29 17:24:01 +10:00
Nigel Tao 7cf7829c9e Implement std/flate Huffman table redirects. 2017-07-29 16:25:00 +10:00
Nigel Tao 7fe783d785 Call memset instead of using an explicit loop. 2017-07-28 16:24:47 +10:00
Nigel Tao 23a4aeb7ce Turn some struct fields into local variables. 2017-07-28 16:12:45 +10:00
Nigel Tao 3a8106daa5 Refactor std/flate comments. 2017-07-28 16:03:26 +10:00
Nigel Tao 6b019831ad Check over- and under-subscribed Huffman codes. 2017-07-28 15:49:05 +10:00
Nigel Tao 3b5e858fea Add the printf prototype to generated C files. 2017-07-28 14:15:26 +10:00
Nigel Tao bfbcae4365 Decode std/flate fixed Huffman tables. 2017-07-28 13:28:31 +10:00
Nigel Tao cbcf1b6025 Remove test_puffs_flate_work_in_progress. 2017-07-28 11:33:48 +10:00
Nigel Tao d2aca16f3c Add a copy_history32 method. 2017-07-28 11:25:03 +10:00
Nigel Tao d7cb39b766 Decode base+extra length and distance pairs. 2017-07-28 09:57:39 +10:00
Nigel Tao 9e03aeabe0 Refactor std/flate's decoder.decode. 2017-07-28 09:04:34 +10:00
Nigel Tao 89d4f68036 Fill array-of-u32 Huffman table for base+extra. 2017-07-27 17:20:31 +10:00
Nigel Tao 6387834cfb Consistently use 0x89AB style for hex constants. 2017-07-27 16:16:45 +10:00
Nigel Tao 67b95c01c3 Decode literals from the lcode Huffman table. 2017-07-27 15:32:05 +10:00