Commit Graph
159 Commits
Author SHA1 Message Date
Nigel Tao 209178a2c6 Add a std/flate decode_blocks method. 2017-08-31 11:16:23 +10:00
Nigel Tao b328529e00 Remove unnecessary {}s. 2017-08-26 17:30:04 +10:00
Nigel Tao 018d8d1893 Don't have suspend state if we don't suspend. 2017-08-26 17:27:01 +10:00
Nigel Tao fdddcc8e1d Merge multiple puffs-xxx-c binaries into one. 2017-08-24 09:43:57 +10:00
Nigel Tao b3710e583f Add a zlib decoder to std/flate. 2017-08-05 16:34:03 +10:00
Nigel Tao 61c5b40bf6 Unroll the copy_history32 loop.
name                             old speed      new speed      delta
puffs_flate_decode_1k/clang       127MB/s ± 2%   140MB/s ± 0%  +10.13%  (p=0.000 n=83+95)
puffs_flate_decode_10k/clang      151MB/s ± 1%   166MB/s ± 0%  +10.38%  (p=0.000 n=82+97)
puffs_flate_decode_100k/clang     165MB/s ± 1%   177MB/s ± 0%   +7.42%  (p=0.000 n=89+94)
puffs_flate_decode_1k/gcc         155MB/s ± 2%   153MB/s ± 1%   -1.67%  (p=0.000 n=91+89)
puffs_flate_decode_10k/gcc        146MB/s ± 2%   147MB/s ± 0%   +0.41%  (p=0.000 n=86+83)
puffs_flate_decode_100k/gcc       166MB/s ± 1%   170MB/s ± 0%   +2.34%  (p=0.000 n=88+84)
2017-07-30 13:36:32 +10:00
Nigel Tao df8772dadf Remove hand-written edit to generated C code. 2017-07-30 11:30:32 +10:00
Nigel Tao 265d3a5a1a Add a hand-written C impl of decode_huffman.
This gives a rough upper bound on how fast Puffs' generated C code can
be, with a sufficiently smart Puffs compiler.

A comparison of the 'old', safe, generated C code and the 'new', unsafe,
hand-written C code:

name                           old speed     new speed     delta
puffs_flate_decode_1k/clang    127MB/s ± 2%  181MB/s ± 2%  +42.27%  (p=0.000 n=83+5)
puffs_flate_decode_10k/clang   151MB/s ± 1%  235MB/s ± 2%  +56.04%  (p=0.000 n=82+5)
puffs_flate_decode_100k/clang  165MB/s ± 1%  275MB/s ± 3%  +66.69%  (p=0.000 n=89+5)
puffs_flate_decode_1k/gcc      155MB/s ± 2%  181MB/s ± 1%  +16.96%  (p=0.000 n=91+5)
puffs_flate_decode_10k/gcc     146MB/s ± 2%  241MB/s ± 2%  +64.78%  (p=0.000 n=86+5)
puffs_flate_decode_100k/gcc    166MB/s ± 1%  277MB/s ± 3%  +66.78%  (p=0.000 n=88+5)

While we're discussing benchmark numbers, below is an overall snapshot.

std/flate

puffs_flate_decode_1k/clang       127MB/s ± 2%
puffs_flate_decode_10k/clang      151MB/s ± 1%
puffs_flate_decode_100k/clang     165MB/s ± 1%

puffs_flate_decode_1k/gcc         155MB/s ± 2%
puffs_flate_decode_10k/gcc        146MB/s ± 2%
puffs_flate_decode_100k/gcc       166MB/s ± 1%

mimic_adler32_10k                2.98GB/s ± 1%
mimic_adler32_100k               2.93GB/s ± 1%
mimic_crc32_10k                  1.38GB/s ± 1%
mimic_crc32_100k                 1.37GB/s ± 1%

mimic_flate_decode_1k             220MB/s ± 2%
mimic_flate_decode_10k            262MB/s ± 1%
mimic_flate_decode_100k           281MB/s ± 1%
mimic_gzip_decode_10k             221MB/s ± 1%
mimic_gzip_decode_100k            259MB/s ± 1%
mimic_zlib_decode_10k             242MB/s ± 2%
mimic_zlib_decode_100k            289MB/s ± 1%

std/gif

puffs_gif_lzw_decode_20k/clang    125MB/s ± 1%
puffs_gif_lzw_decode_100k/clang   173MB/s ± 1%
puffs_gif_decode_1k/clang         376MB/s ± 3%
puffs_gif_decode_10k/clang        128MB/s ± 2%
puffs_gif_decode_100k/clang       120MB/s ± 2%
puffs_gif_decode_1000k/clang      121MB/s ± 3%

puffs_gif_lzw_decode_20k/gcc      153MB/s ± 1%
puffs_gif_lzw_decode_100k/gcc     208MB/s ± 1%
puffs_gif_decode_1k/gcc           429MB/s ± 1%
puffs_gif_decode_10k/gcc          161MB/s ± 1%
puffs_gif_decode_100k/gcc         140MB/s ± 1%
puffs_gif_decode_1000k/gcc        143MB/s ± 1%

mimic_gif_decode_1k               158MB/s ± 1%
mimic_gif_decode_10k             93.9MB/s ± 1%
mimic_gif_decode_100k             100MB/s ± 1%
mimic_gif_decode_1000k            102MB/s ± 1%
2017-07-30 11:13:40 +10:00
Nigel Tao 7cf7829c9e Implement std/flate Huffman table redirects. 2017-07-29 16:25:00 +10:00
Nigel Tao 7fe783d785 Call memset instead of using an explicit loop. 2017-07-28 16:24:47 +10:00
Nigel Tao 23a4aeb7ce Turn some struct fields into local variables. 2017-07-28 16:12:45 +10:00
Nigel Tao 6b019831ad Check over- and under-subscribed Huffman codes. 2017-07-28 15:49:05 +10:00
Nigel Tao 3b5e858fea Add the printf prototype to generated C files. 2017-07-28 14:15:26 +10:00
Nigel Tao bfbcae4365 Decode std/flate fixed Huffman tables. 2017-07-28 13:28:31 +10:00
Nigel Tao d2aca16f3c Add a copy_history32 method. 2017-07-28 11:25:03 +10:00
Nigel Tao d7cb39b766 Decode base+extra length and distance pairs. 2017-07-28 09:57:39 +10:00
Nigel Tao 9e03aeabe0 Refactor std/flate's decoder.decode. 2017-07-28 09:04:34 +10:00
Nigel Tao 89d4f68036 Fill array-of-u32 Huffman table for base+extra. 2017-07-27 17:20:31 +10:00
Nigel Tao 67b95c01c3 Decode literals from the lcode Huffman table. 2017-07-27 15:32:05 +10:00
Nigel Tao be3b9b81e7 Generate the lcode and dcode Huffman tables. 2017-07-27 14:56:23 +10:00
Nigel Tao bf51551eda Have init_huff take a slice of the code_lengths. 2017-07-27 14:42:26 +10:00
Nigel Tao ea935e1f8c Use array-of-u32 Huffman decoder. 2017-07-27 14:18:32 +10:00
Nigel Tao e1be6d9582 Type and bounds check "x | y | z". 2017-07-27 13:07:10 +10:00
Nigel Tao eee67e083d Add array-of-u32 Huffman decoder. 2017-07-27 11:30:43 +10:00
Nigel Tao d4ab9caa33 Add table to reverse the bits in a byte. 2017-07-26 09:05:45 +10:00
Nigel Tao 69a3b5804f Remove the unnecessary huffman_decoder struct. 2017-07-26 09:04:14 +10:00
Nigel Tao e772352036 Decode the lcode and dcode code lengths. 2017-07-22 16:45:54 +10:00
Nigel Tao 389d9bc8bf Remove the placeholder code limit count. 2017-07-22 10:14:50 +10:00
Nigel Tao fd07fa1f27 Decode flate's clcode symbols. 2017-07-21 17:47:58 +10:00
Nigel Tao 74400247f2 Refactor std/flate's decoder.decode_dynamic. 2017-07-21 16:16:09 +10:00
Nigel Tao f7fb991619 Implement init_huffman. 2017-07-21 15:55:49 +10:00
Nigel Tao 02cd837d9d Add a huffman_decoder.consts field. 2017-07-21 11:48:15 +10:00
Nigel Tao 34198f3de5 Start the init_huffman implementation. 2017-07-21 11:00:56 +10:00
Nigel Tao 65c4efbe8b Add a placeholder huffman_decoder struct. 2017-07-21 10:14:59 +10:00
Nigel Tao 4b7a350a68 Rename the code_length_code_lengths field. 2017-07-21 10:09:44 +10:00
Nigel Tao 50e091f976 Fix some std/flate visibilities: s/pub/pri/. 2017-07-16 19:28:45 +10:00
Nigel Tao fe7e6ed10e Handle suspending inside a skip32 call. 2017-07-16 19:28:09 +10:00
Nigel Tao fa18eec3e9 Fix returning limited vs short read. 2017-07-16 19:26:58 +10:00
Nigel Tao bd6d2ea3a1 Handle decoding a GIF in many short reads. 2017-07-16 19:25:49 +10:00
Nigel Tao a0c772f617 Improve the check for LIMITED_READ vs SHORT_READ. 2017-07-16 19:24:16 +10:00
Nigel Tao 5eb9bce5f7 Add limited read/write status codes. 2017-07-16 15:51:45 +10:00
Nigel Tao 21bb96d756 Refactor short read status code calculations. 2017-07-16 15:21:27 +10:00
Nigel Tao e1fa0e8a34 Don't save local vars if we're not suspending. 2017-07-16 15:04:03 +10:00
Nigel Tao fc2a295354 Save derived vars (I/O pointers) even on error. 2017-07-16 15:01:23 +10:00
Nigel Tao 7b3628d78f Be more consistent with pub/pri error handling. 2017-07-16 14:57:46 +10:00
Nigel Tao 20f37a6dab Decode flate code length code lengths. 2017-07-16 12:51:44 +10:00
Nigel Tao b78807d60a Add the "const" keyword. 2017-07-16 12:02:12 +10:00
Nigel Tao 04a41987f0 Add some undescores to generated C error names. 2017-07-14 16:40:59 +10:00
Nigel Tao 7b7dca4767 Start a flate decoder.decode_dynamic method. 2017-07-14 16:36:51 +10:00
Nigel Tao 368bd5e4f7 Add a read_u32le method. 2017-07-13 16:20:59 +10:00