Commit Graph
169 Commits
Author SHA1 Message Date
Nigel Tao ed8a91ef51 Add an array.copy_from method. 2017-09-22 16:32:11 +10:00
Nigel Tao b14bafa717 Make puffs_u16be etc functions, not macros. 2017-09-22 14:41:08 +10:00
Nigel Tao 2fb9972bb9 Add a slice.suffix method. 2017-09-22 14:12:54 +10:00
Nigel Tao 51f2b183a2 Add a slice.length method. 2017-09-22 12:37:07 +10:00
Nigel Tao fda696bf95 Add PUFFS_IGNORE_POTENTIALLY_UNUSED_VARIABLE. 2017-09-22 12:00:14 +10:00
Nigel Tao 18e32d61e5 Add a writer1.slice method. 2017-09-22 11:54:24 +10:00
Nigel Tao 519ec373f2 First cut at a "[] u8" slice type. 2017-09-08 16:53:59 +10:00
Nigel Tao 0f86add17e Add a status.is_suspension method. 2017-09-02 09:40:39 +10:00
Nigel Tao 935cd73686 Add a "status" type and "try" keyword. 2017-09-01 16:41:42 +10:00
Nigel Tao 363dcbe714 Make the scratch field per-func, not per-struct. 2017-09-01 14:10:47 +10:00
Nigel Tao 209178a2c6 Add a std/flate decode_blocks method. 2017-08-31 11:16:23 +10:00
Nigel Tao b328529e00 Remove unnecessary {}s. 2017-08-26 17:30:04 +10:00
Nigel Tao 018d8d1893 Don't have suspend state if we don't suspend. 2017-08-26 17:27:01 +10:00
Nigel Tao fdddcc8e1d Merge multiple puffs-xxx-c binaries into one. 2017-08-24 09:43:57 +10:00
Nigel Tao b3710e583f Add a zlib decoder to std/flate. 2017-08-05 16:34:03 +10:00
Nigel Tao 61c5b40bf6 Unroll the copy_history32 loop.
name                             old speed      new speed      delta
puffs_flate_decode_1k/clang       127MB/s ± 2%   140MB/s ± 0%  +10.13%  (p=0.000 n=83+95)
puffs_flate_decode_10k/clang      151MB/s ± 1%   166MB/s ± 0%  +10.38%  (p=0.000 n=82+97)
puffs_flate_decode_100k/clang     165MB/s ± 1%   177MB/s ± 0%   +7.42%  (p=0.000 n=89+94)
puffs_flate_decode_1k/gcc         155MB/s ± 2%   153MB/s ± 1%   -1.67%  (p=0.000 n=91+89)
puffs_flate_decode_10k/gcc        146MB/s ± 2%   147MB/s ± 0%   +0.41%  (p=0.000 n=86+83)
puffs_flate_decode_100k/gcc       166MB/s ± 1%   170MB/s ± 0%   +2.34%  (p=0.000 n=88+84)
2017-07-30 13:36:32 +10:00
Nigel Tao df8772dadf Remove hand-written edit to generated C code. 2017-07-30 11:30:32 +10:00
Nigel Tao 265d3a5a1a Add a hand-written C impl of decode_huffman.
This gives a rough upper bound on how fast Puffs' generated C code can
be, with a sufficiently smart Puffs compiler.

A comparison of the 'old', safe, generated C code and the 'new', unsafe,
hand-written C code:

name                           old speed     new speed     delta
puffs_flate_decode_1k/clang    127MB/s ± 2%  181MB/s ± 2%  +42.27%  (p=0.000 n=83+5)
puffs_flate_decode_10k/clang   151MB/s ± 1%  235MB/s ± 2%  +56.04%  (p=0.000 n=82+5)
puffs_flate_decode_100k/clang  165MB/s ± 1%  275MB/s ± 3%  +66.69%  (p=0.000 n=89+5)
puffs_flate_decode_1k/gcc      155MB/s ± 2%  181MB/s ± 1%  +16.96%  (p=0.000 n=91+5)
puffs_flate_decode_10k/gcc     146MB/s ± 2%  241MB/s ± 2%  +64.78%  (p=0.000 n=86+5)
puffs_flate_decode_100k/gcc    166MB/s ± 1%  277MB/s ± 3%  +66.78%  (p=0.000 n=88+5)

While we're discussing benchmark numbers, below is an overall snapshot.

std/flate

puffs_flate_decode_1k/clang       127MB/s ± 2%
puffs_flate_decode_10k/clang      151MB/s ± 1%
puffs_flate_decode_100k/clang     165MB/s ± 1%

puffs_flate_decode_1k/gcc         155MB/s ± 2%
puffs_flate_decode_10k/gcc        146MB/s ± 2%
puffs_flate_decode_100k/gcc       166MB/s ± 1%

mimic_adler32_10k                2.98GB/s ± 1%
mimic_adler32_100k               2.93GB/s ± 1%
mimic_crc32_10k                  1.38GB/s ± 1%
mimic_crc32_100k                 1.37GB/s ± 1%

mimic_flate_decode_1k             220MB/s ± 2%
mimic_flate_decode_10k            262MB/s ± 1%
mimic_flate_decode_100k           281MB/s ± 1%
mimic_gzip_decode_10k             221MB/s ± 1%
mimic_gzip_decode_100k            259MB/s ± 1%
mimic_zlib_decode_10k             242MB/s ± 2%
mimic_zlib_decode_100k            289MB/s ± 1%

std/gif

puffs_gif_lzw_decode_20k/clang    125MB/s ± 1%
puffs_gif_lzw_decode_100k/clang   173MB/s ± 1%
puffs_gif_decode_1k/clang         376MB/s ± 3%
puffs_gif_decode_10k/clang        128MB/s ± 2%
puffs_gif_decode_100k/clang       120MB/s ± 2%
puffs_gif_decode_1000k/clang      121MB/s ± 3%

puffs_gif_lzw_decode_20k/gcc      153MB/s ± 1%
puffs_gif_lzw_decode_100k/gcc     208MB/s ± 1%
puffs_gif_decode_1k/gcc           429MB/s ± 1%
puffs_gif_decode_10k/gcc          161MB/s ± 1%
puffs_gif_decode_100k/gcc         140MB/s ± 1%
puffs_gif_decode_1000k/gcc        143MB/s ± 1%

mimic_gif_decode_1k               158MB/s ± 1%
mimic_gif_decode_10k             93.9MB/s ± 1%
mimic_gif_decode_100k             100MB/s ± 1%
mimic_gif_decode_1000k            102MB/s ± 1%
2017-07-30 11:13:40 +10:00
Nigel Tao 7cf7829c9e Implement std/flate Huffman table redirects. 2017-07-29 16:25:00 +10:00
Nigel Tao 7fe783d785 Call memset instead of using an explicit loop. 2017-07-28 16:24:47 +10:00
Nigel Tao 23a4aeb7ce Turn some struct fields into local variables. 2017-07-28 16:12:45 +10:00
Nigel Tao 6b019831ad Check over- and under-subscribed Huffman codes. 2017-07-28 15:49:05 +10:00
Nigel Tao 3b5e858fea Add the printf prototype to generated C files. 2017-07-28 14:15:26 +10:00
Nigel Tao bfbcae4365 Decode std/flate fixed Huffman tables. 2017-07-28 13:28:31 +10:00
Nigel Tao d2aca16f3c Add a copy_history32 method. 2017-07-28 11:25:03 +10:00
Nigel Tao d7cb39b766 Decode base+extra length and distance pairs. 2017-07-28 09:57:39 +10:00
Nigel Tao 9e03aeabe0 Refactor std/flate's decoder.decode. 2017-07-28 09:04:34 +10:00
Nigel Tao 89d4f68036 Fill array-of-u32 Huffman table for base+extra. 2017-07-27 17:20:31 +10:00
Nigel Tao 67b95c01c3 Decode literals from the lcode Huffman table. 2017-07-27 15:32:05 +10:00
Nigel Tao be3b9b81e7 Generate the lcode and dcode Huffman tables. 2017-07-27 14:56:23 +10:00
Nigel Tao bf51551eda Have init_huff take a slice of the code_lengths. 2017-07-27 14:42:26 +10:00
Nigel Tao ea935e1f8c Use array-of-u32 Huffman decoder. 2017-07-27 14:18:32 +10:00
Nigel Tao e1be6d9582 Type and bounds check "x | y | z". 2017-07-27 13:07:10 +10:00
Nigel Tao eee67e083d Add array-of-u32 Huffman decoder. 2017-07-27 11:30:43 +10:00
Nigel Tao d4ab9caa33 Add table to reverse the bits in a byte. 2017-07-26 09:05:45 +10:00
Nigel Tao 69a3b5804f Remove the unnecessary huffman_decoder struct. 2017-07-26 09:04:14 +10:00
Nigel Tao e772352036 Decode the lcode and dcode code lengths. 2017-07-22 16:45:54 +10:00
Nigel Tao 389d9bc8bf Remove the placeholder code limit count. 2017-07-22 10:14:50 +10:00
Nigel Tao fd07fa1f27 Decode flate's clcode symbols. 2017-07-21 17:47:58 +10:00
Nigel Tao 74400247f2 Refactor std/flate's decoder.decode_dynamic. 2017-07-21 16:16:09 +10:00
Nigel Tao f7fb991619 Implement init_huffman. 2017-07-21 15:55:49 +10:00
Nigel Tao 02cd837d9d Add a huffman_decoder.consts field. 2017-07-21 11:48:15 +10:00
Nigel Tao 34198f3de5 Start the init_huffman implementation. 2017-07-21 11:00:56 +10:00
Nigel Tao 65c4efbe8b Add a placeholder huffman_decoder struct. 2017-07-21 10:14:59 +10:00
Nigel Tao 4b7a350a68 Rename the code_length_code_lengths field. 2017-07-21 10:09:44 +10:00
Nigel Tao 50e091f976 Fix some std/flate visibilities: s/pub/pri/. 2017-07-16 19:28:45 +10:00
Nigel Tao fe7e6ed10e Handle suspending inside a skip32 call. 2017-07-16 19:28:09 +10:00
Nigel Tao fa18eec3e9 Fix returning limited vs short read. 2017-07-16 19:26:58 +10:00
Nigel Tao bd6d2ea3a1 Handle decoding a GIF in many short reads. 2017-07-16 19:25:49 +10:00
Nigel Tao a0c772f617 Improve the check for LIMITED_READ vs SHORT_READ. 2017-07-16 19:24:16 +10:00