Commit Graph
141 Commits
Author SHA1 Message Date
Nigel Tao c3ae0534df Add a writer1.available method. 2017-10-07 16:15:17 +11:00
Nigel Tao 5a7f9e6cde Remove some duplicated short_read_src code. 2017-10-07 15:36:16 +11:00
Nigel Tao d275b379a3 Remove the idea of limited reads and writes. 2017-10-07 15:32:00 +11:00
Nigel Tao a12292d094 Have "return ok" set coro_susp_point = 0. 2017-10-07 14:43:25 +11:00
Nigel Tao 585ea2024d Drop the "?" from "copy_from32?".
Also add a PUFFS_COROUTINE_SUSPENSION_POINT_MAYBE_SUSPEND macro.

Also add a loop to decoder.decode, as the code generator was previously
(incorrectly) not generating a coro_susp_point at the end of the
function.
2017-10-07 14:34:31 +11:00
Nigel Tao 0e09aa8c10 Call copy_from32 in a trival 1-iteration loop.
Follow-up commits will re-try copy_from32's across I/O boundaries.
2017-10-07 11:50:50 +11:00
Nigel Tao 010c4db54f Allow explicit returns of built-in status codes. 2017-10-06 17:34:58 +11:00
Nigel Tao 2e883fcc23 Drop the "?" from "copy_history32?".
This makes the caller, not the implementation, responsible for detecting
short reads and writes. This (the lack of "?") is consistent with the
slice.copy_from method.

name                           old speed     new speed     delta
puffs_flate_decode_1k/clang    117MB/s ± 6%  120MB/s ± 0%   +2.31%  (p=0.016 n=5+5)
puffs_flate_decode_10k/clang   153MB/s ± 1%  155MB/s ± 0%   +1.16%  (p=0.008 n=5+5)
puffs_flate_decode_100k/clang  168MB/s ± 1%  177MB/s ± 0%   +5.41%  (p=0.008 n=5+5)
puffs_flate_decode_1k/gcc      127MB/s ± 1%  143MB/s ± 0%  +12.15%  (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc     145MB/s ± 0%  180MB/s ± 1%  +24.00%  (p=0.008 n=5+5)
puffs_flate_decode_100k/gcc    163MB/s ± 0%  212MB/s ± 1%  +29.90%  (p=0.008 n=5+5)
2017-10-06 17:02:09 +11:00
Nigel Tao a1271222a4 Call copy_history32 in a trival 1-iteration loop.
Follow-up commits will re-try copy_history32's across I/O boundaries.
2017-10-06 14:53:45 +11:00
Nigel Tao d30d4c3dad Add a writer1.length method. 2017-10-06 14:17:01 +11:00
Nigel Tao cf6b1be5b5 Re-organize flate Huffman decoder table bits.
Benchmarks are mixed, but it seems conceptually cleaner to arrange the
bits in the order that they're examined.

name                           old speed     new speed     delta
puffs_flate_decode_1k/clang    125MB/s ± 0%  123MB/s ± 1%  -1.91%  (p=0.008 n=5+5)
puffs_flate_decode_10k/clang   163MB/s ± 1%  157MB/s ± 0%  -3.55%  (p=0.008 n=5+5)
puffs_flate_decode_100k/clang  175MB/s ± 0%  173MB/s ± 0%  -0.75%  (p=0.016 n=4+5)
puffs_flate_decode_1k/gcc      127MB/s ± 0%  130MB/s ± 0%  +2.14%  (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc     142MB/s ± 1%  149MB/s ± 0%  +4.99%  (p=0.016 n=5+4)
puffs_flate_decode_100k/gcc    162MB/s ± 2%  168MB/s ± 0%  +3.66%  (p=0.016 n=5+4)
2017-10-06 13:07:49 +11:00
Nigel Tao 96a9ab4126 Have copy_history32 compare to the wstart pointer. 2017-10-02 16:08:03 +11:00
Nigel Tao 9b6a1760cd Rename puffs_base_make_slice_u8_subslice_ij. 2017-10-02 14:33:45 +11:00
Nigel Tao 6c53fde1da Remove unused puffs_base_make_slice_u8_from_ints. 2017-10-02 14:31:32 +11:00
Nigel Tao 6f132a74e2 Remove the 'mark' concept, no longer necessary. 2017-10-02 14:02:13 +11:00
Nigel Tao 4aa9fce311 Make writer1.slice's args implicitly (start, ptr). 2017-10-02 13:52:34 +11:00
Nigel Tao fcf1f2b5ae Generate C derived start pointers for buffers. 2017-10-02 13:31:13 +11:00
Nigel Tao a28dba7fd9 Rename C's foo_constructor to foo_initializer. 2017-09-30 13:01:26 +10:00
Nigel Tao 552fcde35a Remove C destructor functions; they're no-ops. 2017-09-30 12:57:55 +10:00
Nigel Tao 04e8a73d10 Update std/flate's decoder.history_index. 2017-09-30 11:56:30 +10:00
Nigel Tao 3b57548b0d Generate C code for a non-trivial slice-of-slice. 2017-09-29 17:07:41 +10:00
Nigel Tao f1643be221 Have copy_from return the number of bytes copied. 2017-09-28 17:27:34 +10:00
Nigel Tao a9bdeee7c1 Generate C code for a[i:j] with explicit i or j. 2017-09-28 15:57:25 +10:00
Nigel Tao 7b6f7384d1 Take more care with a NULL reader1 or writer1 buf. 2017-09-23 15:32:42 +10:00
Nigel Tao 10b7d5a031 Don't resume/suspend vars containing pointers. 2017-09-23 15:16:43 +10:00
Nigel Tao d5c8e20268 Have writer1.slice take mark arguments. 2017-09-23 13:57:48 +10:00
Nigel Tao fd5d44b3fc Add a mark method and type. 2017-09-23 13:17:37 +10:00
Nigel Tao 7aaa6f6222 Remove obsolete optimization TODO.
Modern compilers already optimize functions like puffs_base_load_u32le:
https://godbolt.org/g/uZ9xNa (clang)
https://godbolt.org/g/q5amWw (gcc)
2017-09-23 11:03:51 +10:00
Nigel Tao 1a28112ebd In copy_from, don't call memmove with NULLs. 2017-09-23 11:00:23 +10:00
Nigel Tao a9f12c23a4 Generate C code for an_array[:]. 2017-09-23 10:51:04 +10:00
Nigel Tao f107ec155d Rename puffs_u16be to puffs_base_load_u16be. 2017-09-23 09:29:45 +10:00
Nigel Tao ed8a91ef51 Add an array.copy_from method. 2017-09-22 16:32:11 +10:00
Nigel Tao b14bafa717 Make puffs_u16be etc functions, not macros. 2017-09-22 14:41:08 +10:00
Nigel Tao 2fb9972bb9 Add a slice.suffix method. 2017-09-22 14:12:54 +10:00
Nigel Tao 51f2b183a2 Add a slice.length method. 2017-09-22 12:37:07 +10:00
Nigel Tao fda696bf95 Add PUFFS_IGNORE_POTENTIALLY_UNUSED_VARIABLE. 2017-09-22 12:00:14 +10:00
Nigel Tao 18e32d61e5 Add a writer1.slice method. 2017-09-22 11:54:24 +10:00
Nigel Tao 519ec373f2 First cut at a "[] u8" slice type. 2017-09-08 16:53:59 +10:00
Nigel Tao 0f86add17e Add a status.is_suspension method. 2017-09-02 09:40:39 +10:00
Nigel Tao 935cd73686 Add a "status" type and "try" keyword. 2017-09-01 16:41:42 +10:00
Nigel Tao 363dcbe714 Make the scratch field per-func, not per-struct. 2017-09-01 14:10:47 +10:00
Nigel Tao 209178a2c6 Add a std/flate decode_blocks method. 2017-08-31 11:16:23 +10:00
Nigel Tao b328529e00 Remove unnecessary {}s. 2017-08-26 17:30:04 +10:00
Nigel Tao 018d8d1893 Don't have suspend state if we don't suspend. 2017-08-26 17:27:01 +10:00
Nigel Tao fdddcc8e1d Merge multiple puffs-xxx-c binaries into one. 2017-08-24 09:43:57 +10:00
Nigel Tao b3710e583f Add a zlib decoder to std/flate. 2017-08-05 16:34:03 +10:00
Nigel Tao 61c5b40bf6 Unroll the copy_history32 loop.
name                             old speed      new speed      delta
puffs_flate_decode_1k/clang       127MB/s ± 2%   140MB/s ± 0%  +10.13%  (p=0.000 n=83+95)
puffs_flate_decode_10k/clang      151MB/s ± 1%   166MB/s ± 0%  +10.38%  (p=0.000 n=82+97)
puffs_flate_decode_100k/clang     165MB/s ± 1%   177MB/s ± 0%   +7.42%  (p=0.000 n=89+94)
puffs_flate_decode_1k/gcc         155MB/s ± 2%   153MB/s ± 1%   -1.67%  (p=0.000 n=91+89)
puffs_flate_decode_10k/gcc        146MB/s ± 2%   147MB/s ± 0%   +0.41%  (p=0.000 n=86+83)
puffs_flate_decode_100k/gcc       166MB/s ± 1%   170MB/s ± 0%   +2.34%  (p=0.000 n=88+84)
2017-07-30 13:36:32 +10:00
Nigel Tao df8772dadf Remove hand-written edit to generated C code. 2017-07-30 11:30:32 +10:00
Nigel Tao 265d3a5a1a Add a hand-written C impl of decode_huffman.
This gives a rough upper bound on how fast Puffs' generated C code can
be, with a sufficiently smart Puffs compiler.

A comparison of the 'old', safe, generated C code and the 'new', unsafe,
hand-written C code:

name                           old speed     new speed     delta
puffs_flate_decode_1k/clang    127MB/s ± 2%  181MB/s ± 2%  +42.27%  (p=0.000 n=83+5)
puffs_flate_decode_10k/clang   151MB/s ± 1%  235MB/s ± 2%  +56.04%  (p=0.000 n=82+5)
puffs_flate_decode_100k/clang  165MB/s ± 1%  275MB/s ± 3%  +66.69%  (p=0.000 n=89+5)
puffs_flate_decode_1k/gcc      155MB/s ± 2%  181MB/s ± 1%  +16.96%  (p=0.000 n=91+5)
puffs_flate_decode_10k/gcc     146MB/s ± 2%  241MB/s ± 2%  +64.78%  (p=0.000 n=86+5)
puffs_flate_decode_100k/gcc    166MB/s ± 1%  277MB/s ± 3%  +66.78%  (p=0.000 n=88+5)

While we're discussing benchmark numbers, below is an overall snapshot.

std/flate

puffs_flate_decode_1k/clang       127MB/s ± 2%
puffs_flate_decode_10k/clang      151MB/s ± 1%
puffs_flate_decode_100k/clang     165MB/s ± 1%

puffs_flate_decode_1k/gcc         155MB/s ± 2%
puffs_flate_decode_10k/gcc        146MB/s ± 2%
puffs_flate_decode_100k/gcc       166MB/s ± 1%

mimic_adler32_10k                2.98GB/s ± 1%
mimic_adler32_100k               2.93GB/s ± 1%
mimic_crc32_10k                  1.38GB/s ± 1%
mimic_crc32_100k                 1.37GB/s ± 1%

mimic_flate_decode_1k             220MB/s ± 2%
mimic_flate_decode_10k            262MB/s ± 1%
mimic_flate_decode_100k           281MB/s ± 1%
mimic_gzip_decode_10k             221MB/s ± 1%
mimic_gzip_decode_100k            259MB/s ± 1%
mimic_zlib_decode_10k             242MB/s ± 2%
mimic_zlib_decode_100k            289MB/s ± 1%

std/gif

puffs_gif_lzw_decode_20k/clang    125MB/s ± 1%
puffs_gif_lzw_decode_100k/clang   173MB/s ± 1%
puffs_gif_decode_1k/clang         376MB/s ± 3%
puffs_gif_decode_10k/clang        128MB/s ± 2%
puffs_gif_decode_100k/clang       120MB/s ± 2%
puffs_gif_decode_1000k/clang      121MB/s ± 3%

puffs_gif_lzw_decode_20k/gcc      153MB/s ± 1%
puffs_gif_lzw_decode_100k/gcc     208MB/s ± 1%
puffs_gif_decode_1k/gcc           429MB/s ± 1%
puffs_gif_decode_10k/gcc          161MB/s ± 1%
puffs_gif_decode_100k/gcc         140MB/s ± 1%
puffs_gif_decode_1000k/gcc        143MB/s ± 1%

mimic_gif_decode_1k               158MB/s ± 1%
mimic_gif_decode_10k             93.9MB/s ± 1%
mimic_gif_decode_100k             100MB/s ± 1%
mimic_gif_decode_1000k            102MB/s ± 1%
2017-07-30 11:13:40 +10:00
Nigel Tao 7cf7829c9e Implement std/flate Huffman table redirects. 2017-07-29 16:25:00 +10:00