Nigel Tao
3c708dfe59
Rename PUFFS to WUFFS, part 7 of N
2017-11-30 18:02:59 +11:00
Nigel Tao
eda3130628
Rename PUFFS to WUFFS, part 6 of N
2017-11-30 16:43:39 +11:00
Nigel Tao
30b54616a8
Check copy_from_history32's distance.
2017-11-09 12:53:19 +11:00
Nigel Tao
0bc6f792fb
Remove some suspensions from decode_huffman_fast.
...
name old speed new speed delta
puffs_adler32_10k/clang 2.41GB/s ± 1% 2.39GB/s ± 2% -0.88% (p=0.022 n=9+10)
puffs_adler32_100k/clang 2.41GB/s ± 1% 2.39GB/s ± 2% ~ (p=0.095 n=10+9)
puffs_flate_decode_1k/clang 136MB/s ± 2% 134MB/s ± 1% -0.86% (p=0.036 n=9+8)
puffs_flate_decode_10k/clang 172MB/s ± 0% 175MB/s ± 0% +1.96% (p=0.000 n=8+9)
puffs_flate_decode_100k/clang 206MB/s ± 0% 209MB/s ± 1% +1.38% (p=0.000 n=8+9)
puffs_zlib_decode_10k/clang 160MB/s ± 1% 163MB/s ± 2% +1.73% (p=0.001 n=9+9)
puffs_zlib_decode_100k/clang 189MB/s ± 1% 188MB/s ± 6% ~ (p=0.143 n=10+10)
puffs_adler32_10k/gcc 3.27GB/s ± 0% 3.20GB/s ± 2% -2.03% (p=0.000 n=8+10)
puffs_adler32_100k/gcc 3.27GB/s ± 0% 3.21GB/s ± 1% -1.89% (p=0.000 n=8+10)
puffs_flate_decode_1k/gcc 141MB/s ± 1% 139MB/s ± 1% -1.66% (p=0.000 n=9+10)
puffs_flate_decode_10k/gcc 200MB/s ± 0% 209MB/s ± 1% +4.73% (p=0.000 n=10+10)
puffs_flate_decode_100k/gcc 242MB/s ± 0% 237MB/s ± 0% -2.19% (p=0.000 n=9+10)
puffs_zlib_decode_10k/gcc 188MB/s ± 0% 195MB/s ± 1% +3.71% (p=0.000 n=10+10)
puffs_zlib_decode_100k/gcc 225MB/s ± 0% 221MB/s ± 0% -1.84% (p=0.000 n=8+9)
2017-11-06 16:59:27 +11:00
Nigel Tao
3099991d7f
Add an "invalid I/O operation" error code.
2017-11-05 13:53:35 +11:00
Nigel Tao
aa1f0078db
Add decode_huffman_fast.
...
It's not fast yet, and the immediate impact is indeed a significant
performance loss, but follow-up commits should make it faster.
name old speed new speed delta
puffs_adler32_10k/clang 2.41GB/s ± 0% 2.40GB/s ± 1% ~ (p=0.222 n=5+5)
puffs_adler32_100k/clang 2.41GB/s ± 1% 2.39GB/s ± 1% -0.97% (p=0.016 n=5+5)
puffs_flate_decode_1k/clang 116MB/s ± 5% 115MB/s ± 0% ~ (p=0.310 n=5+5)
puffs_flate_decode_10k/clang 145MB/s ± 0% 139MB/s ± 0% -4.18% (p=0.016 n=4+5)
puffs_flate_decode_100k/clang 164MB/s ± 5% 158MB/s ± 1% ~ (p=0.151 n=5+5)
puffs_zlib_decode_10k/clang 135MB/s ± 2% 131MB/s ± 0% -2.84% (p=0.008 n=5+5)
puffs_zlib_decode_100k/clang 154MB/s ± 1% 148MB/s ± 2% -4.09% (p=0.016 n=4+5)
puffs_adler32_10k/gcc 3.13GB/s ± 4% 3.19GB/s ± 0% +1.94% (p=0.032 n=5+5)
puffs_adler32_100k/gcc 3.14GB/s ± 3% 3.20GB/s ± 3% ~ (p=0.056 n=5+5)
puffs_flate_decode_1k/gcc 122MB/s ± 1% 94MB/s ± 1% -22.84% (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc 143MB/s ± 0% 110MB/s ± 0% -23.24% (p=0.008 n=5+5)
puffs_flate_decode_100k/gcc 158MB/s ± 0% 118MB/s ± 0% -24.98% (p=0.008 n=5+5)
puffs_zlib_decode_10k/gcc 136MB/s ± 0% 119MB/s ± 1% -12.63% (p=0.008 n=5+5)
puffs_zlib_decode_100k/gcc 150MB/s ± 1% 124MB/s ± 2% -17.17% (p=0.008 n=5+5)
2017-11-04 14:45:11 +11:00
Nigel Tao
ded044da41
Add a flate end_of_block field.
2017-11-04 14:12:38 +11:00
Nigel Tao
4810db3994
Rename decode_huffman to decode_huffman_slow.
2017-11-04 13:38:24 +11:00
Nigel Tao
c3420dd138
Refactor std/flate/*.puffs code.
2017-11-04 13:31:39 +11:00
Nigel Tao
f8146cf1c6
Remove more PUFFS_USE_NO_OP_PERFORMANCE_HACKS.
2017-11-03 10:15:43 +11:00
Nigel Tao
e3822f9951
Re-introduce puffs_base__limit1.
...
It's not immediately obvious why this data structure performs differently, but
on net, the benchmark numbers seem better. It also won't require any
PUFFS_USE_NO_OP_PERFORMANCE_HACKS or "redundant but mysteriously performant"
use_limit fields.
name old speed new speed delta
puffs_adler32_10k/clang 2.46GB/s ± 0% 2.43GB/s ± 3% ~ (p=0.513 n=5+10)
puffs_adler32_100k/clang 2.46GB/s ± 0% 2.44GB/s ± 2% ~ (p=0.241 n=5+10)
puffs_flate_decode_1k/clang 122MB/s ± 1% 119MB/s ± 2% -1.86% (p=0.013 n=5+10)
puffs_flate_decode_10k/clang 147MB/s ± 0% 142MB/s ± 2% -3.47% (p=0.001 n=5+10)
puffs_flate_decode_100k/clang 161MB/s ± 0% 161MB/s ± 4% ~ (p=0.635 n=4+10)
puffs_zlib_decode_10k/clang 139MB/s ± 0% 135MB/s ± 1% -2.69% (p=0.001 n=5+10)
puffs_zlib_decode_100k/clang 151MB/s ± 0% 152MB/s ± 3% ~ (p=1.000 n=5+10)
puffs_adler32_10k/gcc 3.21GB/s ± 1% 3.18GB/s ± 2% ~ (p=0.310 n=5+10)
puffs_adler32_100k/gcc 3.22GB/s ± 0% 3.19GB/s ± 2% ~ (p=0.075 n=5+10)
puffs_flate_decode_1k/gcc 121MB/s ± 4% 126MB/s ± 1% +4.54% (p=0.002 n=5+8)
puffs_flate_decode_10k/gcc 144MB/s ± 1% 141MB/s ± 1% -2.52% (p=0.001 n=5+9)
puffs_flate_decode_100k/gcc 154MB/s ± 1% 158MB/s ± 0% +2.39% (p=0.001 n=5+9)
puffs_zlib_decode_10k/gcc 137MB/s ± 2% 135MB/s ± 1% ~ (p=0.055 n=5+10)
puffs_zlib_decode_100k/gcc 146MB/s ± 2% 150MB/s ± 0% +2.87% (p=0.001 n=5+10)
puffs_gif_lzw_decode_20k/clang 132MB/s ± 0% 125MB/s ± 0% -5.24% (p=0.001 n=5+10)
puffs_gif_lzw_decode_100k/clang 176MB/s ± 0% 164MB/s ± 0% -6.82% (p=0.001 n=5+9)
puffs_gif_decode_1k/clang 363MB/s ± 0% 339MB/s ± 1% -6.58% (p=0.002 n=4+10)
puffs_gif_decode_10k/clang 138MB/s ± 0% 133MB/s ± 1% -3.77% (p=0.001 n=5+10)
puffs_gif_decode_100k/clang 125MB/s ± 0% 119MB/s ± 0% -4.79% (p=0.001 n=5+10)
puffs_gif_decode_1000k/clang 127MB/s ± 0% 121MB/s ± 0% -5.04% (p=0.001 n=5+10)
puffs_gif_lzw_decode_20k/gcc 141MB/s ± 0% 140MB/s ± 2% ~ (p=1.000 n=5+10)
puffs_gif_lzw_decode_100k/gcc 182MB/s ± 0% 180MB/s ± 2% -1.56% (p=0.001 n=5+10)
puffs_gif_decode_1k/gcc 363MB/s ± 0% 409MB/s ± 3% +12.71% (p=0.001 n=5+10)
puffs_gif_decode_10k/gcc 127MB/s ± 0% 161MB/s ± 3% +26.15% (p=0.001 n=5+10)
puffs_gif_decode_100k/gcc 112MB/s ± 0% 136MB/s ± 2% +21.95% (p=0.001 n=5+10)
puffs_gif_decode_1000k/gcc 114MB/s ± 0% 140MB/s ± 2% +22.78% (p=0.001 n=5+10)
2017-11-03 10:09:57 +11:00
Nigel Tao
e5db8233fc
Re-introduce writer1.use_limit.
...
Nobody uses it yet, as we only decode and not encode, but it's there for
symmetry.
No benchmark changes, as nobody uses it yet.
2017-11-02 16:46:03 +11:00
Nigel Tao
7d8085f891
Re-introduce reader1.use_limit.
...
The std/flate benchmarks get better. The std/gif benchmarks get worse,
but that's possibly because the PUFFS_USE_NO_OP_PERFORMANCE_HACKS hacks
are fragile.
name old speed new speed delta
puffs_adler32_10k/clang 2.45GB/s ± 0% 2.45GB/s ± 0% ~ (p=0.310 n=5+5)
puffs_adler32_100k/clang 2.46GB/s ± 0% 2.46GB/s ± 0% ~ (p=0.690 n=5+5)
puffs_flate_decode_1k/clang 113MB/s ± 0% 113MB/s ± 0% ~ (p=0.690 n=5+5)
puffs_flate_decode_10k/clang 140MB/s ± 0% 140MB/s ± 0% ~ (p=0.222 n=5+5)
puffs_flate_decode_100k/clang 151MB/s ± 0% 151MB/s ± 0% ~ (p=0.095 n=5+5)
puffs_zlib_decode_10k/clang 132MB/s ± 1% 132MB/s ± 0% ~ (p=0.548 n=5+5)
puffs_zlib_decode_100k/clang 143MB/s ± 0% 143MB/s ± 0% ~ (p=0.730 n=5+4)
puffs_adler32_10k/gcc 3.26GB/s ± 0% 3.26GB/s ± 0% ~ (p=0.548 n=5+5)
puffs_adler32_100k/gcc 3.27GB/s ± 0% 3.27GB/s ± 0% ~ (p=0.841 n=5+5)
puffs_flate_decode_1k/gcc 108MB/s ± 0% 125MB/s ± 0% +14.97% (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc 128MB/s ± 0% 148MB/s ± 0% +15.48% (p=0.016 n=4+5)
puffs_flate_decode_100k/gcc 136MB/s ± 0% 158MB/s ± 0% +16.40% (p=0.008 n=5+5)
puffs_zlib_decode_10k/gcc 123MB/s ± 0% 141MB/s ± 0% +14.70% (p=0.016 n=4+5)
puffs_zlib_decode_100k/gcc 131MB/s ± 0% 151MB/s ± 0% +15.60% (p=0.016 n=5+4)
puffs_gif_lzw_decode_20k/clang 131MB/s ± 1% 128MB/s ± 3% -2.04% (p=0.032 n=5+5)
puffs_gif_lzw_decode_100k/clang 172MB/s ± 1% 173MB/s ± 1% ~ (p=0.151 n=5+5)
puffs_gif_decode_1k/clang 351MB/s ± 3% 341MB/s ± 5% ~ (p=0.310 n=5+5)
puffs_gif_decode_10k/clang 138MB/s ± 1% 134MB/s ± 3% -3.34% (p=0.008 n=5+5)
puffs_gif_decode_100k/clang 122MB/s ± 2% 122MB/s ± 2% ~ (p=1.000 n=5+5)
puffs_gif_decode_1000k/clang 126MB/s ± 1% 122MB/s ± 4% -3.07% (p=0.016 n=5+5)
puffs_gif_lzw_decode_20k/gcc 140MB/s ± 3% 140MB/s ± 3% ~ (p=0.421 n=5+5)
puffs_gif_lzw_decode_100k/gcc 187MB/s ± 2% 184MB/s ± 1% ~ (p=0.056 n=5+5)
puffs_gif_decode_1k/gcc 401MB/s ± 1% 357MB/s ± 1% -10.88% (p=0.008 n=5+5)
puffs_gif_decode_10k/gcc 154MB/s ± 1% 126MB/s ± 1% -18.42% (p=0.008 n=5+5)
puffs_gif_decode_100k/gcc 131MB/s ± 2% 109MB/s ± 0% -17.37% (p=0.008 n=5+5)
puffs_gif_decode_1000k/gcc 135MB/s ± 1% 111MB/s ± 1% -17.65% (p=0.008 n=5+5)
2017-11-02 16:35:15 +11:00
Nigel Tao
ed6ce6fd54
Add PUFFS_USE_NO_OP_PERFORMANCE_HACKS.
...
name old speed new speed delta
puffs_adler32_10k/gcc 3.26GB/s ± 0% 3.26GB/s ± 0% ~ (p=0.222 n=5+5)
puffs_adler32_100k/gcc 3.27GB/s ± 0% 3.27GB/s ± 0% -0.12% (p=0.032 n=5+5)
puffs_flate_decode_1k/gcc 108MB/s ± 0% 108MB/s ± 0% ~ (p=0.841 n=5+5)
puffs_flate_decode_10k/gcc 128MB/s ± 0% 128MB/s ± 0% ~ (p=0.057 n=4+4)
puffs_flate_decode_100k/gcc 136MB/s ± 0% 136MB/s ± 0% ~ (p=0.222 n=5+5)
puffs_zlib_decode_10k/gcc 123MB/s ± 0% 123MB/s ± 0% ~ (p=0.730 n=5+4)
puffs_zlib_decode_100k/gcc 130MB/s ± 0% 131MB/s ± 0% ~ (p=1.000 n=5+5)
puffs_gif_lzw_decode_20k/gcc 137MB/s ± 4% 140MB/s ± 3% ~ (p=0.095 n=5+5)
puffs_gif_lzw_decode_100k/gcc 177MB/s ± 3% 187MB/s ± 2% +5.75% (p=0.008 n=5+5)
puffs_gif_decode_1k/gcc 348MB/s ± 0% 401MB/s ± 1% +15.34% (p=0.016 n=4+5)
puffs_gif_decode_10k/gcc 121MB/s ± 5% 154MB/s ± 1% +27.90% (p=0.008 n=5+5)
puffs_gif_decode_100k/gcc 106MB/s ± 4% 131MB/s ± 2% +24.35% (p=0.008 n=5+5)
puffs_gif_decode_1000k/gcc 109MB/s ± 2% 135MB/s ± 1% +24.03% (p=0.008 n=5+5)
2017-11-02 14:51:29 +11:00
Nigel Tao
aa396e7992
Change cgen's limit from a count to a pointer.
2017-10-27 10:28:35 +11:00
Nigel Tao
3485950a3f
Remove the obsolete puffs_base__limit1 concept.
2017-10-27 07:51:57 +11:00
Nigel Tao
8ff453c752
Re-do how limits work.
2017-10-26 16:59:03 +11:00
Nigel Tao
b886e3a1ea
Add reader1.mark and reader1.since_mark methods.
2017-10-26 14:39:38 +11:00
Nigel Tao
51012a0cca
Change flate block_size from u8 to u64.
2017-10-26 14:05:02 +11:00
Nigel Tao
21bbbd422f
Generate code for "mark in.dst".
...
The generated code is ugly and the language design is not finalized, but
the flate_backref_crosses_blocks test (testing a correctness bug) now
passes. We can fix the ugliness in subsequent commits.
2017-10-22 14:44:53 +11:00
Nigel Tao
f29c4e278f
Follow the pkg__type__method convention for base.
2017-10-21 15:59:08 +11:00
Nigel Tao
6815375de5
Generate double '_'s for pkg__type__method names.
2017-10-21 15:10:25 +11:00
Nigel Tao
2639f8f46a
Rename std/flate's decoder to flate_decoder.
2017-10-21 13:05:19 +11:00
Nigel Tao
1c75edb32e
Calculate the zlib checksum.
2017-10-21 12:38:23 +11:00
Nigel Tao
62935c41d7
Prepare for calculating the zlib checksum.
2017-10-21 11:55:58 +11:00
Nigel Tao
74f3b76b09
Rename the adler struct to adler32.
2017-10-19 20:49:20 +11:00
Nigel Tao
5b0d6f6f3e
Add a skeleton of an Adler checksummer.
2017-10-19 18:09:14 +11:00
Nigel Tao
c1789e0065
Rename some variables for clarity.
2017-10-14 11:24:40 +11:00
Nigel Tao
c99fdaf63d
Actually copy from the flate decoder's history.
2017-10-13 14:50:34 +11:00
Nigel Tao
a33f744da5
Drop the "?" from "writer1.copy_from_slice?".
2017-10-13 11:44:53 +11:00
Nigel Tao
36ba4b866c
Calculate the length-distance for a history copy.
2017-10-12 16:06:28 +11:00
Nigel Tao
d4372cb5b8
Change license to Apache 2.
...
Also remove explicit PATENTS file. The new LICENSE file already
discusses patents.
Note that the Puffs project has not yet been publicly released.
2017-10-12 11:17:41 +11:00
Nigel Tao
d275b379a3
Remove the idea of limited reads and writes.
2017-10-07 15:32:00 +11:00
Nigel Tao
585ea2024d
Drop the "?" from "copy_from32?".
...
Also add a PUFFS_COROUTINE_SUSPENSION_POINT_MAYBE_SUSPEND macro.
Also add a loop to decoder.decode, as the code generator was previously
(incorrectly) not generating a coro_susp_point at the end of the
function.
2017-10-07 14:34:31 +11:00
Nigel Tao
0e09aa8c10
Call copy_from32 in a trival 1-iteration loop.
...
Follow-up commits will re-try copy_from32's across I/O boundaries.
2017-10-07 11:50:50 +11:00
Nigel Tao
2e883fcc23
Drop the "?" from "copy_history32?".
...
This makes the caller, not the implementation, responsible for detecting
short reads and writes. This (the lack of "?") is consistent with the
slice.copy_from method.
name old speed new speed delta
puffs_flate_decode_1k/clang 117MB/s ± 6% 120MB/s ± 0% +2.31% (p=0.016 n=5+5)
puffs_flate_decode_10k/clang 153MB/s ± 1% 155MB/s ± 0% +1.16% (p=0.008 n=5+5)
puffs_flate_decode_100k/clang 168MB/s ± 1% 177MB/s ± 0% +5.41% (p=0.008 n=5+5)
puffs_flate_decode_1k/gcc 127MB/s ± 1% 143MB/s ± 0% +12.15% (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc 145MB/s ± 0% 180MB/s ± 1% +24.00% (p=0.008 n=5+5)
puffs_flate_decode_100k/gcc 163MB/s ± 0% 212MB/s ± 1% +29.90% (p=0.008 n=5+5)
2017-10-06 17:02:09 +11:00
Nigel Tao
6f132a74e2
Remove the 'mark' concept, no longer necessary.
2017-10-02 14:02:13 +11:00
Nigel Tao
a28dba7fd9
Rename C's foo_constructor to foo_initializer.
2017-09-30 13:01:26 +10:00
Nigel Tao
552fcde35a
Remove C destructor functions; they're no-ops.
2017-09-30 12:57:55 +10:00
Nigel Tao
04e8a73d10
Update std/flate's decoder.history_index.
2017-09-30 11:56:30 +10:00
Nigel Tao
f1643be221
Have copy_from return the number of bytes copied.
2017-09-28 17:27:34 +10:00
Nigel Tao
10b7d5a031
Don't resume/suspend vars containing pointers.
2017-09-23 15:16:43 +10:00
Nigel Tao
fd5d44b3fc
Add a mark method and type.
2017-09-23 13:17:37 +10:00
Nigel Tao
ed8a91ef51
Add an array.copy_from method.
2017-09-22 16:32:11 +10:00
Nigel Tao
519ec373f2
First cut at a "[] u8" slice type.
2017-09-08 16:53:59 +10:00
Nigel Tao
935cd73686
Add a "status" type and "try" keyword.
2017-09-01 16:41:42 +10:00
Nigel Tao
363dcbe714
Make the scratch field per-func, not per-struct.
2017-09-01 14:10:47 +10:00
Nigel Tao
209178a2c6
Add a std/flate decode_blocks method.
2017-08-31 11:16:23 +10:00
Nigel Tao
018d8d1893
Don't have suspend state if we don't suspend.
2017-08-26 17:27:01 +10:00
Nigel Tao
fdddcc8e1d
Merge multiple puffs-xxx-c binaries into one.
2017-08-24 09:43:57 +10:00