Nigel Tao
8ff453c752
Re-do how limits work.
2017-10-26 16:59:03 +11:00
Nigel Tao
a382101a9c
Remove an obsolete TODO.
2017-10-26 15:43:46 +11:00
Nigel Tao
a9ba7e85ac
Add reader1.limitt and writer1.limitt methods.
...
The "limitt" typo will be renamed to "limit" once we remove the keyword
named "limit".
2017-10-26 15:06:59 +11:00
Nigel Tao
b886e3a1ea
Add reader1.mark and reader1.since_mark methods.
2017-10-26 14:39:38 +11:00
Nigel Tao
15ded0a6d0
Add while/break in anticipation of adding try.
2017-10-26 14:09:31 +11:00
Nigel Tao
51012a0cca
Change flate block_size from u8 to u64.
2017-10-26 14:05:02 +11:00
Nigel Tao
c0c023e1cf
Remove the writer1.length method.
2017-10-26 13:15:24 +11:00
Nigel Tao
5052b16f2d
Rename writer1.slice to writer1.since_mark.
2017-10-26 13:03:19 +11:00
Nigel Tao
0d32b6cb47
Add a mark call to zlib_decoder.decode.
2017-10-26 12:34:01 +11:00
Nigel Tao
474a0d2ed7
Make mark a method, not a keyword.
2017-10-26 12:31:27 +11:00
Nigel Tao
36f5ae9bf4
Move the "mark in.dst" into the flate decode loop.
2017-10-26 11:20:42 +11:00
Nigel Tao
21bbbd422f
Generate code for "mark in.dst".
...
The generated code is ugly and the language design is not finalized, but
the flate_backref_crosses_blocks test (testing a correctness bug) now
passes. We can fix the ugliness in subsequent commits.
2017-10-22 14:44:53 +11:00
Nigel Tao
ac793d33bc
Generate placeholder code for "mark in.dst".
2017-10-22 13:57:37 +11:00
Nigel Tao
76f7621221
Re-order some decode_huffman checks.
...
name old speed new speed delta
puffs_flate_decode_1k/clang 112MB/s ± 1% 123MB/s ± 0% +10.03% (p=0.008 n=5+5)
puffs_flate_decode_10k/clang 135MB/s ± 0% 146MB/s ± 0% +7.81% (p=0.008 n=5+5)
puffs_flate_decode_100k/clang 154MB/s ± 0% 166MB/s ± 0% +7.61% (p=0.016 n=5+4)
puffs_zlib_decode_10k/clang 128MB/s ± 0% 138MB/s ± 0% +7.79% (p=0.008 n=5+5)
puffs_zlib_decode_100k/clang 145MB/s ± 0% 156MB/s ± 0% +7.33% (p=0.016 n=5+4)
puffs_flate_decode_1k/gcc 119MB/s ± 0% 128MB/s ± 0% +7.49% (p=0.029 n=4+4)
puffs_flate_decode_10k/gcc 138MB/s ± 1% 146MB/s ± 0% +6.18% (p=0.016 n=5+4)
puffs_flate_decode_100k/gcc 153MB/s ± 0% 164MB/s ± 0% +6.92% (p=0.029 n=4+4)
puffs_zlib_decode_10k/gcc 132MB/s ± 0% 140MB/s ± 0% +6.13% (p=0.016 n=5+4)
puffs_zlib_decode_100k/gcc 147MB/s ± 0% 156MB/s ± 0% +6.48% (p=0.016 n=5+4)
2017-10-21 17:19:43 +11:00
Nigel Tao
2ec0cc1db9
Add TODO to think about a std/zlib directory.
2017-10-21 16:27:18 +11:00
Nigel Tao
8ee56a7911
Tweak puffsfmt'ing "iterate.8 (etc)".
2017-10-21 14:33:29 +11:00
Nigel Tao
1f9e391e7d
Add a TODO to add a checksum opt out API.
2017-10-21 13:20:14 +11:00
Nigel Tao
2639f8f46a
Rename std/flate's decoder to flate_decoder.
2017-10-21 13:05:19 +11:00
Nigel Tao
1c75edb32e
Calculate the zlib checksum.
2017-10-21 12:38:23 +11:00
Nigel Tao
62935c41d7
Prepare for calculating the zlib checksum.
2017-10-21 11:55:58 +11:00
Nigel Tao
245e3ec7b9
Unroll iterate loops.
...
name old speed new speed delta
puffs_adler32_10k/clang 2.12GB/s ± 1% 2.42GB/s ± 1% +14.24% (p=0.008 n=5+5)
puffs_adler32_100k/clang 2.12GB/s ± 3% 2.43GB/s ± 0% +14.29% (p=0.008 n=5+5)
mimic_adler32_10k/clang 2.93GB/s ± 2% 2.96GB/s ± 0% ~ (p=0.310 n=5+5)
mimic_adler32_100k/clang 2.89GB/s ± 2% 2.91GB/s ± 0% ~ (p=1.000 n=5+5)
puffs_adler32_10k/gcc 2.17GB/s ± 1% 3.23GB/s ± 0% +48.59% (p=0.008 n=5+5)
puffs_adler32_100k/gcc 2.18GB/s ± 1% 3.23GB/s ± 0% +48.34% (p=0.008 n=5+5)
mimic_adler32_10k/gcc 2.97GB/s ± 0% 2.96GB/s ± 1% ~ (p=1.000 n=5+5)
mimic_adler32_100k/gcc 2.91GB/s ± 1% 2.91GB/s ± 1% ~ (p=0.548 n=5+5)
2017-10-20 17:28:21 +11:00
Nigel Tao
2cd6ebed8e
Add a "deref" unary operator.
2017-10-20 15:44:30 +11:00
Nigel Tao
51bd52239b
Add an "iterate" keyword.
2017-10-20 15:33:31 +11:00
Nigel Tao
74f3b76b09
Rename the adler struct to adler32.
2017-10-19 20:49:20 +11:00
Nigel Tao
f9cea5c17c
Fix the adler.update implementation.
2017-10-19 20:45:43 +11:00
Nigel Tao
d770bf7534
Add some adler.update implementation.
2017-10-19 19:32:10 +11:00
Nigel Tao
50369c782c
Add a skeleton of an adler.update method.
2017-10-19 18:58:17 +11:00
Nigel Tao
5b0d6f6f3e
Add a skeleton of an Adler checksummer.
2017-10-19 18:09:14 +11:00
Nigel Tao
6492c52156
Add a ~+ operator.
2017-10-19 16:50:05 +11:00
Nigel Tao
e7d01e7b2a
Fix flate decoding across multiple I/O calls.
2017-10-14 16:27:53 +11:00
Nigel Tao
c1789e0065
Rename some variables for clarity.
2017-10-14 11:24:40 +11:00
Nigel Tao
b402429eee
Remove some redundant inequalities.
2017-10-13 14:55:15 +11:00
Nigel Tao
c99fdaf63d
Actually copy from the flate decoder's history.
2017-10-13 14:50:34 +11:00
Nigel Tao
4357c22e91
Add a compiler TODO.
2017-10-13 13:21:57 +11:00
Nigel Tao
a33f744da5
Drop the "?" from "writer1.copy_from_slice?".
2017-10-13 11:44:53 +11:00
Nigel Tao
0384c5e4a8
Rename the copy_from_xxx methods for consistency.
2017-10-13 10:59:47 +11:00
Nigel Tao
66f712039b
Prepare for introducing copy_from_slice.
2017-10-13 10:30:22 +11:00
Nigel Tao
36ba4b866c
Calculate the length-distance for a history copy.
2017-10-12 16:06:28 +11:00
Nigel Tao
d4372cb5b8
Change license to Apache 2.
...
Also remove explicit PATENTS file. The new LICENSE file already
discusses patents.
Note that the Puffs project has not yet been publicly released.
2017-10-12 11:17:41 +11:00
Nigel Tao
c3ae0534df
Add a writer1.available method.
2017-10-07 16:15:17 +11:00
Nigel Tao
d275b379a3
Remove the idea of limited reads and writes.
2017-10-07 15:32:00 +11:00
Nigel Tao
585ea2024d
Drop the "?" from "copy_from32?".
...
Also add a PUFFS_COROUTINE_SUSPENSION_POINT_MAYBE_SUSPEND macro.
Also add a loop to decoder.decode, as the code generator was previously
(incorrectly) not generating a coro_susp_point at the end of the
function.
2017-10-07 14:34:31 +11:00
Nigel Tao
0e09aa8c10
Call copy_from32 in a trival 1-iteration loop.
...
Follow-up commits will re-try copy_from32's across I/O boundaries.
2017-10-07 11:50:50 +11:00
Nigel Tao
010c4db54f
Allow explicit returns of built-in status codes.
2017-10-06 17:34:58 +11:00
Nigel Tao
2e883fcc23
Drop the "?" from "copy_history32?".
...
This makes the caller, not the implementation, responsible for detecting
short reads and writes. This (the lack of "?") is consistent with the
slice.copy_from method.
name old speed new speed delta
puffs_flate_decode_1k/clang 117MB/s ± 6% 120MB/s ± 0% +2.31% (p=0.016 n=5+5)
puffs_flate_decode_10k/clang 153MB/s ± 1% 155MB/s ± 0% +1.16% (p=0.008 n=5+5)
puffs_flate_decode_100k/clang 168MB/s ± 1% 177MB/s ± 0% +5.41% (p=0.008 n=5+5)
puffs_flate_decode_1k/gcc 127MB/s ± 1% 143MB/s ± 0% +12.15% (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc 145MB/s ± 0% 180MB/s ± 1% +24.00% (p=0.008 n=5+5)
puffs_flate_decode_100k/gcc 163MB/s ± 0% 212MB/s ± 1% +29.90% (p=0.008 n=5+5)
2017-10-06 17:02:09 +11:00
Nigel Tao
a1271222a4
Call copy_history32 in a trival 1-iteration loop.
...
Follow-up commits will re-try copy_history32's across I/O boundaries.
2017-10-06 14:53:45 +11:00
Nigel Tao
d30d4c3dad
Add a writer1.length method.
2017-10-06 14:17:01 +11:00
Nigel Tao
e9df25d599
Remove comment links to file format specs.
...
The specifications are already linked to from the README.md files.
2017-10-06 13:26:26 +11:00
Nigel Tao
e831eecca3
Update TODO on generating suspension points.
2017-10-06 13:22:16 +11:00
Nigel Tao
cf6b1be5b5
Re-organize flate Huffman decoder table bits.
...
Benchmarks are mixed, but it seems conceptually cleaner to arrange the
bits in the order that they're examined.
name old speed new speed delta
puffs_flate_decode_1k/clang 125MB/s ± 0% 123MB/s ± 1% -1.91% (p=0.008 n=5+5)
puffs_flate_decode_10k/clang 163MB/s ± 1% 157MB/s ± 0% -3.55% (p=0.008 n=5+5)
puffs_flate_decode_100k/clang 175MB/s ± 0% 173MB/s ± 0% -0.75% (p=0.016 n=4+5)
puffs_flate_decode_1k/gcc 127MB/s ± 0% 130MB/s ± 0% +2.14% (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc 142MB/s ± 1% 149MB/s ± 0% +4.99% (p=0.016 n=5+4)
puffs_flate_decode_100k/gcc 162MB/s ± 2% 168MB/s ± 0% +3.66% (p=0.016 n=5+4)
2017-10-06 13:07:49 +11:00