Nigel Tao
fca0cab724
Add write and read limits to some tests.
2017-10-14 14:52:54 +11:00
Nigel Tao
d4372cb5b8
Change license to Apache 2.
...
Also remove explicit PATENTS file. The new LICENSE file already
discusses patents.
Note that the Puffs project has not yet been publicly released.
2017-10-12 11:17:41 +11:00
Nigel Tao
ac405d485b
Rename some internal test functions.
2017-10-07 15:57:18 +11:00
Nigel Tao
d275b379a3
Remove the idea of limited reads and writes.
2017-10-07 15:32:00 +11:00
Nigel Tao
010c4db54f
Allow explicit returns of built-in status codes.
2017-10-06 17:34:58 +11:00
Nigel Tao
2e883fcc23
Drop the "?" from "copy_history32?".
...
This makes the caller, not the implementation, responsible for detecting
short reads and writes. This (the lack of "?") is consistent with the
slice.copy_from method.
name old speed new speed delta
puffs_flate_decode_1k/clang 117MB/s ± 6% 120MB/s ± 0% +2.31% (p=0.016 n=5+5)
puffs_flate_decode_10k/clang 153MB/s ± 1% 155MB/s ± 0% +1.16% (p=0.008 n=5+5)
puffs_flate_decode_100k/clang 168MB/s ± 1% 177MB/s ± 0% +5.41% (p=0.008 n=5+5)
puffs_flate_decode_1k/gcc 127MB/s ± 1% 143MB/s ± 0% +12.15% (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc 145MB/s ± 0% 180MB/s ± 1% +24.00% (p=0.008 n=5+5)
puffs_flate_decode_100k/gcc 163MB/s ± 0% 212MB/s ± 1% +29.90% (p=0.008 n=5+5)
2017-10-06 17:02:09 +11:00
Nigel Tao
cf6b1be5b5
Re-organize flate Huffman decoder table bits.
...
Benchmarks are mixed, but it seems conceptually cleaner to arrange the
bits in the order that they're examined.
name old speed new speed delta
puffs_flate_decode_1k/clang 125MB/s ± 0% 123MB/s ± 1% -1.91% (p=0.008 n=5+5)
puffs_flate_decode_10k/clang 163MB/s ± 1% 157MB/s ± 0% -3.55% (p=0.008 n=5+5)
puffs_flate_decode_100k/clang 175MB/s ± 0% 173MB/s ± 0% -0.75% (p=0.016 n=4+5)
puffs_flate_decode_1k/gcc 127MB/s ± 0% 130MB/s ± 0% +2.14% (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc 142MB/s ± 1% 149MB/s ± 0% +4.99% (p=0.016 n=5+4)
puffs_flate_decode_100k/gcc 162MB/s ± 2% 168MB/s ± 0% +3.66% (p=0.016 n=5+4)
2017-10-06 13:07:49 +11:00
Nigel Tao
e8eff8f5e4
Test that flate history copy doesn't go too far.
2017-10-02 14:39:07 +11:00
Nigel Tao
a28dba7fd9
Rename C's foo_constructor to foo_initializer.
2017-09-30 13:01:26 +10:00
Nigel Tao
552fcde35a
Remove C destructor functions; they're no-ops.
2017-09-30 12:57:55 +10:00
Nigel Tao
04e8a73d10
Update std/flate's decoder.history_index.
2017-09-30 11:56:30 +10:00
Nigel Tao
6a48794033
Add a flate history test.
2017-09-23 12:39:02 +10:00
Nigel Tao
b3710e583f
Add a zlib decoder to std/flate.
2017-08-05 16:34:03 +10:00
Nigel Tao
e0f87fb2a7
Add a -reps=N flag to "puffs bench".
2017-07-30 08:27:52 +10:00
Nigel Tao
0a45eee9d0
Fix some comment grammar.
2017-07-29 17:24:01 +10:00
Nigel Tao
7cf7829c9e
Implement std/flate Huffman table redirects.
2017-07-29 16:25:00 +10:00
Nigel Tao
bfbcae4365
Decode std/flate fixed Huffman tables.
2017-07-28 13:28:31 +10:00
Nigel Tao
cbcf1b6025
Remove test_puffs_flate_work_in_progress.
2017-07-28 11:33:48 +10:00
Nigel Tao
d2aca16f3c
Add a copy_history32 method.
2017-07-28 11:25:03 +10:00
Nigel Tao
e772352036
Decode the lcode and dcode code lengths.
2017-07-22 16:45:54 +10:00
Nigel Tao
f7fb991619
Implement init_huffman.
2017-07-21 15:55:49 +10:00
Nigel Tao
4b7a350a68
Rename the code_length_code_lengths field.
2017-07-21 10:09:44 +10:00
Nigel Tao
c463f4956f
Add script/print-bits.go.
2017-07-17 17:28:19 +10:00
Nigel Tao
547351cfec
Add testdata/romeo.txt.{flate,zlib}.
2017-07-17 16:53:45 +10:00
Nigel Tao
1e39d0302a
Have "puffs bench" show the compiler version.
2017-07-16 23:47:04 +10:00
Nigel Tao
4b4473cc91
Flush "puffs bench"'s stdout.
2017-07-16 23:27:36 +10:00
Nigel Tao
fe7e6ed10e
Handle suspending inside a skip32 call.
2017-07-16 19:28:09 +10:00
Nigel Tao
fa18eec3e9
Fix returning limited vs short read.
2017-07-16 19:26:58 +10:00
Nigel Tao
bd6d2ea3a1
Handle decoding a GIF in many short reads.
2017-07-16 19:25:49 +10:00
Nigel Tao
20f37a6dab
Decode flate code length code lengths.
2017-07-16 12:51:44 +10:00
Nigel Tao
7b7dca4767
Start a flate decoder.decode_dynamic method.
2017-07-14 16:36:51 +10:00
Nigel Tao
85610b5df2
Add a throughput_counter concept.
...
Example benchstat summary of "puffs bench -mimic" output below, with
some blank lines added for clarity.
For example, gzip and zlib both add a checksum (crc32 and adler32
respectively) to raw flate. The headline mimic_{gzip,zlib}_decode_100k
numbers are 386µs and 347µs per op. Subtracting 73.2µs and 34.3µs for
the checksum times from the headline times give the same number: 313µs.
This 313µs differs from 358µs for raw flate (mimic_flate_decode_100k)
because zlib takes two different code paths for wrapped vs raw flate. In
the zlib source code, this is inflate.c vs infback.c respectively.
----
name time/op
mimic_adler32_10k/clang 3.74µs ± 1%
mimic_adler32_100k/clang 34.3µs ± 1%
mimic_crc32_10k/clang 8.10µs ± 1%
mimic_crc32_100k/clang 73.2µs ± 0%
mimic_flate_decode_1k/clang 4.31µs ± 1%
mimic_flate_decode_10k/clang 42.1µs ± 1%
mimic_flate_decode_100k/clang 358µs ± 1%
mimic_gzip_decode_10k/clang 49.8µs ± 1%
mimic_gzip_decode_100k/clang 386µs ± 0%
mimic_zlib_decode_10k/clang 45.3µs ± 0%
mimic_zlib_decode_100k/clang 347µs ± 1%
mimic_adler32_10k/gcc 3.72µs ± 1%
mimic_adler32_100k/gcc 34.3µs ± 2%
mimic_crc32_10k/gcc 8.06µs ± 0%
mimic_crc32_100k/gcc 73.1µs ± 0%
mimic_flate_decode_1k/gcc 4.26µs ± 0%
mimic_flate_decode_10k/gcc 42.0µs ± 0%
mimic_flate_decode_100k/gcc 356µs ± 0%
mimic_gzip_decode_10k/gcc 50.4µs ± 4%
mimic_gzip_decode_100k/gcc 390µs ± 2%
mimic_zlib_decode_10k/gcc 45.6µs ± 1%
mimic_zlib_decode_100k/gcc 348µs ± 1%
puffs_gif_lzw_decode_20k/clang 151µs ± 0%
puffs_gif_lzw_decode_100k/clang 566µs ± 0%
puffs_gif_decode_1k/clang 2.74µs ± 1%
puffs_gif_decode_10k/clang 73.8µs ± 0%
puffs_gif_decode_100k/clang 1.13ms ± 0%
puffs_gif_decode_1000k/clang 7.99ms ± 0%
mimic_gif_decode_1k/clang 6.44µs ± 0%
mimic_gif_decode_10k/clang 107µs ± 0%
mimic_gif_decode_100k/clang 1.38ms ± 0%
mimic_gif_decode_1000k/clang 9.79ms ± 0%
puffs_gif_lzw_decode_20k/gcc 127µs ± 0%
puffs_gif_lzw_decode_100k/gcc 501µs ± 0%
puffs_gif_decode_1k/gcc 2.45µs ± 1%
puffs_gif_decode_10k/gcc 65.1µs ± 0%
puffs_gif_decode_100k/gcc 1.01ms ± 0%
puffs_gif_decode_1000k/gcc 7.16ms ± 1%
mimic_gif_decode_1k/gcc 6.66µs ± 2%
mimic_gif_decode_10k/gcc 108µs ± 1%
mimic_gif_decode_100k/gcc 1.39ms ± 0%
mimic_gif_decode_1000k/gcc 9.93ms ± 1%
name speed
mimic_adler32_10k/clang 2.96GB/s ± 1%
mimic_adler32_100k/clang 2.91GB/s ± 1%
mimic_crc32_10k/clang 1.37GB/s ± 1%
mimic_crc32_100k/clang 1.37GB/s ± 0%
mimic_flate_decode_1k/clang 219MB/s ± 1%
mimic_flate_decode_10k/clang 263MB/s ± 1%
mimic_flate_decode_100k/clang 280MB/s ± 1%
mimic_gzip_decode_10k/clang 222MB/s ± 1%
mimic_gzip_decode_100k/clang 259MB/s ± 0%
mimic_zlib_decode_10k/clang 244MB/s ± 0%
mimic_zlib_decode_100k/clang 288MB/s ± 1%
mimic_adler32_10k/gcc 2.97GB/s ± 1%
mimic_adler32_100k/gcc 2.92GB/s ± 2%
mimic_crc32_10k/gcc 1.37GB/s ± 0%
mimic_crc32_100k/gcc 1.37GB/s ± 0%
mimic_flate_decode_1k/gcc 221MB/s ± 0%
mimic_flate_decode_10k/gcc 264MB/s ± 0%
mimic_flate_decode_100k/gcc 281MB/s ± 0%
mimic_gzip_decode_10k/gcc 219MB/s ± 4%
mimic_gzip_decode_100k/gcc 256MB/s ± 2%
mimic_zlib_decode_10k/gcc 243MB/s ± 1%
mimic_zlib_decode_100k/gcc 287MB/s ± 1%
puffs_gif_lzw_decode_20k/clang 128MB/s ± 0%
puffs_gif_lzw_decode_100k/clang 177MB/s ± 0%
puffs_gif_decode_1k/clang 373MB/s ± 1%
puffs_gif_decode_10k/clang 137MB/s ± 0%
puffs_gif_decode_100k/clang 122MB/s ± 0%
puffs_gif_decode_1000k/clang 125MB/s ± 0%
mimic_gif_decode_1k/clang 159MB/s ± 0%
mimic_gif_decode_10k/clang 94.2MB/s ± 0%
mimic_gif_decode_100k/clang 100MB/s ± 0%
mimic_gif_decode_1000k/clang 102MB/s ± 0%
puffs_gif_lzw_decode_20k/gcc 151MB/s ± 0%
puffs_gif_lzw_decode_100k/gcc 200MB/s ± 0%
puffs_gif_decode_1k/gcc 418MB/s ± 1%
puffs_gif_decode_10k/gcc 155MB/s ± 0%
puffs_gif_decode_100k/gcc 137MB/s ± 0%
puffs_gif_decode_1000k/gcc 140MB/s ± 1%
mimic_gif_decode_1k/gcc 154MB/s ± 2%
mimic_gif_decode_10k/gcc 93.0MB/s ± 1%
mimic_gif_decode_100k/gcc 98.9MB/s ± 0%
mimic_gif_decode_1000k/gcc 101MB/s ± 1%
----
2017-07-14 13:09:45 +10:00
Nigel Tao
8be6dc3394
Add adler32 and crc32 benchmarks.
2017-07-14 13:01:08 +10:00
Nigel Tao
03572374dd
Add zlib (not just raw flate) benchmark.
2017-07-14 12:00:00 +10:00
Nigel Tao
6c8414099a
Add gzip (not just raw flate) benchmark.
2017-07-14 10:53:33 +10:00
Nigel Tao
4302619eba
Add "PUFFS" to "ERROR_BAD_PUFFS_VERSION".
2017-07-13 11:34:36 +10:00
Nigel Tao
a3302ff1e5
Fix suspending copy_from32.
2017-07-13 11:30:16 +10:00
Nigel Tao
7a41ee4da1
Rename the "status" keyword to "suspension".
2017-07-07 16:54:19 +10:00
Nigel Tao
6a34375cb3
Decode flate stored blocks.
2017-07-07 15:08:40 +10:00
Nigel Tao
fe96654119
Rename some tests and benches for consistency.
2017-07-07 12:37:15 +10:00
Nigel Tao
0561297826
Increase soem testlib buffer sizes.
2017-07-07 12:08:56 +10:00
Nigel Tao
0b9f9162a5
Add std/flate tests.
2017-07-07 12:06:54 +10:00
Nigel Tao
4efce30bfc
Add more testdata/*.gz files.
2017-07-06 16:35:18 +10:00
Nigel Tao
727073ac89
Make status code names ALL_CAPS; they're macros.
2017-07-06 12:42:09 +10:00
Nigel Tao
4a6907d18a
Tweak the "-mimic" flag comments.
2017-07-05 09:28:56 +10:00
Nigel Tao
5ef30a9b60
Add comment about manually running benchmarks.
2017-07-04 22:44:18 +10:00
Nigel Tao
d974988eab
Reset coro_state to zero at function end.
...
This allows us to call that coroutine function multiple times.
2017-07-02 13:59:42 +10:00
Nigel Tao
004a583aaf
Add a comment about gif_mimic_DGifSlurp.
2017-07-02 13:26:42 +10:00
Nigel Tao
30f9c947f5
Roll back the custom gif_mimic_DGifSlurp function.
...
See the previous commit for the rationale.
2017-07-02 13:17:36 +10:00
Nigel Tao
ab7e0ae795
Add a custom gif_mimic_DGifSlurp function.
...
This avoids some malloc's of intermediate buffers when using giflib,
i.e. for mimic benchmarks. The numbers don't show a huge difference:
name old speed new speed delta
gif_mimic_decode_1k/clang 158MB/s ± 0% 158MB/s ± 2% ~ (p=0.421 n=5+5)
gif_mimic_decode_10k/clang 94.5MB/s ± 0% 93.8MB/s ± 1% -0.70% (p=0.016 n=5+5)
gif_mimic_decode_100k/clang 100MB/s ± 0% 100MB/s ± 0% -0.42% (p=0.008 n=5+5)
gif_mimic_decode_1000k/clang 102MB/s ± 0% 102MB/s ± 0% -0.29% (p=0.016 n=5+5)
gif_mimic_decode_1k/gcc 158MB/s ± 1% 160MB/s ± 0% +1.34% (p=0.008 n=5+5)
gif_mimic_decode_10k/gcc 94.3MB/s ± 0% 94.6MB/s ± 0% +0.36% (p=0.008 n=5+5)
gif_mimic_decode_100k/gcc 100MB/s ± 0% 101MB/s ± 0% +0.46% (p=0.008 n=5+5)
gif_mimic_decode_1000k/gcc 102MB/s ± 0% 103MB/s ± 0% +0.70% (p=0.008 n=5+5)
This commit will immediately be followed by a rollback, but it is
committed anyway so that we can refer to these numbers in the git log.
2017-07-02 13:12:45 +10:00