Nigel Tao
e772352036
Decode the lcode and dcode code lengths.
2017-07-22 16:45:54 +10:00
Nigel Tao
f7fb991619
Implement init_huffman.
2017-07-21 15:55:49 +10:00
Nigel Tao
4b7a350a68
Rename the code_length_code_lengths field.
2017-07-21 10:09:44 +10:00
Nigel Tao
c463f4956f
Add script/print-bits.go.
2017-07-17 17:28:19 +10:00
Nigel Tao
547351cfec
Add testdata/romeo.txt.{flate,zlib}.
2017-07-17 16:53:45 +10:00
Nigel Tao
1e39d0302a
Have "puffs bench" show the compiler version.
2017-07-16 23:47:04 +10:00
Nigel Tao
4b4473cc91
Flush "puffs bench"'s stdout.
2017-07-16 23:27:36 +10:00
Nigel Tao
fe7e6ed10e
Handle suspending inside a skip32 call.
2017-07-16 19:28:09 +10:00
Nigel Tao
fa18eec3e9
Fix returning limited vs short read.
2017-07-16 19:26:58 +10:00
Nigel Tao
bd6d2ea3a1
Handle decoding a GIF in many short reads.
2017-07-16 19:25:49 +10:00
Nigel Tao
20f37a6dab
Decode flate code length code lengths.
2017-07-16 12:51:44 +10:00
Nigel Tao
7b7dca4767
Start a flate decoder.decode_dynamic method.
2017-07-14 16:36:51 +10:00
Nigel Tao
85610b5df2
Add a throughput_counter concept.
...
Example benchstat summary of "puffs bench -mimic" output below, with
some blank lines added for clarity.
For example, gzip and zlib both add a checksum (crc32 and adler32
respectively) to raw flate. The headline mimic_{gzip,zlib}_decode_100k
numbers are 386µs and 347µs per op. Subtracting 73.2µs and 34.3µs for
the checksum times from the headline times give the same number: 313µs.
This 313µs differs from 358µs for raw flate (mimic_flate_decode_100k)
because zlib takes two different code paths for wrapped vs raw flate. In
the zlib source code, this is inflate.c vs infback.c respectively.
----
name time/op
mimic_adler32_10k/clang 3.74µs ± 1%
mimic_adler32_100k/clang 34.3µs ± 1%
mimic_crc32_10k/clang 8.10µs ± 1%
mimic_crc32_100k/clang 73.2µs ± 0%
mimic_flate_decode_1k/clang 4.31µs ± 1%
mimic_flate_decode_10k/clang 42.1µs ± 1%
mimic_flate_decode_100k/clang 358µs ± 1%
mimic_gzip_decode_10k/clang 49.8µs ± 1%
mimic_gzip_decode_100k/clang 386µs ± 0%
mimic_zlib_decode_10k/clang 45.3µs ± 0%
mimic_zlib_decode_100k/clang 347µs ± 1%
mimic_adler32_10k/gcc 3.72µs ± 1%
mimic_adler32_100k/gcc 34.3µs ± 2%
mimic_crc32_10k/gcc 8.06µs ± 0%
mimic_crc32_100k/gcc 73.1µs ± 0%
mimic_flate_decode_1k/gcc 4.26µs ± 0%
mimic_flate_decode_10k/gcc 42.0µs ± 0%
mimic_flate_decode_100k/gcc 356µs ± 0%
mimic_gzip_decode_10k/gcc 50.4µs ± 4%
mimic_gzip_decode_100k/gcc 390µs ± 2%
mimic_zlib_decode_10k/gcc 45.6µs ± 1%
mimic_zlib_decode_100k/gcc 348µs ± 1%
puffs_gif_lzw_decode_20k/clang 151µs ± 0%
puffs_gif_lzw_decode_100k/clang 566µs ± 0%
puffs_gif_decode_1k/clang 2.74µs ± 1%
puffs_gif_decode_10k/clang 73.8µs ± 0%
puffs_gif_decode_100k/clang 1.13ms ± 0%
puffs_gif_decode_1000k/clang 7.99ms ± 0%
mimic_gif_decode_1k/clang 6.44µs ± 0%
mimic_gif_decode_10k/clang 107µs ± 0%
mimic_gif_decode_100k/clang 1.38ms ± 0%
mimic_gif_decode_1000k/clang 9.79ms ± 0%
puffs_gif_lzw_decode_20k/gcc 127µs ± 0%
puffs_gif_lzw_decode_100k/gcc 501µs ± 0%
puffs_gif_decode_1k/gcc 2.45µs ± 1%
puffs_gif_decode_10k/gcc 65.1µs ± 0%
puffs_gif_decode_100k/gcc 1.01ms ± 0%
puffs_gif_decode_1000k/gcc 7.16ms ± 1%
mimic_gif_decode_1k/gcc 6.66µs ± 2%
mimic_gif_decode_10k/gcc 108µs ± 1%
mimic_gif_decode_100k/gcc 1.39ms ± 0%
mimic_gif_decode_1000k/gcc 9.93ms ± 1%
name speed
mimic_adler32_10k/clang 2.96GB/s ± 1%
mimic_adler32_100k/clang 2.91GB/s ± 1%
mimic_crc32_10k/clang 1.37GB/s ± 1%
mimic_crc32_100k/clang 1.37GB/s ± 0%
mimic_flate_decode_1k/clang 219MB/s ± 1%
mimic_flate_decode_10k/clang 263MB/s ± 1%
mimic_flate_decode_100k/clang 280MB/s ± 1%
mimic_gzip_decode_10k/clang 222MB/s ± 1%
mimic_gzip_decode_100k/clang 259MB/s ± 0%
mimic_zlib_decode_10k/clang 244MB/s ± 0%
mimic_zlib_decode_100k/clang 288MB/s ± 1%
mimic_adler32_10k/gcc 2.97GB/s ± 1%
mimic_adler32_100k/gcc 2.92GB/s ± 2%
mimic_crc32_10k/gcc 1.37GB/s ± 0%
mimic_crc32_100k/gcc 1.37GB/s ± 0%
mimic_flate_decode_1k/gcc 221MB/s ± 0%
mimic_flate_decode_10k/gcc 264MB/s ± 0%
mimic_flate_decode_100k/gcc 281MB/s ± 0%
mimic_gzip_decode_10k/gcc 219MB/s ± 4%
mimic_gzip_decode_100k/gcc 256MB/s ± 2%
mimic_zlib_decode_10k/gcc 243MB/s ± 1%
mimic_zlib_decode_100k/gcc 287MB/s ± 1%
puffs_gif_lzw_decode_20k/clang 128MB/s ± 0%
puffs_gif_lzw_decode_100k/clang 177MB/s ± 0%
puffs_gif_decode_1k/clang 373MB/s ± 1%
puffs_gif_decode_10k/clang 137MB/s ± 0%
puffs_gif_decode_100k/clang 122MB/s ± 0%
puffs_gif_decode_1000k/clang 125MB/s ± 0%
mimic_gif_decode_1k/clang 159MB/s ± 0%
mimic_gif_decode_10k/clang 94.2MB/s ± 0%
mimic_gif_decode_100k/clang 100MB/s ± 0%
mimic_gif_decode_1000k/clang 102MB/s ± 0%
puffs_gif_lzw_decode_20k/gcc 151MB/s ± 0%
puffs_gif_lzw_decode_100k/gcc 200MB/s ± 0%
puffs_gif_decode_1k/gcc 418MB/s ± 1%
puffs_gif_decode_10k/gcc 155MB/s ± 0%
puffs_gif_decode_100k/gcc 137MB/s ± 0%
puffs_gif_decode_1000k/gcc 140MB/s ± 1%
mimic_gif_decode_1k/gcc 154MB/s ± 2%
mimic_gif_decode_10k/gcc 93.0MB/s ± 1%
mimic_gif_decode_100k/gcc 98.9MB/s ± 0%
mimic_gif_decode_1000k/gcc 101MB/s ± 1%
----
2017-07-14 13:09:45 +10:00
Nigel Tao
8be6dc3394
Add adler32 and crc32 benchmarks.
2017-07-14 13:01:08 +10:00
Nigel Tao
03572374dd
Add zlib (not just raw flate) benchmark.
2017-07-14 12:00:00 +10:00
Nigel Tao
6c8414099a
Add gzip (not just raw flate) benchmark.
2017-07-14 10:53:33 +10:00
Nigel Tao
4302619eba
Add "PUFFS" to "ERROR_BAD_PUFFS_VERSION".
2017-07-13 11:34:36 +10:00
Nigel Tao
a3302ff1e5
Fix suspending copy_from32.
2017-07-13 11:30:16 +10:00
Nigel Tao
7a41ee4da1
Rename the "status" keyword to "suspension".
2017-07-07 16:54:19 +10:00
Nigel Tao
6a34375cb3
Decode flate stored blocks.
2017-07-07 15:08:40 +10:00
Nigel Tao
fe96654119
Rename some tests and benches for consistency.
2017-07-07 12:37:15 +10:00
Nigel Tao
0561297826
Increase soem testlib buffer sizes.
2017-07-07 12:08:56 +10:00
Nigel Tao
0b9f9162a5
Add std/flate tests.
2017-07-07 12:06:54 +10:00
Nigel Tao
4efce30bfc
Add more testdata/*.gz files.
2017-07-06 16:35:18 +10:00
Nigel Tao
727073ac89
Make status code names ALL_CAPS; they're macros.
2017-07-06 12:42:09 +10:00
Nigel Tao
4a6907d18a
Tweak the "-mimic" flag comments.
2017-07-05 09:28:56 +10:00
Nigel Tao
5ef30a9b60
Add comment about manually running benchmarks.
2017-07-04 22:44:18 +10:00
Nigel Tao
d974988eab
Reset coro_state to zero at function end.
...
This allows us to call that coroutine function multiple times.
2017-07-02 13:59:42 +10:00
Nigel Tao
004a583aaf
Add a comment about gif_mimic_DGifSlurp.
2017-07-02 13:26:42 +10:00
Nigel Tao
30f9c947f5
Roll back the custom gif_mimic_DGifSlurp function.
...
See the previous commit for the rationale.
2017-07-02 13:17:36 +10:00
Nigel Tao
ab7e0ae795
Add a custom gif_mimic_DGifSlurp function.
...
This avoids some malloc's of intermediate buffers when using giflib,
i.e. for mimic benchmarks. The numbers don't show a huge difference:
name old speed new speed delta
gif_mimic_decode_1k/clang 158MB/s ± 0% 158MB/s ± 2% ~ (p=0.421 n=5+5)
gif_mimic_decode_10k/clang 94.5MB/s ± 0% 93.8MB/s ± 1% -0.70% (p=0.016 n=5+5)
gif_mimic_decode_100k/clang 100MB/s ± 0% 100MB/s ± 0% -0.42% (p=0.008 n=5+5)
gif_mimic_decode_1000k/clang 102MB/s ± 0% 102MB/s ± 0% -0.29% (p=0.016 n=5+5)
gif_mimic_decode_1k/gcc 158MB/s ± 1% 160MB/s ± 0% +1.34% (p=0.008 n=5+5)
gif_mimic_decode_10k/gcc 94.3MB/s ± 0% 94.6MB/s ± 0% +0.36% (p=0.008 n=5+5)
gif_mimic_decode_100k/gcc 100MB/s ± 0% 101MB/s ± 0% +0.46% (p=0.008 n=5+5)
gif_mimic_decode_1000k/gcc 102MB/s ± 0% 103MB/s ± 0% +0.70% (p=0.008 n=5+5)
This commit will immediately be followed by a rollback, but it is
committed anyway so that we can refer to these numbers in the git log.
2017-07-02 13:12:45 +10:00
Nigel Tao
c06580a4f9
Fix a typo.
2017-07-02 12:53:56 +10:00
Nigel Tao
ed6c642f98
Strip the "bench_" from "Benchmarkbench_etc".
2017-07-02 11:49:34 +10:00
Nigel Tao
8d5ef6365d
Add mimic benchmarks.
2017-07-02 11:44:24 +10:00
Nigel Tao
a65e2bacf0
Add mimic tests.
2017-07-02 11:19:23 +10:00
Nigel Tao
11f4cfeb49
Fix C for loop initializer style nit.
2017-06-30 11:46:04 +10:00
Nigel Tao
30ca6d42b2
Rename some testdata files for consistency.
2017-06-30 10:47:00 +10:00
Nigel Tao
9fd51a9fc3
Re-organize some test/c/std/gif.c code.
2017-06-30 10:36:31 +10:00
Nigel Tao
6a0cdd4daf
Add some more giflzw tests.
2017-06-30 10:35:00 +10:00
Nigel Tao
0cba6885fa
Spell the "-b" flag fully, as "-bench".
2017-06-30 08:50:12 +10:00
Nigel Tao
84b3e6e5c2
Make benchmark suffixes "/gcc" not "_gcc".
2017-06-30 08:35:14 +10:00
Nigel Tao
9e59fd1202
Add instructions to install benchstat.
2017-06-30 08:33:06 +10:00
Nigel Tao
0203d2f148
Compile with gcc without -std=c99.
2017-06-29 16:27:04 +10:00
Nigel Tao
ddde376744
Add testdata/hat.* images.
2017-06-29 15:51:45 +10:00
Nigel Tao
480c509214
Add benchmarks.
2017-06-29 14:13:23 +10:00
Nigel Tao
04e78ad4e7
Add some detail to testdata/README.md
2017-06-29 10:02:59 +10:00
Nigel Tao
d9b1602557
Add testdata/pi.txt* data.
2017-06-23 18:17:57 +10:00
Nigel Tao
8d16c132da
Add testdata/hibiscus.* images.
2017-06-23 17:54:11 +10:00
Nigel Tao
8fe438d0b4
Temporary code to continue this.lzw.decode calls.
...
This is a hard-coded, short term fix so that GIF decoding works
end-to-end. The long term fix is to have some principled way of
responding to non-fatal status codes such as "short read".
2017-06-23 15:46:08 +10:00
Nigel Tao
8ad82f5e1f
Generate C code to set coroutine state.
2017-06-23 15:35:18 +10:00