Commit Graph
104 Commits
Author SHA1 Message Date
Nigel Tao b3710e583f Add a zlib decoder to std/flate. 2017-08-05 16:34:03 +10:00
Nigel Tao e0f87fb2a7 Add a -reps=N flag to "puffs bench". 2017-07-30 08:27:52 +10:00
Nigel Tao 0a45eee9d0 Fix some comment grammar. 2017-07-29 17:24:01 +10:00
Nigel Tao 7cf7829c9e Implement std/flate Huffman table redirects. 2017-07-29 16:25:00 +10:00
Nigel Tao bfbcae4365 Decode std/flate fixed Huffman tables. 2017-07-28 13:28:31 +10:00
Nigel Tao cbcf1b6025 Remove test_puffs_flate_work_in_progress. 2017-07-28 11:33:48 +10:00
Nigel Tao d2aca16f3c Add a copy_history32 method. 2017-07-28 11:25:03 +10:00
Nigel Tao e772352036 Decode the lcode and dcode code lengths. 2017-07-22 16:45:54 +10:00
Nigel Tao f7fb991619 Implement init_huffman. 2017-07-21 15:55:49 +10:00
Nigel Tao 4b7a350a68 Rename the code_length_code_lengths field. 2017-07-21 10:09:44 +10:00
Nigel Tao c463f4956f Add script/print-bits.go. 2017-07-17 17:28:19 +10:00
Nigel Tao 547351cfec Add testdata/romeo.txt.{flate,zlib}. 2017-07-17 16:53:45 +10:00
Nigel Tao 1e39d0302a Have "puffs bench" show the compiler version. 2017-07-16 23:47:04 +10:00
Nigel Tao 4b4473cc91 Flush "puffs bench"'s stdout. 2017-07-16 23:27:36 +10:00
Nigel Tao fe7e6ed10e Handle suspending inside a skip32 call. 2017-07-16 19:28:09 +10:00
Nigel Tao fa18eec3e9 Fix returning limited vs short read. 2017-07-16 19:26:58 +10:00
Nigel Tao bd6d2ea3a1 Handle decoding a GIF in many short reads. 2017-07-16 19:25:49 +10:00
Nigel Tao 20f37a6dab Decode flate code length code lengths. 2017-07-16 12:51:44 +10:00
Nigel Tao 7b7dca4767 Start a flate decoder.decode_dynamic method. 2017-07-14 16:36:51 +10:00
Nigel Tao 85610b5df2 Add a throughput_counter concept.
Example benchstat summary of "puffs bench -mimic" output below, with
some blank lines added for clarity.

For example, gzip and zlib both add a checksum (crc32 and adler32
respectively) to raw flate. The headline mimic_{gzip,zlib}_decode_100k
numbers are 386µs and 347µs per op. Subtracting 73.2µs and 34.3µs for
the checksum times from the headline times give the same number: 313µs.

This 313µs differs from 358µs for raw flate (mimic_flate_decode_100k)
because zlib takes two different code paths for wrapped vs raw flate. In
the zlib source code, this is inflate.c vs infback.c respectively.

----
name                             time/op

mimic_adler32_10k/clang            3.74µs ± 1%
mimic_adler32_100k/clang           34.3µs ± 1%
mimic_crc32_10k/clang              8.10µs ± 1%
mimic_crc32_100k/clang             73.2µs ± 0%

mimic_flate_decode_1k/clang        4.31µs ± 1%
mimic_flate_decode_10k/clang       42.1µs ± 1%
mimic_flate_decode_100k/clang       358µs ± 1%
mimic_gzip_decode_10k/clang        49.8µs ± 1%
mimic_gzip_decode_100k/clang        386µs ± 0%
mimic_zlib_decode_10k/clang        45.3µs ± 0%
mimic_zlib_decode_100k/clang        347µs ± 1%

mimic_adler32_10k/gcc              3.72µs ± 1%
mimic_adler32_100k/gcc             34.3µs ± 2%
mimic_crc32_10k/gcc                8.06µs ± 0%
mimic_crc32_100k/gcc               73.1µs ± 0%

mimic_flate_decode_1k/gcc          4.26µs ± 0%
mimic_flate_decode_10k/gcc         42.0µs ± 0%
mimic_flate_decode_100k/gcc         356µs ± 0%
mimic_gzip_decode_10k/gcc          50.4µs ± 4%
mimic_gzip_decode_100k/gcc          390µs ± 2%
mimic_zlib_decode_10k/gcc          45.6µs ± 1%
mimic_zlib_decode_100k/gcc          348µs ± 1%

puffs_gif_lzw_decode_20k/clang      151µs ± 0%
puffs_gif_lzw_decode_100k/clang     566µs ± 0%
puffs_gif_decode_1k/clang          2.74µs ± 1%
puffs_gif_decode_10k/clang         73.8µs ± 0%
puffs_gif_decode_100k/clang        1.13ms ± 0%
puffs_gif_decode_1000k/clang       7.99ms ± 0%

mimic_gif_decode_1k/clang          6.44µs ± 0%
mimic_gif_decode_10k/clang          107µs ± 0%
mimic_gif_decode_100k/clang        1.38ms ± 0%
mimic_gif_decode_1000k/clang       9.79ms ± 0%

puffs_gif_lzw_decode_20k/gcc        127µs ± 0%
puffs_gif_lzw_decode_100k/gcc       501µs ± 0%
puffs_gif_decode_1k/gcc            2.45µs ± 1%
puffs_gif_decode_10k/gcc           65.1µs ± 0%
puffs_gif_decode_100k/gcc          1.01ms ± 0%
puffs_gif_decode_1000k/gcc         7.16ms ± 1%

mimic_gif_decode_1k/gcc            6.66µs ± 2%
mimic_gif_decode_10k/gcc            108µs ± 1%
mimic_gif_decode_100k/gcc          1.39ms ± 0%
mimic_gif_decode_1000k/gcc         9.93ms ± 1%

name                             speed

mimic_adler32_10k/clang          2.96GB/s ± 1%
mimic_adler32_100k/clang         2.91GB/s ± 1%
mimic_crc32_10k/clang            1.37GB/s ± 1%
mimic_crc32_100k/clang           1.37GB/s ± 0%

mimic_flate_decode_1k/clang       219MB/s ± 1%
mimic_flate_decode_10k/clang      263MB/s ± 1%
mimic_flate_decode_100k/clang     280MB/s ± 1%
mimic_gzip_decode_10k/clang       222MB/s ± 1%
mimic_gzip_decode_100k/clang      259MB/s ± 0%
mimic_zlib_decode_10k/clang       244MB/s ± 0%
mimic_zlib_decode_100k/clang      288MB/s ± 1%

mimic_adler32_10k/gcc            2.97GB/s ± 1%
mimic_adler32_100k/gcc           2.92GB/s ± 2%
mimic_crc32_10k/gcc              1.37GB/s ± 0%
mimic_crc32_100k/gcc             1.37GB/s ± 0%

mimic_flate_decode_1k/gcc         221MB/s ± 0%
mimic_flate_decode_10k/gcc        264MB/s ± 0%
mimic_flate_decode_100k/gcc       281MB/s ± 0%
mimic_gzip_decode_10k/gcc         219MB/s ± 4%
mimic_gzip_decode_100k/gcc        256MB/s ± 2%
mimic_zlib_decode_10k/gcc         243MB/s ± 1%
mimic_zlib_decode_100k/gcc        287MB/s ± 1%

puffs_gif_lzw_decode_20k/clang    128MB/s ± 0%
puffs_gif_lzw_decode_100k/clang   177MB/s ± 0%
puffs_gif_decode_1k/clang         373MB/s ± 1%
puffs_gif_decode_10k/clang        137MB/s ± 0%
puffs_gif_decode_100k/clang       122MB/s ± 0%
puffs_gif_decode_1000k/clang      125MB/s ± 0%

mimic_gif_decode_1k/clang         159MB/s ± 0%
mimic_gif_decode_10k/clang       94.2MB/s ± 0%
mimic_gif_decode_100k/clang       100MB/s ± 0%
mimic_gif_decode_1000k/clang      102MB/s ± 0%

puffs_gif_lzw_decode_20k/gcc      151MB/s ± 0%
puffs_gif_lzw_decode_100k/gcc     200MB/s ± 0%
puffs_gif_decode_1k/gcc           418MB/s ± 1%
puffs_gif_decode_10k/gcc          155MB/s ± 0%
puffs_gif_decode_100k/gcc         137MB/s ± 0%
puffs_gif_decode_1000k/gcc        140MB/s ± 1%

mimic_gif_decode_1k/gcc           154MB/s ± 2%
mimic_gif_decode_10k/gcc         93.0MB/s ± 1%
mimic_gif_decode_100k/gcc        98.9MB/s ± 0%
mimic_gif_decode_1000k/gcc        101MB/s ± 1%
----
2017-07-14 13:09:45 +10:00
Nigel Tao 8be6dc3394 Add adler32 and crc32 benchmarks. 2017-07-14 13:01:08 +10:00
Nigel Tao 03572374dd Add zlib (not just raw flate) benchmark. 2017-07-14 12:00:00 +10:00
Nigel Tao 6c8414099a Add gzip (not just raw flate) benchmark. 2017-07-14 10:53:33 +10:00
Nigel Tao 4302619eba Add "PUFFS" to "ERROR_BAD_PUFFS_VERSION". 2017-07-13 11:34:36 +10:00
Nigel Tao a3302ff1e5 Fix suspending copy_from32. 2017-07-13 11:30:16 +10:00
Nigel Tao 7a41ee4da1 Rename the "status" keyword to "suspension". 2017-07-07 16:54:19 +10:00
Nigel Tao 6a34375cb3 Decode flate stored blocks. 2017-07-07 15:08:40 +10:00
Nigel Tao fe96654119 Rename some tests and benches for consistency. 2017-07-07 12:37:15 +10:00
Nigel Tao 0561297826 Increase soem testlib buffer sizes. 2017-07-07 12:08:56 +10:00
Nigel Tao 0b9f9162a5 Add std/flate tests. 2017-07-07 12:06:54 +10:00
Nigel Tao 4efce30bfc Add more testdata/*.gz files. 2017-07-06 16:35:18 +10:00
Nigel Tao 727073ac89 Make status code names ALL_CAPS; they're macros. 2017-07-06 12:42:09 +10:00
Nigel Tao 4a6907d18a Tweak the "-mimic" flag comments. 2017-07-05 09:28:56 +10:00
Nigel Tao 5ef30a9b60 Add comment about manually running benchmarks. 2017-07-04 22:44:18 +10:00
Nigel Tao d974988eab Reset coro_state to zero at function end.
This allows us to call that coroutine function multiple times.
2017-07-02 13:59:42 +10:00
Nigel Tao 004a583aaf Add a comment about gif_mimic_DGifSlurp. 2017-07-02 13:26:42 +10:00
Nigel Tao 30f9c947f5 Roll back the custom gif_mimic_DGifSlurp function.
See the previous commit for the rationale.
2017-07-02 13:17:36 +10:00
Nigel Tao ab7e0ae795 Add a custom gif_mimic_DGifSlurp function.
This avoids some malloc's of intermediate buffers when using giflib,
i.e. for mimic benchmarks. The numbers don't show a huge difference:

name                          old speed      new speed      delta
gif_mimic_decode_1k/clang      158MB/s ± 0%   158MB/s ± 2%    ~     (p=0.421 n=5+5)
gif_mimic_decode_10k/clang    94.5MB/s ± 0%  93.8MB/s ± 1%  -0.70%  (p=0.016 n=5+5)
gif_mimic_decode_100k/clang    100MB/s ± 0%   100MB/s ± 0%  -0.42%  (p=0.008 n=5+5)
gif_mimic_decode_1000k/clang   102MB/s ± 0%   102MB/s ± 0%  -0.29%  (p=0.016 n=5+5)
gif_mimic_decode_1k/gcc        158MB/s ± 1%   160MB/s ± 0%  +1.34%  (p=0.008 n=5+5)
gif_mimic_decode_10k/gcc      94.3MB/s ± 0%  94.6MB/s ± 0%  +0.36%  (p=0.008 n=5+5)
gif_mimic_decode_100k/gcc      100MB/s ± 0%   101MB/s ± 0%  +0.46%  (p=0.008 n=5+5)
gif_mimic_decode_1000k/gcc     102MB/s ± 0%   103MB/s ± 0%  +0.70%  (p=0.008 n=5+5)

This commit will immediately be followed by a rollback, but it is
committed anyway so that we can refer to these numbers in the git log.
2017-07-02 13:12:45 +10:00
Nigel Tao c06580a4f9 Fix a typo. 2017-07-02 12:53:56 +10:00
Nigel Tao ed6c642f98 Strip the "bench_" from "Benchmarkbench_etc". 2017-07-02 11:49:34 +10:00
Nigel Tao 8d5ef6365d Add mimic benchmarks. 2017-07-02 11:44:24 +10:00
Nigel Tao a65e2bacf0 Add mimic tests. 2017-07-02 11:19:23 +10:00
Nigel Tao 11f4cfeb49 Fix C for loop initializer style nit. 2017-06-30 11:46:04 +10:00
Nigel Tao 30ca6d42b2 Rename some testdata files for consistency. 2017-06-30 10:47:00 +10:00
Nigel Tao 9fd51a9fc3 Re-organize some test/c/std/gif.c code. 2017-06-30 10:36:31 +10:00
Nigel Tao 6a0cdd4daf Add some more giflzw tests. 2017-06-30 10:35:00 +10:00
Nigel Tao 0cba6885fa Spell the "-b" flag fully, as "-bench". 2017-06-30 08:50:12 +10:00
Nigel Tao 84b3e6e5c2 Make benchmark suffixes "/gcc" not "_gcc". 2017-06-30 08:35:14 +10:00
Nigel Tao 9e59fd1202 Add instructions to install benchstat. 2017-06-30 08:33:06 +10:00
Nigel Tao 0203d2f148 Compile with gcc without -std=c99. 2017-06-29 16:27:04 +10:00