Commit Graph
116 Commits
Author SHA1 Message Date
Nigel Tao fca0cab724 Add write and read limits to some tests. 2017-10-14 14:52:54 +11:00
Nigel Tao d4372cb5b8 Change license to Apache 2.
Also remove explicit PATENTS file. The new LICENSE file already
discusses patents.

Note that the Puffs project has not yet been publicly released.
2017-10-12 11:17:41 +11:00
Nigel Tao ac405d485b Rename some internal test functions. 2017-10-07 15:57:18 +11:00
Nigel Tao d275b379a3 Remove the idea of limited reads and writes. 2017-10-07 15:32:00 +11:00
Nigel Tao 010c4db54f Allow explicit returns of built-in status codes. 2017-10-06 17:34:58 +11:00
Nigel Tao 2e883fcc23 Drop the "?" from "copy_history32?".
This makes the caller, not the implementation, responsible for detecting
short reads and writes. This (the lack of "?") is consistent with the
slice.copy_from method.

name                           old speed     new speed     delta
puffs_flate_decode_1k/clang    117MB/s ± 6%  120MB/s ± 0%   +2.31%  (p=0.016 n=5+5)
puffs_flate_decode_10k/clang   153MB/s ± 1%  155MB/s ± 0%   +1.16%  (p=0.008 n=5+5)
puffs_flate_decode_100k/clang  168MB/s ± 1%  177MB/s ± 0%   +5.41%  (p=0.008 n=5+5)
puffs_flate_decode_1k/gcc      127MB/s ± 1%  143MB/s ± 0%  +12.15%  (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc     145MB/s ± 0%  180MB/s ± 1%  +24.00%  (p=0.008 n=5+5)
puffs_flate_decode_100k/gcc    163MB/s ± 0%  212MB/s ± 1%  +29.90%  (p=0.008 n=5+5)
2017-10-06 17:02:09 +11:00
Nigel Tao cf6b1be5b5 Re-organize flate Huffman decoder table bits.
Benchmarks are mixed, but it seems conceptually cleaner to arrange the
bits in the order that they're examined.

name                           old speed     new speed     delta
puffs_flate_decode_1k/clang    125MB/s ± 0%  123MB/s ± 1%  -1.91%  (p=0.008 n=5+5)
puffs_flate_decode_10k/clang   163MB/s ± 1%  157MB/s ± 0%  -3.55%  (p=0.008 n=5+5)
puffs_flate_decode_100k/clang  175MB/s ± 0%  173MB/s ± 0%  -0.75%  (p=0.016 n=4+5)
puffs_flate_decode_1k/gcc      127MB/s ± 0%  130MB/s ± 0%  +2.14%  (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc     142MB/s ± 1%  149MB/s ± 0%  +4.99%  (p=0.016 n=5+4)
puffs_flate_decode_100k/gcc    162MB/s ± 2%  168MB/s ± 0%  +3.66%  (p=0.016 n=5+4)
2017-10-06 13:07:49 +11:00
Nigel Tao e8eff8f5e4 Test that flate history copy doesn't go too far. 2017-10-02 14:39:07 +11:00
Nigel Tao a28dba7fd9 Rename C's foo_constructor to foo_initializer. 2017-09-30 13:01:26 +10:00
Nigel Tao 552fcde35a Remove C destructor functions; they're no-ops. 2017-09-30 12:57:55 +10:00
Nigel Tao 04e8a73d10 Update std/flate's decoder.history_index. 2017-09-30 11:56:30 +10:00
Nigel Tao 6a48794033 Add a flate history test. 2017-09-23 12:39:02 +10:00
Nigel Tao b3710e583f Add a zlib decoder to std/flate. 2017-08-05 16:34:03 +10:00
Nigel Tao e0f87fb2a7 Add a -reps=N flag to "puffs bench". 2017-07-30 08:27:52 +10:00
Nigel Tao 0a45eee9d0 Fix some comment grammar. 2017-07-29 17:24:01 +10:00
Nigel Tao 7cf7829c9e Implement std/flate Huffman table redirects. 2017-07-29 16:25:00 +10:00
Nigel Tao bfbcae4365 Decode std/flate fixed Huffman tables. 2017-07-28 13:28:31 +10:00
Nigel Tao cbcf1b6025 Remove test_puffs_flate_work_in_progress. 2017-07-28 11:33:48 +10:00
Nigel Tao d2aca16f3c Add a copy_history32 method. 2017-07-28 11:25:03 +10:00
Nigel Tao e772352036 Decode the lcode and dcode code lengths. 2017-07-22 16:45:54 +10:00
Nigel Tao f7fb991619 Implement init_huffman. 2017-07-21 15:55:49 +10:00
Nigel Tao 4b7a350a68 Rename the code_length_code_lengths field. 2017-07-21 10:09:44 +10:00
Nigel Tao c463f4956f Add script/print-bits.go. 2017-07-17 17:28:19 +10:00
Nigel Tao 547351cfec Add testdata/romeo.txt.{flate,zlib}. 2017-07-17 16:53:45 +10:00
Nigel Tao 1e39d0302a Have "puffs bench" show the compiler version. 2017-07-16 23:47:04 +10:00
Nigel Tao 4b4473cc91 Flush "puffs bench"'s stdout. 2017-07-16 23:27:36 +10:00
Nigel Tao fe7e6ed10e Handle suspending inside a skip32 call. 2017-07-16 19:28:09 +10:00
Nigel Tao fa18eec3e9 Fix returning limited vs short read. 2017-07-16 19:26:58 +10:00
Nigel Tao bd6d2ea3a1 Handle decoding a GIF in many short reads. 2017-07-16 19:25:49 +10:00
Nigel Tao 20f37a6dab Decode flate code length code lengths. 2017-07-16 12:51:44 +10:00
Nigel Tao 7b7dca4767 Start a flate decoder.decode_dynamic method. 2017-07-14 16:36:51 +10:00
Nigel Tao 85610b5df2 Add a throughput_counter concept.
Example benchstat summary of "puffs bench -mimic" output below, with
some blank lines added for clarity.

For example, gzip and zlib both add a checksum (crc32 and adler32
respectively) to raw flate. The headline mimic_{gzip,zlib}_decode_100k
numbers are 386µs and 347µs per op. Subtracting 73.2µs and 34.3µs for
the checksum times from the headline times give the same number: 313µs.

This 313µs differs from 358µs for raw flate (mimic_flate_decode_100k)
because zlib takes two different code paths for wrapped vs raw flate. In
the zlib source code, this is inflate.c vs infback.c respectively.

----
name                             time/op

mimic_adler32_10k/clang            3.74µs ± 1%
mimic_adler32_100k/clang           34.3µs ± 1%
mimic_crc32_10k/clang              8.10µs ± 1%
mimic_crc32_100k/clang             73.2µs ± 0%

mimic_flate_decode_1k/clang        4.31µs ± 1%
mimic_flate_decode_10k/clang       42.1µs ± 1%
mimic_flate_decode_100k/clang       358µs ± 1%
mimic_gzip_decode_10k/clang        49.8µs ± 1%
mimic_gzip_decode_100k/clang        386µs ± 0%
mimic_zlib_decode_10k/clang        45.3µs ± 0%
mimic_zlib_decode_100k/clang        347µs ± 1%

mimic_adler32_10k/gcc              3.72µs ± 1%
mimic_adler32_100k/gcc             34.3µs ± 2%
mimic_crc32_10k/gcc                8.06µs ± 0%
mimic_crc32_100k/gcc               73.1µs ± 0%

mimic_flate_decode_1k/gcc          4.26µs ± 0%
mimic_flate_decode_10k/gcc         42.0µs ± 0%
mimic_flate_decode_100k/gcc         356µs ± 0%
mimic_gzip_decode_10k/gcc          50.4µs ± 4%
mimic_gzip_decode_100k/gcc          390µs ± 2%
mimic_zlib_decode_10k/gcc          45.6µs ± 1%
mimic_zlib_decode_100k/gcc          348µs ± 1%

puffs_gif_lzw_decode_20k/clang      151µs ± 0%
puffs_gif_lzw_decode_100k/clang     566µs ± 0%
puffs_gif_decode_1k/clang          2.74µs ± 1%
puffs_gif_decode_10k/clang         73.8µs ± 0%
puffs_gif_decode_100k/clang        1.13ms ± 0%
puffs_gif_decode_1000k/clang       7.99ms ± 0%

mimic_gif_decode_1k/clang          6.44µs ± 0%
mimic_gif_decode_10k/clang          107µs ± 0%
mimic_gif_decode_100k/clang        1.38ms ± 0%
mimic_gif_decode_1000k/clang       9.79ms ± 0%

puffs_gif_lzw_decode_20k/gcc        127µs ± 0%
puffs_gif_lzw_decode_100k/gcc       501µs ± 0%
puffs_gif_decode_1k/gcc            2.45µs ± 1%
puffs_gif_decode_10k/gcc           65.1µs ± 0%
puffs_gif_decode_100k/gcc          1.01ms ± 0%
puffs_gif_decode_1000k/gcc         7.16ms ± 1%

mimic_gif_decode_1k/gcc            6.66µs ± 2%
mimic_gif_decode_10k/gcc            108µs ± 1%
mimic_gif_decode_100k/gcc          1.39ms ± 0%
mimic_gif_decode_1000k/gcc         9.93ms ± 1%

name                             speed

mimic_adler32_10k/clang          2.96GB/s ± 1%
mimic_adler32_100k/clang         2.91GB/s ± 1%
mimic_crc32_10k/clang            1.37GB/s ± 1%
mimic_crc32_100k/clang           1.37GB/s ± 0%

mimic_flate_decode_1k/clang       219MB/s ± 1%
mimic_flate_decode_10k/clang      263MB/s ± 1%
mimic_flate_decode_100k/clang     280MB/s ± 1%
mimic_gzip_decode_10k/clang       222MB/s ± 1%
mimic_gzip_decode_100k/clang      259MB/s ± 0%
mimic_zlib_decode_10k/clang       244MB/s ± 0%
mimic_zlib_decode_100k/clang      288MB/s ± 1%

mimic_adler32_10k/gcc            2.97GB/s ± 1%
mimic_adler32_100k/gcc           2.92GB/s ± 2%
mimic_crc32_10k/gcc              1.37GB/s ± 0%
mimic_crc32_100k/gcc             1.37GB/s ± 0%

mimic_flate_decode_1k/gcc         221MB/s ± 0%
mimic_flate_decode_10k/gcc        264MB/s ± 0%
mimic_flate_decode_100k/gcc       281MB/s ± 0%
mimic_gzip_decode_10k/gcc         219MB/s ± 4%
mimic_gzip_decode_100k/gcc        256MB/s ± 2%
mimic_zlib_decode_10k/gcc         243MB/s ± 1%
mimic_zlib_decode_100k/gcc        287MB/s ± 1%

puffs_gif_lzw_decode_20k/clang    128MB/s ± 0%
puffs_gif_lzw_decode_100k/clang   177MB/s ± 0%
puffs_gif_decode_1k/clang         373MB/s ± 1%
puffs_gif_decode_10k/clang        137MB/s ± 0%
puffs_gif_decode_100k/clang       122MB/s ± 0%
puffs_gif_decode_1000k/clang      125MB/s ± 0%

mimic_gif_decode_1k/clang         159MB/s ± 0%
mimic_gif_decode_10k/clang       94.2MB/s ± 0%
mimic_gif_decode_100k/clang       100MB/s ± 0%
mimic_gif_decode_1000k/clang      102MB/s ± 0%

puffs_gif_lzw_decode_20k/gcc      151MB/s ± 0%
puffs_gif_lzw_decode_100k/gcc     200MB/s ± 0%
puffs_gif_decode_1k/gcc           418MB/s ± 1%
puffs_gif_decode_10k/gcc          155MB/s ± 0%
puffs_gif_decode_100k/gcc         137MB/s ± 0%
puffs_gif_decode_1000k/gcc        140MB/s ± 1%

mimic_gif_decode_1k/gcc           154MB/s ± 2%
mimic_gif_decode_10k/gcc         93.0MB/s ± 1%
mimic_gif_decode_100k/gcc        98.9MB/s ± 0%
mimic_gif_decode_1000k/gcc        101MB/s ± 1%
----
2017-07-14 13:09:45 +10:00
Nigel Tao 8be6dc3394 Add adler32 and crc32 benchmarks. 2017-07-14 13:01:08 +10:00
Nigel Tao 03572374dd Add zlib (not just raw flate) benchmark. 2017-07-14 12:00:00 +10:00
Nigel Tao 6c8414099a Add gzip (not just raw flate) benchmark. 2017-07-14 10:53:33 +10:00
Nigel Tao 4302619eba Add "PUFFS" to "ERROR_BAD_PUFFS_VERSION". 2017-07-13 11:34:36 +10:00
Nigel Tao a3302ff1e5 Fix suspending copy_from32. 2017-07-13 11:30:16 +10:00
Nigel Tao 7a41ee4da1 Rename the "status" keyword to "suspension". 2017-07-07 16:54:19 +10:00
Nigel Tao 6a34375cb3 Decode flate stored blocks. 2017-07-07 15:08:40 +10:00
Nigel Tao fe96654119 Rename some tests and benches for consistency. 2017-07-07 12:37:15 +10:00
Nigel Tao 0561297826 Increase soem testlib buffer sizes. 2017-07-07 12:08:56 +10:00
Nigel Tao 0b9f9162a5 Add std/flate tests. 2017-07-07 12:06:54 +10:00
Nigel Tao 4efce30bfc Add more testdata/*.gz files. 2017-07-06 16:35:18 +10:00
Nigel Tao 727073ac89 Make status code names ALL_CAPS; they're macros. 2017-07-06 12:42:09 +10:00
Nigel Tao 4a6907d18a Tweak the "-mimic" flag comments. 2017-07-05 09:28:56 +10:00
Nigel Tao 5ef30a9b60 Add comment about manually running benchmarks. 2017-07-04 22:44:18 +10:00
Nigel Tao d974988eab Reset coro_state to zero at function end.
This allows us to call that coroutine function multiple times.
2017-07-02 13:59:42 +10:00
Nigel Tao 004a583aaf Add a comment about gif_mimic_DGifSlurp. 2017-07-02 13:26:42 +10:00
Nigel Tao 30f9c947f5 Roll back the custom gif_mimic_DGifSlurp function.
See the previous commit for the rationale.
2017-07-02 13:17:36 +10:00
Nigel Tao ab7e0ae795 Add a custom gif_mimic_DGifSlurp function.
This avoids some malloc's of intermediate buffers when using giflib,
i.e. for mimic benchmarks. The numbers don't show a huge difference:

name                          old speed      new speed      delta
gif_mimic_decode_1k/clang      158MB/s ± 0%   158MB/s ± 2%    ~     (p=0.421 n=5+5)
gif_mimic_decode_10k/clang    94.5MB/s ± 0%  93.8MB/s ± 1%  -0.70%  (p=0.016 n=5+5)
gif_mimic_decode_100k/clang    100MB/s ± 0%   100MB/s ± 0%  -0.42%  (p=0.008 n=5+5)
gif_mimic_decode_1000k/clang   102MB/s ± 0%   102MB/s ± 0%  -0.29%  (p=0.016 n=5+5)
gif_mimic_decode_1k/gcc        158MB/s ± 1%   160MB/s ± 0%  +1.34%  (p=0.008 n=5+5)
gif_mimic_decode_10k/gcc      94.3MB/s ± 0%  94.6MB/s ± 0%  +0.36%  (p=0.008 n=5+5)
gif_mimic_decode_100k/gcc      100MB/s ± 0%   101MB/s ± 0%  +0.46%  (p=0.008 n=5+5)
gif_mimic_decode_1000k/gcc     102MB/s ± 0%   103MB/s ± 0%  +0.70%  (p=0.008 n=5+5)

This commit will immediately be followed by a rollback, but it is
committed anyway so that we can refer to these numbers in the git log.
2017-07-02 13:12:45 +10:00