Commit Graph
49 Commits
Author SHA1 Message Date
Nigel Tao b3710e583f Add a zlib decoder to std/flate. 2017-08-05 16:34:03 +10:00
Nigel Tao 0a45eee9d0 Fix some comment grammar. 2017-07-29 17:24:01 +10:00
Nigel Tao 7cf7829c9e Implement std/flate Huffman table redirects. 2017-07-29 16:25:00 +10:00
Nigel Tao bfbcae4365 Decode std/flate fixed Huffman tables. 2017-07-28 13:28:31 +10:00
Nigel Tao cbcf1b6025 Remove test_puffs_flate_work_in_progress. 2017-07-28 11:33:48 +10:00
Nigel Tao d2aca16f3c Add a copy_history32 method. 2017-07-28 11:25:03 +10:00
Nigel Tao e772352036 Decode the lcode and dcode code lengths. 2017-07-22 16:45:54 +10:00
Nigel Tao f7fb991619 Implement init_huffman. 2017-07-21 15:55:49 +10:00
Nigel Tao 4b7a350a68 Rename the code_length_code_lengths field. 2017-07-21 10:09:44 +10:00
Nigel Tao fe7e6ed10e Handle suspending inside a skip32 call. 2017-07-16 19:28:09 +10:00
Nigel Tao fa18eec3e9 Fix returning limited vs short read. 2017-07-16 19:26:58 +10:00
Nigel Tao bd6d2ea3a1 Handle decoding a GIF in many short reads. 2017-07-16 19:25:49 +10:00
Nigel Tao 20f37a6dab Decode flate code length code lengths. 2017-07-16 12:51:44 +10:00
Nigel Tao 7b7dca4767 Start a flate decoder.decode_dynamic method. 2017-07-14 16:36:51 +10:00
Nigel Tao 85610b5df2 Add a throughput_counter concept.
Example benchstat summary of "puffs bench -mimic" output below, with
some blank lines added for clarity.

For example, gzip and zlib both add a checksum (crc32 and adler32
respectively) to raw flate. The headline mimic_{gzip,zlib}_decode_100k
numbers are 386µs and 347µs per op. Subtracting 73.2µs and 34.3µs for
the checksum times from the headline times give the same number: 313µs.

This 313µs differs from 358µs for raw flate (mimic_flate_decode_100k)
because zlib takes two different code paths for wrapped vs raw flate. In
the zlib source code, this is inflate.c vs infback.c respectively.

----
name                             time/op

mimic_adler32_10k/clang            3.74µs ± 1%
mimic_adler32_100k/clang           34.3µs ± 1%
mimic_crc32_10k/clang              8.10µs ± 1%
mimic_crc32_100k/clang             73.2µs ± 0%

mimic_flate_decode_1k/clang        4.31µs ± 1%
mimic_flate_decode_10k/clang       42.1µs ± 1%
mimic_flate_decode_100k/clang       358µs ± 1%
mimic_gzip_decode_10k/clang        49.8µs ± 1%
mimic_gzip_decode_100k/clang        386µs ± 0%
mimic_zlib_decode_10k/clang        45.3µs ± 0%
mimic_zlib_decode_100k/clang        347µs ± 1%

mimic_adler32_10k/gcc              3.72µs ± 1%
mimic_adler32_100k/gcc             34.3µs ± 2%
mimic_crc32_10k/gcc                8.06µs ± 0%
mimic_crc32_100k/gcc               73.1µs ± 0%

mimic_flate_decode_1k/gcc          4.26µs ± 0%
mimic_flate_decode_10k/gcc         42.0µs ± 0%
mimic_flate_decode_100k/gcc         356µs ± 0%
mimic_gzip_decode_10k/gcc          50.4µs ± 4%
mimic_gzip_decode_100k/gcc          390µs ± 2%
mimic_zlib_decode_10k/gcc          45.6µs ± 1%
mimic_zlib_decode_100k/gcc          348µs ± 1%

puffs_gif_lzw_decode_20k/clang      151µs ± 0%
puffs_gif_lzw_decode_100k/clang     566µs ± 0%
puffs_gif_decode_1k/clang          2.74µs ± 1%
puffs_gif_decode_10k/clang         73.8µs ± 0%
puffs_gif_decode_100k/clang        1.13ms ± 0%
puffs_gif_decode_1000k/clang       7.99ms ± 0%

mimic_gif_decode_1k/clang          6.44µs ± 0%
mimic_gif_decode_10k/clang          107µs ± 0%
mimic_gif_decode_100k/clang        1.38ms ± 0%
mimic_gif_decode_1000k/clang       9.79ms ± 0%

puffs_gif_lzw_decode_20k/gcc        127µs ± 0%
puffs_gif_lzw_decode_100k/gcc       501µs ± 0%
puffs_gif_decode_1k/gcc            2.45µs ± 1%
puffs_gif_decode_10k/gcc           65.1µs ± 0%
puffs_gif_decode_100k/gcc          1.01ms ± 0%
puffs_gif_decode_1000k/gcc         7.16ms ± 1%

mimic_gif_decode_1k/gcc            6.66µs ± 2%
mimic_gif_decode_10k/gcc            108µs ± 1%
mimic_gif_decode_100k/gcc          1.39ms ± 0%
mimic_gif_decode_1000k/gcc         9.93ms ± 1%

name                             speed

mimic_adler32_10k/clang          2.96GB/s ± 1%
mimic_adler32_100k/clang         2.91GB/s ± 1%
mimic_crc32_10k/clang            1.37GB/s ± 1%
mimic_crc32_100k/clang           1.37GB/s ± 0%

mimic_flate_decode_1k/clang       219MB/s ± 1%
mimic_flate_decode_10k/clang      263MB/s ± 1%
mimic_flate_decode_100k/clang     280MB/s ± 1%
mimic_gzip_decode_10k/clang       222MB/s ± 1%
mimic_gzip_decode_100k/clang      259MB/s ± 0%
mimic_zlib_decode_10k/clang       244MB/s ± 0%
mimic_zlib_decode_100k/clang      288MB/s ± 1%

mimic_adler32_10k/gcc            2.97GB/s ± 1%
mimic_adler32_100k/gcc           2.92GB/s ± 2%
mimic_crc32_10k/gcc              1.37GB/s ± 0%
mimic_crc32_100k/gcc             1.37GB/s ± 0%

mimic_flate_decode_1k/gcc         221MB/s ± 0%
mimic_flate_decode_10k/gcc        264MB/s ± 0%
mimic_flate_decode_100k/gcc       281MB/s ± 0%
mimic_gzip_decode_10k/gcc         219MB/s ± 4%
mimic_gzip_decode_100k/gcc        256MB/s ± 2%
mimic_zlib_decode_10k/gcc         243MB/s ± 1%
mimic_zlib_decode_100k/gcc        287MB/s ± 1%

puffs_gif_lzw_decode_20k/clang    128MB/s ± 0%
puffs_gif_lzw_decode_100k/clang   177MB/s ± 0%
puffs_gif_decode_1k/clang         373MB/s ± 1%
puffs_gif_decode_10k/clang        137MB/s ± 0%
puffs_gif_decode_100k/clang       122MB/s ± 0%
puffs_gif_decode_1000k/clang      125MB/s ± 0%

mimic_gif_decode_1k/clang         159MB/s ± 0%
mimic_gif_decode_10k/clang       94.2MB/s ± 0%
mimic_gif_decode_100k/clang       100MB/s ± 0%
mimic_gif_decode_1000k/clang      102MB/s ± 0%

puffs_gif_lzw_decode_20k/gcc      151MB/s ± 0%
puffs_gif_lzw_decode_100k/gcc     200MB/s ± 0%
puffs_gif_decode_1k/gcc           418MB/s ± 1%
puffs_gif_decode_10k/gcc          155MB/s ± 0%
puffs_gif_decode_100k/gcc         137MB/s ± 0%
puffs_gif_decode_1000k/gcc        140MB/s ± 1%

mimic_gif_decode_1k/gcc           154MB/s ± 2%
mimic_gif_decode_10k/gcc         93.0MB/s ± 1%
mimic_gif_decode_100k/gcc        98.9MB/s ± 0%
mimic_gif_decode_1000k/gcc        101MB/s ± 1%
----
2017-07-14 13:09:45 +10:00
Nigel Tao 8be6dc3394 Add adler32 and crc32 benchmarks. 2017-07-14 13:01:08 +10:00
Nigel Tao 03572374dd Add zlib (not just raw flate) benchmark. 2017-07-14 12:00:00 +10:00
Nigel Tao 6c8414099a Add gzip (not just raw flate) benchmark. 2017-07-14 10:53:33 +10:00
Nigel Tao 4302619eba Add "PUFFS" to "ERROR_BAD_PUFFS_VERSION". 2017-07-13 11:34:36 +10:00
Nigel Tao a3302ff1e5 Fix suspending copy_from32. 2017-07-13 11:30:16 +10:00
Nigel Tao 7a41ee4da1 Rename the "status" keyword to "suspension". 2017-07-07 16:54:19 +10:00
Nigel Tao 6a34375cb3 Decode flate stored blocks. 2017-07-07 15:08:40 +10:00
Nigel Tao fe96654119 Rename some tests and benches for consistency. 2017-07-07 12:37:15 +10:00
Nigel Tao 0b9f9162a5 Add std/flate tests. 2017-07-07 12:06:54 +10:00
Nigel Tao 727073ac89 Make status code names ALL_CAPS; they're macros. 2017-07-06 12:42:09 +10:00
Nigel Tao 4a6907d18a Tweak the "-mimic" flag comments. 2017-07-05 09:28:56 +10:00
Nigel Tao 5ef30a9b60 Add comment about manually running benchmarks. 2017-07-04 22:44:18 +10:00
Nigel Tao d974988eab Reset coro_state to zero at function end.
This allows us to call that coroutine function multiple times.
2017-07-02 13:59:42 +10:00
Nigel Tao 8d5ef6365d Add mimic benchmarks. 2017-07-02 11:44:24 +10:00
Nigel Tao a65e2bacf0 Add mimic tests. 2017-07-02 11:19:23 +10:00
Nigel Tao 30ca6d42b2 Rename some testdata files for consistency. 2017-06-30 10:47:00 +10:00
Nigel Tao 9fd51a9fc3 Re-organize some test/c/std/gif.c code. 2017-06-30 10:36:31 +10:00
Nigel Tao 6a0cdd4daf Add some more giflzw tests. 2017-06-30 10:35:00 +10:00
Nigel Tao 0203d2f148 Compile with gcc without -std=c99. 2017-06-29 16:27:04 +10:00
Nigel Tao ddde376744 Add testdata/hat.* images. 2017-06-29 15:51:45 +10:00
Nigel Tao 480c509214 Add benchmarks. 2017-06-29 14:13:23 +10:00
Nigel Tao 8fe438d0b4 Temporary code to continue this.lzw.decode calls.
This is a hard-coded, short term fix so that GIF decoding works
end-to-end. The long term fix is to have some principled way of
responding to non-fatal status codes such as "short read".
2017-06-23 15:46:08 +10:00
Nigel Tao 8ad82f5e1f Generate C code to set coroutine state. 2017-06-23 15:35:18 +10:00
Nigel Tao 0088c7e257 Have read_u8 honor the limit. 2017-06-23 10:01:31 +10:00
Nigel Tao 7a3ddbc025 Add a "limit" keyword. 2017-06-22 17:32:56 +10:00
Nigel Tao 17e47fbc1e Add reader1 and writer1 base types. 2017-06-18 11:50:34 +10:00
Nigel Tao d16a25806f Decode a GIF's Global Color Table. 2017-06-18 11:11:10 +10:00
Nigel Tao 524d323992 Decode a GIF's width and height. 2017-06-18 10:05:07 +10:00
Nigel Tao d059fff2ae Re-organize test/c/std/gif.c function names. 2017-06-16 13:07:49 +10:00
Nigel Tao 8882085f91 Generate C code for "if foo?()". 2017-06-16 13:05:07 +10:00
Nigel Tao 1c2ccee966 Put "std" in the "gen/c/std/gif.c" filename. 2017-06-16 11:32:39 +10:00
Nigel Tao dec40addf5 Re-organize test/c/std/gif.c. 2017-06-16 11:02:42 +10:00
Nigel Tao 622d115148 Make test_constructor_not_called more robust.
Previously, it could report a false negative, based on re-using stack
memory from a previous test.
2017-06-16 11:01:32 +10:00
Nigel Tao 70612df43a Re-organize test/c code. 2017-06-16 10:47:54 +10:00