Commit Graph
1572 Commits
Author SHA1 Message Date
Nigel Tao 11a6819be9 Add a deflate distance-code-31 test 2019-02-02 13:04:09 +11:00
Nigel Tao e9709992e2 Have the fuzzers check for internal errors 2019-02-02 12:08:44 +11:00
Nigel Tao 92f3958a28 Reduce the deflate decoder Huffman table size
name                                             old speed     new speed     delta

wuffs_deflate_decode_1k/clang5                   138MB/s ± 0%  140MB/s ± 1%  +1.16%  (p=0.008 n=5+5)
wuffs_deflate_decode_10k/clang5                  228MB/s ± 1%  229MB/s ± 1%    ~     (p=0.222 n=5+5)
wuffs_deflate_decode_100k_just_one_read/clang5   267MB/s ± 1%  267MB/s ± 1%    ~     (p=0.690 n=5+5)
wuffs_deflate_decode_100k_many_big_reads/clang5  225MB/s ± 0%  225MB/s ± 0%    ~     (p=0.310 n=5+5)

wuffs_deflate_decode_1k/gcc7                     157MB/s ± 0%  157MB/s ± 0%    ~     (p=0.730 n=4+5)
wuffs_deflate_decode_10k/gcc7                    269MB/s ± 0%  269MB/s ± 1%    ~     (p=0.222 n=5+5)
wuffs_deflate_decode_100k_just_one_read/gcc7     321MB/s ± 0%  321MB/s ± 1%    ~     (p=0.548 n=5+5)
wuffs_deflate_decode_100k_many_big_reads/gcc7    254MB/s ± 0%  254MB/s ± 0%    ~     (p=0.421 n=5+5)

wuffs_gzip_decode_10k/clang5                     205MB/s ± 0%  212MB/s ± 0%  +3.50%  (p=0.016 n=5+4)
wuffs_gzip_decode_100k/clang5                    238MB/s ± 0%  245MB/s ± 0%  +3.31%  (p=0.008 n=5+5)

wuffs_gzip_decode_10k/gcc7                       247MB/s ± 0%  248MB/s ± 0%  +0.47%  (p=0.016 n=5+5)
wuffs_gzip_decode_100k/gcc7                      293MB/s ± 1%  293MB/s ± 0%    ~     (p=0.690 n=5+5)

wuffs_zlib_decode_10k/clang5                     210MB/s ± 0%  210MB/s ± 0%    ~     (p=0.056 n=5+5)
wuffs_zlib_decode_100k/clang5                    244MB/s ± 0%  244MB/s ± 0%    ~     (p=0.556 n=4+5)

wuffs_zlib_decode_10k/gcc7                       247MB/s ± 0%  249MB/s ± 1%  +0.77%  (p=0.008 n=5+5)
wuffs_zlib_decode_100k/gcc7                      288MB/s ± 0%  288MB/s ± 0%    ~     (p=1.000 n=5+5)
2019-02-02 08:46:40 +11:00
Nigel Tao 670b45be53 Add some "horizontal rule" comment lines 2019-02-02 08:10:08 +11:00
Nigel Tao fc66207b59 Add script/mmap-ring-buffer.c 2019-02-02 08:01:01 +11:00
Nigel Tao 8bbdcc4ce1 Allow scalar constants in type expressions 2019-02-02 07:53:59 +11:00
Nigel Tao 278200f560 Fix example for initialize method name change 2019-01-26 16:59:01 +11:00
Nigel Tao 705a84723a For "x shift y", check that y < (x's bit-size) 2019-01-26 16:51:49 +11:00
Nigel Tao 65c2f4971f Rename some initialize methods to prepare or set 2019-01-26 15:46:42 +11:00
Nigel Tao ecccafab09 Add check for interleaved coroutines
It's not an optimization per se, but it seems to help:

name                                             old speed      new speed      delta

wuffs_deflate_decode_1k/clang5                    138MB/s ± 1%   150MB/s ± 1%   +8.96%  (p=0.008 n=5+5)
wuffs_deflate_decode_10k/clang5                   223MB/s ± 0%   243MB/s ± 0%   +9.25%  (p=0.008 n=5+5)
wuffs_deflate_decode_100k_just_one_read/clang5    263MB/s ± 2%   289MB/s ± 0%  +10.19%  (p=0.008 n=5+5)
wuffs_deflate_decode_100k_many_big_reads/clang5   220MB/s ± 1%   243MB/s ± 0%  +10.42%  (p=0.008 n=5+5)

wuffs_deflate_decode_1k/gcc7                      158MB/s ± 0%   157MB/s ± 0%     ~     (p=0.056 n=5+5)
wuffs_deflate_decode_10k/gcc7                     268MB/s ± 0%   268MB/s ± 0%     ~     (p=1.000 n=5+5)
wuffs_deflate_decode_100k_just_one_read/gcc7      312MB/s ± 0%   320MB/s ± 0%   +2.62%  (p=0.008 n=5+5)
wuffs_deflate_decode_100k_many_big_reads/gcc7     254MB/s ± 0%   253MB/s ± 0%   -0.48%  (p=0.016 n=5+5)
2019-01-26 15:33:43 +11:00
Nigel Tao d076b6e800 Remove hand-written decode_huffman_fast type pun
Type punning is undefined behavior.
2019-01-26 10:48:14 +11:00
Nigel Tao b31ddaa052 Make hand-written decode_huffman_fast standalone 2019-01-26 10:19:53 +11:00
Nigel Tao a27b24099e Raise example/zcat's buffer size from 16K to 128K
This matches the 128K buffer size (ZSTD_DStreamOutSize returns
ZSTD_BLOCKSIZE_MAX, defined to be 1<<17 in
https://github.com/facebook/zstd/blob/dev/lib/zstd.h) as shipped as
/usr/bin/zstdcat on Debian.

Decoding a 156 MiB gzipped file:
$ /usr/bin/time ./gen/bin/example-zcat < linux-4.20.4.tar.gz > /dev/null

Before:
2.14user 0.13system 0:02.28elapsed 100%CPU (0avgtext+0avgdata 1076maxresident)k
0inputs+0outputs (0major+75minor)pagefaults 0swaps

After:
2.03user 0.05system 0:02.09elapsed 99%CPU (0avgtext+0avgdata 1460maxresident)k
0inputs+0outputs (0major+135minor)pagefaults 0swaps

Before/After elapsed ratio: 2.28 / 2.09 = 1.09.
2019-01-26 09:32:55 +11:00
Nigel Tao 89fef4cf5f Align cgen's private_impl.placeholder 2019-01-26 09:28:50 +11:00
Nigel Tao f4c5d953ec Have build-all.sh check as a .h file, not just .c 2019-01-26 09:21:18 +11:00
Nigel Tao fda3c4c986 wuffs gen -version=0.2.0-alpha.29 2019-01-19 15:00:39 +11:00
Nigel Tao dec519d9b4 Remove image_config.workbuf_len 2019-01-19 14:49:27 +11:00
Nigel Tao 989c611711 Allow C++ methods even when !WUFFS_IMPLEMENTATION
Also disallow copy and assign.
2019-01-19 14:38:19 +11:00
Nigel Tao f8a619f47d Update lang/check tests for coroutine_resumed 2019-01-19 12:36:27 +11:00
Nigel Tao 6326479e81 Have hand-written decode_huffman_fast copy history
This makes it pass "wuffs test -skipgen std/deflate".
2019-01-19 12:13:09 +11:00
Nigel Tao c6a48b3731 Call decode_huffman_fast more often
name                                             old speed     new speed     delta

wuffs_deflate_decode_1k/clang5                   137MB/s ± 0%  139MB/s ± 0%   +1.19%  (p=0.008 n=5+5)
wuffs_deflate_decode_10k/clang5                  219MB/s ± 0%  224MB/s ± 0%   +2.59%  (p=0.008 n=5+5)
wuffs_deflate_decode_100k_just_one_read/clang5   257MB/s ± 0%  265MB/s ± 0%   +3.41%  (p=0.008 n=5+5)
wuffs_deflate_decode_100k_many_big_reads/clang5  181MB/s ± 0%  220MB/s ± 0%  +21.72%  (p=0.008 n=5+5)

wuffs_deflate_decode_1k/gcc7                     157MB/s ± 0%  156MB/s ± 1%   -0.63%  (p=0.032 n=5+5)
wuffs_deflate_decode_10k/gcc7                    263MB/s ± 1%  269MB/s ± 0%   +2.39%  (p=0.008 n=5+5)
wuffs_deflate_decode_100k_just_one_read/gcc7     310MB/s ± 1%  314MB/s ± 0%   +1.27%  (p=0.008 n=5+5)
wuffs_deflate_decode_100k_many_big_reads/gcc7    158MB/s ± 1%  254MB/s ± 0%  +61.29%  (p=0.008 n=5+5)
2019-01-19 10:50:40 +11:00
Nigel Tao 2fd03f42b5 Prepare to call decode_huffman_fast more often 2019-01-19 10:33:58 +11:00
Nigel Tao 1af543866c Add an implicit coroutine_resumed variable 2019-01-13 11:41:58 +11:00
Nigel Tao 89c136ebe4 Add token.ID.IsCannotAssignTo 2019-01-13 11:15:17 +11:00
Nigel Tao b18209c7dd Re-order some token.ID numbers 2019-01-13 11:11:39 +11:00
Nigel Tao 109d6f04bc Add std/deflate many_big_read benchmarks 2019-01-13 10:08:40 +11:00
Nigel Tao cf52415f9f Have hand-written decode_huffman_fast obey limits
This makes it pass "wuffs test -skipgen std/deflate".
2019-01-13 09:00:37 +11:00
Nigel Tao dea71ad324 Update wuffs-deflate-decoder-decode-huffman.c 2019-01-13 08:33:40 +11:00
Nigel Tao 031783f9c8 Add C compiler version to test and bench output 2019-01-12 14:52:30 +11:00
Nigel Tao e071e171cc Have bench-go-gif process multiple images 2019-01-12 14:38:17 +11:00
Nigel Tao c3a07db892 Add wuffs_gif_decode_20k benchmark
That GIF image's LZW-compressed data is the same as that used for the
wuffs_lzw_decode_20k benchmark. Comparing the two speeds gives some
indication of the relative overhead of the framing format, as well as
decoding to a richer data structure (2D table instead of a 1D array,
potentially to BGRA instead of palette-index, amongst other things).

name                        speed
wuffs_gif_decode_20k/clang  246MB/s ± 1%
wuffs_gif_decode_20k/gcc    234MB/s ± 1%
wuffs_lzw_decode_20k/clang  272MB/s ± 0%
wuffs_lzw_decode_20k/gcc    269MB/s ± 0%
2019-01-12 14:17:03 +11:00
Nigel Tao 419d403257 Build benchmarks with "-Wall -Werror" 2019-01-12 12:37:52 +11:00
Nigel Tao 95d02eed0a Update a script/bench-etc program for API changes 2019-01-12 12:34:40 +11:00
Nigel Tao dd3d9f6766 Add wuffs_base__pixel_format__bits_per_pixel 2019-01-12 11:52:02 +11:00
Nigel Tao 16e97281e2 Rename some decode methods to decode_io_writer 2019-01-12 10:29:41 +11:00
Nigel Tao abeff31736 Take an if check out of incrementing lzw's width
name                                    old speed      new speed      delta

wuffs_gif_decode_1k_bw/clang             245MB/s ± 1%   246MB/s ± 1%     ~     (p=0.132 n=48+48)
wuffs_gif_decode_1k_color/clang          140MB/s ± 1%   145MB/s ± 1%   +3.75%  (p=0.000 n=47+47)
wuffs_gif_decode_10k_bgra/clang          684MB/s ± 1%   741MB/s ± 1%   +8.37%  (p=0.000 n=50+47)
wuffs_gif_decode_10k_indexed/clang       183MB/s ± 1%   200MB/s ± 1%   +9.38%  (p=0.000 n=48+44)
wuffs_gif_decode_100k_artificial/clang   530MB/s ± 1%   562MB/s ± 0%   +6.06%  (p=0.000 n=47+48)
wuffs_gif_decode_100k_realistic/clang    212MB/s ± 0%   231MB/s ± 0%   +9.10%  (p=0.000 n=44+48)
wuffs_gif_decode_1000k/clang             216MB/s ± 0%   237MB/s ± 1%   +9.69%  (p=0.000 n=46+48)
wuffs_gif_decode_anim_screencap/clang   1.09GB/s ± 0%  1.12GB/s ± 0%   +2.57%  (p=0.000 n=46+47)

wuffs_gif_decode_1k_bw/gcc               265MB/s ± 1%   264MB/s ± 1%   -0.29%  (p=0.000 n=48+49)
wuffs_gif_decode_1k_color/gcc            147MB/s ± 1%   146MB/s ± 0%   -0.46%  (p=0.000 n=46+47)
wuffs_gif_decode_10k_bgra/gcc            603MB/s ± 1%   625MB/s ± 1%   +3.62%  (p=0.000 n=46+47)
wuffs_gif_decode_10k_indexed/gcc         187MB/s ± 1%   195MB/s ± 1%   +4.20%  (p=0.000 n=48+47)
wuffs_gif_decode_100k_artificial/gcc     517MB/s ± 1%   517MB/s ± 1%   -0.17%  (p=0.001 n=44+48)
wuffs_gif_decode_100k_realistic/gcc      213MB/s ± 1%   212MB/s ± 1%   -0.69%  (p=0.000 n=45+48)
wuffs_gif_decode_1000k/gcc               217MB/s ± 1%   216MB/s ± 1%   -0.22%  (p=0.000 n=46+48)
wuffs_gif_decode_anim_screencap/gcc     1.08GB/s ± 1%  1.07GB/s ± 1%   -1.00%  (p=0.000 n=45+48)

wuffs_lzw_decode_20k/clang               251MB/s ± 0%   274MB/s ± 1%   +8.80%  (p=0.000 n=48+48)
wuffs_lzw_decode_100k/clang              430MB/s ± 0%   479MB/s ± 0%  +11.29%  (p=0.000 n=46+44)

wuffs_lzw_decode_20k/gcc                 268MB/s ± 1%   273MB/s ± 0%   +1.75%  (p=0.000 n=47+45)
wuffs_lzw_decode_100k/gcc                480MB/s ± 1%   488MB/s ± 1%   +1.59%  (p=0.000 n=46+47)
2019-01-12 10:29:02 +11:00
Nigel Tao bdd31a2dc8 wuffs gen -version=0.2.0-alpha.28 2019-01-06 21:23:40 +11:00
Nigel Tao 867ea1cdcc Re-organize WUFFS_VERSION_BUILD_METADATA_XXX 2019-01-06 21:21:36 +11:00
Nigel Tao ef5fc86f8a Allow "if true" and "if false" 2019-01-06 20:28:33 +11:00
Nigel Tao 9c631e25cf Fix lib/nie/README.md typo 2018-12-30 22:21:27 +11:00
Nigel Tao 5addc976aa Add docs for Naïve Image Formats: NIE, NII, NIA 2018-12-30 22:14:39 +11:00
Nigel Tao aef136611c Add WUFFS_VERSION_GIT_REV_LIST_COUNT comment 2018-12-30 21:39:14 +11:00
Nigel Tao 63988f3077 Have gen release use commit date not current date 2018-12-30 21:27:25 +11:00
Nigel Tao 01afa9496b Have "wuffs gen" call "git rev-parse HEAD" 2018-12-30 21:02:28 +11:00
Nigel Tao dc5e81868d wuffs gen -version=0.2.0-alpha.27 2018-12-29 15:52:12 +11:00
Nigel Tao 2b631202bc Generate WUFFS_VERSION_GIT_REV_LIST_COUNT 2018-12-29 15:45:04 +11:00
Nigel Tao 11d7629efd Fix a "release/c/etc.c" comment typo 2018-12-29 15:20:38 +11:00
Nigel Tao 34bf05c5c6 wuffs gen -version=0.2.0-alpha.26 2018-12-29 14:43:01 +11:00
Nigel Tao 314b1209ed Let std/lzw mix automatic and manual flushes 2018-12-29 14:23:27 +11:00
Nigel Tao c4cc0f4177 Add comment about previous perf-related commit 2018-12-29 14:10:57 +11:00