Commit Graph
1362 Commits
Author SHA1 Message Date
Nigel Tao 8d7bd36179 Add more GIF benchmarks
The existing benchmarks decoded realistic photos. The new benchmarks
also decode artificially generated images, which compress better.

Also adjust script/extract-giflzw.go to optionally analyze and print a
histogram of LZW code emission lengths. "Compresses better" is highly
correlated with "a lower proportion of literal (1 length) codes".
2018-10-21 11:46:37 +11:00
Nigel Tao 6945bdc75c Fill the LZW bit buffer less often
name                             old speed     new speed     delta

wuffs_gif_decode_1k_bw/clang     292MB/s ± 1%  256MB/s ± 1%  -12.29%  (p=0.008 n=5+5)
wuffs_gif_decode_1k_color/clang  143MB/s ± 0%  159MB/s ± 0%  +10.95%  (p=0.008 n=5+5)
wuffs_gif_decode_10k/clang       150MB/s ± 1%  165MB/s ± 0%  +10.24%  (p=0.008 n=5+5)
wuffs_gif_decode_100k/clang      152MB/s ± 0%  150MB/s ± 0%   -1.19%  (p=0.016 n=4+5)
wuffs_gif_decode_1000k/clang     156MB/s ± 1%  153MB/s ± 1%   -1.60%  (p=0.008 n=5+5)

wuffs_gif_decode_1k_bw/gcc       250MB/s ± 1%  330MB/s ± 0%  +31.99%  (p=0.008 n=5+5)
wuffs_gif_decode_1k_color/gcc    172MB/s ± 1%  184MB/s ± 1%   +7.40%  (p=0.008 n=5+5)
wuffs_gif_decode_10k/gcc         189MB/s ± 0%  193MB/s ± 0%   +2.31%  (p=0.008 n=5+5)
wuffs_gif_decode_100k/gcc        166MB/s ± 0%  180MB/s ± 0%   +8.56%  (p=0.008 n=5+5)
wuffs_gif_decode_1000k/gcc       171MB/s ± 0%  186MB/s ± 0%   +8.19%  (p=0.008 n=5+5)

wuffs_lzw_decode_20k/clang       168MB/s ± 3%  168MB/s ± 0%     ~     (p=0.222 n=5+5)
wuffs_lzw_decode_100k/clang      252MB/s ± 1%  239MB/s ± 0%   -4.89%  (p=0.008 n=5+5)

wuffs_lzw_decode_20k/gcc         209MB/s ± 0%  217MB/s ± 0%   +4.28%  (p=0.008 n=5+5)
wuffs_lzw_decode_100k/gcc        307MB/s ± 0%  314MB/s ± 0%   +2.27%  (p=0.008 n=5+5)
2018-10-20 07:22:23 +11:00
Nigel Tao 24e7ee0104 Flush LZW output if stalled on input
name                             old speed     new speed     delta

wuffs_gif_decode_1k_bw/clang     295MB/s ± 0%  292MB/s ± 1%   -0.89%  (p=0.008 n=5+5)
wuffs_gif_decode_1k_color/clang  163MB/s ± 0%  143MB/s ± 0%  -12.15%  (p=0.008 n=5+5)
wuffs_gif_decode_10k/clang       179MB/s ± 0%  150MB/s ± 1%  -16.37%  (p=0.008 n=5+5)
wuffs_gif_decode_100k/clang      155MB/s ± 0%  152MB/s ± 0%   -1.84%  (p=0.016 n=5+4)
wuffs_gif_decode_1000k/clang     159MB/s ± 0%  156MB/s ± 1%   -2.26%  (p=0.008 n=5+5)

wuffs_gif_decode_1k_bw/gcc       313MB/s ± 0%  250MB/s ± 1%  -20.20%  (p=0.008 n=5+5)
wuffs_gif_decode_1k_color/gcc    173MB/s ± 0%  172MB/s ± 1%   -1.01%  (p=0.008 n=5+5)
wuffs_gif_decode_10k/gcc         184MB/s ± 1%  189MB/s ± 0%   +2.34%  (p=0.008 n=5+5)
wuffs_gif_decode_100k/gcc        173MB/s ± 1%  166MB/s ± 0%   -3.88%  (p=0.008 n=5+5)
wuffs_gif_decode_1000k/gcc       179MB/s ± 1%  171MB/s ± 0%   -4.07%  (p=0.008 n=5+5)

wuffs_lzw_decode_20k/clang       185MB/s ± 0%  168MB/s ± 3%   -9.34%  (p=0.008 n=5+5)
wuffs_lzw_decode_100k/clang      260MB/s ± 0%  252MB/s ± 1%   -3.36%  (p=0.008 n=5+5)

wuffs_lzw_decode_20k/gcc         211MB/s ± 0%  209MB/s ± 0%   -1.01%  (p=0.008 n=5+5)
wuffs_lzw_decode_100k/gcc        300MB/s ± 0%  307MB/s ± 0%   +2.16%  (p=0.008 n=5+5)
2018-10-14 22:35:42 +11:00
Nigel Tao ff92d22ea6 Read LZW input bits 4 bytes at a time, not 1
name                             old speed     new speed     delta

wuffs_gif_decode_1k_bw/clang     306MB/s ± 0%  295MB/s ± 0%   -3.62%  (p=0.008 n=5+5)
wuffs_gif_decode_1k_color/clang  156MB/s ± 0%  163MB/s ± 0%   +4.64%  (p=0.008 n=5+5)
wuffs_gif_decode_10k/clang       153MB/s ± 0%  179MB/s ± 0%  +17.34%  (p=0.008 n=5+5)
wuffs_gif_decode_100k/clang      147MB/s ± 0%  155MB/s ± 0%   +5.13%  (p=0.008 n=5+5)
wuffs_gif_decode_1000k/clang     151MB/s ± 1%  159MB/s ± 0%   +5.34%  (p=0.008 n=5+5)

wuffs_gif_decode_1k_bw/gcc       319MB/s ± 0%  313MB/s ± 0%   -1.79%  (p=0.008 n=5+5)
wuffs_gif_decode_1k_color/gcc    165MB/s ± 0%  173MB/s ± 0%   +4.82%  (p=0.008 n=5+5)
wuffs_gif_decode_10k/gcc         171MB/s ± 1%  184MB/s ± 1%   +7.48%  (p=0.008 n=5+5)
wuffs_gif_decode_100k/gcc        161MB/s ± 1%  173MB/s ± 1%   +7.32%  (p=0.008 n=5+5)
wuffs_gif_decode_1000k/gcc       166MB/s ± 0%  179MB/s ± 1%   +7.53%  (p=0.008 n=5+5)

wuffs_lzw_decode_20k/clang       167MB/s ± 0%  185MB/s ± 0%  +10.85%  (p=0.008 n=5+5)
wuffs_lzw_decode_100k/clang      239MB/s ± 0%  260MB/s ± 0%   +8.96%  (p=0.008 n=5+5)

wuffs_lzw_decode_20k/gcc         192MB/s ± 0%  211MB/s ± 0%   +9.47%  (p=0.008 n=5+5)
wuffs_lzw_decode_100k/gcc        295MB/s ± 0%  300MB/s ± 0%   +1.65%  (p=0.008 n=5+5)
2018-10-14 22:14:02 +11:00
Nigel Tao 4e27b1280e Write LZW decoder output in batches
name                             old speed     new speed     delta

wuffs_gif_decode_1k_bw/clang     309MB/s ± 0%  306MB/s ± 0%   -0.93%  (p=0.008 n=5+5)
wuffs_gif_decode_1k_color/clang  160MB/s ± 0%  156MB/s ± 0%   -2.26%  (p=0.008 n=5+5)
wuffs_gif_decode_10k/clang       145MB/s ± 0%  153MB/s ± 0%   +5.21%  (p=0.008 n=5+5)
wuffs_gif_decode_100k/clang      131MB/s ± 1%  147MB/s ± 0%  +12.15%  (p=0.008 n=5+5)
wuffs_gif_decode_1000k/clang     134MB/s ± 0%  151MB/s ± 1%  +12.83%  (p=0.008 n=5+5)

wuffs_gif_decode_1k_bw/gcc       339MB/s ± 0%  319MB/s ± 0%   -5.99%  (p=0.008 n=5+5)
wuffs_gif_decode_1k_color/gcc    186MB/s ± 0%  165MB/s ± 0%  -10.93%  (p=0.008 n=5+5)
wuffs_gif_decode_10k/gcc         164MB/s ± 0%  171MB/s ± 1%   +4.19%  (p=0.008 n=5+5)
wuffs_gif_decode_100k/gcc        143MB/s ± 0%  161MB/s ± 1%  +12.32%  (p=0.008 n=5+5)
wuffs_gif_decode_1000k/gcc       146MB/s ± 0%  166MB/s ± 0%  +13.61%  (p=0.008 n=5+5)

wuffs_lzw_decode_20k/clang       142MB/s ± 0%  167MB/s ± 0%  +17.51%  (p=0.008 n=5+5)
wuffs_lzw_decode_100k/clang      186MB/s ± 1%  239MB/s ± 0%  +28.68%  (p=0.008 n=5+5)

wuffs_lzw_decode_20k/gcc         162MB/s ± 0%  192MB/s ± 0%  +18.63%  (p=0.008 n=5+5)
wuffs_lzw_decode_100k/gcc        235MB/s ± 1%  295MB/s ± 0%  +25.59%  (p=0.008 n=5+5)
2018-10-14 17:53:20 +11:00
Nigel Tao 9573b88a02 Remove unused appendFact code path 2018-10-14 13:11:58 +11:00
Nigel Tao 97f2570977 Fix codegen for skip_fast
args[0] is actual, args[1] is worst_case.
2018-10-14 12:52:52 +11:00
Nigel Tao 630a96ede6 Add token.IDXBinaryTildeModShiftL string form 2018-10-14 12:52:11 +11:00
Nigel Tao cae1bfbc7d Remove LZW "cyclical prefix chain" internal error
name                             old speed     new speed     delta

wuffs_gif_decode_1k_bw/clang     289MB/s ± 1%  309MB/s ± 0%   +6.94%  (p=0.000 n=50+5)
wuffs_gif_decode_1k_color/clang  159MB/s ± 1%  160MB/s ± 0%     ~     (p=0.080 n=48+5)
wuffs_gif_decode_10k/clang       145MB/s ± 1%  145MB/s ± 0%     ~     (p=0.371 n=49+5)
wuffs_gif_decode_100k/clang      125MB/s ± 0%  131MB/s ± 1%   +4.84%  (p=0.000 n=46+5)
wuffs_gif_decode_1000k/clang     128MB/s ± 1%  134MB/s ± 0%   +5.22%  (p=0.000 n=47+5)

wuffs_gif_decode_1k_bw/gcc       341MB/s ± 1%  339MB/s ± 0%   -0.48%  (p=0.001 n=49+5)
wuffs_gif_decode_1k_color/gcc    184MB/s ± 1%  186MB/s ± 0%   +1.10%  (p=0.000 n=50+5)
wuffs_gif_decode_10k/gcc         162MB/s ± 0%  164MB/s ± 0%   +1.76%  (p=0.000 n=50+5)
wuffs_gif_decode_100k/gcc        139MB/s ± 0%  143MB/s ± 0%   +3.49%  (p=0.000 n=49+5)
wuffs_gif_decode_1000k/gcc       142MB/s ± 0%  146MB/s ± 0%   +3.08%  (p=0.000 n=49+5)

wuffs_lzw_decode_20k/clang       132MB/s ± 0%  142MB/s ± 0%   +7.91%  (p=0.000 n=46+5)
wuffs_lzw_decode_100k/clang      170MB/s ± 0%  186MB/s ± 1%   +9.18%  (p=0.000 n=46+5)

wuffs_lzw_decode_20k/gcc         156MB/s ± 0%  162MB/s ± 0%   +3.74%  (p=0.000 n=47+5)
wuffs_lzw_decode_100k/gcc        214MB/s ± 0%  235MB/s ± 1%  +10.03%  (p=0.000 n=47+5)
2018-10-14 11:06:38 +11:00
Nigel Tao b0ab88c3bb wuffs gen -version=0.2.0-alpha.21 2018-10-13 17:02:41 +11:00
Nigel Tao 7be9c39283 Move num_loops out of the image_config
For the GIF format, it isn't necessarily before the first frame.
2018-10-13 17:00:45 +11:00
Nigel Tao 36fd9cfd31 Add comment on how we handle out-of-bound frames 2018-10-13 15:56:45 +11:00
Nigel Tao b68830e292 Add a MASK macro, for hand-written C 2018-10-13 11:43:02 +11:00
Nigel Tao ecd7152581 Fix a comment typo from the previous commit 2018-10-13 11:33:47 +11:00
Nigel Tao 99597e1ff1 Raise the N in crc32's slicing-by-N from 8 to 16
name                          old speed      new speed      delta
wuffs_crc32_ieee_10k/clang    2.35GB/s ± 0%  2.86GB/s ± 1%  +21.45%  (p=0.000 n=47+5)
wuffs_crc32_ieee_100k/clang   2.35GB/s ± 0%  2.86GB/s ± 2%  +21.84%  (p=0.000 n=48+5)
wuffs_crc32_ieee_10k/gcc      2.69GB/s ± 0%  3.36GB/s ± 1%  +25.10%  (p=0.000 n=47+5)
wuffs_crc32_ieee_100k/gcc     2.68GB/s ± 1%  3.39GB/s ± 0%  +26.39%  (p=0.000 n=44+5)
wuffs_gzip_decode_10k/clang    213MB/s ± 0%   215MB/s ± 0%   +0.95%  (p=0.000 n=46+5)
wuffs_gzip_decode_100k/clang   237MB/s ± 0%   240MB/s ± 0%   +1.31%  (p=0.000 n=48+5)
wuffs_gzip_decode_10k/gcc      241MB/s ± 1%   246MB/s ± 0%   +2.00%  (p=0.000 n=45+5)
wuffs_gzip_decode_100k/gcc     283MB/s ± 1%   290MB/s ± 0%   +2.25%  (p=0.000 n=48+5)
2018-10-07 21:01:18 +11:00
Nigel Tao 07151f88ce Copy Huffman optimizations, for hand-written C 2018-10-07 18:24:53 +11:00
Nigel Tao 34049e52d8 Optimize deflate Huffman; tighten an if
name                             old speed     new speed     delta
wuffs_deflate_decode_1k/clang    148MB/s ± 0%  149MB/s ± 0%  +0.61%  (p=0.008 n=5+5)
wuffs_deflate_decode_10k/clang   228MB/s ± 1%  235MB/s ± 0%  +3.45%  (p=0.016 n=5+4)
wuffs_deflate_decode_100k/clang  253MB/s ± 0%  262MB/s ± 0%  +3.42%  (p=0.008 n=5+5)
wuffs_deflate_decode_1k/gcc      158MB/s ± 1%  157MB/s ± 0%  -0.44%  (p=0.032 n=5+5)
wuffs_deflate_decode_10k/gcc     265MB/s ± 0%  274MB/s ± 0%  +3.31%  (p=0.008 n=5+5)
wuffs_deflate_decode_100k/gcc    300MB/s ± 0%  317MB/s ± 0%  +5.45%  (p=0.008 n=5+5)
2018-10-07 18:13:25 +11:00
Nigel Tao 0181537d0d Optimize deflate Huffman; remove unnecessary if
name                             old speed     new speed     delta
wuffs_deflate_decode_1k/clang    150MB/s ± 0%  148MB/s ± 0%  -1.50%  (p=0.008 n=5+5)
wuffs_deflate_decode_10k/clang   223MB/s ± 0%  228MB/s ± 1%  +1.92%  (p=0.008 n=5+5)
wuffs_deflate_decode_100k/clang  243MB/s ± 0%  253MB/s ± 0%  +4.50%  (p=0.008 n=5+5)
wuffs_deflate_decode_1k/gcc      157MB/s ± 0%  158MB/s ± 1%  +0.67%  (p=0.008 n=5+5)
wuffs_deflate_decode_10k/gcc     265MB/s ± 0%  265MB/s ± 0%    ~     (p=0.095 n=5+5)
wuffs_deflate_decode_100k/gcc    299MB/s ± 0%  300MB/s ± 0%    ~     (p=0.056 n=5+5)
2018-10-07 17:57:02 +11:00
Nigel Tao c89833331c wuffs gen -version=0.2.0-alpha.20 2018-10-06 10:37:40 +10:00
Nigel Tao 8b1ffec576 Make struct impls private (opaque pointers)
This gives us flexibility to change sizeof(wuffs_foo__bar__struct)
across Wuffs versions, while retaining ABI / API compatibility.

In particular, this lets us add and remove fields.
2018-10-06 10:33:47 +10:00
Nigel Tao 26a448450e Move C++ method impls inside struct definitions 2018-10-06 10:06:07 +10:00
Nigel Tao 5b82dd905a Separate C struct declaration and definition 2018-10-06 09:45:03 +10:00
Nigel Tao e26ba24fbf Add wuffs_foo__bar__struct names 2018-10-06 09:41:50 +10:00
Nigel Tao dc17398d64 Generate "WUFFS C HEADER ENDS HERE"
Future commits will mean more than one "#ifdef WUFFS_IMPLEMENTATION".
2018-10-06 09:12:04 +10:00
Nigel Tao 7039a5b9c7 wuffs gen -version=0.2.0-alpha.19 2018-09-23 14:54:37 +10:00
Nigel Tao c4edf6ac25 Add sizeof__wuffs_foo__bar functions 2018-09-23 09:26:08 +10:00
Nigel Tao 6cc954d7e1 Have tests return a "const char*" status 2018-09-22 08:43:56 +10:00
Nigel Tao b6da2f4fb4 Clean up iters vs iters_unscaled 2018-09-15 19:42:27 +10:00
Nigel Tao 058d435759 Don't repeat tests iterscale times 2018-09-15 17:33:39 +10:00
Nigel Tao d1758d7a1c Update wuffs-deflate-decoder-decode-huffman.c 2018-09-15 15:05:43 +10:00
Nigel Tao ad02f2ea62 Have pixbuf_len return uint64_t not size_t 2018-09-15 12:50:39 +10:00
Nigel Tao 4985876c5a wuffs gen -version=0.2.0-alpha.18 2018-09-15 09:44:13 +10:00
Nigel Tao a12c45bb7f Rename io_position_reader to reader_io_position 2018-09-15 09:19:34 +10:00
Nigel Tao 8c6cc80b57 Add wuffs_base__status__is_complete 2018-09-15 09:18:53 +10:00
Nigel Tao 73ed2eece1 Change warning string's prefix from "!" to "~" 2018-09-15 08:59:37 +10:00
Nigel Tao 6fa3d5a9f5 have io_writer.set also reset meta.pos 2018-09-15 08:47:30 +10:00
Nigel Tao 6fed251b40 Split an io_buffer's fields into data and meta 2018-09-15 08:45:50 +10:00
Nigel Tao 2e804c8f20 Remove the testlib's global_palette_buffer 2018-09-09 21:50:28 +10:00
Nigel Tao 990463bdac Move u8 subslice methods from private to public 2018-09-09 21:43:34 +10:00
Nigel Tao 180ce5e481 Add wuffs_base__malloc_slice_uxx functions 2018-09-09 21:31:37 +10:00
Nigel Tao 399a7af6ef Fix comment about palette pointer alignment 2018-09-08 11:21:40 +10:00
Nigel Tao 5894b9448c wuffs gen -version=0.2.0-alpha.17 2018-09-08 11:17:58 +10:00
Nigel Tao ead965c61f Add a ! effect to copy_from_slice 2018-09-08 11:14:37 +10:00
Nigel Tao 68e553f305 Tweak wuffs_base__slice_u8 formatting 2018-09-08 11:12:34 +10:00
Nigel Tao 724b136bf8 Remove the obsolete set_palette method 2018-09-08 11:11:36 +10:00
Nigel Tao 2c7fd8058a Repurpose a pixbuf's plane 3 for the palette 2018-09-08 11:03:22 +10:00
Nigel Tao 29986823e5 Don't assume that pixbuf_len == number of pixels 2018-09-08 09:21:24 +10:00
Nigel Tao fbbdc412d1 Rename work_buffer_size to workbuf_len 2018-09-08 09:06:56 +10:00
Nigel Tao ca940b0c56 Rename pixbuf_size to pixbuf_len 2018-09-08 08:47:34 +10:00
Nigel Tao 5bf7c5c051 Add image_config.first_frame_io_position
Also fix a type typo for image_config.first_frame_is_opaque.
2018-09-08 08:40:45 +10:00