Commit Graph
1463 Commits
Author SHA1 Message Date
Nigel Tao bf7baf5381 Refactor gif's decode_id_part1 method 2018-12-23 08:18:37 +11:00
Nigel Tao 8adbc5ddf7 wuffs gen -version=0.2.0-alpha.25 2018-12-22 17:04:58 +11:00
Nigel Tao 39a01cdc64 Flush std/gif when paused on the next block size 2018-12-22 16:51:46 +11:00
Nigel Tao 04c91f1410 Generate .c files instead of .h files
The files' contents haven't changed (other than some relative #include's
that refer to other .c files).

Some build systems have difficulty recognizing .h files as things to be
compiled, instead of just things referred to by things to be compiled.
2018-12-22 15:29:00 +11:00
Nigel Tao b0429923fc wuffs gen -version=0.2.0-alpha.24 2018-12-22 15:03:00 +11:00
Nigel Tao 179f7afb9b Have lzw rewind in and flush out on a bad code
name                                    old speed      new speed      delta

wuffs_lzw_decode_20k/clang               214MB/s ± 0%   204MB/s ± 2%  -4.62%  (p=0.008 n=5+5)
wuffs_lzw_decode_100k/clang              369MB/s ± 0%   337MB/s ± 2%  -8.72%  (p=0.008 n=5+5)

wuffs_lzw_decode_20k/gcc                 232MB/s ± 1%   236MB/s ± 0%  +1.99%  (p=0.008 n=5+5)
wuffs_lzw_decode_100k/gcc                384MB/s ± 1%   396MB/s ± 1%  +3.00%  (p=0.008 n=5+5)

wuffs_gif_decode_1k_bw/clang             236MB/s ± 0%   230MB/s ± 0%  -2.67%  (p=0.008 n=5+5)
wuffs_gif_decode_1k_color/clang          118MB/s ± 1%   120MB/s ± 0%  +1.10%  (p=0.008 n=5+5)
wuffs_gif_decode_10k_bgra/clang          562MB/s ± 0%   562MB/s ± 0%    ~     (p=0.690 n=5+5)
wuffs_gif_decode_10k_indexed/clang       149MB/s ± 0%   149MB/s ± 0%    ~     (p=0.421 n=5+5)
wuffs_gif_decode_100k_artificial/clang   487MB/s ± 0%   459MB/s ± 1%  -5.63%  (p=0.008 n=5+5)
wuffs_gif_decode_100k_realistic/clang    183MB/s ± 0%   174MB/s ± 0%  -4.52%  (p=0.008 n=5+5)
wuffs_gif_decode_1000k/clang             185MB/s ± 0%   177MB/s ± 1%  -4.61%  (p=0.008 n=5+5)
wuffs_gif_decode_anim_screencap/clang   1.02GB/s ± 0%  0.97GB/s ± 0%  -5.30%  (p=0.008 n=5+5)

wuffs_gif_decode_1k_bw/gcc               250MB/s ± 0%   249MB/s ± 0%  -0.63%  (p=0.016 n=5+5)
wuffs_gif_decode_1k_color/gcc            133MB/s ± 0%   133MB/s ± 1%    ~     (p=0.151 n=5+5)
wuffs_gif_decode_10k_bgra/gcc            543MB/s ± 1%   543MB/s ± 0%    ~     (p=0.548 n=5+5)
wuffs_gif_decode_10k_indexed/gcc         167MB/s ± 1%   166MB/s ± 1%  -0.83%  (p=0.032 n=5+5)
wuffs_gif_decode_100k_artificial/gcc     465MB/s ± 1%   465MB/s ± 1%    ~     (p=0.841 n=5+5)
wuffs_gif_decode_100k_realistic/gcc      190MB/s ± 0%   190MB/s ± 1%    ~     (p=0.222 n=5+5)
wuffs_gif_decode_1000k/gcc               192MB/s ± 1%   193MB/s ± 0%    ~     (p=0.421 n=5+5)
wuffs_gif_decode_anim_screencap/gcc     1.00GB/s ± 1%  1.00GB/s ± 1%    ~     (p=0.841 n=5+5)
2018-12-22 14:45:42 +11:00
Nigel Tao 010df42d75 Have std/lzw always rewind excess bits
I'm not sure of the underlying reason for the lzw/gcc benchmark anomaly
(the gif/gcc numbers don't change), but it's the same mystery as commit
ecb3995 `Tweak how std/lzw yields "short read"`.

name                                    old speed      new speed      delta

wuffs_lzw_decode_20k/clang               223MB/s ± 0%   214MB/s ± 0%   -3.96%  (p=0.008 n=5+5)
wuffs_lzw_decode_100k/clang              385MB/s ± 0%   369MB/s ± 0%   -4.15%  (p=0.008 n=5+5)

wuffs_lzw_decode_20k/gcc                 186MB/s ± 1%   232MB/s ± 1%  +24.41%  (p=0.008 n=5+5)
wuffs_lzw_decode_100k/gcc                224MB/s ± 1%   384MB/s ± 1%  +71.81%  (p=0.008 n=5+5)

wuffs_gif_decode_1k_bw/clang             238MB/s ± 1%   236MB/s ± 0%     ~     (p=0.222 n=5+5)
wuffs_gif_decode_1k_color/clang          124MB/s ± 0%   118MB/s ± 1%   -4.75%  (p=0.008 n=5+5)
wuffs_gif_decode_10k_bgra/clang          596MB/s ± 0%   562MB/s ± 0%   -5.71%  (p=0.008 n=5+5)
wuffs_gif_decode_10k_indexed/clang       159MB/s ± 0%   149MB/s ± 0%   -6.42%  (p=0.008 n=5+5)
wuffs_gif_decode_100k_artificial/clang   492MB/s ± 1%   487MB/s ± 0%   -0.98%  (p=0.008 n=5+5)
wuffs_gif_decode_100k_realistic/clang    192MB/s ± 0%   183MB/s ± 0%   -5.07%  (p=0.008 n=5+5)
wuffs_gif_decode_1000k/clang             195MB/s ± 0%   185MB/s ± 0%   -4.93%  (p=0.008 n=5+5)
wuffs_gif_decode_anim_screencap/clang   1.01GB/s ± 1%  1.02GB/s ± 0%   +1.25%  (p=0.008 n=5+5)

wuffs_gif_decode_1k_bw/gcc               247MB/s ± 0%   250MB/s ± 0%   +1.26%  (p=0.008 n=5+5)
wuffs_gif_decode_1k_color/gcc            131MB/s ± 2%   133MB/s ± 0%     ~     (p=0.151 n=5+5)
wuffs_gif_decode_10k_bgra/gcc            541MB/s ± 1%   543MB/s ± 1%     ~     (p=0.548 n=5+5)
wuffs_gif_decode_10k_indexed/gcc         167MB/s ± 0%   167MB/s ± 1%     ~     (p=0.730 n=4+5)
wuffs_gif_decode_100k_artificial/gcc     469MB/s ± 0%   465MB/s ± 1%   -0.78%  (p=0.016 n=4+5)
wuffs_gif_decode_100k_realistic/gcc      190MB/s ± 0%   190MB/s ± 0%   -0.34%  (p=0.032 n=4+5)
wuffs_gif_decode_1000k/gcc               193MB/s ± 1%   192MB/s ± 1%     ~     (p=0.556 n=4+5)
wuffs_gif_decode_anim_screencap/gcc      995MB/s ± 1%   995MB/s ± 1%     ~     (p=0.841 n=5+5)
2018-12-22 14:05:34 +11:00
Nigel Tao 0f27e97e28 Discard std/gif's compressed buffer after decode 2018-12-22 13:19:33 +11:00
Nigel Tao 529ebb0a61 Introduce binary alpha 2018-12-22 08:48:49 +11:00
Nigel Tao 57e5a785f7 Rename some private copy_n_from_history variables 2018-12-16 11:33:35 +11:00
Nigel Tao baf1b9f9e6 Rename some I/O private methods 2018-12-16 11:28:25 +11:00
Nigel Tao eb0cbd802a Make SubExprHasEffect an ast.Flags not ast.Effect 2018-12-16 11:09:23 +11:00
Nigel Tao dd28f3c0f9 Remove the "? but not !?" effect 2018-12-16 11:03:31 +11:00
Nigel Tao 9311f7a694 Rename some std/lzw methods 2018-12-16 10:23:53 +11:00
Nigel Tao 7a02605144 Remove the std/lzw decoder.available method 2018-12-16 10:21:55 +11:00
Nigel Tao 247232091d Delete an obsolete io_bind in std/gif 2018-12-16 10:12:43 +11:00
Nigel Tao 622a76d4c0 Avoid buffer copies from LZW to GIF
name                                    old speed     new speed      delta

wuffs_lzw_decode_20k/clang              213MB/s ± 0%   224MB/s ± 1%   +4.89%  (p=0.008 n=5+5)
wuffs_lzw_decode_100k/clang             359MB/s ± 1%   393MB/s ± 2%   +9.36%  (p=0.008 n=5+5)

wuffs_lzw_decode_20k/gcc                188MB/s ± 0%   187MB/s ± 0%   -0.70%  (p=0.008 n=5+5)
wuffs_lzw_decode_100k/gcc               223MB/s ± 2%   224MB/s ± 0%     ~     (p=0.690 n=5+5)

wuffs_gif_decode_1k_bw/clang            227MB/s ± 1%   240MB/s ± 0%   +5.89%  (p=0.008 n=5+5)
wuffs_gif_decode_1k_color/clang         117MB/s ± 0%   125MB/s ± 0%   +6.16%  (p=0.008 n=5+5)
wuffs_gif_decode_10k_bgra/clang         567MB/s ± 1%   599MB/s ± 0%   +5.56%  (p=0.008 n=5+5)
wuffs_gif_decode_10k_indexed/clang      152MB/s ± 0%   159MB/s ± 1%   +4.76%  (p=0.008 n=5+5)
wuffs_gif_decode_100k_artificial/clang  455MB/s ± 1%   504MB/s ± 0%  +10.93%  (p=0.008 n=5+5)
wuffs_gif_decode_100k_realistic/clang   178MB/s ± 2%   194MB/s ± 0%   +9.00%  (p=0.008 n=5+5)
wuffs_gif_decode_1000k/clang            179MB/s ± 1%   197MB/s ± 0%   +9.81%  (p=0.016 n=5+4)
wuffs_gif_decode_anim_screencap/clang   952MB/s ± 0%  1050MB/s ± 1%  +10.29%  (p=0.008 n=5+5)

wuffs_gif_decode_1k_bw/gcc              243MB/s ± 1%   252MB/s ± 0%   +3.71%  (p=0.008 n=5+5)
wuffs_gif_decode_1k_color/gcc           130MB/s ± 0%   133MB/s ± 1%   +2.69%  (p=0.008 n=5+5)
wuffs_gif_decode_10k_bgra/gcc           537MB/s ± 0%   547MB/s ± 1%   +1.93%  (p=0.008 n=5+5)
wuffs_gif_decode_10k_indexed/gcc        163MB/s ± 0%   167MB/s ± 1%   +2.40%  (p=0.008 n=5+5)
wuffs_gif_decode_100k_artificial/gcc    458MB/s ± 0%   471MB/s ± 0%   +2.90%  (p=0.016 n=5+4)
wuffs_gif_decode_100k_realistic/gcc     186MB/s ± 0%   191MB/s ± 0%   +3.08%  (p=0.008 n=5+5)
wuffs_gif_decode_1000k/gcc              189MB/s ± 0%   194MB/s ± 0%   +2.70%  (p=0.008 n=5+5)
wuffs_gif_decode_anim_screencap/gcc     976MB/s ± 0%  1010MB/s ± 0%   +3.49%  (p=0.008 n=5+5)
2018-12-16 09:57:15 +11:00
Nigel Tao 4164583323 Add a src arg to std/gif's copy_to_image_buffer 2018-12-16 08:52:32 +11:00
Nigel Tao 5aede827ad Roll back Tweak how std/lzw yields "short read"
See the previous commit for the rationale.
2018-12-16 08:23:34 +11:00
Nigel Tao ecb399508c Tweak how std/lzw yields "short read"
This fixes a std/lzw performance regression (for gcc only, not clang),
introduced in 33a4557 "Collect GIF's LZW data into larger batches".

This commit restores the std/lzw performance, but it also makes the
std/gif benchmarks worse. As LZW is not really used outside of GIF, this
commit will immediately be followed by a rollback, but it is committed
anyway so that we can refer to these numbers in the git log.

name                                    old speed     new speed     delta

wuffs_lzw_decode_20k/clang              213MB/s ± 1%  205MB/s ± 1%   -3.90%  (p=0.008 n=5+5)
wuffs_lzw_decode_100k/clang             359MB/s ± 1%  351MB/s ± 0%   -2.14%  (p=0.008 n=5+5)

wuffs_lzw_decode_20k/gcc                189MB/s ± 0%  229MB/s ± 0%  +21.37%  (p=0.008 n=5+5)
wuffs_lzw_decode_100k/gcc               223MB/s ± 0%  390MB/s ± 1%  +74.77%  (p=0.016 n=4+5)

wuffs_gif_decode_1k_bw/clang            225MB/s ± 1%  229MB/s ± 0%   +1.52%  (p=0.008 n=5+5)
wuffs_gif_decode_1k_color/clang         118MB/s ± 1%  118MB/s ± 1%     ~     (p=0.841 n=5+5)
wuffs_gif_decode_10k_bgra/clang         569MB/s ± 0%  565MB/s ± 0%   -0.66%  (p=0.008 n=5+5)
wuffs_gif_decode_10k_indexed/clang      152MB/s ± 1%  150MB/s ± 1%   -1.25%  (p=0.008 n=5+5)
wuffs_gif_decode_100k_artificial/clang  454MB/s ± 1%  459MB/s ± 0%   +1.05%  (p=0.008 n=5+5)
wuffs_gif_decode_100k_realistic/clang   179MB/s ± 0%  178MB/s ± 1%     ~     (p=0.222 n=5+5)
wuffs_gif_decode_1000k/clang            180MB/s ± 1%  181MB/s ± 0%   +0.79%  (p=0.016 n=5+5)
wuffs_gif_decode_anim_screencap/clang   951MB/s ± 0%  958MB/s ± 0%   +0.66%  (p=0.008 n=5+5)

wuffs_gif_decode_1k_bw/gcc              238MB/s ± 0%  240MB/s ± 0%   +0.91%  (p=0.008 n=5+5)
wuffs_gif_decode_1k_color/gcc           130MB/s ± 1%  127MB/s ± 0%   -2.25%  (p=0.008 n=5+5)
wuffs_gif_decode_10k_bgra/gcc           537MB/s ± 1%  518MB/s ± 2%   -3.59%  (p=0.008 n=5+5)
wuffs_gif_decode_10k_indexed/gcc        164MB/s ± 1%  157MB/s ± 1%   -4.43%  (p=0.008 n=5+5)
wuffs_gif_decode_100k_artificial/gcc    454MB/s ± 2%  447MB/s ± 0%     ~     (p=0.095 n=5+5)
wuffs_gif_decode_100k_realistic/gcc     186MB/s ± 1%  179MB/s ± 1%   -3.28%  (p=0.008 n=5+5)
wuffs_gif_decode_1000k/gcc              188MB/s ± 1%  182MB/s ± 0%   -3.06%  (p=0.008 n=5+5)
wuffs_gif_decode_anim_screencap/gcc     971MB/s ± 1%  941MB/s ± 0%   -3.11%  (p=0.008 n=5+5)
2018-12-16 08:17:29 +11:00
Nigel Tao 6c5d7806bf Fix comment typo 2018-12-16 07:27:02 +11:00
Nigel Tao 6c3c73b056 Fix signed vs unsigned comparison in reader.take 2018-12-15 15:55:37 +11:00
Nigel Tao beec3214b3 Simplify some gif.decoder read/write indexes 2018-12-15 15:52:16 +11:00
Nigel Tao 33a4557d98 Collect GIF's LZW data into larger batches
name                                    old speed     new speed     delta

wuffs_gif_decode_1k_bw/clang            224MB/s ± 1%  227MB/s ± 0%  +0.98%  (p=0.000 n=10+9)
wuffs_gif_decode_1k_color/clang         116MB/s ± 1%  118MB/s ± 1%  +2.26%  (p=0.000 n=10+10)
wuffs_gif_decode_10k_bgra/clang         541MB/s ± 0%  568MB/s ± 1%  +4.97%  (p=0.000 n=9+10)
wuffs_gif_decode_10k_indexed/clang      144MB/s ± 0%  152MB/s ± 0%  +5.61%  (p=0.000 n=9+10)
wuffs_gif_decode_100k_artificial/clang  438MB/s ± 1%  454MB/s ± 1%  +3.56%  (p=0.000 n=9+10)
wuffs_gif_decode_100k_realistic/clang   171MB/s ± 0%  179MB/s ± 0%  +4.64%  (p=0.000 n=8+10)
wuffs_gif_decode_1000k/clang            174MB/s ± 0%  180MB/s ± 0%  +3.90%  (p=0.000 n=9+10)
wuffs_gif_decode_anim_screencap/clang   897MB/s ± 1%  943MB/s ± 0%  +5.10%  (p=0.000 n=9+9)

wuffs_gif_decode_1k_bw/gcc              250MB/s ± 1%  241MB/s ± 1%  -3.26%  (p=0.000 n=10+10)
wuffs_gif_decode_1k_color/gcc           132MB/s ± 1%  130MB/s ± 1%  -2.15%  (p=0.000 n=10+10)
wuffs_gif_decode_10k_bgra/gcc           534MB/s ± 1%  535MB/s ± 1%    ~     (p=0.211 n=9+10)
wuffs_gif_decode_10k_indexed/gcc        162MB/s ± 1%  163MB/s ± 0%    ~     (p=0.105 n=10+10)
wuffs_gif_decode_100k_artificial/gcc    460MB/s ± 0%  456MB/s ± 0%  -0.80%  (p=0.000 n=10+10)
wuffs_gif_decode_100k_realistic/gcc     186MB/s ± 0%  186MB/s ± 1%  -0.33%  (p=0.001 n=9+10)
wuffs_gif_decode_1000k/gcc              189MB/s ± 1%  188MB/s ± 1%    ~     (p=0.053 n=9+10)
wuffs_gif_decode_anim_screencap/gcc     981MB/s ± 1%  971MB/s ± 1%  -0.95%  (p=0.000 n=10+10)
2018-12-15 14:10:10 +11:00
Nigel Tao e497b38da0 Avoid test names being prefixes of other names 2018-12-15 13:58:22 +11:00
Nigel Tao 6fe313a72c Allow an io_limit limit to be a refined base.u64 2018-12-15 10:45:36 +11:00
Nigel Tao fad2ddce68 Generate less code for foo.since_mark().length() 2018-12-09 11:15:10 +11:00
Nigel Tao a4c6310ae0 Thread the GIF workbuf closer to the LZW call 2018-12-09 10:56:45 +11:00
Nigel Tao f9249d4089 Tweak how std/gif's uncompressed_wi is updated 2018-12-09 10:35:24 +11:00
Nigel Tao 6d2bb77bb7 Add a data:etc argument to io_bind 2018-12-09 09:53:46 +11:00
Nigel Tao badbdfc487 Tweak io_bind syntax 2018-12-09 09:13:29 +11:00
Nigel Tao e992921dce Add an io_limit keyword 2018-12-09 09:03:21 +11:00
Nigel Tao 3aff5e6f42 Split multi-arg io_bind into multiple io_bind's 2018-12-09 07:54:48 +11:00
Nigel Tao f1c5bb6cb7 Add BGRA GIF benchmark, not just indexed color 2018-12-08 21:24:26 +11:00
Nigel Tao f51c71b72c wuffs gen -version=0.2.0-alpha.23 2018-12-08 16:09:45 +11:00
Nigel Tao 45ab79b451 Allow GIF decoding to non-indexed pixel formats 2018-12-08 16:08:02 +11:00
Nigel Tao 90193cb6e2 Add palette arguments to the pixel swizzler 2018-12-08 13:58:52 +11:00
Nigel Tao 6c9dca47ee Add a base.pixel_swizzler type 2018-12-08 13:25:53 +11:00
Nigel Tao 86b8408223 Refactor cgen's base/base-{private,public}.h 2018-12-08 10:46:02 +11:00
Nigel Tao 3f3772e74b Merge cgen's writeStatement{Assign,Expr} 2018-12-08 09:45:23 +11:00
Nigel Tao d256df0fe3 Refactor cgen of question-calls 2018-12-02 10:20:43 +11:00
Nigel Tao b162747934 Remove cgen's obsolete replacementPolicy concept 2018-12-01 22:41:41 +11:00
Nigel Tao 8f1240f20e Mark cgen's replaceNothing as unused 2018-12-01 22:36:32 +11:00
Nigel Tao 2936b586cf Refactor cgen's writeStatement{Assign,Var} 2018-12-01 22:14:49 +11:00
Nigel Tao 09f857dc47 Re-number some cgen temporary variables 2018-12-01 20:30:28 +11:00
Nigel Tao 743b48f9dc Rename a cgen temporary variable 2018-12-01 20:28:40 +11:00
Nigel Tao 5cae1f8c82 Remove the obsolete Effect.RootCause concept 2018-12-01 13:37:33 +11:00
Nigel Tao 9741eada02 Replace "= try foo" with "=? foo" 2018-12-01 13:11:47 +11:00
Nigel Tao ad9851ea75 Prohibit effect-ful subexpressions 2018-12-01 11:33:26 +11:00
Nigel Tao 3e70383c6c Remove some if's from deflate.decode_huffman_fast
name                             old speed     new speed     delta

wuffs_deflate_decode_1k/clang    145MB/s ± 0%  151MB/s ± 1%  +4.54%  (p=0.008 n=5+5)
wuffs_deflate_decode_10k/clang   234MB/s ± 0%  230MB/s ± 0%  -1.75%  (p=0.008 n=5+5)
wuffs_deflate_decode_100k/clang  263MB/s ± 0%  276MB/s ± 1%  +5.17%  (p=0.008 n=5+5)

wuffs_deflate_decode_1k/gcc      157MB/s ± 1%  157MB/s ± 0%    ~     (p=0.421 n=5+5)
wuffs_deflate_decode_10k/gcc     265MB/s ± 0%  259MB/s ± 0%  -2.16%  (p=0.008 n=5+5)
wuffs_deflate_decode_100k/gcc    313MB/s ± 0%  315MB/s ± 0%  +0.39%  (p=0.016 n=5+5)

wuffs_gzip_decode_10k/clang      216MB/s ± 0%  212MB/s ± 0%  -1.69%  (p=0.016 n=5+4)
wuffs_gzip_decode_100k/clang     241MB/s ± 0%  252MB/s ± 0%  +4.67%  (p=0.016 n=5+4)

wuffs_gzip_decode_10k/gcc        251MB/s ± 1%  248MB/s ± 1%  -1.05%  (p=0.008 n=5+5)
wuffs_gzip_decode_100k/gcc       285MB/s ± 1%  291MB/s ± 0%  +2.16%  (p=0.008 n=5+5)

wuffs_zlib_decode_10k/clang      213MB/s ± 0%  210MB/s ± 0%  -1.18%  (p=0.008 n=5+5)
wuffs_zlib_decode_100k/clang     239MB/s ± 0%  247MB/s ± 0%  +3.08%  (p=0.008 n=5+5)

wuffs_zlib_decode_10k/gcc        244MB/s ± 0%  247MB/s ± 0%  +1.15%  (p=0.008 n=5+5)
wuffs_zlib_decode_100k/gcc       282MB/s ± 0%  291MB/s ± 0%  +2.90%  (p=0.008 n=5+5)
2018-12-01 10:26:09 +11:00