Commit Graph
1457 Commits
Author SHA1 Message Date
Nigel Tao 010df42d75 Have std/lzw always rewind excess bits
I'm not sure of the underlying reason for the lzw/gcc benchmark anomaly
(the gif/gcc numbers don't change), but it's the same mystery as commit
ecb3995 `Tweak how std/lzw yields "short read"`.

name                                    old speed      new speed      delta

wuffs_lzw_decode_20k/clang               223MB/s ± 0%   214MB/s ± 0%   -3.96%  (p=0.008 n=5+5)
wuffs_lzw_decode_100k/clang              385MB/s ± 0%   369MB/s ± 0%   -4.15%  (p=0.008 n=5+5)

wuffs_lzw_decode_20k/gcc                 186MB/s ± 1%   232MB/s ± 1%  +24.41%  (p=0.008 n=5+5)
wuffs_lzw_decode_100k/gcc                224MB/s ± 1%   384MB/s ± 1%  +71.81%  (p=0.008 n=5+5)

wuffs_gif_decode_1k_bw/clang             238MB/s ± 1%   236MB/s ± 0%     ~     (p=0.222 n=5+5)
wuffs_gif_decode_1k_color/clang          124MB/s ± 0%   118MB/s ± 1%   -4.75%  (p=0.008 n=5+5)
wuffs_gif_decode_10k_bgra/clang          596MB/s ± 0%   562MB/s ± 0%   -5.71%  (p=0.008 n=5+5)
wuffs_gif_decode_10k_indexed/clang       159MB/s ± 0%   149MB/s ± 0%   -6.42%  (p=0.008 n=5+5)
wuffs_gif_decode_100k_artificial/clang   492MB/s ± 1%   487MB/s ± 0%   -0.98%  (p=0.008 n=5+5)
wuffs_gif_decode_100k_realistic/clang    192MB/s ± 0%   183MB/s ± 0%   -5.07%  (p=0.008 n=5+5)
wuffs_gif_decode_1000k/clang             195MB/s ± 0%   185MB/s ± 0%   -4.93%  (p=0.008 n=5+5)
wuffs_gif_decode_anim_screencap/clang   1.01GB/s ± 1%  1.02GB/s ± 0%   +1.25%  (p=0.008 n=5+5)

wuffs_gif_decode_1k_bw/gcc               247MB/s ± 0%   250MB/s ± 0%   +1.26%  (p=0.008 n=5+5)
wuffs_gif_decode_1k_color/gcc            131MB/s ± 2%   133MB/s ± 0%     ~     (p=0.151 n=5+5)
wuffs_gif_decode_10k_bgra/gcc            541MB/s ± 1%   543MB/s ± 1%     ~     (p=0.548 n=5+5)
wuffs_gif_decode_10k_indexed/gcc         167MB/s ± 0%   167MB/s ± 1%     ~     (p=0.730 n=4+5)
wuffs_gif_decode_100k_artificial/gcc     469MB/s ± 0%   465MB/s ± 1%   -0.78%  (p=0.016 n=4+5)
wuffs_gif_decode_100k_realistic/gcc      190MB/s ± 0%   190MB/s ± 0%   -0.34%  (p=0.032 n=4+5)
wuffs_gif_decode_1000k/gcc               193MB/s ± 1%   192MB/s ± 1%     ~     (p=0.556 n=4+5)
wuffs_gif_decode_anim_screencap/gcc      995MB/s ± 1%   995MB/s ± 1%     ~     (p=0.841 n=5+5)
2018-12-22 14:05:34 +11:00
Nigel Tao 0f27e97e28 Discard std/gif's compressed buffer after decode 2018-12-22 13:19:33 +11:00
Nigel Tao 529ebb0a61 Introduce binary alpha 2018-12-22 08:48:49 +11:00
Nigel Tao 57e5a785f7 Rename some private copy_n_from_history variables 2018-12-16 11:33:35 +11:00
Nigel Tao baf1b9f9e6 Rename some I/O private methods 2018-12-16 11:28:25 +11:00
Nigel Tao eb0cbd802a Make SubExprHasEffect an ast.Flags not ast.Effect 2018-12-16 11:09:23 +11:00
Nigel Tao dd28f3c0f9 Remove the "? but not !?" effect 2018-12-16 11:03:31 +11:00
Nigel Tao 9311f7a694 Rename some std/lzw methods 2018-12-16 10:23:53 +11:00
Nigel Tao 7a02605144 Remove the std/lzw decoder.available method 2018-12-16 10:21:55 +11:00
Nigel Tao 247232091d Delete an obsolete io_bind in std/gif 2018-12-16 10:12:43 +11:00
Nigel Tao 622a76d4c0 Avoid buffer copies from LZW to GIF
name                                    old speed     new speed      delta

wuffs_lzw_decode_20k/clang              213MB/s ± 0%   224MB/s ± 1%   +4.89%  (p=0.008 n=5+5)
wuffs_lzw_decode_100k/clang             359MB/s ± 1%   393MB/s ± 2%   +9.36%  (p=0.008 n=5+5)

wuffs_lzw_decode_20k/gcc                188MB/s ± 0%   187MB/s ± 0%   -0.70%  (p=0.008 n=5+5)
wuffs_lzw_decode_100k/gcc               223MB/s ± 2%   224MB/s ± 0%     ~     (p=0.690 n=5+5)

wuffs_gif_decode_1k_bw/clang            227MB/s ± 1%   240MB/s ± 0%   +5.89%  (p=0.008 n=5+5)
wuffs_gif_decode_1k_color/clang         117MB/s ± 0%   125MB/s ± 0%   +6.16%  (p=0.008 n=5+5)
wuffs_gif_decode_10k_bgra/clang         567MB/s ± 1%   599MB/s ± 0%   +5.56%  (p=0.008 n=5+5)
wuffs_gif_decode_10k_indexed/clang      152MB/s ± 0%   159MB/s ± 1%   +4.76%  (p=0.008 n=5+5)
wuffs_gif_decode_100k_artificial/clang  455MB/s ± 1%   504MB/s ± 0%  +10.93%  (p=0.008 n=5+5)
wuffs_gif_decode_100k_realistic/clang   178MB/s ± 2%   194MB/s ± 0%   +9.00%  (p=0.008 n=5+5)
wuffs_gif_decode_1000k/clang            179MB/s ± 1%   197MB/s ± 0%   +9.81%  (p=0.016 n=5+4)
wuffs_gif_decode_anim_screencap/clang   952MB/s ± 0%  1050MB/s ± 1%  +10.29%  (p=0.008 n=5+5)

wuffs_gif_decode_1k_bw/gcc              243MB/s ± 1%   252MB/s ± 0%   +3.71%  (p=0.008 n=5+5)
wuffs_gif_decode_1k_color/gcc           130MB/s ± 0%   133MB/s ± 1%   +2.69%  (p=0.008 n=5+5)
wuffs_gif_decode_10k_bgra/gcc           537MB/s ± 0%   547MB/s ± 1%   +1.93%  (p=0.008 n=5+5)
wuffs_gif_decode_10k_indexed/gcc        163MB/s ± 0%   167MB/s ± 1%   +2.40%  (p=0.008 n=5+5)
wuffs_gif_decode_100k_artificial/gcc    458MB/s ± 0%   471MB/s ± 0%   +2.90%  (p=0.016 n=5+4)
wuffs_gif_decode_100k_realistic/gcc     186MB/s ± 0%   191MB/s ± 0%   +3.08%  (p=0.008 n=5+5)
wuffs_gif_decode_1000k/gcc              189MB/s ± 0%   194MB/s ± 0%   +2.70%  (p=0.008 n=5+5)
wuffs_gif_decode_anim_screencap/gcc     976MB/s ± 0%  1010MB/s ± 0%   +3.49%  (p=0.008 n=5+5)
2018-12-16 09:57:15 +11:00
Nigel Tao 4164583323 Add a src arg to std/gif's copy_to_image_buffer 2018-12-16 08:52:32 +11:00
Nigel Tao 5aede827ad Roll back Tweak how std/lzw yields "short read"
See the previous commit for the rationale.
2018-12-16 08:23:34 +11:00
Nigel Tao ecb399508c Tweak how std/lzw yields "short read"
This fixes a std/lzw performance regression (for gcc only, not clang),
introduced in 33a4557 "Collect GIF's LZW data into larger batches".

This commit restores the std/lzw performance, but it also makes the
std/gif benchmarks worse. As LZW is not really used outside of GIF, this
commit will immediately be followed by a rollback, but it is committed
anyway so that we can refer to these numbers in the git log.

name                                    old speed     new speed     delta

wuffs_lzw_decode_20k/clang              213MB/s ± 1%  205MB/s ± 1%   -3.90%  (p=0.008 n=5+5)
wuffs_lzw_decode_100k/clang             359MB/s ± 1%  351MB/s ± 0%   -2.14%  (p=0.008 n=5+5)

wuffs_lzw_decode_20k/gcc                189MB/s ± 0%  229MB/s ± 0%  +21.37%  (p=0.008 n=5+5)
wuffs_lzw_decode_100k/gcc               223MB/s ± 0%  390MB/s ± 1%  +74.77%  (p=0.016 n=4+5)

wuffs_gif_decode_1k_bw/clang            225MB/s ± 1%  229MB/s ± 0%   +1.52%  (p=0.008 n=5+5)
wuffs_gif_decode_1k_color/clang         118MB/s ± 1%  118MB/s ± 1%     ~     (p=0.841 n=5+5)
wuffs_gif_decode_10k_bgra/clang         569MB/s ± 0%  565MB/s ± 0%   -0.66%  (p=0.008 n=5+5)
wuffs_gif_decode_10k_indexed/clang      152MB/s ± 1%  150MB/s ± 1%   -1.25%  (p=0.008 n=5+5)
wuffs_gif_decode_100k_artificial/clang  454MB/s ± 1%  459MB/s ± 0%   +1.05%  (p=0.008 n=5+5)
wuffs_gif_decode_100k_realistic/clang   179MB/s ± 0%  178MB/s ± 1%     ~     (p=0.222 n=5+5)
wuffs_gif_decode_1000k/clang            180MB/s ± 1%  181MB/s ± 0%   +0.79%  (p=0.016 n=5+5)
wuffs_gif_decode_anim_screencap/clang   951MB/s ± 0%  958MB/s ± 0%   +0.66%  (p=0.008 n=5+5)

wuffs_gif_decode_1k_bw/gcc              238MB/s ± 0%  240MB/s ± 0%   +0.91%  (p=0.008 n=5+5)
wuffs_gif_decode_1k_color/gcc           130MB/s ± 1%  127MB/s ± 0%   -2.25%  (p=0.008 n=5+5)
wuffs_gif_decode_10k_bgra/gcc           537MB/s ± 1%  518MB/s ± 2%   -3.59%  (p=0.008 n=5+5)
wuffs_gif_decode_10k_indexed/gcc        164MB/s ± 1%  157MB/s ± 1%   -4.43%  (p=0.008 n=5+5)
wuffs_gif_decode_100k_artificial/gcc    454MB/s ± 2%  447MB/s ± 0%     ~     (p=0.095 n=5+5)
wuffs_gif_decode_100k_realistic/gcc     186MB/s ± 1%  179MB/s ± 1%   -3.28%  (p=0.008 n=5+5)
wuffs_gif_decode_1000k/gcc              188MB/s ± 1%  182MB/s ± 0%   -3.06%  (p=0.008 n=5+5)
wuffs_gif_decode_anim_screencap/gcc     971MB/s ± 1%  941MB/s ± 0%   -3.11%  (p=0.008 n=5+5)
2018-12-16 08:17:29 +11:00
Nigel Tao 6c5d7806bf Fix comment typo 2018-12-16 07:27:02 +11:00
Nigel Tao 6c3c73b056 Fix signed vs unsigned comparison in reader.take 2018-12-15 15:55:37 +11:00
Nigel Tao beec3214b3 Simplify some gif.decoder read/write indexes 2018-12-15 15:52:16 +11:00
Nigel Tao 33a4557d98 Collect GIF's LZW data into larger batches
name                                    old speed     new speed     delta

wuffs_gif_decode_1k_bw/clang            224MB/s ± 1%  227MB/s ± 0%  +0.98%  (p=0.000 n=10+9)
wuffs_gif_decode_1k_color/clang         116MB/s ± 1%  118MB/s ± 1%  +2.26%  (p=0.000 n=10+10)
wuffs_gif_decode_10k_bgra/clang         541MB/s ± 0%  568MB/s ± 1%  +4.97%  (p=0.000 n=9+10)
wuffs_gif_decode_10k_indexed/clang      144MB/s ± 0%  152MB/s ± 0%  +5.61%  (p=0.000 n=9+10)
wuffs_gif_decode_100k_artificial/clang  438MB/s ± 1%  454MB/s ± 1%  +3.56%  (p=0.000 n=9+10)
wuffs_gif_decode_100k_realistic/clang   171MB/s ± 0%  179MB/s ± 0%  +4.64%  (p=0.000 n=8+10)
wuffs_gif_decode_1000k/clang            174MB/s ± 0%  180MB/s ± 0%  +3.90%  (p=0.000 n=9+10)
wuffs_gif_decode_anim_screencap/clang   897MB/s ± 1%  943MB/s ± 0%  +5.10%  (p=0.000 n=9+9)

wuffs_gif_decode_1k_bw/gcc              250MB/s ± 1%  241MB/s ± 1%  -3.26%  (p=0.000 n=10+10)
wuffs_gif_decode_1k_color/gcc           132MB/s ± 1%  130MB/s ± 1%  -2.15%  (p=0.000 n=10+10)
wuffs_gif_decode_10k_bgra/gcc           534MB/s ± 1%  535MB/s ± 1%    ~     (p=0.211 n=9+10)
wuffs_gif_decode_10k_indexed/gcc        162MB/s ± 1%  163MB/s ± 0%    ~     (p=0.105 n=10+10)
wuffs_gif_decode_100k_artificial/gcc    460MB/s ± 0%  456MB/s ± 0%  -0.80%  (p=0.000 n=10+10)
wuffs_gif_decode_100k_realistic/gcc     186MB/s ± 0%  186MB/s ± 1%  -0.33%  (p=0.001 n=9+10)
wuffs_gif_decode_1000k/gcc              189MB/s ± 1%  188MB/s ± 1%    ~     (p=0.053 n=9+10)
wuffs_gif_decode_anim_screencap/gcc     981MB/s ± 1%  971MB/s ± 1%  -0.95%  (p=0.000 n=10+10)
2018-12-15 14:10:10 +11:00
Nigel Tao e497b38da0 Avoid test names being prefixes of other names 2018-12-15 13:58:22 +11:00
Nigel Tao 6fe313a72c Allow an io_limit limit to be a refined base.u64 2018-12-15 10:45:36 +11:00
Nigel Tao fad2ddce68 Generate less code for foo.since_mark().length() 2018-12-09 11:15:10 +11:00
Nigel Tao a4c6310ae0 Thread the GIF workbuf closer to the LZW call 2018-12-09 10:56:45 +11:00
Nigel Tao f9249d4089 Tweak how std/gif's uncompressed_wi is updated 2018-12-09 10:35:24 +11:00
Nigel Tao 6d2bb77bb7 Add a data:etc argument to io_bind 2018-12-09 09:53:46 +11:00
Nigel Tao badbdfc487 Tweak io_bind syntax 2018-12-09 09:13:29 +11:00
Nigel Tao e992921dce Add an io_limit keyword 2018-12-09 09:03:21 +11:00
Nigel Tao 3aff5e6f42 Split multi-arg io_bind into multiple io_bind's 2018-12-09 07:54:48 +11:00
Nigel Tao f1c5bb6cb7 Add BGRA GIF benchmark, not just indexed color 2018-12-08 21:24:26 +11:00
Nigel Tao f51c71b72c wuffs gen -version=0.2.0-alpha.23 2018-12-08 16:09:45 +11:00
Nigel Tao 45ab79b451 Allow GIF decoding to non-indexed pixel formats 2018-12-08 16:08:02 +11:00
Nigel Tao 90193cb6e2 Add palette arguments to the pixel swizzler 2018-12-08 13:58:52 +11:00
Nigel Tao 6c9dca47ee Add a base.pixel_swizzler type 2018-12-08 13:25:53 +11:00
Nigel Tao 86b8408223 Refactor cgen's base/base-{private,public}.h 2018-12-08 10:46:02 +11:00
Nigel Tao 3f3772e74b Merge cgen's writeStatement{Assign,Expr} 2018-12-08 09:45:23 +11:00
Nigel Tao d256df0fe3 Refactor cgen of question-calls 2018-12-02 10:20:43 +11:00
Nigel Tao b162747934 Remove cgen's obsolete replacementPolicy concept 2018-12-01 22:41:41 +11:00
Nigel Tao 8f1240f20e Mark cgen's replaceNothing as unused 2018-12-01 22:36:32 +11:00
Nigel Tao 2936b586cf Refactor cgen's writeStatement{Assign,Var} 2018-12-01 22:14:49 +11:00
Nigel Tao 09f857dc47 Re-number some cgen temporary variables 2018-12-01 20:30:28 +11:00
Nigel Tao 743b48f9dc Rename a cgen temporary variable 2018-12-01 20:28:40 +11:00
Nigel Tao 5cae1f8c82 Remove the obsolete Effect.RootCause concept 2018-12-01 13:37:33 +11:00
Nigel Tao 9741eada02 Replace "= try foo" with "=? foo" 2018-12-01 13:11:47 +11:00
Nigel Tao ad9851ea75 Prohibit effect-ful subexpressions 2018-12-01 11:33:26 +11:00
Nigel Tao 3e70383c6c Remove some if's from deflate.decode_huffman_fast
name                             old speed     new speed     delta

wuffs_deflate_decode_1k/clang    145MB/s ± 0%  151MB/s ± 1%  +4.54%  (p=0.008 n=5+5)
wuffs_deflate_decode_10k/clang   234MB/s ± 0%  230MB/s ± 0%  -1.75%  (p=0.008 n=5+5)
wuffs_deflate_decode_100k/clang  263MB/s ± 0%  276MB/s ± 1%  +5.17%  (p=0.008 n=5+5)

wuffs_deflate_decode_1k/gcc      157MB/s ± 1%  157MB/s ± 0%    ~     (p=0.421 n=5+5)
wuffs_deflate_decode_10k/gcc     265MB/s ± 0%  259MB/s ± 0%  -2.16%  (p=0.008 n=5+5)
wuffs_deflate_decode_100k/gcc    313MB/s ± 0%  315MB/s ± 0%  +0.39%  (p=0.016 n=5+5)

wuffs_gzip_decode_10k/clang      216MB/s ± 0%  212MB/s ± 0%  -1.69%  (p=0.016 n=5+4)
wuffs_gzip_decode_100k/clang     241MB/s ± 0%  252MB/s ± 0%  +4.67%  (p=0.016 n=5+4)

wuffs_gzip_decode_10k/gcc        251MB/s ± 1%  248MB/s ± 1%  -1.05%  (p=0.008 n=5+5)
wuffs_gzip_decode_100k/gcc       285MB/s ± 1%  291MB/s ± 0%  +2.16%  (p=0.008 n=5+5)

wuffs_zlib_decode_10k/clang      213MB/s ± 0%  210MB/s ± 0%  -1.18%  (p=0.008 n=5+5)
wuffs_zlib_decode_100k/clang     239MB/s ± 0%  247MB/s ± 0%  +3.08%  (p=0.008 n=5+5)

wuffs_zlib_decode_10k/gcc        244MB/s ± 0%  247MB/s ± 0%  +1.15%  (p=0.008 n=5+5)
wuffs_zlib_decode_100k/gcc       282MB/s ± 0%  291MB/s ± 0%  +2.90%  (p=0.008 n=5+5)
2018-12-01 10:26:09 +11:00
Nigel Tao 776e82d542 Split std/deflate effectful expressions 2018-12-01 09:00:53 +11:00
Nigel Tao 341c5f3770 Split std/gif effectful expressions 2018-12-01 08:41:33 +11:00
Nigel Tao d84d72ce27 Use the new read_uxx_as_uyy methods 2018-11-25 12:29:15 +11:00
Nigel Tao c986536230 Rename some read_uxx methods as read_uxx_as_uyy 2018-11-25 12:15:05 +11:00
Nigel Tao c72f7a158d Re-order some token.ID numbers 2018-11-25 11:24:30 +11:00
Nigel Tao 87a4ef25d2 Eliminate obsolete coroSuspPoint check 2018-11-24 21:25:28 +11:00