Commit Graph
51 Commits
Author SHA1 Message Date
Nigel Tao 39e2044102 Rename std/deflate decode_huffman_fast function 2021-02-08 22:34:28 +11:00
Nigel Tao 3c3d58bfe7 Rename io_writer.history_available 2020-08-13 23:29:59 +10:00
Nigel Tao 1ed0f89948 Rename copy_n32_etc to limited_copy_u32_etc 2020-05-27 19:55:06 +10:00
Nigel Tao 74871344f0 Capitalize Wuffs const names 2020-04-13 15:52:36 +10:00
Nigel Tao 58351d44da Make endwhile mandatory for nameless loops 2020-03-25 21:40:00 +11:00
Nigel Tao e65c861207 Extend std/deflate ringbuffer to simplify copies
name                                             old speed     new speed     delta

wuffs_deflate_decode_1k_full_init/clang5         155MB/s ± 1%  154MB/s ± 0%   -0.98%  (p=0.000 n=10+9)
wuffs_deflate_decode_1k_part_init/clang5         190MB/s ± 0%  193MB/s ± 1%   +1.49%  (p=0.000 n=10+9)
wuffs_deflate_decode_10k_full_init/clang5        240MB/s ± 0%  249MB/s ± 0%   +3.68%  (p=0.000 n=9+10)
wuffs_deflate_decode_10k_part_init/clang5        247MB/s ± 0%  257MB/s ± 1%   +4.03%  (p=0.000 n=10+10)
wuffs_deflate_decode_100k_just_one_read/clang5   292MB/s ± 1%  291MB/s ± 0%   -0.34%  (p=0.043 n=10+9)
wuffs_deflate_decode_100k_many_big_reads/clang5  246MB/s ± 0%  250MB/s ± 0%   +1.77%  (p=0.000 n=9+10)

wuffs_deflate_decode_1k_full_init/gcc9           166MB/s ± 1%  165MB/s ± 1%   -0.48%  (p=0.009 n=10+10)
wuffs_deflate_decode_1k_part_init/gcc9           208MB/s ± 1%  212MB/s ± 0%   +1.85%  (p=0.000 n=10+9)
wuffs_deflate_decode_10k_full_init/gcc9          248MB/s ± 1%  281MB/s ± 0%  +13.05%  (p=0.000 n=9+10)
wuffs_deflate_decode_10k_part_init/gcc9          256MB/s ± 0%  290MB/s ± 0%  +13.34%  (p=0.000 n=10+10)
wuffs_deflate_decode_100k_just_one_read/gcc9     336MB/s ± 0%  333MB/s ± 0%   -0.93%  (p=0.000 n=9+8)
wuffs_deflate_decode_100k_many_big_reads/gcc9    262MB/s ± 0%  280MB/s ± 1%   +6.99%  (p=0.000 n=9+10)
2020-03-05 12:35:03 +11:00
Nigel Tao b1e3a15c08 Add endwhile syntax 2020-02-22 13:11:02 +11:00
Nigel Tao 09ed091fe3 Rename skip / copy_n_etc to skip32 / copy_n32_etc 2020-01-16 22:07:44 +11:00
Nigel Tao a21ad25bb8 Rename x T to x: T for vars 2019-10-12 21:55:13 +11:00
Nigel Tao 1520a1f345 Rename x T to x: T for fields and func args 2019-10-12 21:49:04 +11:00
Nigel Tao 5b4e3647c0 Reformat x:y as x: y 2019-10-12 21:21:39 +11:00
Nigel Tao a9ea63ff06 Rename [i:j] to [i .. j], the same as Rust 2019-10-12 21:14:18 +11:00
Nigel Tao 7872a8893b Rename while:label to while.label 2019-10-12 19:04:32 +11:00
Nigel Tao d501daddc3 Rename [i..j] to [i ..= j], the same as Rust 2019-10-12 18:40:53 +11:00
Nigel Tao 2819fb8e3f Rename some built-in func's arg from x to a 2019-09-28 14:22:48 +10:00
Nigel Tao 9f7435c7b4 Add io_writer.history_available method
Also change copy_n_from_history to examine the buffer start instead of
the buffer mark.

name                                             old speed     new speed     delta

wuffs_deflate_decode_1k_full_init/clang5         151MB/s ± 0%  134MB/s ± 1%  -11.11%  (p=0.000 n=10+10)
wuffs_deflate_decode_1k_part_init/clang5         187MB/s ± 0%  162MB/s ± 1%  -13.11%  (p=0.000 n=10+10)
wuffs_deflate_decode_10k_full_init/clang5        241MB/s ± 0%  220MB/s ± 0%   -8.76%  (p=0.000 n=10+10)
wuffs_deflate_decode_10k_part_init/clang5        248MB/s ± 0%  225MB/s ± 0%   -9.12%  (p=0.000 n=10+9)
wuffs_deflate_decode_100k_just_one_read/clang5   288MB/s ± 0%  270MB/s ± 0%   -6.16%  (p=0.000 n=10+10)
wuffs_deflate_decode_100k_many_big_reads/clang5  239MB/s ± 0%  225MB/s ± 0%   -5.84%  (p=0.000 n=10+10)

wuffs_deflate_decode_1k_full_init/gcc7           153MB/s ± 1%  151MB/s ± 1%   -1.13%  (p=0.000 n=10+9)
wuffs_deflate_decode_1k_part_init/gcc7           187MB/s ± 1%  186MB/s ± 1%     ~     (p=0.052 n=10+10)
wuffs_deflate_decode_10k_full_init/gcc7          261MB/s ± 0%  256MB/s ± 1%   -1.83%  (p=0.000 n=10+10)
wuffs_deflate_decode_10k_part_init/gcc7          269MB/s ± 1%  264MB/s ± 1%   -1.62%  (p=0.000 n=10+10)
wuffs_deflate_decode_100k_just_one_read/gcc7     313MB/s ± 0%  310MB/s ± 1%   -0.69%  (p=0.000 n=9+10)
wuffs_deflate_decode_100k_many_big_reads/gcc7    247MB/s ± 0%  247MB/s ± 0%     ~     (p=0.089 n=10+10)
2019-07-06 11:26:05 +10:00
Nigel Tao 02dc564596 Eliminate a branch in std/deflate decoding
name                                             old speed      new speed      delta

wuffs_deflate_decode_1k_full_init/clang5          139MB/s ± 1%   151MB/s ± 1%   +9.19%  (p=0.000 n=28+30)
wuffs_deflate_decode_1k_part_init/clang5          169MB/s ± 1%   187MB/s ± 1%  +11.15%  (p=0.000 n=28+28)
wuffs_deflate_decode_10k_full_init/clang5         200MB/s ± 0%   242MB/s ± 1%  +20.99%  (p=0.000 n=28+28)
wuffs_deflate_decode_10k_part_init/clang5         205MB/s ± 1%   249MB/s ± 1%  +21.51%  (p=0.000 n=29+29)
wuffs_deflate_decode_100k_just_one_read/clang5    255MB/s ± 1%   280MB/s ± 1%   +9.86%  (p=0.000 n=29+30)
wuffs_deflate_decode_100k_many_big_reads/clang5   218MB/s ± 0%   241MB/s ± 1%  +10.58%  (p=0.000 n=27+24)

wuffs_deflate_decode_1k_full_init/gcc7            155MB/s ± 1%   155MB/s ± 2%     ~     (p=0.521 n=28+29)
wuffs_deflate_decode_1k_part_init/gcc7            190MB/s ± 1%   191MB/s ± 1%   +0.51%  (p=0.000 n=27+28)
wuffs_deflate_decode_10k_full_init/gcc7           265MB/s ± 1%   266MB/s ± 1%   +0.54%  (p=0.000 n=29+30)
wuffs_deflate_decode_10k_part_init/gcc7           272MB/s ± 1%   274MB/s ± 1%   +0.73%  (p=0.000 n=29+30)
wuffs_deflate_decode_100k_just_one_read/gcc7      317MB/s ± 0%   318MB/s ± 0%   +0.58%  (p=0.000 n=28+28)
wuffs_deflate_decode_100k_many_big_reads/gcc7     252MB/s ± 1%   253MB/s ± 0%   +0.64%  (p=0.000 n=29+27)
2019-03-16 14:02:15 +11:00
Nigel Tao ef7aa0d980 Rename "!=" to "<>"; "!" now only shows impurity 2019-03-02 14:51:32 +11:00
Nigel Tao 5aeb98c701 Restore deflate.decoder.n_huffs_bits's refinement 2019-02-24 09:15:31 +11:00
Nigel Tao 931fdce475 Rename "yield foo" to "yield? foo" 2019-02-23 17:15:57 +11:00
Nigel Tao 045f180a6c Rename errors from "?msg" to "#msg" 2019-02-23 17:06:24 +11:00
Nigel Tao 92959fb81f Check that extra-field types aren't refined 2019-02-16 15:40:02 +11:00
Nigel Tao 92f3958a28 Reduce the deflate decoder Huffman table size
name                                             old speed     new speed     delta

wuffs_deflate_decode_1k/clang5                   138MB/s ± 0%  140MB/s ± 1%  +1.16%  (p=0.008 n=5+5)
wuffs_deflate_decode_10k/clang5                  228MB/s ± 1%  229MB/s ± 1%    ~     (p=0.222 n=5+5)
wuffs_deflate_decode_100k_just_one_read/clang5   267MB/s ± 1%  267MB/s ± 1%    ~     (p=0.690 n=5+5)
wuffs_deflate_decode_100k_many_big_reads/clang5  225MB/s ± 0%  225MB/s ± 0%    ~     (p=0.310 n=5+5)

wuffs_deflate_decode_1k/gcc7                     157MB/s ± 0%  157MB/s ± 0%    ~     (p=0.730 n=4+5)
wuffs_deflate_decode_10k/gcc7                    269MB/s ± 0%  269MB/s ± 1%    ~     (p=0.222 n=5+5)
wuffs_deflate_decode_100k_just_one_read/gcc7     321MB/s ± 0%  321MB/s ± 1%    ~     (p=0.548 n=5+5)
wuffs_deflate_decode_100k_many_big_reads/gcc7    254MB/s ± 0%  254MB/s ± 0%    ~     (p=0.421 n=5+5)

wuffs_gzip_decode_10k/clang5                     205MB/s ± 0%  212MB/s ± 0%  +3.50%  (p=0.016 n=5+4)
wuffs_gzip_decode_100k/clang5                    238MB/s ± 0%  245MB/s ± 0%  +3.31%  (p=0.008 n=5+5)

wuffs_gzip_decode_10k/gcc7                       247MB/s ± 0%  248MB/s ± 0%  +0.47%  (p=0.016 n=5+5)
wuffs_gzip_decode_100k/gcc7                      293MB/s ± 1%  293MB/s ± 0%    ~     (p=0.690 n=5+5)

wuffs_zlib_decode_10k/clang5                     210MB/s ± 0%  210MB/s ± 0%    ~     (p=0.056 n=5+5)
wuffs_zlib_decode_100k/clang5                    244MB/s ± 0%  244MB/s ± 0%    ~     (p=0.556 n=4+5)

wuffs_zlib_decode_10k/gcc7                       247MB/s ± 0%  249MB/s ± 1%  +0.77%  (p=0.008 n=5+5)
wuffs_zlib_decode_100k/gcc7                      288MB/s ± 0%  288MB/s ± 0%    ~     (p=1.000 n=5+5)
2019-02-02 08:46:40 +11:00
Nigel Tao 8bbdcc4ce1 Allow scalar constants in type expressions 2019-02-02 07:53:59 +11:00
Nigel Tao 705a84723a For "x shift y", check that y < (x's bit-size) 2019-01-26 16:51:49 +11:00
Nigel Tao c6a48b3731 Call decode_huffman_fast more often
name                                             old speed     new speed     delta

wuffs_deflate_decode_1k/clang5                   137MB/s ± 0%  139MB/s ± 0%   +1.19%  (p=0.008 n=5+5)
wuffs_deflate_decode_10k/clang5                  219MB/s ± 0%  224MB/s ± 0%   +2.59%  (p=0.008 n=5+5)
wuffs_deflate_decode_100k_just_one_read/clang5   257MB/s ± 0%  265MB/s ± 0%   +3.41%  (p=0.008 n=5+5)
wuffs_deflate_decode_100k_many_big_reads/clang5  181MB/s ± 0%  220MB/s ± 0%  +21.72%  (p=0.008 n=5+5)

wuffs_deflate_decode_1k/gcc7                     157MB/s ± 0%  156MB/s ± 1%   -0.63%  (p=0.032 n=5+5)
wuffs_deflate_decode_10k/gcc7                    263MB/s ± 1%  269MB/s ± 0%   +2.39%  (p=0.008 n=5+5)
wuffs_deflate_decode_100k_just_one_read/gcc7     310MB/s ± 1%  314MB/s ± 0%   +1.27%  (p=0.008 n=5+5)
wuffs_deflate_decode_100k_many_big_reads/gcc7    158MB/s ± 1%  254MB/s ± 0%  +61.29%  (p=0.008 n=5+5)
2019-01-19 10:50:40 +11:00
Nigel Tao 093268e179 Rename the !?? effect to ? 2018-12-29 13:57:57 +11:00
Nigel Tao 1ceb304ad9 Have wuffsfmt align the "T"s in "var x T" blocks 2018-12-27 14:19:20 +11:00
Nigel Tao cd9ab50f63 Place std/deflate vars at the top of functions 2018-12-26 21:09:20 +11:00
Nigel Tao 3e70383c6c Remove some if's from deflate.decode_huffman_fast
name                             old speed     new speed     delta

wuffs_deflate_decode_1k/clang    145MB/s ± 0%  151MB/s ± 1%  +4.54%  (p=0.008 n=5+5)
wuffs_deflate_decode_10k/clang   234MB/s ± 0%  230MB/s ± 0%  -1.75%  (p=0.008 n=5+5)
wuffs_deflate_decode_100k/clang  263MB/s ± 0%  276MB/s ± 1%  +5.17%  (p=0.008 n=5+5)

wuffs_deflate_decode_1k/gcc      157MB/s ± 1%  157MB/s ± 0%    ~     (p=0.421 n=5+5)
wuffs_deflate_decode_10k/gcc     265MB/s ± 0%  259MB/s ± 0%  -2.16%  (p=0.008 n=5+5)
wuffs_deflate_decode_100k/gcc    313MB/s ± 0%  315MB/s ± 0%  +0.39%  (p=0.016 n=5+5)

wuffs_gzip_decode_10k/clang      216MB/s ± 0%  212MB/s ± 0%  -1.69%  (p=0.016 n=5+4)
wuffs_gzip_decode_100k/clang     241MB/s ± 0%  252MB/s ± 0%  +4.67%  (p=0.016 n=5+4)

wuffs_gzip_decode_10k/gcc        251MB/s ± 1%  248MB/s ± 1%  -1.05%  (p=0.008 n=5+5)
wuffs_gzip_decode_100k/gcc       285MB/s ± 1%  291MB/s ± 0%  +2.16%  (p=0.008 n=5+5)

wuffs_zlib_decode_10k/clang      213MB/s ± 0%  210MB/s ± 0%  -1.18%  (p=0.008 n=5+5)
wuffs_zlib_decode_100k/clang     239MB/s ± 0%  247MB/s ± 0%  +3.08%  (p=0.008 n=5+5)

wuffs_zlib_decode_10k/gcc        244MB/s ± 0%  247MB/s ± 0%  +1.15%  (p=0.008 n=5+5)
wuffs_zlib_decode_100k/gcc       282MB/s ± 0%  291MB/s ± 0%  +2.90%  (p=0.008 n=5+5)
2018-12-01 10:26:09 +11:00
Nigel Tao 776e82d542 Split std/deflate effectful expressions 2018-12-01 09:00:53 +11:00
Nigel Tao d84d72ce27 Use the new read_uxx_as_uyy methods 2018-11-25 12:29:15 +11:00
Nigel Tao 9e5aec5d25 Change "$foo" to base."$foo" 2018-11-24 13:36:09 +11:00
Nigel Tao 875362ea07 Change status "?foo" to just "?foo" 2018-11-24 12:36:42 +11:00
Nigel Tao eec0fce647 Change error "?foo" to status "?foo" 2018-08-12 21:31:56 +10:00
Nigel Tao b385c30b4f Add a "?" prefix to non-built-in status messages 2018-08-12 14:07:40 +10:00
Nigel Tao eca5565821 Removed closed-for-read/write status codes 2018-08-04 09:34:39 +10:00
Nigel Tao 2100a9f837 Use !?? to denote coroutines 2018-07-29 13:57:13 +10:00
Nigel Tao ca06083f8a Rename the implicit in variable to args 2018-07-29 10:26:22 +10:00
Nigel Tao 9919d78245 Change func out-type from struct to bare type 2018-07-29 10:02:06 +10:00
Nigel Tao 26eba56f57 Rename some copy_from_xxx methods 2018-07-08 13:56:49 +10:00
Nigel Tao 131732e7eb Fix some built-in methods' effects 2018-05-12 17:55:57 +10:00
Nigel Tao a698b47cb6 Rename ~+ to ~mod+; add ~mod-. 2018-04-26 10:05:19 +10:00
Nigel Tao f95239f6e0 Rename u32, io_reader, etc to base.u32, etc 2018-04-12 21:49:17 +10:00
Nigel Tao 97aab37462 Rename buf1, reader1, etc to io_buffer, io_reader
Also remove the unused Buf1, Buf2 and Usize tokens.
2018-04-05 20:49:48 +10:00
Nigel Tao 26445adcdf Rename deflate's "distance minus 1" variable 2018-03-23 12:54:46 +11:00
Nigel Tao 4675efdcc5 Fix deflate decode when the distance is 32768 2018-03-23 12:49:42 +11:00
Nigel Tao bbc3d34e1b Check distance > 0 for decode_huffman_slow
decode_huffman_fast already does this. The slow flavor should too.

Updates https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=6524
2018-02-24 11:31:12 +11:00
Nigel Tao d14b56ea39 Type check built-in functions more thoroughly 2017-12-16 13:25:26 +11:00
Nigel Tao 8e2255916e Drop the "flate_" in "deflate.flate_decoder" 2017-12-04 10:35:08 +11:00