Commit Graph
338 Commits
Author SHA1 Message Date
Nigel Tao 33efa88e54 Fix a comment typo 2017-12-28 14:30:49 +11:00
Nigel Tao c403f06b25 Fix ast.Expr.Str for impure calls 2017-12-28 14:27:02 +11:00
Nigel Tao e450f049cf Add an ast.Node.id2 field 2017-12-28 14:25:31 +11:00
Nigel Tao 5bf8c5d6ae Add some docs about the Node ID fields 2017-12-28 12:53:21 +11:00
Nigel Tao 751d409e04 Remove unused ast.Raw methods 2017-12-28 12:52:57 +11:00
Nigel Tao f6159a1c95 Consistently use a and t for ast and token 2017-12-28 11:47:46 +11:00
Nigel Tao bdc47bd6e2 Save the "t" name for the token package 2017-12-28 11:42:09 +11:00
Nigel Tao 8b0c63df09 Clean up tcheckDot 2017-12-28 11:39:24 +11:00
Nigel Tao 1255b162ea Resolve used packages during type checking 2017-12-28 11:24:59 +11:00
Nigel Tao 7fb19d7669 Fix lang/check tests 2017-12-28 11:04:31 +11:00
Nigel Tao d92e90d4f0 Move func WuffsRoot to package generate 2017-12-28 11:02:49 +11:00
Nigel Tao b5d4d104e8 Generate .wuffs summary API code 2017-12-27 13:06:47 +11:00
Nigel Tao 7fea629f10 Check missing packageid declaration 2017-12-27 10:43:50 +11:00
Nigel Tao 3eea5914ac Disallow double underscore names 2017-12-27 10:35:22 +11:00
Nigel Tao 172bbdbc3f Add even more built-in slice functions 2017-12-21 14:32:53 +11:00
Nigel Tao c59f65674b Add some more built-in slice functions 2017-12-21 14:25:00 +11:00
Nigel Tao 339673ae82 Add built-in slice functions 2017-12-16 17:23:49 +11:00
Nigel Tao 333b11dc65 Add some more built-in functions 2017-12-16 15:05:26 +11:00
Nigel Tao d14b56ea39 Type check built-in functions more thoroughly 2017-12-16 13:25:26 +11:00
Nigel Tao 3b822f8b17 Rename some arguments for consistency 2017-12-09 16:03:18 +11:00
Nigel Tao 90f1fcc328 Bounds check call arguments more thoroughly 2017-12-09 16:01:01 +11:00
Nigel Tao b92c782f95 Type check call arguments more thoroughly 2017-12-09 14:44:32 +11:00
Nigel Tao bf00d114e4 Let ast.TypeExpr represent method types 2017-12-09 13:55:59 +11:00
Nigel Tao 8e2255916e Drop the "flate_" in "deflate.flate_decoder" 2017-12-04 10:35:08 +11:00
Nigel Tao 1388f84e5c Rename std/flate to std/deflate 2017-12-04 10:27:48 +11:00
Nigel Tao 0a32c01014 Allow referring to types from used packages 2017-12-03 13:21:23 +11:00
Nigel Tao 5f5791e56d Remove redundant builtin.TrimQuotes function 2017-12-02 12:25:50 +11:00
Nigel Tao 404b149a9a Have "wuffs gen" follow use "foo" dependencies 2017-12-02 12:18:16 +11:00
Nigel Tao 906bca4e39 Drop volatile facts after a yield statement 2017-12-01 16:24:54 +11:00
Nigel Tao 849db0faa2 Make C hex constants' capitalization consistent 2017-12-01 15:35:41 +11:00
Nigel Tao 65dcf6a5b9 Add a yield keyword 2017-12-01 15:24:48 +11:00
Nigel Tao 7601fb45ce Rename String(*token.Map) to Str(*token.Map) 2017-12-01 11:22:08 +11:00
Nigel Tao 024dc7f97a Rename PUFFS to WUFFS, part 11 of N 2017-11-30 18:18:40 +11:00
Nigel Tao 3c708dfe59 Rename PUFFS to WUFFS, part 7 of N 2017-11-30 18:02:59 +11:00
Nigel Tao 79a94558be Rename PUFFS to WUFFS, part 5 of N 2017-11-30 16:37:20 +11:00
Nigel Tao 0cea46531b Rename PUFFS to WUFFS, part 2 of N 2017-11-30 16:23:16 +11:00
Nigel Tao 1cee9c6ea2 Add note to consider a read_u8_fast method. 2017-11-10 09:56:27 +11:00
Nigel Tao 693af478d6 Rename some bcheckOptimizeXxx methods. 2017-11-09 15:15:30 +11:00
Nigel Tao d2a01dd938 Refactor lang/check/bounds.go. 2017-11-09 15:11:45 +11:00
Nigel Tao 9b4cc179c4 Use puffs_base__writer1__copy_from_history32__bco.
name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.45GB/s ± 0%  2.45GB/s ± 0%    ~     (p=0.063 n=5+5)
puffs_adler32_100k/clang       2.45GB/s ± 0%  2.45GB/s ± 0%    ~     (p=0.905 n=5+4)
puffs_flate_decode_1k/clang     144MB/s ± 1%   146MB/s ± 0%  +1.41%  (p=0.016 n=5+5)
puffs_flate_decode_10k/clang    186MB/s ± 0%   204MB/s ± 0%  +9.39%  (p=0.008 n=5+5)
puffs_flate_decode_100k/clang   228MB/s ± 0%   240MB/s ± 0%  +5.24%  (p=0.008 n=5+5)
puffs_zlib_decode_10k/clang     173MB/s ± 0%   188MB/s ± 0%  +8.69%  (p=0.008 n=5+5)
puffs_zlib_decode_100k/clang    209MB/s ± 0%   219MB/s ± 0%  +4.81%  (p=0.008 n=5+5)

puffs_adler32_10k/gcc          3.26GB/s ± 0%  3.26GB/s ± 0%    ~     (p=0.286 n=5+4)
puffs_adler32_100k/gcc         3.26GB/s ± 0%  3.26GB/s ± 0%    ~     (p=0.190 n=5+4)
puffs_flate_decode_1k/gcc       148MB/s ± 0%   148MB/s ± 0%  +0.27%  (p=0.016 n=5+4)
puffs_flate_decode_10k/gcc      245MB/s ± 0%   254MB/s ± 0%  +3.73%  (p=0.008 n=5+5)
puffs_flate_decode_100k/gcc     284MB/s ± 0%   298MB/s ± 0%  +4.90%  (p=0.008 n=5+5)
puffs_zlib_decode_10k/gcc       228MB/s ± 0%   236MB/s ± 0%  +3.33%  (p=0.008 n=5+5)
puffs_zlib_decode_100k/gcc      261MB/s ± 0%   273MB/s ± 0%  +4.46%  (p=0.016 n=5+4)
2017-11-09 15:08:28 +11:00
Nigel Tao 30b54616a8 Check copy_from_history32's distance. 2017-11-09 12:53:19 +11:00
Nigel Tao 67fb7bf1dc Prepare to optimize w.since_mark.
It's not obvious why the benchmark numbers don't improve, so the
intuitively-better codegen is disabled for now. I'm also having trouble
exactly reproducing the numbers from yesterdays' commits. While I'm
investigating, land this commit and move on.
2017-11-09 12:03:38 +11:00
Nigel Tao 3bdd515e47 Allow "assert foo", not just "assert foo < bar". 2017-11-09 10:53:37 +11:00
Nigel Tao e2ce9f1b1d Add a writer1.is_marked method. 2017-11-09 10:38:24 +11:00
Nigel Tao 0bc6f792fb Remove some suspensions from decode_huffman_fast.
name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.41GB/s ± 1%  2.39GB/s ± 2%  -0.88%  (p=0.022 n=9+10)
puffs_adler32_100k/clang       2.41GB/s ± 1%  2.39GB/s ± 2%    ~     (p=0.095 n=10+9)
puffs_flate_decode_1k/clang     136MB/s ± 2%   134MB/s ± 1%  -0.86%  (p=0.036 n=9+8)
puffs_flate_decode_10k/clang    172MB/s ± 0%   175MB/s ± 0%  +1.96%  (p=0.000 n=8+9)
puffs_flate_decode_100k/clang   206MB/s ± 0%   209MB/s ± 1%  +1.38%  (p=0.000 n=8+9)
puffs_zlib_decode_10k/clang     160MB/s ± 1%   163MB/s ± 2%  +1.73%  (p=0.001 n=9+9)
puffs_zlib_decode_100k/clang    189MB/s ± 1%   188MB/s ± 6%    ~     (p=0.143 n=10+10)

puffs_adler32_10k/gcc          3.27GB/s ± 0%  3.20GB/s ± 2%  -2.03%  (p=0.000 n=8+10)
puffs_adler32_100k/gcc         3.27GB/s ± 0%  3.21GB/s ± 1%  -1.89%  (p=0.000 n=8+10)
puffs_flate_decode_1k/gcc       141MB/s ± 1%   139MB/s ± 1%  -1.66%  (p=0.000 n=9+10)
puffs_flate_decode_10k/gcc      200MB/s ± 0%   209MB/s ± 1%  +4.73%  (p=0.000 n=10+10)
puffs_flate_decode_100k/gcc     242MB/s ± 0%   237MB/s ± 0%  -2.19%  (p=0.000 n=9+10)
puffs_zlib_decode_10k/gcc       188MB/s ± 0%   195MB/s ± 1%  +3.71%  (p=0.000 n=10+10)
puffs_zlib_decode_100k/gcc      225MB/s ± 0%   221MB/s ± 0%  -1.84%  (p=0.000 n=8+9)
2017-11-06 16:59:27 +11:00
Nigel Tao 058938006a Remove some suspensions from decode_huffman_fast.
name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.45GB/s ± 0%  2.41GB/s ± 1%  -1.82%  (p=0.000 n=9+9)
puffs_adler32_100k/clang       2.45GB/s ± 0%  2.41GB/s ± 1%  -1.74%  (p=0.000 n=9+10)
puffs_flate_decode_1k/clang     133MB/s ± 0%   136MB/s ± 2%  +1.93%  (p=0.003 n=9+9)
puffs_flate_decode_10k/clang    181MB/s ± 0%   172MB/s ± 0%  -5.18%  (p=0.000 n=9+8)
puffs_flate_decode_100k/clang   204MB/s ± 0%   206MB/s ± 0%  +0.63%  (p=0.000 n=10+8)
puffs_zlib_decode_10k/clang     168MB/s ± 0%   160MB/s ± 1%  -4.82%  (p=0.000 n=10+9)
puffs_zlib_decode_100k/clang    189MB/s ± 0%   189MB/s ± 1%    ~     (p=0.143 n=10+10)

puffs_adler32_10k/gcc          3.26GB/s ± 0%  3.27GB/s ± 0%  +0.12%  (p=0.000 n=10+8)
puffs_adler32_100k/gcc         3.27GB/s ± 0%  3.27GB/s ± 0%  +0.18%  (p=0.000 n=10+8)
puffs_flate_decode_1k/gcc       130MB/s ± 0%   141MB/s ± 1%  +8.71%  (p=0.000 n=10+9)
puffs_flate_decode_10k/gcc      203MB/s ± 0%   200MB/s ± 0%  -1.72%  (p=0.000 n=9+10)
puffs_flate_decode_100k/gcc     241MB/s ± 0%   242MB/s ± 0%  +0.54%  (p=0.000 n=8+9)
puffs_zlib_decode_10k/gcc       188MB/s ± 0%   188MB/s ± 0%  +0.26%  (p=0.000 n=9+10)
puffs_zlib_decode_100k/gcc      223MB/s ± 0%   225MB/s ± 0%  +0.93%  (p=0.000 n=9+8)
2017-11-06 15:25:19 +11:00
Nigel Tao 73778b0767 Re-pack token keys' numeric values. 2017-11-05 20:07:30 +11:00
Nigel Tao 13731f989f Add a reader1.unread_u8 method.
Also re-enable a number of std/flate tests and benchmarks.

It's not an optimization per se, but as a data point, here are some
benchmark numbers between 36a93fa and this commit. 36a93fa is "36a93fa
Add a TODO about impure functions", which is one commit before "f968950
Read bits up front in decode_huffman_fast", and f968950 was the commit
that made decode_huffman_fast read more than one byte at a time.

name                             old speed      new speed       delta

puffs_adler32_10k/clang          2.45GB/s ± 0%   2.45GB/s ± 0%     ~     (p=0.684 n=10+10)
puffs_adler32_100k/clang         2.45GB/s ± 0%   2.46GB/s ± 0%   +0.07%  (p=0.019 n=10+10)
puffs_flate_decode_1k/clang       124MB/s ± 0%    132MB/s ± 0%   +6.06%  (p=0.000 n=10+10)
puffs_flate_decode_10k/clang      145MB/s ± 0%    174MB/s ± 0%  +20.19%  (p=0.000 n=9+10)
puffs_flate_decode_100k/clang     168MB/s ± 0%    208MB/s ± 0%  +23.31%  (p=0.000 n=10+10)
puffs_zlib_decode_10k/clang       136MB/s ± 0%    162MB/s ± 0%  +18.94%  (p=0.000 n=10+9)
puffs_zlib_decode_100k/clang      158MB/s ± 0%    192MB/s ± 0%  +21.58%  (p=0.000 n=10+9)

puffs_adler32_10k/gcc            3.26GB/s ± 0%   3.26GB/s ± 0%     ~     (p=0.631 n=10+10)
puffs_adler32_100k/gcc           3.27GB/s ± 0%   3.27GB/s ± 0%     ~     (p=0.237 n=10+8)
puffs_flate_decode_1k/gcc        95.3MB/s ± 0%  105.5MB/s ± 0%  +10.67%  (p=0.000 n=10+10)
puffs_flate_decode_10k/gcc        110MB/s ± 0%    140MB/s ± 0%  +27.32%  (p=0.000 n=9+9)
puffs_flate_decode_100k/gcc       121MB/s ± 0%    150MB/s ± 0%  +24.02%  (p=0.000 n=8+10)
puffs_zlib_decode_10k/gcc         112MB/s ± 0%    120MB/s ± 0%   +6.96%  (p=0.000 n=10+9)
puffs_zlib_decode_100k/gcc        123MB/s ± 0%    134MB/s ± 0%   +8.93%  (p=0.000 n=9+8)
2017-11-05 15:59:02 +11:00
Nigel Tao 3099991d7f Add an "invalid I/O operation" error code. 2017-11-05 13:53:35 +11:00
Nigel Tao 55e0bc513b Don't suspend for read_u8 if data is available.
It's not obvious why the benchmarks get worse when the code looks
better, but the long term goal is for all of decode_huffman_fast to not
suspend, and this is one step along that path.

name                           old speed      new speed      delta

puffs_adler32_10k/clang        2.40GB/s ± 1%  2.40GB/s ± 1%     ~     (p=0.841 n=5+5)
puffs_adler32_100k/clang       2.40GB/s ± 1%  2.39GB/s ± 2%     ~     (p=0.421 n=5+5)
puffs_flate_decode_1k/clang     131MB/s ± 1%   128MB/s ± 0%   -2.51%  (p=0.008 n=5+5)
puffs_flate_decode_10k/clang    171MB/s ± 1%   167MB/s ± 2%   -2.86%  (p=0.008 n=5+5)
puffs_flate_decode_100k/clang   202MB/s ± 0%   193MB/s ± 2%   -4.64%  (p=0.016 n=4+5)
puffs_zlib_decode_10k/clang     159MB/s ± 1%   157MB/s ± 0%   -1.65%  (p=0.008 n=5+5)
puffs_zlib_decode_100k/clang    185MB/s ± 1%   180MB/s ± 1%   -3.11%  (p=0.008 n=5+5)

puffs_adler32_10k/gcc          3.26GB/s ± 0%  3.26GB/s ± 0%     ~     (p=0.421 n=5+5)
puffs_adler32_100k/gcc         3.27GB/s ± 0%  3.26GB/s ± 0%     ~     (p=0.151 n=5+5)
puffs_flate_decode_1k/gcc       132MB/s ± 0%   129MB/s ± 0%   -2.29%  (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc      170MB/s ± 0%   164MB/s ± 0%   -3.13%  (p=0.008 n=5+5)
puffs_flate_decode_100k/gcc     207MB/s ± 0%   185MB/s ± 0%  -10.45%  (p=0.016 n=5+4)
puffs_zlib_decode_10k/gcc       162MB/s ± 0%   157MB/s ± 0%   -2.95%  (p=0.008 n=5+5)
puffs_zlib_decode_100k/gcc      194MB/s ± 0%   175MB/s ± 0%   -9.78%  (p=0.016 n=5+4)
2017-11-05 08:03:21 +11:00