Nigel Tao
0b06dbcf02
Simplify big.Int comparisons to zero
2018-01-04 11:08:41 +11:00
Nigel Tao
117a6c829b
Unexport some unused lang/check API
2017-12-29 14:02:56 +11:00
Nigel Tao
1004d898d5
Add statusPkg arg to ast.NewExpr
2017-12-29 13:33:46 +11:00
Nigel Tao
8b4ba30a36
Rename some ast.Expr methods
2017-12-29 12:58:01 +11:00
Nigel Tao
ed03c5943a
Add pkg to ast Func, Struct and TypeExpr nodes
2017-12-29 12:08:17 +11:00
Nigel Tao
d14b56ea39
Type check built-in functions more thoroughly
2017-12-16 13:25:26 +11:00
Nigel Tao
3b822f8b17
Rename some arguments for consistency
2017-12-09 16:03:18 +11:00
Nigel Tao
90f1fcc328
Bounds check call arguments more thoroughly
2017-12-09 16:01:01 +11:00
Nigel Tao
906bca4e39
Drop volatile facts after a yield statement
2017-12-01 16:24:54 +11:00
Nigel Tao
65dcf6a5b9
Add a yield keyword
2017-12-01 15:24:48 +11:00
Nigel Tao
7601fb45ce
Rename String(*token.Map) to Str(*token.Map)
2017-12-01 11:22:08 +11:00
Nigel Tao
79a94558be
Rename PUFFS to WUFFS, part 5 of N
2017-11-30 16:37:20 +11:00
Nigel Tao
0cea46531b
Rename PUFFS to WUFFS, part 2 of N
2017-11-30 16:23:16 +11:00
Nigel Tao
693af478d6
Rename some bcheckOptimizeXxx methods.
2017-11-09 15:15:30 +11:00
Nigel Tao
d2a01dd938
Refactor lang/check/bounds.go.
2017-11-09 15:11:45 +11:00
Nigel Tao
9b4cc179c4
Use puffs_base__writer1__copy_from_history32__bco.
...
name old speed new speed delta
puffs_adler32_10k/clang 2.45GB/s ± 0% 2.45GB/s ± 0% ~ (p=0.063 n=5+5)
puffs_adler32_100k/clang 2.45GB/s ± 0% 2.45GB/s ± 0% ~ (p=0.905 n=5+4)
puffs_flate_decode_1k/clang 144MB/s ± 1% 146MB/s ± 0% +1.41% (p=0.016 n=5+5)
puffs_flate_decode_10k/clang 186MB/s ± 0% 204MB/s ± 0% +9.39% (p=0.008 n=5+5)
puffs_flate_decode_100k/clang 228MB/s ± 0% 240MB/s ± 0% +5.24% (p=0.008 n=5+5)
puffs_zlib_decode_10k/clang 173MB/s ± 0% 188MB/s ± 0% +8.69% (p=0.008 n=5+5)
puffs_zlib_decode_100k/clang 209MB/s ± 0% 219MB/s ± 0% +4.81% (p=0.008 n=5+5)
puffs_adler32_10k/gcc 3.26GB/s ± 0% 3.26GB/s ± 0% ~ (p=0.286 n=5+4)
puffs_adler32_100k/gcc 3.26GB/s ± 0% 3.26GB/s ± 0% ~ (p=0.190 n=5+4)
puffs_flate_decode_1k/gcc 148MB/s ± 0% 148MB/s ± 0% +0.27% (p=0.016 n=5+4)
puffs_flate_decode_10k/gcc 245MB/s ± 0% 254MB/s ± 0% +3.73% (p=0.008 n=5+5)
puffs_flate_decode_100k/gcc 284MB/s ± 0% 298MB/s ± 0% +4.90% (p=0.008 n=5+5)
puffs_zlib_decode_10k/gcc 228MB/s ± 0% 236MB/s ± 0% +3.33% (p=0.008 n=5+5)
puffs_zlib_decode_100k/gcc 261MB/s ± 0% 273MB/s ± 0% +4.46% (p=0.016 n=5+4)
2017-11-09 15:08:28 +11:00
Nigel Tao
67fb7bf1dc
Prepare to optimize w.since_mark.
...
It's not obvious why the benchmark numbers don't improve, so the
intuitively-better codegen is disabled for now. I'm also having trouble
exactly reproducing the numbers from yesterdays' commits. While I'm
investigating, land this commit and move on.
2017-11-09 12:03:38 +11:00
Nigel Tao
3bdd515e47
Allow "assert foo", not just "assert foo < bar".
2017-11-09 10:53:37 +11:00
Nigel Tao
e2ce9f1b1d
Add a writer1.is_marked method.
2017-11-09 10:38:24 +11:00
Nigel Tao
0bc6f792fb
Remove some suspensions from decode_huffman_fast.
...
name old speed new speed delta
puffs_adler32_10k/clang 2.41GB/s ± 1% 2.39GB/s ± 2% -0.88% (p=0.022 n=9+10)
puffs_adler32_100k/clang 2.41GB/s ± 1% 2.39GB/s ± 2% ~ (p=0.095 n=10+9)
puffs_flate_decode_1k/clang 136MB/s ± 2% 134MB/s ± 1% -0.86% (p=0.036 n=9+8)
puffs_flate_decode_10k/clang 172MB/s ± 0% 175MB/s ± 0% +1.96% (p=0.000 n=8+9)
puffs_flate_decode_100k/clang 206MB/s ± 0% 209MB/s ± 1% +1.38% (p=0.000 n=8+9)
puffs_zlib_decode_10k/clang 160MB/s ± 1% 163MB/s ± 2% +1.73% (p=0.001 n=9+9)
puffs_zlib_decode_100k/clang 189MB/s ± 1% 188MB/s ± 6% ~ (p=0.143 n=10+10)
puffs_adler32_10k/gcc 3.27GB/s ± 0% 3.20GB/s ± 2% -2.03% (p=0.000 n=8+10)
puffs_adler32_100k/gcc 3.27GB/s ± 0% 3.21GB/s ± 1% -1.89% (p=0.000 n=8+10)
puffs_flate_decode_1k/gcc 141MB/s ± 1% 139MB/s ± 1% -1.66% (p=0.000 n=9+10)
puffs_flate_decode_10k/gcc 200MB/s ± 0% 209MB/s ± 1% +4.73% (p=0.000 n=10+10)
puffs_flate_decode_100k/gcc 242MB/s ± 0% 237MB/s ± 0% -2.19% (p=0.000 n=9+10)
puffs_zlib_decode_10k/gcc 188MB/s ± 0% 195MB/s ± 1% +3.71% (p=0.000 n=10+10)
puffs_zlib_decode_100k/gcc 225MB/s ± 0% 221MB/s ± 0% -1.84% (p=0.000 n=8+9)
2017-11-06 16:59:27 +11:00
Nigel Tao
058938006a
Remove some suspensions from decode_huffman_fast.
...
name old speed new speed delta
puffs_adler32_10k/clang 2.45GB/s ± 0% 2.41GB/s ± 1% -1.82% (p=0.000 n=9+9)
puffs_adler32_100k/clang 2.45GB/s ± 0% 2.41GB/s ± 1% -1.74% (p=0.000 n=9+10)
puffs_flate_decode_1k/clang 133MB/s ± 0% 136MB/s ± 2% +1.93% (p=0.003 n=9+9)
puffs_flate_decode_10k/clang 181MB/s ± 0% 172MB/s ± 0% -5.18% (p=0.000 n=9+8)
puffs_flate_decode_100k/clang 204MB/s ± 0% 206MB/s ± 0% +0.63% (p=0.000 n=10+8)
puffs_zlib_decode_10k/clang 168MB/s ± 0% 160MB/s ± 1% -4.82% (p=0.000 n=10+9)
puffs_zlib_decode_100k/clang 189MB/s ± 0% 189MB/s ± 1% ~ (p=0.143 n=10+10)
puffs_adler32_10k/gcc 3.26GB/s ± 0% 3.27GB/s ± 0% +0.12% (p=0.000 n=10+8)
puffs_adler32_100k/gcc 3.27GB/s ± 0% 3.27GB/s ± 0% +0.18% (p=0.000 n=10+8)
puffs_flate_decode_1k/gcc 130MB/s ± 0% 141MB/s ± 1% +8.71% (p=0.000 n=10+9)
puffs_flate_decode_10k/gcc 203MB/s ± 0% 200MB/s ± 0% -1.72% (p=0.000 n=9+10)
puffs_flate_decode_100k/gcc 241MB/s ± 0% 242MB/s ± 0% +0.54% (p=0.000 n=8+9)
puffs_zlib_decode_10k/gcc 188MB/s ± 0% 188MB/s ± 0% +0.26% (p=0.000 n=9+10)
puffs_zlib_decode_100k/gcc 223MB/s ± 0% 225MB/s ± 0% +0.93% (p=0.000 n=9+8)
2017-11-06 15:25:19 +11:00
Nigel Tao
13731f989f
Add a reader1.unread_u8 method.
...
Also re-enable a number of std/flate tests and benchmarks.
It's not an optimization per se, but as a data point, here are some
benchmark numbers between 36a93fa and this commit. 36a93fa is "36a93fa
Add a TODO about impure functions", which is one commit before "f968950
Read bits up front in decode_huffman_fast", and f968950 was the commit
that made decode_huffman_fast read more than one byte at a time.
name old speed new speed delta
puffs_adler32_10k/clang 2.45GB/s ± 0% 2.45GB/s ± 0% ~ (p=0.684 n=10+10)
puffs_adler32_100k/clang 2.45GB/s ± 0% 2.46GB/s ± 0% +0.07% (p=0.019 n=10+10)
puffs_flate_decode_1k/clang 124MB/s ± 0% 132MB/s ± 0% +6.06% (p=0.000 n=10+10)
puffs_flate_decode_10k/clang 145MB/s ± 0% 174MB/s ± 0% +20.19% (p=0.000 n=9+10)
puffs_flate_decode_100k/clang 168MB/s ± 0% 208MB/s ± 0% +23.31% (p=0.000 n=10+10)
puffs_zlib_decode_10k/clang 136MB/s ± 0% 162MB/s ± 0% +18.94% (p=0.000 n=10+9)
puffs_zlib_decode_100k/clang 158MB/s ± 0% 192MB/s ± 0% +21.58% (p=0.000 n=10+9)
puffs_adler32_10k/gcc 3.26GB/s ± 0% 3.26GB/s ± 0% ~ (p=0.631 n=10+10)
puffs_adler32_100k/gcc 3.27GB/s ± 0% 3.27GB/s ± 0% ~ (p=0.237 n=10+8)
puffs_flate_decode_1k/gcc 95.3MB/s ± 0% 105.5MB/s ± 0% +10.67% (p=0.000 n=10+10)
puffs_flate_decode_10k/gcc 110MB/s ± 0% 140MB/s ± 0% +27.32% (p=0.000 n=9+9)
puffs_flate_decode_100k/gcc 121MB/s ± 0% 150MB/s ± 0% +24.02% (p=0.000 n=8+10)
puffs_zlib_decode_10k/gcc 112MB/s ± 0% 120MB/s ± 0% +6.96% (p=0.000 n=10+9)
puffs_zlib_decode_100k/gcc 123MB/s ± 0% 134MB/s ± 0% +8.93% (p=0.000 n=9+8)
2017-11-05 15:59:02 +11:00
Nigel Tao
55e0bc513b
Don't suspend for read_u8 if data is available.
...
It's not obvious why the benchmarks get worse when the code looks
better, but the long term goal is for all of decode_huffman_fast to not
suspend, and this is one step along that path.
name old speed new speed delta
puffs_adler32_10k/clang 2.40GB/s ± 1% 2.40GB/s ± 1% ~ (p=0.841 n=5+5)
puffs_adler32_100k/clang 2.40GB/s ± 1% 2.39GB/s ± 2% ~ (p=0.421 n=5+5)
puffs_flate_decode_1k/clang 131MB/s ± 1% 128MB/s ± 0% -2.51% (p=0.008 n=5+5)
puffs_flate_decode_10k/clang 171MB/s ± 1% 167MB/s ± 2% -2.86% (p=0.008 n=5+5)
puffs_flate_decode_100k/clang 202MB/s ± 0% 193MB/s ± 2% -4.64% (p=0.016 n=4+5)
puffs_zlib_decode_10k/clang 159MB/s ± 1% 157MB/s ± 0% -1.65% (p=0.008 n=5+5)
puffs_zlib_decode_100k/clang 185MB/s ± 1% 180MB/s ± 1% -3.11% (p=0.008 n=5+5)
puffs_adler32_10k/gcc 3.26GB/s ± 0% 3.26GB/s ± 0% ~ (p=0.421 n=5+5)
puffs_adler32_100k/gcc 3.27GB/s ± 0% 3.26GB/s ± 0% ~ (p=0.151 n=5+5)
puffs_flate_decode_1k/gcc 132MB/s ± 0% 129MB/s ± 0% -2.29% (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc 170MB/s ± 0% 164MB/s ± 0% -3.13% (p=0.008 n=5+5)
puffs_flate_decode_100k/gcc 207MB/s ± 0% 185MB/s ± 0% -10.45% (p=0.016 n=5+4)
puffs_zlib_decode_10k/gcc 162MB/s ± 0% 157MB/s ± 0% -2.95% (p=0.008 n=5+5)
puffs_zlib_decode_100k/gcc 194MB/s ± 0% 175MB/s ± 0% -9.78% (p=0.016 n=5+4)
2017-11-05 08:03:21 +11:00
Nigel Tao
f968950345
Read bits up front in decode_huffman_fast.
...
name old speed new speed delta
puffs_adler32_10k/clang 2.36GB/s ± 4% 2.38GB/s ± 2% ~ (p=1.000 n=5+5)
puffs_adler32_100k/clang 2.39GB/s ± 4% 2.39GB/s ± 1% ~ (p=0.841 n=5+5)
puffs_flate_decode_1k/clang 121MB/s ± 1% 129MB/s ± 2% +5.95% (p=0.008 n=5+5)
puffs_flate_decode_10k/clang 138MB/s ± 3% 161MB/s ± 1% +16.52% (p=0.008 n=5+5)
puffs_flate_decode_100k/clang 163MB/s ± 4% 187MB/s ± 3% +14.50% (p=0.008 n=5+5)
puffs_zlib_decode_10k/clang 132MB/s ± 2% 150MB/s ± 1% +13.92% (p=0.008 n=5+5)
puffs_zlib_decode_100k/clang 152MB/s ± 6% 174MB/s ± 1% +14.60% (p=0.008 n=5+5)
puffs_adler32_10k/gcc 3.25GB/s ± 0% 3.12GB/s ± 3% -4.06% (p=0.008 n=5+5)
puffs_adler32_100k/gcc 3.25GB/s ± 0% 3.12GB/s ± 3% -3.99% (p=0.008 n=5+5)
puffs_flate_decode_1k/gcc 95.1MB/s ± 0% 127.7MB/s ± 3% +34.25% (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc 110MB/s ± 0% 172MB/s ± 4% +55.66% (p=0.008 n=5+5)
puffs_flate_decode_100k/gcc 121MB/s ± 0% 196MB/s ± 2% +61.45% (p=0.008 n=5+5)
puffs_zlib_decode_10k/gcc 112MB/s ± 0% 164MB/s ± 1% +46.14% (p=0.008 n=5+5)
puffs_zlib_decode_100k/gcc 123MB/s ± 0% 186MB/s ± 0% +51.22% (p=0.016 n=5+4)
2017-11-04 17:37:54 +11:00
Nigel Tao
aa1f0078db
Add decode_huffman_fast.
...
It's not fast yet, and the immediate impact is indeed a significant
performance loss, but follow-up commits should make it faster.
name old speed new speed delta
puffs_adler32_10k/clang 2.41GB/s ± 0% 2.40GB/s ± 1% ~ (p=0.222 n=5+5)
puffs_adler32_100k/clang 2.41GB/s ± 1% 2.39GB/s ± 1% -0.97% (p=0.016 n=5+5)
puffs_flate_decode_1k/clang 116MB/s ± 5% 115MB/s ± 0% ~ (p=0.310 n=5+5)
puffs_flate_decode_10k/clang 145MB/s ± 0% 139MB/s ± 0% -4.18% (p=0.016 n=4+5)
puffs_flate_decode_100k/clang 164MB/s ± 5% 158MB/s ± 1% ~ (p=0.151 n=5+5)
puffs_zlib_decode_10k/clang 135MB/s ± 2% 131MB/s ± 0% -2.84% (p=0.008 n=5+5)
puffs_zlib_decode_100k/clang 154MB/s ± 1% 148MB/s ± 2% -4.09% (p=0.016 n=4+5)
puffs_adler32_10k/gcc 3.13GB/s ± 4% 3.19GB/s ± 0% +1.94% (p=0.032 n=5+5)
puffs_adler32_100k/gcc 3.14GB/s ± 3% 3.20GB/s ± 3% ~ (p=0.056 n=5+5)
puffs_flate_decode_1k/gcc 122MB/s ± 1% 94MB/s ± 1% -22.84% (p=0.008 n=5+5)
puffs_flate_decode_10k/gcc 143MB/s ± 0% 110MB/s ± 0% -23.24% (p=0.008 n=5+5)
puffs_flate_decode_100k/gcc 158MB/s ± 0% 118MB/s ± 0% -24.98% (p=0.008 n=5+5)
puffs_zlib_decode_10k/gcc 136MB/s ± 0% 119MB/s ± 1% -12.63% (p=0.008 n=5+5)
puffs_zlib_decode_100k/gcc 150MB/s ± 1% 124MB/s ± 2% -17.17% (p=0.008 n=5+5)
2017-11-04 14:45:11 +11:00
Nigel Tao
4810db3994
Rename decode_huffman to decode_huffman_slow.
2017-11-04 13:38:24 +11:00
Nigel Tao
7cefcccc98
Make error "foo" an expression.
2017-10-27 13:00:13 +11:00
Nigel Tao
9a8508857f
Fix the "limitt" typo.
2017-10-27 11:10:25 +11:00
Nigel Tao
cbc8c39375
Delete old limit- and mark-related code.
2017-10-27 10:57:32 +11:00
Nigel Tao
8ff453c752
Re-do how limits work.
2017-10-26 16:59:03 +11:00
Nigel Tao
a9ba7e85ac
Add reader1.limitt and writer1.limitt methods.
...
The "limitt" typo will be renamed to "limit" once we remove the keyword
named "limit".
2017-10-26 15:06:59 +11:00
Nigel Tao
b886e3a1ea
Add reader1.mark and reader1.since_mark methods.
2017-10-26 14:39:38 +11:00
Nigel Tao
5052b16f2d
Rename writer1.slice to writer1.since_mark.
2017-10-26 13:03:19 +11:00
Nigel Tao
474a0d2ed7
Make mark a method, not a keyword.
2017-10-26 12:31:27 +11:00
Nigel Tao
ac793d33bc
Generate placeholder code for "mark in.dst".
2017-10-22 13:57:37 +11:00
Nigel Tao
1c75edb32e
Calculate the zlib checksum.
2017-10-21 12:38:23 +11:00
Nigel Tao
62935c41d7
Prepare for calculating the zlib checksum.
2017-10-21 11:55:58 +11:00
Nigel Tao
2cd6ebed8e
Add a "deref" unary operator.
2017-10-20 15:44:30 +11:00
Nigel Tao
51bd52239b
Add an "iterate" keyword.
2017-10-20 15:33:31 +11:00
Nigel Tao
f9cea5c17c
Fix the adler.update implementation.
2017-10-19 20:45:43 +11:00
Nigel Tao
d770bf7534
Add some adler.update implementation.
2017-10-19 19:32:10 +11:00
Nigel Tao
5b0d6f6f3e
Add a skeleton of an Adler checksummer.
2017-10-19 18:09:14 +11:00
Nigel Tao
6492c52156
Add a ~+ operator.
2017-10-19 16:50:05 +11:00
Nigel Tao
c99fdaf63d
Actually copy from the flate decoder's history.
2017-10-13 14:50:34 +11:00
Nigel Tao
0384c5e4a8
Rename the copy_from_xxx methods for consistency.
2017-10-13 10:59:47 +11:00
Nigel Tao
d4372cb5b8
Change license to Apache 2.
...
Also remove explicit PATENTS file. The new LICENSE file already
discusses patents.
Note that the Puffs project has not yet been publicly released.
2017-10-12 11:17:41 +11:00
Nigel Tao
c3ae0534df
Add a writer1.available method.
2017-10-07 16:15:17 +11:00
Nigel Tao
6f132a74e2
Remove the 'mark' concept, no longer necessary.
2017-10-02 14:02:13 +11:00
Nigel Tao
4aa9fce311
Make writer1.slice's args implicitly (start, ptr).
2017-10-02 13:52:34 +11:00
Nigel Tao
3b57548b0d
Generate C code for a non-trivial slice-of-slice.
2017-09-29 17:07:41 +10:00