Nigel Tao
|
7df75101cd
|
Simplify tokenization of multi-byte squiggles.
|
2017-05-21 10:56:21 +10:00 |
|
Nigel Tao
|
a8c304236d
|
First cut of a bounds checker.
|
2017-05-18 13:37:46 +10:00 |
|
Nigel Tao
|
c1ce1b08de
|
Check "var z u64[:123]".
|
2017-05-11 17:11:17 +10:00 |
|
Nigel Tao
|
54567dbd47
|
Rename ParseFile, RenderFile to Parse, Render.
Also make various funcs' arg order consist wrt the IDMap and the input
or inputs.
|
2017-05-11 09:48:01 +10:00 |
|
Nigel Tao
|
cf8167a648
|
Add ByID and ByToken to token.IDMap.
|
2017-05-06 17:02:11 +10:00 |
|
Nigel Tao
|
6424985f0f
|
Export token Key and Flags bit sizes.
|
2017-05-06 14:20:18 +10:00 |
|
Nigel Tao
|
60a4fdb9fd
|
Parse use "std/io".
|
2017-05-05 15:07:30 +10:00 |
|
Nigel Tao
|
94cb8b25cb
|
Tokenize and render comments.
|
2017-05-05 12:33:38 +10:00 |
|
Nigel Tao
|
1617d5eb34
|
Enforce a maximum token size.
|
2017-05-04 11:16:37 +10:00 |
|
Nigel Tao
|
5c934e5599
|
Hoist some methods from token.ID to token.Token.
|
2017-04-30 13:42:48 +10:00 |
|
Nigel Tao
|
a48bbf6d2e
|
Change Token.Line from int32 to uint32.
|
2017-04-30 13:27:55 +10:00 |
|
Nigel Tao
|
0cfb27db56
|
Simplify unrecognized token byte error message.
|
2017-04-30 13:11:58 +10:00 |
|
Nigel Tao
|
3072f64368
|
Introduce token.Flags.
|
2017-04-30 13:09:36 +10:00 |
|
Nigel Tao
|
ea2bc6c10c
|
First cut of a parser.
|
2017-04-29 16:57:56 +10:00 |
|
Nigel Tao
|
21c6c34d92
|
Insert implicit semicolons.
|
2017-04-29 11:51:37 +10:00 |
|
Nigel Tao
|
a91ae8cdbf
|
First cut of a tokenizer.
|
2017-04-29 11:27:38 +10:00 |
|