Commit Graph
17 Commits
Author SHA1 Message Date
Nigel Tao 6e7e566232 Rename token.IDMap to token.Map. 2017-06-08 13:10:01 +10:00
Nigel Tao 7df75101cd Simplify tokenization of multi-byte squiggles. 2017-05-21 10:56:21 +10:00
Nigel Tao a8c304236d First cut of a bounds checker. 2017-05-18 13:37:46 +10:00
Nigel Tao c1ce1b08de Check "var z u64[:123]". 2017-05-11 17:11:17 +10:00
Nigel Tao 54567dbd47 Rename ParseFile, RenderFile to Parse, Render.
Also make various funcs' arg order consist wrt the IDMap and the input
or inputs.
2017-05-11 09:48:01 +10:00
Nigel Tao cf8167a648 Add ByID and ByToken to token.IDMap. 2017-05-06 17:02:11 +10:00
Nigel Tao 6424985f0f Export token Key and Flags bit sizes. 2017-05-06 14:20:18 +10:00
Nigel Tao 60a4fdb9fd Parse use "std/io". 2017-05-05 15:07:30 +10:00
Nigel Tao 94cb8b25cb Tokenize and render comments. 2017-05-05 12:33:38 +10:00
Nigel Tao 1617d5eb34 Enforce a maximum token size. 2017-05-04 11:16:37 +10:00
Nigel Tao 5c934e5599 Hoist some methods from token.ID to token.Token. 2017-04-30 13:42:48 +10:00
Nigel Tao a48bbf6d2e Change Token.Line from int32 to uint32. 2017-04-30 13:27:55 +10:00
Nigel Tao 0cfb27db56 Simplify unrecognized token byte error message. 2017-04-30 13:11:58 +10:00
Nigel Tao 3072f64368 Introduce token.Flags. 2017-04-30 13:09:36 +10:00
Nigel Tao ea2bc6c10c First cut of a parser. 2017-04-29 16:57:56 +10:00
Nigel Tao 21c6c34d92 Insert implicit semicolons. 2017-04-29 11:51:37 +10:00
Nigel Tao a91ae8cdbf First cut of a tokenizer. 2017-04-29 11:27:38 +10:00