2a31ed08b8
Add method for checking whether token can be type
2025-09-16 08:14:22 +07:00
41672a7125
Add token for goto
2025-09-16 08:13:56 +07:00
d9923fd762
Fix comments
2025-09-16 08:13:04 +07:00
d519ecab2e
Fix documentation and comments
2025-08-11 03:31:26 +07:00
933722bd42
Add iterator over tokens to TokenizedFile
2025-08-07 17:25:43 +07:00
9ab65b0b02
Add missing tokens to lexer
2025-08-07 13:49:19 +07:00
9ff20c7a60
Rename TokenSpan to TokenPiece and tidy code layout
2025-08-06 23:18:08 +07:00
579c2a4d3d
Refactor Line
...
Previous definition of `Line` type was obnoxious and too difficult to
work with. This one should make iterator implementation much easier and
has clearer structure on its own.
2025-08-06 23:17:55 +07:00
4b9d6a6adb
Initial commit
2025-07-30 19:47:11 +07:00
