Commit Graph

5 Commits

Author SHA1 Message Date
e2d17f2e8a Add iterator over tokens to TokenizedFile 2025-08-07 17:24:35 +07:00
9ab65b0b02 Add missing tokens to lexer 2025-08-07 13:49:19 +07:00
9ff20c7a60 Rename TokenSpan to TokenPiece and tidy code layout 2025-08-06 23:18:08 +07:00
579c2a4d3d Refactor Line
Previous definition of `Line` type was obnoxious and too difficult to
work with. This one should make iterator implementation much easier and
has clearer structure on its own.
2025-08-06 23:17:55 +07:00
4b9d6a6adb Initial commit 2025-07-30 19:47:11 +07:00