WithFromTo returns a Type with the given value and indices into the input stream.

EOF is end of file.

EOL is end of line.

FloatLit is float literal.

IntLit is integer literal.

Invalid token.

Name is a variable name or keyword.

one of (, ), {, }, `,` a sequence of these gives a sequence of single char lexemes.

one of +, -, *, /, =, <, >, ! a sequence of these stick together in a single lexeme.

StringLit is String literal.

Token as produced by the lexer.

Kind is the token kind.