DecodeEscape unescapes a backslash-escaped buffer byteMode indicates whether we are creating a unicode string or a bytes output.

Lex a file only, returning a sequence of tokens.

Lex a string.

Create a new lexer The mode argument specifies what kind of code must be compiled; it can be 'exec' if source consists of a sequence of statements, 'eval' if it consists of a single expression, or 'single' if it consists of a single interactive statement.

Parse a file.

Parse a string.

Set the debug level 0 = off, 4 = max.

A Token with value.

An slice of LexToken~s.