IsIgnores - checks if the given Type is an ignored token type.

LookupKeywords - looks up a keyword in the keywords map and returns its corresponding Type.

New - creates a new Token with the given type and literal value.

Symbols */.

Keywords */.

Special Types */.

Identifiers & Literals */.

Comments */.

Whitespace */.

PositionInfo - represents the current position in the input source code.

Token - represents a lexical token in the input source code.

WithIgnores - is a helper struct that includes a token and a list of ignored tokens.

Type - defines a custom type for tokens.