Categorygithub.com/fealsamh/go-utilstokeniser
package
0.1.33
Repository: https://github.com/fealsamh/go-utils.git
Documentation: pkg.go.dev
Overview
Versions
1
Dependencies
8
Dependents
1
Files
217 SLOC

# Functions

Tokenise tokenises the content of a reader.

# Constants

token types.
token types.
token types.
token types.
token types.
token types.

# Structs

Config is a tokeniser's configuration.
Token is a textual token.

# Type aliases

TokenType is a token's type.