//
pkg.gl
Category
github.com/moutend/codespeak
internal
token
package
1.1.0
Repository:
https://github.com/moutend/codespeak.git
Documentation:
pkg.go.dev
Overview
Versions
1
Dependencies
0
Dependents
2
Files
67 SLOC
#
Functions
GetKind
GetKind returns kind of a rune.
IsAlphabet
IsAlphabet matches `[a-zA-Z]`.
IsNumber
IsNumber matches [0-9].
IsSymbol
IsSymbol matches non-alphanumeric characters.
Split
Split converts string to Token slice.
#
Constants
Alphabet
No description provided by the author
Invalid
No description provided by the author
Number
No description provided by the author
Symbol
No description provided by the author
Unicode
No description provided by the author
#
Structs
Token
Token contains splitted words.
#
Type aliases
Kind
Kind represents a kind of token.