NewPolicy create a new policy instance with given arguments.

NewSpec creates a new spec with given arguments.

NewToken creates a new token with given arguments.

NewTokenizer create a new tokenizer instance with given parameters.

BlacklistPolicy declare a policy to use blacklist logic.

WhitelistPolicy declare a policy to use whitelist logic.

Policy handles policy checks based on configuration.

spec for the tokenizer.

Token represents a single token.

tokenizer that lazily pulls a token from a stream.

PolicyType represent policy type values.

TokenType is the type of the token.