NewTokenizer creates a new instance of Tokenizer.

NewTokenStream creates a new instance of TokenStream.

Tokenizer is an autogenerated mock type for the Tokenizer type.

Tokenizer_Destroy_Call is a *mock.Call that shadows Run/Return methods with type explicit version for method 'Destroy'.

Tokenizer_NewTokenStream_Call is a *mock.Call that shadows Run/Return methods with type explicit version for method 'NewTokenStream'.

TokenStream is an autogenerated mock type for the TokenStream type.

TokenStream_Advance_Call is a *mock.Call that shadows Run/Return methods with type explicit version for method 'Advance'.

TokenStream_Destroy_Call is a *mock.Call that shadows Run/Return methods with type explicit version for method 'Destroy'.

TokenStream_Token_Call is a *mock.Call that shadows Run/Return methods with type explicit version for method 'Token'.