# README
Basic examples
This demonstrates how to use different models (i.e., BERT or BPE) in a tokenizer.
To run:
go run . -model=bert
go run . -model=bpe
This demonstrates how to use different models (i.e., BERT or BPE) in a tokenizer.
To run:
go run . -model=bert
go run . -model=bpe