Custom Tokenizer
Tokenizer Method
CHAR
BPE
WORD
Selected:
CHAR
Load Default Vocab
1) Train from Custom Corpus (Text)
Train Tokenizer
View Vocab
Download vocab.json