Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func BertBaseUncased ¶
BertBaseUncase loads pretrained BERT tokenizer.
It uses special tokens: `[UNK]`, `[SEP]`, `[CLS]` and `[MASK]` Its normalizer configued with: clean text, lower-case, handle Chinese characters and strip accents.
Types ¶
This section is empty.
Source Files
Click to show internal directories.
Click to hide internal directories.