gitmyhub

bert_wwm_cn-en_pretrain

Python ★ 6 updated 3y ago

Pretrain own bert / roberta model with wwm-mlm and modified tokenizer (both chinese and english).

No plain-English explanation yet — one is being written right now. Check back in a minute.