electra-pytorch
Python
★ 237
updated 3y ago
A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch
No plain-English explanation yet — one is being written right now. Check back in a minute.