Megatron-DeepSpeed
Python
★ 1.4k
updated 2y ago
Ongoing research training transformer language models at scale, including: BERT & GPT-2
No plain-English explanation yet — one is being written right now. Check back in a minute.