gpt-neox
Python
★ 1
updated 5y ago
⑂ fork
An implementation of model parallel GPT-3-like models on GPUs, based on the DeepSpeed library. Designed to be able to train models in the hundreds of billions of parameters or larger.
No plain-English explanation yet — one is being written right now. Check back in a minute.