veScale

Python ★ 1.0k updated 4mo ago

Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs

No plain-English explanation yet — one is being written right now. Check back in a minute.