torchft

Python ★ 1 updated 11mo ago ⑂ fork

Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)

No plain-English explanation yet — one is being written right now. Check back in a minute.