swarm-jax
Python
★ 0
updated 3y ago
⑂ fork
Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes
No plain-English explanation yet — one is being written right now. Check back in a minute.