gitmyhub

bsdp

Python ★ 0 updated 7mo ago

A data parallelism that shards a model block-wise to support optimizers like Shampoo and Muon

No plain-English explanation yet — one is being written right now. Check back in a minute.