flux

C++ ★ 1.3k updated 9mo ago

A fast communication-overlapping library for tensor/expert parallelism on GPUs.

No plain-English explanation yet — one is being written right now. Check back in a minute.