gitmyhub

FleetX

Python ★ 0 updated 3y ago ⑂ fork

Paddle Distributed Training Examples. 飞桨分布式训练示例 Resnet Bert GPT MOE DataParallel ModelParallel PipelineParallel HybridParallel AutoParallel Zero Sharding Recompute GradientMerge Offload AMP DGC LocalSGD Wide&Deep

No plain-English explanation yet — one is being written right now. Check back in a minute.