FastLLM
Python
★ 41
updated 2y ago
Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
No plain-English explanation yet — one is being written right now. Check back in a minute.