SDP4Bit
Python
★ 44
updated 1y ago
official implementation of paper SDP4Bit: Toward 4-bit Communication Quantization in Sharded Data Parallelism for LLM Training
No plain-English explanation yet — one is being written right now. Check back in a minute.