TurboQuant
★ 1
updated 2mo ago
⑂ fork
TurboQuant KV Cache Compression for llama.cpp — 5.2x memory reduction with near-lossless quality | Implementation of Google DeepMind's TurboQuant (ICLR 2026)
No plain-English explanation yet — one is being written right now. Check back in a minute.