turboquant-experiment
Python
★ 3
updated 2mo ago
KV Cache with PagedAttention vs PagedAttention + TurboQuant - experiments across token sizes comparing memory, latency, and accuracy.
No plain-English explanation yet — one is being written right now. Check back in a minute.