gitmyhub

llama.cpp-turboquant-hip

★ 0 updated 1mo ago ⑂ fork

TurboQuant KV cache compression for llama.cpp — HIP/ROCm port for AMD RDNA3 (gfx1100)

No plain-English explanation yet — one is being written right now. Check back in a minute.