InfiniStore

C++ ★ 421 updated 7mo ago

KV cache store for distributed LLM inference

No plain-English explanation yet — one is being written right now. Check back in a minute.