speculators
★ 0
updated 4mo ago
⑂ fork
A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM
No plain-English explanation yet — one is being written right now. Check back in a minute.