vLLM-Hook
Jupyter Notebook
★ 86
updated 2d ago
Repo for vLLM Hook, an vLLM plug-in for programming internal states of models deployed on vLLM
No plain-English explanation yet — one is being written right now. Check back in a minute.