worker-vllm
Python
★ 0
updated 1y ago
⑂ fork
The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
No plain-English explanation yet — one is being written right now. Check back in a minute.