vllm-bnb-plugin

Python ★ 1 updated 23d ago

vLLM Quantization plugin for bitsandbytes

No plain-English explanation yet — one is being written right now. Check back in a minute.