vllm-function-api

★ 0 updated 2y ago

OpenAI-style API for vllm & outlines backend.

No plain-English explanation yet — one is being written right now. Check back in a minute.

Open on GitHub →