inference
★ 0
updated 20d ago
⑂ fork
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
No plain-English explanation yet — one is being written right now. Check back in a minute.