batch-gateway
★ 0
updated 1d ago
⑂ fork
The batch gateway is an llm-d implementation of the OpenAI batch inference API
No plain-English explanation yet — one is being written right now. Check back in a minute.