llm-d

★ 0 updated 1y ago ⑂ fork

llm-d is a Kubernetes-native high-performance distributed LLM inference framework

No plain-English explanation yet — one is being written right now. Check back in a minute.