vllm-mlx
Python
★ 0
updated 3mo ago
⑂ fork
OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models (Llama, Qwen-VL, LLaVA) with continuous batching, MCP tool calling, and multimodal support. Native MLX backend, 400+ tok/s. Works with Claude Code.
No plain-English explanation yet — one is being written right now. Check back in a minute.