Xorbits ORG

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Run open-source AI models on your own hardware with a single API that's compatible with OpenAI, so you can switch from paid cloud AI to a self-hosted model by changing one line of code.

Scalable Python DS & ML, in an API compatible & lightning fast way.

Build personal agents and enterprise AI workforces that plan, delegate, use tools, and deliver real work — without brittle workflows.

Python actor framework for heterogeneous computing.

xllamacpp - a Python wrapper of llama.cpp

No description.

No description.

Performance benchmarks that Xorbits vs other libraries.

Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.

Xorbits Example Notebooks

Made pandas and SQL APIs work seamlessly together, with out-of-core and distributed capabilities.

Xoscar on Ray.

Official enterprise version docs.

No description.

Prompt-aware LLM routing: predict which model can complete a prompt, then route to the cheapest one.

Xagent Python SDK

No description.

No description.

No description.

No description.