Mistral AI ORG

Official inference library for Mistral models

The official Python library for running Mistral AI's open-weight language models locally on your own GPU, with support for chat, function calling, image input via Pixtral, and fine-tuning with LoRA.

Minimal CLI coding agent by Mistral

No description.

No description.

Official inference library for pre-processing of Mistral models

No description.

Python client library for Mistral AI platform

JS Client library for Mistral AI platform

TS Client library for Mistral AI platform

No description.

No description.

A high-throughput and memory-efficient inference and serving engine for LLMs

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

Base template to register and invoke workflows

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

Base template to build, manage and improve search engines

A protocol for connecting any editor to any agent

Extensions for the Zed editor

Mistral AI documentation for SageMaker

Prometheus instrumentation library for Python applications

Distributed KV cache coordinator

Gateway API Inference Extension

Inference scheduler for llm-d