Members
-
smg ★ PINNED
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
Rust ★ 378 2m agoExplain → -
TorchSpec ★ PINNED
A PyTorch native library for training speculative decoding models
Python ★ 190 3d agoExplain → -
tokenspeed ★ PINNED
TokenSpeed is a speed-of-light LLM inference engine.
Python ★ 1.6k 4m agoExplain → -
smg-dev-guide
Shepherd Model Gateway Claude Code Skills
★ 11 19d agoExplain → -
triton ⑂
Triton language and compiler releases for LightSeek Foundation
MLIR ★ 0 1h agoExplain → -
whl
No description.
HTML ★ 0 11h agoExplain → -
.github
No description.
★ 0 9d agoExplain →
No repos match these filters.
More creators on gitmyhub
JakeWharton lucidrains rafaballerini hiteshchoudhary IDouble