Tom Turney

No description.

Open long-context inference stack: retrieval + open weights, no closed parts. pip install longctx.

LLM inference in C/C++

I'm crazy and trying to make a ForScan OBD reader work on my mac.

vLLM Metal plugin powered by mlx-swift — high-performance LLM inference on Apple Silicon

No description.

A high-throughput and memory-efficient inference and serving engine for LLMs

MLX: An array framework for Apple silicon

Deterministic State Recovery for AI Coding Agents

Driverless NVIDIA Pascal (GTX 1060) compute from macOS Apple Silicon over Thunderbolt eGPU

The new Book Ties!!

Add ranged link support to Obsidian

Offline Spurgeon study companion — pastoral counsel, sermon prep, and Sword & Trowel sermon grading. Gemma-4-12B fine-tune served on TurboQuant llama.cpp.

Book Ties old source code.

StemVille real-time data plotting experiment

No description.

just perl code

FFAI — F*cking Fast AI. Dual-engine inference: Swift (Apple/iPhone, native Metal) + Rust (cross-platform: CUDA/Vulkan/ROCm). Shared kernels via metaltile.

A Rust-embedded DSL for writing Apple Metal GPU kernels. Write tile-level algorithms in Rust, get optimized Metal Shading Language out.

Private backup of TQ+ Metal port work on antirez/ds4. Branch tom/turbo3-kv-cuda (turbo2/3/4 + Wave M3 inline-dequant + half-tile + CUDA stubs + h8 Flash WIP).

Unified toolkit for benchmarking and integrating TurboQuant+ KV-cache compression across llama.cpp, vLLM, MLX, and vllm-swift.

Swift API for MLX

LLMs and VLMs with MLX Swift

Community maintained hardware plugin for vLLM on Apple Silicon

Compressed KV cache as cross-backend wire format for Metal + CUDA split inference over Thunderbolt 5

No description.

No description.

DeepSeek 4 Flash local inference engine for Metal and CUDA

Pure Rust Inference Engine

Homebrew tap for TheTom projects (vllm-swift)

TurboQuant KV cache compression for llama.cpp — HIP/ROCm port for AMD RDNA3 (gfx1100)

C API for MLX

Run LLMs with MLX

No description.

Your own customization bible in your personal vault!

WOW TBC - Quest tracking tool for multi-chars

Wow addon for TBC expansion - quick profit checks

No description.

No description.