gitmyhub

brolm

C++ ★ 1 updated 13d ago

Language-model inference in C++20. Tokenizers, transformer blocks, KV-cache generation, sampling, and safetensors + GGUF loaders.

No plain-English explanation yet — one is being written right now. Check back in a minute.