gitmyhub

auto-round

★ 0 updated 8mo ago ⑂ fork

Advanced Quantization Algorithm for LLMs and VLMs, with support for CPU, Intel GPU, CUDA and HPU.

No plain-English explanation yet — one is being written right now. Check back in a minute.