gitmyhub

auto-round

★ 0 updated 7mo ago ⑂ fork

Advanced quantization toolkit for LLMs and VLMs. Support for WOQ, MXFP4, NVFP4, GGUF, Adaptive Schemes and seamless integration with Transformers, vLLM, SGLang, and llm-compressor

No plain-English explanation yet — one is being written right now. Check back in a minute.