AutoGPTQ
Python
★ 0
updated 2y ago
⑂ fork
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
No plain-English explanation yet — one is being written right now. Check back in a minute.