Model-Optimizer
Python
★ 3.0k
updated 1d ago
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
No plain-English explanation yet — one is being written right now. Check back in a minute.