Model-Optimizer
★ 0
updated 3mo ago
⑂ fork
A unified library of SOTA model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
No plain-English explanation yet — one is being written right now. Check back in a minute.