TensorRT-Model-Optimizer
Python
★ 2
updated 1y ago
⑂ fork
TensorRT Model Optimizer is a unified library of state-of-the-art model optimization techniques such as quantization and sparsity. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM or TensorRT to optimize inference speed on NVIDIA GPUs.
No plain-English explanation yet — one is being written right now. Check back in a minute.