cortex.tensorrt-llm
C++
★ 42
updated 1y ago
⑂ fork
▣ archived
Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU accelerated inference on NVIDIA's GPUs.
No plain-English explanation yet — one is being written right now. Check back in a minute.