inference-benchmark
Python
★ 28
updated 3y ago
Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
No plain-English explanation yet — one is being written right now. Check back in a minute.