aiobatch
Python
★ 1
updated 1y ago
Lightweight dynamic batching for asyncio requests. Helpful for improve performance of AI model inferencing.
No plain-English explanation yet — one is being written right now. Check back in a minute.