gitmyhub

LitServe

Python ★ 3.9k updated 11d ago

A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

No plain-English explanation yet — one is being written right now. Check back in a minute.