llama-cpp-python

Python ★ 3 updated 3y ago

llama-cpp-python forked version while contains some modifications, provides much more simpler inference API and demo. Integrated with my ChatBots.

No plain-English explanation yet — one is being written right now. Check back in a minute.