vasted
Python
★ 1
updated 2mo ago
GPU inference in one command. Auto-picks a cheap Vast.ai GPU, loads any GGUF model, gives you an OpenAI-compatible endpoint.
No plain-English explanation yet — one is being written right now. Check back in a minute.