froginfer

C ★ 9 updated 3mo ago

a micro inference runtime to run llama 2 models

No plain-English explanation yet — one is being written right now. Check back in a minute.