gitmyhub

TinyLlama

★ 0 updated 2y ago ⑂ fork

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

No plain-English explanation yet — one is being written right now. Check back in a minute.