gitmyhub

kgpt

Jupyter Notebook ★ 24 updated 3mo ago

A GPT-2-class language model trained from scratch on OpenWebText with the intent to augment AI Transformer-model education and reverse engineer GPT models from scratch.

No plain-English explanation yet — one is being written right now. Check back in a minute.