ToyGPT
Jupyter Notebook
★ 1
updated 1y ago
ToyGPT, inspired by Andrej Karpathy’s GPT from scratch, creates a toy generative pre-trained transformer at its most basic level using a simple bigram language model with attention to help educate on the basics of creating an LLM from scratch.
No plain-English explanation yet — one is being written right now. Check back in a minute.