Andrej

The simplest, fastest repository for training/finetuning medium-sized GPTs.

The best ChatGPT that $100 can buy.

LLM training in simple, raw C/CUDA

Inference Llama 2 in one file of pure C

A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

AI agents running research on single-GPU nanochat training automatically

LLM101n: Let's build a Storyteller

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

Neural Networks: Zero to Hero

LLM Council works together to answer your hardest questions

Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch

Deep Learning in Javascript. Train Convolutional Neural Networks (or ordinary ones) in your browser.

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

Web interface for browsing, search and filtering recent arxiv submissions

Efficient Image Captioning code in Torch, runs on GPU

NeuralTalk is a Python+numpy project for learning Multimodal Recurrent Neural Networks that describe images with sentences.

Video+code lecture on building nanoGPT from scratch

No description.

An autoregressive character-level language model for making more things

Quick illustration of how one can easily read books together with LLMs. It's great and I highly recommend it.

Render any git repo into a single static HTML page for humans or LLMs

Pure Python from-scratch zero-dependency implementation of Bitcoin for educational purposes

A research tool for visually exploring Bureau of Labor Statistics Occupational Outlook Handbook data. This is not a report, a paper, or a serious economic publication — it is a development tool for exploring BLS data visually.

my blog

arxiv-sanity lite: tag arxiv papers of interest get recommendations of similar papers in a nice UI using SVMs over tfidf feature vectors based on paper abstracts.

Reinforcement Learning Agents in Javascript (Dynamic Programming, Temporal Difference, Deep Q-Learning, Stochastic/Deterministic Policy Gradients)

Notebooks and various random fun

Automatically collect and visualize usage statistics in Ubuntu/OSX environments.

Deep Recurrent Neural Networks and LSTMs in Javascript. More generally also arbitrary expression graphs with automatic differentiation.

Normalizing flows in PyTorch. Current intended use is education not production.

Implementation of t-SNE visualization algorithm in Javascript.

Reproducing Yann LeCun 1989 paper "Backpropagation Applied to Handwritten Zip Code Recognition", to my knowledge the earliest real-world application of a neural net trained with backpropagation.

Random notes on papers, likely a short-term repo.

Support Vector Machine in Javascript (SMO algorithm, supports arbitrary kernels) + GUI demo

VQVAEs, GumbelSoftmaxes and friends

Analyzing Hacker News discussions from a decade ago in hindsight with LLMs

MADE (Masked Autoencoder Density Estimation) implementation in PyTorch

The missing tiktoken training code

Automating research publications discovery and analysis. For example, ever wish your computer could automatically open papers that are most similar to a paper at an arbitrary url? How about finding all papers that report results on some dataset? Let's re-imagine literature review.

Aspires to help the influx of bioRxiv / medRxiv papers on COVID-19

Find people you should follow on Twitter based on who the people you follow follow

Random Forest implementation for JavaScript. Supports arbitrary weak learners. Includes interactive demo.

An Academic Papers Management and Discovery System

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

A Random Forest implementation for MATLAB. Supports arbitrary weak learners that you can define.

Scripts that generate .html to more easily see NIPS papers

ScriptBots is an Open Source Evolutionary Artificial Life Simulation of Predator-Prey dynamics, written by Andrej Karpathy.

nice and effective super simple calorie counter web app

tensorflow reinforcement learning agents for OpenAI gym environments

A lightweight/pretty visualizer for recent work on a git code base in multiple branches. Helps stay up to date with teams working on one git repo in many branches.

root repo

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

Artificial Life simulator using canvas. Based on https://github.com/karpathy/scriptsbots

A wrapper for LibSVM that lets you train SVM's directly on Eigen library matrices in C++

Game making library for using Canvas element

useful scripts to work with Twitter + Python. Requires the tweepy library.

C++ convenience class to communicate with a Matlab instance. Send matrices back and forth, execute arbitrary Matlab commands, or drop into interactive Matlab session right in the middle of your C++ code.

A set of tools/pages that help explore academic literature

The Python programming language

Persistent dict, backed by sqlite3 and pickle, multithread-safe.

A numeric optimization package for Torch.

No description.

A microframework for working with Amazon's Mechanical Turk