minbpe
TypeScript
★ 18
updated 2y ago
Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization. Pure JavaScript port of karpathy/minbpe
No plain-English explanation yet — one is being written right now. Check back in a minute.