gitmyhub

gpt-neo

Python ★ 8.3k updated 4y ago ▣ archived

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

No plain-English explanation yet — one is being written right now. Check back in a minute.