SwitchTransformers
Python
★ 145
updated 10d ago
Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity"
No plain-English explanation yet — one is being written right now. Check back in a minute.