SwitchTransformers
Python
★ 142
updated 1d ago
Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity"
No plain-English explanation yet — one is being written right now. Check back in a minute.