Infini-attention
Python
★ 59
updated 1d ago
Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTORCH
No plain-English explanation yet — one is being written right now. Check back in a minute.