ring-attention-pytorch
Python
β
547
updated 1y ago
Implementation of π Ring Attention, from Liu et al. at Berkeley AI, in Pytorch
No plain-English explanation yet β one is being written right now. Check back in a minute.