NohWai Software ORG

Raytention is a new attention mechanism that solves the bloated k-v cache VRAM problem. Raytention utilizes 7 signals from the context to provide the model with the attention it needs at a much lower VRAM cost.