Sparse Attention as Compact Kernel Regression.

Saul José Rodrigues dos Santos Nuno Gonçalves Daniel C. McNamee André F. T. Martins Sparse Attention as Compact Kernel Regression. 2026 January abs/2601.22766 CoRR https://doi.org/10.48550/arXiv.2601.22766 db/journals/corr/corr2601.html#abs-2601-22766 streams/journals/corr