From the source
The Nyströmformer, which approximates self-attention in linear time and memory using the Nyström method.
Nyströmformer: Approximating self-attention in linear time and memory via the Nyström method
Research paper
From the source
Nyströmformer is one of many efficient Transformer models that approximates standard self-attention with O(n) complexity.
huggingface.co
