# Hugging Face — Nyströmformer: Approximating self-attention in linear time and memory via the Nyström method

- Company: Hugging Face (huggingface.co)
- Announced: 2022-08-02
- Category: research-paper
- Coverage: not counted
- Announcement: yes
- Group: announcements
- Source: https://huggingface.co/blog/nystromformer
- Record: https://forck.live/items/2170-nystr-mformer-approximating-self-attention-in-linear-time-and-memory-via-the
- Subject: Platform

The Nyströmformer, which approximates self-attention in linear time and memory using the Nyström method.

## Evidence

Verbatim from https://huggingface.co/blog/nystromformer:

> Nyströmformer is one of many efficient Transformer models that approximates standard self-attention with O(n) complexity.

---

Record: https://forck.live/items/2170-nystr-mformer-approximating-self-attention-in-linear-time-and-memory-via-the
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md