# Hugging Face — DiScoFormer: One transformer for density and score, across distributions

- Company: Hugging Face (huggingface.co)
- Announced: 2026-06-29T18:02:48+00:00
- Category: research-paper
- Subject: Platform
- Models affected: DiScoFormer
- Source: https://huggingface.co/blog/allenai/discoformer
- Record: https://forck.live/items/1471-discoformer-one-transformer-for-density-and-score-across-distributions

Hugging Face and Ai2 announce DiScoFormer, a transformer that estimates both density and score of a distribution in a single forward pass without retraining, outperforming KDE in high dimensions.

## Evidence

Verbatim from https://huggingface.co/blog/allenai/discoformer:

> We introduce a new solution called the DiScoFormer (Density and Score Transformer) — one model that, given a set of data points, estimates both the density and the score of the distribution in a single forward pass without retraining.

---

Record: https://forck.live/items/1471-discoformer-one-transformer-for-density-and-score-across-distributions
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md