# Hugging Face — What We Learned by Reproducing 2,200 papers from ICML

- Company: Hugging Face (huggingface.co)
- Announced: 2026-08-13T00:00:00+00:00
- Category: research-paper
- Subject: Platform
- Source: https://huggingface.co/blog/icml-2026-open-reproductions
- Record: https://forck.live/items/3741-what-we-learned-by-reproducing-2-200-papers-from-icml

Hugging Face reports on a community hackathon that reproduced 2,226 papers from ICML 2026 using coding agents, finding 51% of examined papers had at least one verified claim and 23% had at least one falsified claim.

## Evidence

Verbatim from https://huggingface.co/blog/icml-2026-open-reproductions:

> Back in July, we ran a hackathon where more than 1,200 community members brought their own coding agents and tried to reproduce the papers published at ICML 2026, claim by claim. In 19 days, participants published 6,816 Trackio logbooks reproducing 2,226 papers, about a third of the conference

---

Record: https://forck.live/items/3741-what-we-learned-by-reproducing-2-200-papers-from-icml
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md