# Hugging Face — BigCodeArena: Judging code generations end to end with code executions

- Company: Hugging Face (huggingface.co)
- Announced: 2025-10-07T09:37:25+00:00
- Category: research-paper
- Subject: Platform
- Source: https://huggingface.co/blog/bigcode/arena
- Record: https://forck.live/items/1608-bigcodearena-judging-code-generations-end-to-end-with-code-executions

Hugging Face's BigCode team announces BigCodeArena, a human-in-the-loop platform for evaluating code generation models through execution, and shares findings from 5 months of community evaluation including 14,000 conversations and 4,700+ preference votes.

## Evidence

Verbatim from https://huggingface.co/blog/bigcode/arena:

> BigCodeArena: Judging code generations end to end with code executions

---

Record: https://forck.live/items/1608-bigcodearena-judging-code-generations-end-to-end-with-code-executions
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md