# Hugging Face — Introducing the LiveCodeBench Leaderboard - Holistic and Contamination-Free Evaluation of Code LLMs

- Company: Hugging Face (huggingface.co)
- Announced: 2024-04-16T00:00:00+00:00
- Category: developer-tool-release
- Subject: Platform
- Source: https://huggingface.co/blog/leaderboard-livecodebench
- Record: https://forck.live/items/1906-introducing-the-livecodebench-leaderboard-holistic-and-contamination-free

Hugging Face introduces the LiveCodeBench leaderboard, a new benchmark for evaluating code LLMs that collects coding problems over time from various coding contest platforms to prevent contamination, and includes four scenarios: code generation, self-repair, code execution, and test output prediction.

## Evidence

Verbatim from https://huggingface.co/blog/leaderboard-livecodebench:

> We are excited to introduce the LiveCodeBench leaderboard, based on LiveCodeBench, a new benchmark developed by researchers from UC Berkeley, MIT, and Cornell for measuring LLMs’ code generation capabilities.

---

Record: https://forck.live/items/1906-introducing-the-livecodebench-leaderboard-holistic-and-contamination-free
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md