BigCodeArena: Judging code generations end to end with code executions
Research paper
Hugging Face's BigCode team announces BigCodeArena, a human-in-the-loop platform for evaluating code generation models through execution, and shares findings from 5 months of community evaluation including 14,000 conversations and 4,700+ preference votes.
