# Harvey — BigLaw Bench – Sources

- Company: Harvey (harvey.ai)
- Announced: 2024-09-23T21:41:00+00:00
- Category: not stated
- Coverage: not counted
- Announcement: no
- Group: routine
- Source: https://www.harvey.ai/blog/biglaw-bench-sources
- Record: https://forck.live/items/17725-biglaw-bench-sources
- Subject: Harvey

Harvey launched BigLaw Bench, a public benchmark for evaluating large language models on complex legal tasks, with a focus on source referencing accuracy. The benchmark introduces a 'source score' to measure how well model answers connect factual statements to source documents. Harvey reports that its systems substantially outperform other LLMs on this metric.

## Evidence

Verbatim from https://www.harvey.ai/blog/biglaw-bench-sources:

> BigLaw Bench is a framework for quantitatively evaluating the performance of LLMs on real-world legal tasks; supplementing prior work that measures LLM legal reasoning in more structured settings.

---

Record: https://forck.live/items/17725-biglaw-bench-sources
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md