From the source
Harvey is expanding its public evaluation work into four areas: Insights, Research, Approaches, and Context.
The company argues that the most important missing piece in LLM evaluation is a shared understanding of what evaluation does and does not tell us, and that misaligned benchmarks risk pushing models toward unhelpful behaviors.
Harvey plans to publish at least two novel benchmarks: Contract Intelligence and a BLB Challenge benchmark focused on tasks where leading models struggle.
