From the source
Harvey introduced BigLaw Bench: Research, a dataset of hard US Case Law research problems that current models cannot solve even with search tools.
The benchmark requires models to use tools for searches and provide grounded, cited responses, aiming to identify model improvements and failure modes in legal research.
Harvey will use the benchmark to evaluate models' research capabilities across practice areas such as corporate, securities litigation, and privacy.
