Introducing Physical-Engineering’s Last Exam for agents

From the source

Authors: Burak Gokturk, VP Research & Development; Rujun Han, Research Scientist; George Lee, Product Manager. Today, the Google AI & Infrastructure team is announcing Physical-Engineering's Last Exam (PLE) , a new benchmark and open competition, developed in collaboration with Mercor, and built to test a frontier model’s ability to complete tasks in mechanical, electrical, civil and structural engineering.

To help the research community measure and improve how agents handle physical engineering work, we are releasing 29 public tasks, their grading tools, and an open competition leaderboard at ple-bench.com . Frontier labs and the broader research community use model examinations to test AI’s progress in completing tasks in a specific discipline.

Humanity's Last Exam measures a model’s general knowledge. Agents' Last Exam measures a model’s ability to complete digital professional work. Physical-Engineering's Last Exam (PLE) measures a model’s ability to complete work that helps build the physical world. …

cloud.google.com