The Decoder· 3h agoOpenAI asks outside experts, including a Nobel laureate, to check proofs its AI produced in math, computer science, and physics
Outside experts will judge proofs on ETH, a wave conjecture and physics
Research paper
OpenAI has asked outside experts to check proofs its internal AI models produced in math, computer science and physics, saying the manuscripts are raw research data that still needs to be understood.
- The computer science result claims the Exponential Time Hypothesis is false, a hypothesis hundreds of papers in graph theory, computational biology, databases and computational geometry build on.
- OpenAI says it translated the math and computer science proofs into Lean, a language that lets a computer check every step, though Lean only checks the statement as written, not whether it captures the intended problem.
- Ryan Williams of MIT will check the result with Russell Impagliazzo and Ramamohan Paturi of UC San Diego, who proposed the ETH with Francis Zane; Williams writes that the group signed no nondisclosure agreements, is working unpaid and plans to share interim findings.
- The three say in an open letter that their involvement is not an endorsement, and at their request OpenAI is publishing all the raw data, including the written proof and the Lean proof.
- OpenAI also committed to funding a conference on what the result means for the field, and says the result could help researchers find better algorithms, though practical gains would still take a lot of research.
From the source
OpenAI says its internal models have disproved a central assumption in computer science and proved part of one of the Millennium Prize Problems, among other results. Outside experts will now decide whether the proofs hold up.
OpenAI laid out three results from math, computer science, and physics in a blog post . The company says its internal AI models produced the proofs. OpenAI calls the manuscripts a kind of raw research data that still needs to be understood.
So OpenAI asked outside experts to act as "shepherds" for the results. Based on their advice, the company is handling each field differently. OpenAI says it also translated the math and computer science proofs into Lean.
Lean is a programming language that lets a computer check every step of a proof. That doesn't guarantee the result is error-free, though. Lean only checks whether the proof establishes the statement as it was written in Lean. Experts still have to decide whether that statement actually captures the intended problem.
If OpenAI is right, a core assumption in computer science is wrong
The computer science result centers on the Exponential Time Hypothesis (ETH).