From the source
Microsoft AI published research in Science on MAI-DxO, a diagnostic system that coordinates a panel of virtual physicians and outperformed physicians on step-by-step diagnosis.
- The company says MAI-DxO reached 83% accuracy on 304 complex NEJM cases, against 22% for physicians without reference resources and 36% with them.
- On more typical emergency-department cases from MIMIC-IV-ED, it scored 80% versus 47% for physicians.
- A cost-optimised configuration hit 81% accuracy on NEJM cases at less than half the cost of comparative systems, and
Microsoft says no other human or AI approach was both more accurate and less costly across both datasets.
- The gains held when the evaluation was repeated with newer models, including GPT-5.5, without changing the orchestration method.
- Microsoft is open-sourcing SDBench for select NEJM cases, including the benchmark, Gatekeeper, Judge and cost-estimation code, and will run a prospective study with Beth Israel Deaconess Medical Center where patients interact with the system directly.
