AfriMed-QA: Benchmarking large language models for global health

Google Research presents AfriMed-QA, a benchmark question-answer dataset for evaluating LLMs on African health tasks, developed with partners across Africa. The dataset includes ~15,000 questions from 60 medical schools across 16 countries. The paper was published at ACL 2025 and won the Best Social Impact Paper Award. The dataset and evaluation code are open-sourced.

From the source
We present AfriMed-QA, a collection of contextually relevant datasets for evaluation of LLMs on African health question answering tasks, developed in partnership with organizations across Africa.
research.google

Visit source ↗research.google

Announced: 24 Sep 2025 19:11 UTC
Detected

Other stories

Google Research · 27 AugPlanetary prediction engine: Automating global models via Earth AIResearch paper

OpenAI · 27 AugBetter answers, broader thinking: What students gain from ChatGPT and critical-thinking trainingResearch paper

LG AI Research · 27 Aug[ACL 2026] ReSQL: A Self-Improving Text-to-SQL Framework through Retrieval-Augmented Error ReasoningResearch paper

xAI · 29 Aug

03 Aug 2026 21:12 UTC (+313d after)

Grok Bot now works with X

Capability change

GitHub · 28 AugGitHub Copilot in Visual Studio — August update

GitHub · 28 AugGitHub Copilot weekly releases — August 24Capability change