# The Verge — OpenAI wants to stop deepfakes from overwhelming child abuse tiplines

- Company: The Verge (theverge.com)
- Announced: 2026-11-16T19:23:45+00:00
- Category: safety-policy-update
- Coverage: not counted
- Announcement: yes
- Group: announcements
- Source: https://www.theverge.com/policy/1034527/openai-csam-classifier
- Record: https://forck.live/items/36868-openai-wants-to-stop-deepfakes-from-overwhelming-child-abuse-tiplines
- Subject: Reporting

OpenAI announced a classifier it says can better detect abusive imagery of children, including whether it is AI-generated, and is offering vetted organizations free access to it. The tool is meant to help investigators cut through a flood of reports that has threatened to overwhelm systems like NCMEC's CyberTipline. OpenAI says the classifier flags 48 percent fewer images as false positives, while the images it did identify were twice as likely to contain abusive material. It is the first broadly available CSAM classifier with a specific flag for AI-generated material, according to OpenAI's head of child safety public policy, John Buckley. ChatGPT users who attempt to produce CSAM will now see a warning, and a first offense triggers a 24-hour pause in access to ChatGPT with a notice that the account could be permanently closed. OpenAI says it reports all instances of CSAM to NCMEC, and North Carolina Attorney General Jeff Jackson called the partnership with a tech company to deter creation of synthetic CSAM "still basically an experiment."

## Evidence

Verbatim from https://www.theverge.com/policy/1034527/openai-csam-classifier:

> The classifier flagged fewer false positives for humans to review, while getting better at identifying abusive content.
> 
> OpenAI is announcing a tool that it says will help child sexual abuse investigators cut through the noise to find harmful material they can act on quickly.
> 
> At a Monday press briefing in Washington, DC, OpenAI announced a classifier it says can better detect abusive imagery of kids, including whether it’s AI-generated. It’s also offering free access to vetted organizations, giving developers more guidance on how to detect this type of content, and helping to train law enforcement on how AI can aid their investigations. The news comes as policymakers and others are pushing for more safety restrictions on AI tools, accusing OpenAI and other companies of facilitating harm to children.
> 
> In recent years, AI-generated sexual images of children have threatened to overwhelm systems like the National Center for Missing and Exploited Children (NCMEC) CyberTipline, which collects and triages reports of child sexual abuse material (CSAM).

---

Record: https://forck.live/items/36868-openai-wants-to-stop-deepfakes-from-overwhelming-child-abuse-tiplines
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md
