From the source
OpenAI released an image classifier that detects potential child sexual abuse material, including AI-generated images, and is offering it free through its API to vetted organizations.
- The company says it is the first broadly available CSAM classifier with a specific signal for whether material may be AI generated, and it was trained and evaluated with help from the National Center for Missing and Exploited Children.
- In an evaluation of user-uploaded images, OpenAI estimated the classifier would flag 48% fewer images while finding roughly the same number of abusive images as its existing tool, and flagged images were about twice as likely to contain abuse.
- Early partners reported their own results: fal reviewers confirmed 72% of high-confidence flags as novel CSAM, invideo AI saw one in four flagged cases lead to a ban, and SafetyKit detected 90% of cases involving drawings or animations that sexualize children.
- OpenAI is working with the Tech Coalition and ROOST to share access, and recently joined the Tech Coalition's Lantern program to exchange signals on child sexual exploitation and abuse across platforms.




