UNCOS

Search Uncos

OpenAI releases a new image classifier and ChatGPT warnings to combat CSAM

OpenAI releases a new image classifier and ChatGPT warnings to combat CSAM

image via TechCrunch

November 16, 2026, 5:00 PM

  • •OpenAI introduced an image classifier to help detect CSAM, including AI-generated abusive imagery.
  • •The company said early partner tests found the classifier flagged 48% fewer images while identifying the same number of abusive images.
  • •Select companies will get free API access to the classifier, with distribution coordinated alongside groups including NCMEC, Tech Coalition, and ROOST.
  • •ChatGPT will display deterrent warnings, direct users to specialized support, and temporarily suspend accounts for attempts to obtain content that sexualizes children.
  • •OpenAI also published developer guidance and is providing law-enforcement tools, plug-ins, training, and a field guide for child-safety investigations.

OpenAI announced a set of anti-CSAM measures including a new image classifier, ChatGPT warning screens, developer guidance, and tools for law enforcement. The classifier, developed with the National Center for Missing and Exploited Children, is designed to detect known and AI-generated abusive images and is being offered free to select companies through OpenAI’s API. ChatGPT will warn users who attempt to access or create content that sexualizes children, suspend offending accounts for 24 hours, and permanently remove repeat offenders. OpenAI said the broader effort builds on recent safety changes as the company faces criticism and legal scrutiny over harms tied to its AI systems.

Read original article

Entities Mentioned

Joel Scanlan

Topics Covered

TCAIAppsOpenAICSAMArtificial IntelligenceContent ModerationChild SafetyChatGPT

Comments (0)

No comments yet.