Nude detection dataset contains child sexual abuse imagery
What happened
Nude detection dataset contains child sexual abuse imagery
Occurred: December 2025 Page published: December 2025Report incident🔥| Improve page 💁| Access database 🔢
NudeNet, a large dataset of over 700,000 images scraped from the internet for training AI nudity detection tools, was found to contain child sexual abuse material (CSAM), raising questions about the safety of the AI systems using it and the ethics and competence of the individual who created the resource.What happenedCanadian Centre for Child Protection (C3P) analysis of NudeNet, a dataset containing over 700,000 images scraped from the internet, discovered nearly 680 images that were confirmed or suspected to be CSAM or other harmful material of minors.This included images of known victims of CSAM, images depicting the genital/anal area of pre-pubescent and post-pubescent children and images depicting sexual or abusive acts involving children and teenagers.The dataset aimed to enable AI classifiers for the automatic detection of nudity but inadvertently included illegal imagery, thereby potentially enabling the non-consensual distribution of images of victims, and enabling AI models trained on the dataset to generate or propagate CSAM.The discovery also potentially contributed to the ethical contamination of the academic community. NudeNet had been publicly available on Academic Torrents since June 2019 and cited in over 250 academic works to train AI classifiers designed to automatically detect nudity.Following the discovery, a removal notice was issued, and the images were taken down from the web service distributing the dataset.Why it happenedPoor due dligence of the NudeNet combined with a lack of transparency in sourcing internet-scraped images from social media and pornographic websites meant that CSAM entered the collection. The sheer scale and speed of collecting hundreds of thousands of images, often without ethical review, prioritised quantity over safety. Limited ethical guidelines for AI training data at the time failed to mandate thorough audits, mirroring issues in other datasets like LAION-5B, which contained over 1,000 verified CSAM instances. What it meansVictims face "revictimisation" through repeated exposure in AI training pipelines and subsequent AI modelsResearchers risk legal liabilities for using tainted dataFor society, the inclusion of CSAM in NudeNet amplifies the risk of AI image generation tools such as Stable Diffusion being misused. It also highlights the need for stricter data provenance standards.System 🤖NudeNetDeveloper: Bedapudi Praneeth Country: GlobalSector: MultiplePurpose: Detect nude images Technology: Database/dataset Issue: Privacy/surveillance; Safety; Transparency
News, commentary, analysis 🗞️https://www.404media.co/ai-dataset-for-detecting-nudity-contained-child-sexual-abuse-images/
Related 🌐Child sex abuse images discovered on LAION-5B, LAION-400M datasetsApple NeuralHash CSAM scanning system raises privacy concernsAIAAIC Repository ID: AIAAIC2159
Reported impact
- Affected parties
- Not publicly disclosed
- Harm type
- Not publicly disclosed
- Scale
- Not publicly disclosed
- Financial impact
- Not publicly disclosed
- Regulatory action
- Not publicly disclosed
Classification
Relevant governance controls
Governance control mapping is not available for this record.
- No controls mapped
Not publicly disclosed
Control mapping is analytical. It does not state that any control would have prevented the incident.