Skip to content
← All news

Children & education

AI‑enabled child exploitation surges as safeguards lag behind rapid tech advances

UN officials warn that over 1.2 million children in 11 nations have become victims of deepfake abuse and that AI‑linked child sexual abuse reports jumped 1,325 % in a single year, exposing a widening protection gap.

Wholehuman Collective News Desk2 min read
Editorial illustration: AI‑enabled child exploitation surges as safeguards lag behind rapid tech advances
AI-generated editorial illustration.

Rising tide of AI‑powered abuse

A recent UN‑backed analysis shows more than 1.2 million children across eleven countries have had their likenesses altered into sexually explicit deepfakes. In the twelve‑month period between 2023 and 2024, the United States National Center for Missing and Exploited Children recorded a 1,325 % increase in reports of child sexual abuse material generated by generative AI. Experts stress that the majority of these AI‑facilitated offenses go unreported and are rarely prosecuted, meaning the true scale of the problem is likely far larger than official figures suggest.

Why current defences falter

UN Special Representative Dr. Najat Maalla M’jid highlighted that regulators are trailing behind the speed of AI development. Predators are exploiting conversational agents to win children’s trust, extract personal details and pressure them into sharing explicit content. Advanced profiling tools enable predictive targeting of vulnerable youths, while “nudification” applications turn ordinary images into humiliating deepfakes. Emerging agentic systems can autonomously generate abusive role‑play scripts, expanding the threat landscape. Voluntary safety commitments from technology firms have proved inadequate, leaving a regulatory vacuum that lets these tools scale rapidly and evade detection.

Building a safer digital landscape

In July, Secretary‑General António Guterres introduced the AI Child Safety Pledge, calling for mandatory safety and privacy‑by‑design standards before AI reaches children and a zero‑tolerance stance on AI‑generated child sexual abuse material. Deputy Secretary‑General Amina Mohammed noted that AI also offers promising tools for spotting abusive content, identifying victims and flagging early grooming signals. The UN is urging the creation of enforceable global standards that move beyond voluntary industry codes, aiming to certify AI systems as safe and to embed child‑protection safeguards at the core of future AI governance.