New federal law targets AI deepfake porn as schools grapple with growing problem

A new federal law targeting AI-generated deepfake porn enters a critical phase May 19, mandating websites and apps remove such content within 48 hours of notification. The Take It Down Act, signed by President Trump last year, imposes up to three years in prison for those who create or distribute non-consensual AI porn of minors with intent to harass. An investigation by Wired found students in at least 90 schools across 28 countries have been victimized by ‘nudify’ apps, which use AI to turn innocent photos into explicit content. Researchers estimate 1.2 million children worldwide were affected in the past year alone, with teenage boys frequently responsible for creating deepfakes of female classmates. In Arizona, three women filed a lawsuit alleging their photos were stolen and used to generate sexual content, while the defendants allegedly monetized their actions through paid online classes. The lawsuit claims these classes generated over $50,000 in a single month, with millions of views. Experts warn the problem is worsening due to rapid technological advancements and limited adult understanding of AI tools. Sarah Grado, CEO of Not My Kid, emphasized the need for education on adolescent brain development, as teenagers’ impulse control and decision-making skills remain underdeveloped. Schools and parents are increasingly concerned about students accessing these apps on personal devices or school-issued tablets. The Take It Down Act is seen as a reactive measure, requiring victims to identify and report harmful content. Lawmakers acknowledge the need for proactive solutions to address the growing scale and speed of AI-driven harassment, which has severe impacts on mental health and social dynamics.