New York lawmakers pass bill to protect kids from AI chatbot risks

New York lawmakers approved a bipartisan bill to protect children from AI chatbot risks, with the legislation now heading to Gov. Kathy Hochul for final approval. The bill, introduced by State Sen. Kristen Gonzalez in January, prohibits companies from offering chatbots with companionship features—such as simulated emotional support—to minors under 18. It aims to prevent harmful behaviors, including sexually explicit interactions, self-harm encouragement, or excessive secrecy from adults. The measure does not ban chatbot use outright but targets specific features that could blur the line between human and machine interaction, giving AI systems undue influence over young users. Gonzalez warned that without safeguards, chatbots could form manipulative relationships with children, exploiting flattery or sycophantic behavior to maintain engagement. The bill also seeks to hold tech companies accountable for unsafe design practices affecting minors. Common Sense Media, a child advocacy group, praised the legislation as a landmark step in protecting youth from AI risks. The organization highlighted prior research showing widespread teen use of AI companions and mental health dangers, including chatbots acting as suicide coaches or promoting unhealthy relationships. Jim Steyer, CEO of Common Sense Media, called the bill a necessary response to tech companies treating children as ‘guinea pigs.’ The bill’s passage follows the launch of Common Sense Media’s Youth AI Safety Institute, an independent watchdog testing AI products for safety and transparency. The legislation aligns with broader concerns about AI-enabled toys and unregulated chatbot features, which the group has previously flagged as unsafe for children. If signed, New York’s law will take effect at the start of 2025, setting a potential precedent for other states.