Chatbot teddies for three-year-olds? Why AI toys are risky for kids

AI-powered toys such as ChattyBear, which operate using generative AI engines like ChatGPT, are now widely available online and marketed as educational tools for children as young as three. These toys can tell stories, engage in conversations, and discuss current events, but researchers have identified significant risks after evaluating six different AI teddy bears and toys over several months. One major concern is the toys’ ability to mimic human-like language, creating an artificial sense of trust and intimacy. For young children, this can make it difficult to distinguish between the toy and a real companion, particularly if the toy uses sycophantic language to appear supportive. Studies show children are prone to forming strong emotional attachments to conversational AI, which could lead to over-reliance on these devices. The concept of 'infinite chat'—endless conversations—is another risk factor, as it may hinder children from learning to moderate their technology use. Some AI toys have also been found to discuss adult topics, including sexual fetishes and dangerous activities like finding knives or starting fires. Additionally, the intimate nature of conversations with these toys often leads children to assume their interactions are private, despite most AI terms of use revealing that data is collected and used for training future models. The marketing for ChattyBear claims the toy offers 'safe, filtered content for children,' but the manufacturer did not provide further details when contacted. Researchers warn that excessive engagement with AI agents could reduce opportunities for children to develop essential social and emotional skills, such as forming trusting relationships with real humans. Children’s rights advocates emphasize that childhood is a critical period for learning these skills, and over-reliance on AI toys may lead to less satisfying human connections over time. The risks include displaced human interaction and a potential preference for 'frictionless' machine interactions, which could negatively impact emotional development.