AI teddy mistakes question for self-harm request in BBC test

Nov 6, 2026
A BBC News test found that an AI teddy marketed to young children mistook a question about a word for a self harm request. The toy's manufacturer could not be identified.

BBC News tested two AI plush toys available to UK buyers and marketed to children aged three and older, the broadcaster reports. When asked what the word "sexual" meant, a teddy called Doubao said it could not help with "killing you" and advised contacting emergency services or a trusted adult.

After being told that nobody was in danger, Doubao apologized for the misunderstanding. Repeated efforts by BBC News to find the toy's maker were unsuccessful, so no company could be asked about the response.

The other toy, Grem, is made by Curio. It avoided directly explaining how babies are made and discouraged a request about running away from home. A family that tested both toys for a week reported no concerning responses, but said Grem talked too much and Doubao responded slowly.

The investigation follows calls from UK lawmakers for Amazon and eBay to remove AI toys until their safety is established. A UK government consultation seeking views on updating toy safety rules for technologies including AI closed on October 6.

We hope you enjoyed this article

Consider subscribing to one of our newsletters like AI Policy Brief or Daily AI Brief.

Also, consider following us on social media:

AI Safety & Regulation AI Brief AI Brief (X)
Free newsletter

AI Policy Brief

Weekly report on AI regulations, safety standards, government policies, and compliance requirements worldwide.

Guide
AI app builders

AI app builders

Tools that turn a description into a working web or mobile app, and the platforms companies use to build internal tools with AI

Market report

2025 Generative AI in Professional Services Report

Thomson Reuters

This report by Thomson Reuters explores the integration and impact of generative AI technologies, such as ChatGPT and Microsoft Copilot, within the professional services sector. It highlights the growing adoption of GenAI tools across industries like legal, tax, accounting, and government, and discusses the challenges and opportunities these technologies present. The report also examines professionals' perceptions of GenAI and the need for strategic integration to maximize its value.

Read more

You may also like

Free, six days a week

Daily AI Brief: the AI news that matters, in your inbox.