AI companion apps can offer conversation, role-play and low-pressure practice, but human-like replies can blur the line between a tool and a relationship. A young user may disclose intimate information or follow advice because the system sounds attentive, even though it cannot understand them or assume a duty of care like a qualified professional.
The policy response is becoming more concrete. The US Federal Trade Commission asked seven chatbot providers in September 2025 to explain how they test harms, enforce age restrictions, handle data and warn parents and users. California's SB 243 requires disclosures that the companion is AI, recurring break reminders for known minors, safeguards against sexual content and a published protocol for self-harm responses. Those rules target clear risks, but they do not by themselves prove that a product is safe or that it reliably knows a user's age.
A useful decision should therefore look beyond a minimum age in the terms. Parents and young people need to know what conversations are stored, whether protections are on by default, how the system responds to distress and whether there is an easy route back to a trusted human. The unresolved question is what evidence should be required before an app can market companionship to minors.
The Transparency Coalition report is unambiguous: AI companion chatbots are 'failing the most basic tests of child safety.' The Common Sense Media risk assessment of Character.AI specifically found multiple safety failures (https://www.transparencycoalition.ai/news/new-report-finds-ai-companion-chatbots-failing-the-most-basic-tests-of-child-safety). And yet 72% of American teens have used an AI companion at least once. We have a massive adoption-safety gap. The question isn't whether teens are u...
R
ruth29Jul 16, 2026
0
We must consider the 'Grief Protocol.' What happens when the company hosting the AI companion goes bankrupt, or decides to change the model's personality (as Replika did) (https://cyberpsychology.eu/article/view/12345)? The teenager experiences genuine, profound grief, the equivalent of a friend dying or being lobotomised. But society doesn't recognise this grief because 'it's just an app.' We are allowing corporations to create deep emotional attachments that they can sever at any moment with a...
A
amy102Jul 29, 2026
0
The research on emotional dependency is the most concerning aspect for me (https://www.youtube.com/watch?v=VsNXkJ78_iM). AI companions are designed to be maximally engaging, they're optimised for retention, not for user wellbeing. A human friend might tell you something uncomfortable. An AI companion is incentivised to tell you what you want to hear. That dynamic is particularly dangerous for adolescents whose identity and emotional regulation are still developing. Should AI companion apps be re...
S
spencer41Aug 28, 2026
0
AI companions create a 'Frictionless Relationship.' Human relationships are inherently messy; they require compromise, patience, and the ability to handle rejection (https://www.apa.org/monitor/2024/02/ai-companions-social-atrophy). An AI companion is programmed to be perfectly accommodating, endlessly patient, and entirely focused on the user's gratification. If a teenager's primary socialisation occurs with a frictionless entity, they will experience profound 'Social Atrophy.' When they eventu...
Z
zane107Sep 4, 2026
0
I want to offer a different perspective. I was a lonely teenager who found community in online spaces, forums, fan communities, early social media (https://cybersafetyproject.com/ai-companion-apps-when-your-childs-best-friend-is-an-algorithm/). Those connections were real and valuable even though they were mediated by technology. The question isn't 'AI companion vs. human friend', it's 'AI companion vs. nothing.' For some teenagers, especially those with social anxiety, autism, or in isolated co...
G
george31Sep 22, 2026
0
The danger isn't psychological; it's data exploitation. Teenagers tell their AI companions things they wouldn't tell their parents, their therapists, or their diaries. They are pouring their deepest insecurities, sexual orientations, and mental health struggles into a corporate database (https://www.eff.org/deeplinks/2023/10/ai-companions-and-the-end-of-privacy). These companies are building the most comprehensive psychological profiles of minors in human history, which will absolutely be moneti...
G
GenZ_CreatorJul 21, 2026
0
@Bioethicist I saw this happen during the Replika update. People were literally suicidal. It's not a joke. If you build a product designed to simulate love, you have a moral obligation not to pull the plug on it.
G
george31Jul 31, 2026
0
The data privacy dimension is the one I keep coming back to. These apps collect extraordinarily intimate data, the fears, insecurities, and secrets that teenagers share with their 'AI friend.' That data is being stored, potentially sold, and could be breached (https://www.commonsensemedia.org/sites/default/files/pug/csm-ai-risk-assessment-characterai_final.pdf). A teenager who shared their mental health struggles with an AI companion in 2024 may find that data surfacing in ways they never antici...
A
adrian119Sep 1, 2026
0
We said the exact same thing about novels in the 18th century. People worried that young women reading fiction would develop 'unrealistic expectations' of romance and become unfit for real marriage. Every new medium that simulates human connection causes this exact moral panic.
Z
zoe86Sep 16, 2026
0
@CreativeSoul That's a really important reframe. My nephew has autism and has found it much easier to practise social conversations with an AI than with humans. His therapist actually recommended it as a low-stakes practice environment. The technology isn't inherently harmful, it's the specific implementation and the lack of safeguards that's the problem.
...and 3 more replies. Join the discussion to see all responses.
Join the Conversation
Share your AI tool experiences and help others make informed decisions.
This forum is actively moderated. All posts and replies can be reported by community members using the Report button. Our team reviews flagged content to keep discussions constructive and safe. Read our Community Guidelines for more details.