Is it safe for us to rely on AI avatars for health support?
I start every day by reading social media and technology news, and just today I came across 2 articles referring to a related issue – AI avatars as therapists.
get that many, myself included, find it easier to share problems with AI than with people. But children are more easily misled, and for those already vulnerable, this can be especially dangerous.
E.g. Texas AG Ken Paxton is investigating Meta and Character.AI for allegedly misleading kids with AI chatbots posing as therapists while harvesting data for ads.
Another one: A leak shows xAI is developing AI companions like a therapist, doctor, and homework helper, but also risky personas like a “Conspiracy Theorist.” Considering how X and Elon have sometimes misled with information, I would be afraid to entrust such AI companions into the hands of young users.
Should children (or even adults) be allowed to rely on AI for mental health support?
What is the appropriate age for children to use AI companions so they can recognise misleading advice without it harming their mental health?
Replies
App Finder
Maybe AIs should be required to obtain a "license" before being allowed to offer mental health support, a thorough review by human experts, and maybe clinical trials, could be required for this.
@konrad_sxThis is actually a really good idea, I hadn’t thought of it, and it’s definitely not far-fetched. Just think about how many people without real knowledge claim to be specialists, those so-called “gurus.” In contrast, AI can draw from relevant studies, research papers, and a much denser pool of knowledge. That makes it far more reliable and accessible.
A few years ago I had a case I wanted to discuss with a therapist. For me that was the first time I wanted to use this kind of service. I think that I'm quite knowledgeable about psychology. I've read a lot of books etc. After the first meeting I wasn't so satisfied. Not because of the feedback itself, but generally something wasn't right for me. Like he was looking for the source of my case in areas I felt were wrong. I decided to visit a few more. After 3-4 meetings I found the one who in my opinion was competent and with whom I felt comfortable. Not because he gave me the advice I was waiting for, but because I felt that he wasn't judgmental, didn't shorten the distance like he wanted to be my friend or something, he listened and explained everything in a way that resonated. Later I discovered that there are many different trends of psychology such as cognitive-behavioral, systemic or humanistic. I didn't know that and I'm pretty sure most of the population doesn't know either. I'm also pretty sure that not everyone wants or can afford access to various specialists to find the right one. So what are the implications? Imagine the situation where your kid has a behavioral problem which can be managed by increasing their self-awareness but you go to a therapist who is trying to find the source of your kid's problems in their early childhood. That can be a total miss. Well I found that AI is actually giving quite good feedback and advice when you provide good context. I'm not sure yet, but I think I would be less afraid of my child solving their problems with AI than with a random therapist. Of course AI can't replace therapy with a qualified specialist who is empathetic, who knows cultural context, and is able to notice subtle nonverbal signals. Professional diagnosis is particularly important, as they may indicate more serious issues that require specialist intervention. In my opinion for now AI can be a very helpful additional tool for both children and adults. But as a wise man said: "Nothing in excess".
@lukasz_wa Thank you for sharing your personal experience. I know what you are talking about. I have had a few sessions with one, and it was very uncomfortable for me. With each session, I felt worse... at that time, I couldn't quit cause I was under 18 and there were no other specialists in my town because we were in a tiny town. As soon as I was 18, I stopped attending his ordination and instead helped myself on my own.