ONE HUNDRED days into the war in Gaza, I was finding it increasingly difficult to read the news. My husband told me it might be time to talk to a therapist. Instead, on a cold winter morning, after having fought back tears reading yet another story of human tragedy, I turned to artificial intelligence.
鈥淚鈥檓 feeling pretty bummed out about the state of the world,鈥 I typed into ChatGPT. 鈥淚t鈥檚 completely understandable to feel overwhelmed,鈥 it responded, before offering a list of pragmatic advice: limit media exposure, focus on the positive and practise self-care.
Advertisement
I closed the chat. While I was sure I could benefit from doing all of these things, at that moment, I didn鈥檛 feel much better.
It might seem strange that AI can even attempt to offer this kind of assistance. But millions of people are already turning to ChatGPT and specialist therapy chatbots, which offer convenient and inexpensive mental health support. Even doctors are purportedly using AI to help craft more empathetic notes to patients.
Some experts say this is a boon. After all, AI, unhindered by embarrassment and burnout, might be able to express empathy more openly and tirelessly than humans. 鈥淲e praise empathetic AI,鈥 one group of psychology researchers .
But others aren鈥檛 so sure. Many question the idea that an AI could ever be capable of empathy, and worry about the consequences of people seeking emotional support from machines that can only pretend to care. Some even wonder if the rise of so-called empathetic AI might change the way we conceive of empathy and interact with one another.
It is fair to say that empathy is one of our species鈥 defining traits, evolving as it did in lockstep with social interaction. And yet while we all know instinctively what empathy is, it is actually quite a slippery concept.
One , which looked at 52 studies published between 1980 and 2019, found that researchers frequently declared the concept had no standard definition. Even so, almost all frameworks of empathy, whether they came from philosophy, neuroscience, psychology or medicine, shared certain dimensions, says psychologist at Stockholm University in Sweden, a co-author of the paper.
The researchers found that the empathiser must first be able to discern how the other person is feeling. They must also be affected by those emotions, feel them to some degree themselves, and differentiate between themselves and the other person, grasping that the other person鈥檚 feelings aren鈥檛 their own while still being able to imagine their experience.
Large language models and empathy
On the first point, in recent years, AI-powered chatbots have made strides in their ability to read human emotions. Most chatbots are powered by large language models (LLMs) that work by predicting which words are most likely to appear together based on training data. In this way, LLMs like ChatGPT can seemingly identify our feelings and . 鈥淭he idea that [LLMs] could learn to express those words is not at all surprising to me,鈥 says bioethicist at the University of California, Berkeley. 鈥淭here鈥檚 no magic in it.鈥
But when it comes to the other criteria, AI still misses the mark in many ways. Empathy is , with continued cues and feedback helping to hone the empathiser鈥檚 response. It also requires some degree of intuitive awareness 鈥 no matter how fleeting 鈥 of an individual and their situation.
Consider someone who cries while telling a doctor she is pregnant. If we know her history of trying for years to conceive, we can imagine that her tears mean something different than, say, if she didn鈥檛 want to have kids.
Current AIs are incapable of that kind of nuanced understanding. More to the point, says Halpern, is that they are incapable of feeling for the person they are interacting with. 鈥淲e have no reason to think AI can experience empathy,鈥 she says. 鈥淚t can produce a product 鈥 the language that mimics the actual empathy humans have. But it does not have empathy.鈥
All of which helps to explain conversations like the ones I had with ChatGPT and, later, with , one of several commercial chatbots that now offer mental health support 鈥 and one that, according to its creators, has been used by more than 100,000 people. When I told it how I was feeling about current events, it asked: 鈥淗ow does thinking about these situations affect your daily life and emotions?鈥 鈥淚鈥檓 finding it hard to cope,鈥 I responded. 鈥淚鈥檓 sorry to hear that,鈥 it said. 鈥淎re there any specific behaviours or thoughts that you鈥檝e noticed?鈥
Every time I answered, Elomia immediately generated another question. The prompts gave me an opportunity to reflect. But what I really wanted was for someone to say, 鈥淯gh, I know exactly how you feel,鈥 share their own struggles or give me a hug 鈥 not pepper me with questions. In other words, I was looking for a response that was genuinely empathetic.
The big question, then, is whether that is even possible. Some believe that AIs may, in fact, become capable of experiencing and sharing human emotions. One approach is to continue scaling up LLMs with ever vaster and more diverse datasets. Virtual agents build on the language-processing abilities of chatbots by also 鈥渞eading鈥 our facial expressions and vocal tone. Most complex of all are robots that analyse these features, plus body language and hand gestures. Rudimentary versions of these emotion-detecting bots already exist, but more input can also create confusion in them. 鈥淭he more modalities we add to the system, the more and more difficult it becomes,鈥 says at , a German start-up studying human-AI interaction.
Making machines that are more adept at reading emotions is still unlikely to create genuine empathy, though, says psychologist at the University of Toronto in Canada, one of the researchers who wrote the paper praising 鈥渆mpathetic AI鈥. 鈥淵ou need to have emotions to experience empathy,鈥 he says.
Emotions and algorithms
Some computer scientists argue that certain types of algorithm already experience primitive emotions 鈥 although it is a controversial position. These algorithms, called reinforcement learning agents, are rewarded for taking certain actions over others. The expectation of receiving a reward drives simple human survival instincts, such as seeking out food and water, too. We also expect and receive social rewards from each other that correspond to an array of human emotions, says Yoshua Bengio at the University of Montreal in Canada. The richness of our emotional palette is a result of the richness of our social interactions, he says. So the idea is that if you can capture similar social complexity in AI, then actual emotions 鈥 and perhaps empathy 鈥 could emerge.
Another approach hinges on mirror neurons: the brain cells thought to fire when we see someone performing an action or expressing an emotion, activating the same parts of our brain that would light up if we were to do or feel the same thing ourselves. Computer scientists have already built , arguing that these are the key to AI empathy.
But over the past decade, some of the research on mirror neurons has been discredited and, what鈥檚 more, we have learned that the brain areas where the cells reside .
Ultimately, you can鈥檛 really know what sadness is unless you have felt sad. The evolution of empathy is intertwined with social interactions and a recognition that other minds exist, too. Empathy emerges as a holistic whole, says Inzlicht. 鈥淵ou probably need consciousness to experience empathy.鈥 That is far from a given for AI, now or in the future.
But what if AI doesn鈥檛 need genuine empathy to be useful? One online experiment from 2021 found that talking to a chatbot perceived as being caring in people 鈥 albeit not as much as talking to their human partner. And in January, another chatbot, designed by Google to conduct medical interviews, was by 20 people who were trained to impersonate patients 鈥 all while delivering more accurate diagnoses. Unlike humans, 鈥渁n AI doesn鈥檛 get stressed out or burned out. It can work 24 hours without getting tired,鈥 says H氓kansson. However, the participants in the Google study didn鈥檛 know whether they were speaking to a chatbot or a doctor. Empathy is a two-way process, so its effectiveness also depends on how we perceive and emotionally connect to the other person 鈥 or machine. Research shows, for example, that when people know they are interacting with an AI, they .
鈥淭his means AI has two bad alternatives,鈥 says H氓kansson. Either the person doesn鈥檛 know the AI is an AI and thinks it is human, which might be effective but unethical, or they know it is an AI and this makes it ineffective.
Then again, Inzlicht has just wrapped up as-yet-unpublished research that indicates a preference for AI empathy 鈥 even when users know it is AI. In his study, human participants and ChatGPT were given descriptions of different scenarios and asked to write short, compassionate answers. When other participants rated the various responses, they scored the AI responses as highest for empathy.
In the next part of the study, Inzlicht and his team labelled which responses were from AI and which were from humans. 鈥淲hat we found was that people still preferred AI,鈥 he says. Surprisingly, the labelled AI responses were even favoured over a subset of responses by Crisis Line Workers, who are expert deliverers of empathy. (Inzlicht鈥檚 work by John W. Ayers at the University of California, San Diego, and his collaborators.)
AI empathy
This may be explained by the human tendency to project feelings onto objects 鈥 whether that is children playing with Tamagotchis or people conversing with chatbots like Replika that let you create an 鈥淎I friend鈥. In conversational AI, research has found this by priming people to think that the AI really cares about them. 鈥淲e begin to feel that it has feelings for us beyond what it is expressing or what it鈥檚 capable of,鈥 says , director of the Massachusetts Institute of Technology鈥檚 Initiative on Technology and Self. 鈥淭his isn鈥檛 a quality of the machines. This is a vulnerability of people.鈥
And it is a weakness that many worry could be exploited 鈥 particularly given the question of what it means for an AI to be able to discern someone鈥檚 emotions, but not to actually resonate with them or even care about them in a genuine way.
鈥淪ay an AI detects that you鈥檙e heartbroken because your boyfriend has just left you,鈥 says at the Carnegie Council for Ethics in International Affairs in New York. 鈥淚t could seemingly commiserate with you and then slowly turn the conversation to you buying some product. That鈥檚 just a very mild example. Even though the machine cannot feel, you are, in effect, being manipulated through your emotions.鈥 That, say Wallach and other researchers, wouldn鈥檛 make AI empathetic. It .
Concerns over the danger of machines that can 鈥渞ead鈥 us but don鈥檛 care about us are more than theoretical. In March 2023, a Belgian man after six weeks of discussions with an AI chatbot. Media outlets reported that he had been sharing his fears about the climate crisis. The chatbot seemed to feed his worries and to express its own emotions 鈥 including encouraging him to kill himself so that they would 鈥渓ive together in paradise鈥. Pretending at empathy to too great a degree without the common-sense guard rails that a human is likely to offer can, it appears, be lethal.
The possibility that we will increasingly turn to, and perhaps even come to favour, AI empathy over the human variety also concerns Turkle for a profound reason: it could change the nature of empathy itself.
As an analogy, she uses the Turing test, which was designed as a purely behavioural assessment for a computer鈥檚 鈥渋ntelligence鈥. But its definition of intelligence 鈥 whether the computer could converse like a human 鈥 became a stand-in for our understanding of intelligence in general, even though human intelligence is much broader. Turkle suggests that we could start redefining empathy in a similar way 鈥 expecting humans to express empathy that is tireless, for example, but also less genuine or connected.
However, Inzlicht counters that we shouldn鈥檛 be swayed by the critiques so much that we don鈥檛 reap the potential benefits of empathetic-seeming AIs working alongside humans 鈥 whether as a quick assist for overstretched health practitioners or to relieve loneliness among older people, as the voice-operated AI 鈥渃are companion鈥 ElliQ is designed to do. Other researchers, including Turkle, argue that even this hybrid human-AI approach goes too far, as it will reduce key opportunities to practise and improve actual human empathy. We may end up turning to machines, rather than looking for ways to foster genuine connection, she says.
鈥淚t鈥檚 a sad moment when we are actually thinking that being lonely can be fixed by a back-and-forth interaction with something that has no idea about what it is to be born, about what it is to die,鈥 says Turkle.
At the end of the day, despite talking to multiple chatbots online and getting more advice and reflective prompts than I knew what to do with, I found I still felt sad about the state of the world. I did what I knew I had to do all along: I picked up my phone and called a friend.
Amanda Ruggeri is an award-winning journalist and editor based in Switzerland
New 杏吧原创 audio
You can now listen to many articles 鈥 look for the headphones icon in our app
