English
Related papers

Related papers: Evaluating Empathy in Artificial Agents

200 papers

As AI technology develops, trust in AI agents is becoming more important for more AI applications in human society. Possible ways to improve the trust relationship include empathy, success-failure series, and capability (performance).…

Human-Computer Interaction · Computer Science 2025-04-22 Takahiro Tsumura , Seiji Yamada

At the heart of improving conversational AI is the open problem of how to evaluate conversations. Issues with automatic metrics are well known (Liu et al., 2016, arXiv:1603.08023), with human evaluations still considered the gold standard.…

Computation and Language · Computer Science 2022-01-14 Eric Michael Smith , Orion Hsu , Rebecca Qian , Stephen Roller , Y-Lan Boureau , Jason Weston

Prior efforts to create an autonomous computer system capable of predicting what a human being is thinking or feeling from facial expression data have been largely based on outdated, inaccurate models of how emotions work that rely on many…

Artificial Intelligence · Computer Science 2018-08-06 Trevor Buteau , Damian Lyons

Over the past decades, research in cognitive and affective neuroscience has emphasized that emotion is crucial for human intelligence and in fact inseparable from cognition. Concurrently, there has been growing interest in simulating and…

Artificial Intelligence · Computer Science 2023-12-22 Marwen Belkaid , Luiz Pessoa

Empathy, as defined in behavioral sciences, expresses the ability of human beings to recognize, understand and react to emotions, attitudes and beliefs of others. The lack of an operational definition of empathy makes it difficult to…

Computation and Language · Computer Science 2018-01-01 Firoj Alam , Morena Danieli , Giuseppe Riccardi

Current AI evaluation methods, which rely on static, model-only tests, fail to account for harms that emerge through sustained human-AI interaction. As AI systems proliferate and are increasingly integrated into real-world applications,…

Computers and Society · Computer Science 2025-07-31 Lujain Ibrahim , Saffron Huang , Umang Bhatt , Lama Ahmad , Markus Anderljung

Empathy is often understood as the ability to share and understand another individual's state of mind or emotion. With the increasing use of chatbots in various domains, e.g., children seeking help with homework, individuals looking for…

Artificial Intelligence · Computer Science 2026-03-24 Kristina Schaaff , Caroline Reinig , Tim Schlippe

Empathy is widely used in many disciplines such as philosophy, sociology, psychology, health care. Ability to empathise with software end-users seems to be a vital skill software developers should possess. This is because engineering…

Software Engineering · Computer Science 2023-05-09 Hashini Gunatilake , John Grundy , Ingo Mueller , Rashina Hoda

Automated dialogue systems are important applications of artificial intelligence, and traditional systems struggle to understand user emotions and provide empathetic feedback. This study integrates emotional intelligence technology into…

Artificial Intelligence · Computer Science 2024-04-30 Jin Wang , JinFei Wang , Shuying Dai , Jiqiang Yu , Keqin Li

As AI chatbots increasingly incorporate empathy, understanding user-centered perceptions of chatbot empathy and its impact on conversation quality remains essential yet under-explored. This study examines how chatbot identity and perceived…

Human-Computer Interaction · Computer Science 2025-03-10 Tingting Liu , Salvatore Giorgi , Ankit Aich , Allison Lahnala , Brenda Curtis , Lyle Ungar , João Sedoc

Human computer interaction is shifting from screen-based systems to multimodal interfaces where artificial intelligence powered systems increasingly interpret user intent through speech, gesture, and gaze. Yet users rarely understand how…

Human-Computer Interaction · Computer Science 2026-05-05 Ankur Bhatt , Sven Mayer

One of the major challenges we face with ethical AI today is developing computational systems whose reasoning and behaviour are provably aligned with human values. Human values, however, are notorious for being ambiguous, contradictory and…

Artificial Intelligence · Computer Science 2023-05-05 Nardine Osman , Mark d'Inverno

Recent debates on artificial intelligence increasingly emphasise questions of AI consciousness and moral status, yet there remains little agreement on how such properties should be evaluated. In this paper, we argue that awareness offers a…

Artificial Intelligence · Computer Science 2026-01-22 Nadine Meertens , Suet Lee , Ophelia Deroy

AI Alignment research seeks to align human and AI goals to ensure independent actions by a machine are always ethical. This paper argues empathy is necessary for this task, despite being often neglected in favor of more deductive…

Neural and Evolutionary Computing · Computer Science 2023-12-14 Devin Gonier , Adrian Adduci , Cassidy LoCascio

One way to improve the relationship between humans and anthropomorphic agents is to have humans empathize with the agents. In this study, we focused on a task between agents and humans. We experimentally investigated hypotheses stating that…

Human-Computer Interaction · Computer Science 2023-04-05 Takahiro Tsumura , Seiji Yamada

There is a general concern that present developments in artificial intelligence (AI) research will lead to sentient AI systems, and these may pose an existential threat to humanity. But why cannot sentient AI systems benefit humanity…

Artificial Intelligence · Computer Science 2025-02-18 Parashar Das

Communication between humans and artificial agents is essential for their interaction. This is often inspired by human communication, which uses gestures, facial expressions, gaze direction, and other explicit and implicit means. This work…

Robotics · Computer Science 2026-02-26 Ana Christina Almada Campos , Bruno Vilhena Adorno

Empathy has been discussed as a relevant human capability in software engineering, particularly in activities that require understanding users, stakeholders, and the societal implications of technological systems. This relevance becomes…

Scientists and philosophers have debated whether humans can trust advanced artificial intelligence (AI) agents to respect humanity's best interests. Yet what about the reverse? Will advanced AI agents trust humans? Gauging an AI agent's…

Artificial Intelligence · Computer Science 2022-12-29 Tim Johnson , Nick Obradovich

In empathetic conversations, humans express their empathy to others with empathetic intents. However, most existing empathetic conversational methods suffer from a lack of empathetic intents, which leads to monotonous empathy. To address…

Computation and Language · Computer Science 2022-04-27 Mao Yan Chen , Siheng Li , Yujiu Yang