English
Related papers

Related papers: How Should Voice Assistants Deal With Users' Emoti…

200 papers

Emotions play an essential role in human communication. Developing computer vision models for automatic recognition of emotion expression can aid in a variety of domains, including robotics, digital behavioral healthcare, and media…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Yang Qian , Ali Kargarandehkordi , Onur Cezmi Mutlu , Saimourya Surabhi , Mohammadmahdi Honarmand , Dennis Paul Wall , Peter Washington

Background: Human Emotion Recognition (HER) has been a popular field of study in the past years. Despite the great progresses made so far, relatively little attention has been paid to the use of HER in autism. People with autism are known…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Oresti Banos , Zhoe Comas-González , Javier Medina , Aurora Polo-Rodríguez , David Gil , Jesús Peral , Sandra Amador , Claudia Villalonga

Empathy is a cognitive and emotional reaction to an observed situation of others. Empathy has recently attracted interest because it has numerous applications in psychology and AI, but it is unclear how different forms of empathy (e.g.,…

Computation and Language · Computer Science 2022-05-26 Damilola Omitaomu , Shabnam Tafreshi , Tingting Liu , Sven Buechel , Chris Callison-Burch , Johannes Eichstaedt , Lyle Ungar , João Sedoc

This paper introduces EmpathyEar, a pioneering open-source, avatar-based multimodal empathetic chatbot, to fill the gap in traditional text-only empathetic response generation (ERG) systems. Leveraging the advancements of a large language…

Multimedia · Computer Science 2024-06-24 Hao Fei , Han Zhang , Bin Wang , Lizi Liao , Qian Liu , Erik Cambria

Understanding speaker's feelings and producing appropriate responses with emotion connection is a key communicative skill for empathetic dialogue systems. In this paper, we propose a simple technique called Affective Decoding for empathetic…

Computation and Language · Computer Science 2021-10-18 Chengkun Zeng , Guanyi Chen , Chenghua Lin , Ruizhe Li , Zhigang Chen

Affective Computing (AC) has enabled Artificial Intelligence (AI) systems to recognise, interpret, and respond to human emotions - a capability also known as Artificial Emotional Intelligence (AEI). It is increasingly seen as an important…

Human-Computer Interaction · Computer Science 2025-08-19 Yupei Li , Qiyang Sun , Michelle Schlicher , Yee Wen Lim , Björn W. Schuller

The Metaverse is poised to be a future platform that redefines what it means to communicate, socialize, and interact with each other. Yet, it is important for us to consider avoiding the pitfalls of social media platforms we use today;…

Human-Computer Interaction · Computer Science 2023-11-29 Yun Suen Pai , Mark Armstrong , Kinga Skiers , Anish Kundu , Danyang Peng , Yixin Wang , Tamil Selvan Gunasekaran , Chi-Lan Yang , Kouta Minamizawa

As robots and artificial agents become increasingly integrated into daily life, enhancing their ability to interact with humans is essential. Emotions, which play a crucial role in human interactions, can improve the naturalness and…

Robotics · Computer Science 2025-04-17 Francesca Corrao , Alice Nardelli , Jennifer Renoux , Carmine Tommaso Recchiuto

A cluster of research in Affective Computing suggests that it is possible to infer some characteristics of users' affective states by analyzing their electrophysiological activity in real-time. However, it is not clear how to use the…

Human-Computer Interaction · Computer Science 2022-11-22 Andres Pinilla , Jaime Garcia , William Raffe , Jan-Niklas Voigt-Antons , Robert Spang , Sebastian Möller

Intelligent agents have great potential as facilitators of group conversation among older adults. However, little is known about how to design agents for this purpose and user group, especially in terms of agent embodiment. To this end, we…

The novel research area of computational empathy is in its infancy and moving towards developing methods and standards. One major problem is the lack of agreement on the evaluation of empathy in artificial interactive systems. Even though…

Artificial Intelligence · Computer Science 2019-08-16 Özge Nilay Yalçın

Social robots need to understand the affective state of the humans with whom they interact. Successful interactions require understanding mood and emotion in the short term, and personality and attitudes over longer periods. Social robots…

Robotics · Computer Science 2017-05-03 D. B. Skillicorn , N. Alsadhan , R. Billingsley , M. -A. - Williams

Emotions are an essential element in verbal communication, so understanding individuals' affect during a human-robot interaction (HRI) becomes imperative. This paper investigates the application of vision transformer models, namely ViT…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-18 Ruchik Mishra , Andrew Frye , Madan Mohan Rayguru , Dan O. Popa

Exploring moral dilemmas allows individuals to navigate moral complexity, where a reversal in decision certainty, shifting toward the opposite of one's initial choice, could reflect open-mindedness and less rigidity. This study probes how…

Human-Computer Interaction · Computer Science 2024-12-30 Chenyi Zhang , Zhenhao Zhang , Wei Zhang , Tian Zeng , Black Sun , Jian Zhao , Pengcheng An

Affective interaction is not merely about recognizing emotions; it is an embodied, situated process shaped by context and co-created through interaction. In affective computing, the role of haptic feedback within dynamic emotional exchanges…

Robotics · Computer Science 2025-06-25 Qiaoqiao Ren , Tony Belpaeme

Emotions can provide a natural communication modality to complement the existing multi-modal capabilities of social robots, such as text and speech, in many domains. We conducted three online studies with 112, 223, and 151 participants to…

Robotics · Computer Science 2022-08-23 Sami Alperen Akgun , Moojan Ghafurian , Mark Crowley , Kerstin Dautenhahn

Customers' emotions play a vital role in the service industry. The better frontline personnel understand the customer, the better the service they can provide. As human emotions generate certain (unintentional) bodily reactions, such as…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-12 Fabian Thaler , Stefan Faußer , Heiko Gewald

Text-writing robots have been used in assistive writing and drawing applications. However, robots do not convey emotional tones in the writing process due to the lack of behaviors humans typically adopt. To examine how people interpret…

Human-Computer Interaction · Computer Science 2023-02-14 Yanheng Li , Lin Luoying , Xinyan Li , Yaxuan Mao , Ray Lc

The consistency of a response to a given post at semantic-level and emotional-level is essential for a dialogue system to deliver human-like interactions. However, this challenge is not well addressed in the literature, since most of the…

Computation and Language · Computer Science 2021-04-12 Wei Wei , Jiayi Liu , Xianling Mao , Guibin Guo , Feida Zhu , Pan Zhou , Yuchong Hu , Shanshan Feng

Emotional Artificial Intelligences are currently one of the most anticipated developments of AI. If successful, these AIs will be classified as one of the most complex, intelligent nonhuman entities as they will possess sentience, the…

Machine Learning · Computer Science 2023-10-17 Ashley Jisue Hong , David DiStefano , Sejal Dua