English
Related papers

Related papers: How Should Voice Assistants Deal With Users' Emoti…

200 papers

Understanding emotional signals in older adults is crucial for designing virtual assistants that support their well-being. However, existing affective computing models often face significant limitations: (1) limited availability of datasets…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Josep Lopez Camunas , Cristina Bustos , Yanjun Zhu , Raquel Ros , Agata Lapedriza

The recent rapid advancements in artificial intelligence research and deployment have sparked more discussion about the potential ramifications of socially- and emotionally-intelligent AI. The question is not if research can produce such…

Artificial Intelligence · Computer Science 2021-07-30 Desmond C. Ong

A remote robot operator's affective state can significantly impact the resulting robot's motions leading to unexpected consequences, even when the user follows protocol and performs permitted tasks. The recognition of a user operator's…

Human interactions are characterized by explicit as well as implicit channels of communication. While the explicit channel transmits overt messages, the implicit ones transmit hidden messages about the communicator (e.g., his/her intentions…

Human-Computer Interaction · Computer Science 2017-07-12 Katie Hoemann , Behnaz Rezaei , Stacy C. Marsella , Sarah Ostadabbas

Observers can glean information from others' emotional expressions through the act of drawing inferences from another individual's emotional expressions. It is important for socially aware artificial systems to be capable of doing that as…

Multiagent Systems · Computer Science 2023-11-14 Jieting Luo , Mehdi Dastani , Thomas Studer , Beishui Liao

Demographic growth and rise in the average age of the population is increasing the demand for the elderly assistance. Health care oriented ambient intelligence technologies are fundamental to support elderly peoples' autonomy. In this…

Human-Computer Interaction · Computer Science 2023-05-01 Mariya Kilina , Tommaso Elia , Syed Yusha Kareem , Alessandro Carfi , Fulvio Mastrogiovanni

Chatbots' growing popularity has brought new challenges to HCI, having changed the patterns of human interactions with computers. The increasing need to approximate conversational interaction styles raises expectations for chatbots to…

Human-Computer Interaction · Computer Science 2024-01-24 Ana Paula Chaves , Marco Aurelio Gerosa

Artificial Intelligence (AI) algorithms, trained on emotion data extracted from physiological signals, provide a promising approach to monitoring emotions, affect, and mental well-being. However, the field encounters challenges because…

Human-Computer Interaction · Computer Science 2024-06-24 Pragya Singh , Mohan Kumar , Pushpendra Singh

Expressing and identifying emotions through facial and physical expressions is a significant part of social interaction. Emotion recognition is an essential task in computer vision due to its various applications and mainly for allowing a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Willams Costa , David Macêdo , Cleber Zanchettin , Lucas S. Figueiredo , Veronica Teichrieb

Human-computer interaction (HCI) has been a widely researched area for many years, with continuous advancements in technology leading to the development of new techniques that change the way we interact with computers. With the recent…

Human-Computer Interaction · Computer Science 2024-11-08 Kaushik Ranade , Tanmay Khule , Riddhi More

In this paper, we describe approaches for developing Emily, an emotion-affective open-domain chatbot. Emily can perceive a user's negative emotion state and offer supports by positively converting the user's emotion states. This is done by…

Computation and Language · Computer Science 2021-09-21 Weixuan Wang , Xiaoling Cai , Chong Hsuan Huang , Haoran Wang , Haonan Lu , Ximing Liu , Wei Peng

In VR interactions with embodied conversational agents, users' emotional intent is often conveyed more by how something is said than by what is said. However, most VR agent pipelines rely on speech-to-text processing, discarding prosodic…

Human-Computer Interaction · Computer Science 2026-03-11 SangYeop Jeong , Yeongseo Na , Seung Gyu Jeong , Jin-Woo Jeong , Seong-Eun Kim

Speech Emotion Recognition (SER) is essential for improving human-computer interaction, yet its accuracy remains constrained by the complexity of emotional nuances in speech. In this study, we distinguish between descriptive semantics,…

Computation and Language · Computer Science 2025-10-06 Rongchen Guo , Vincent Francoeur , Isar Nejadgholi , Sylvain Gagnon , Miodrag Bolic

This paper proposes an approach to detect emotion from human speech employing majority voting technique over several machine learning techniques. The contribution of this work is in two folds: firstly it selects those features of speech…

Sound · Computer Science 2018-07-12 Md. Kamruzzaman Sarker , Kazi Md. Rokibul Alam , Md. Arifuzzaman

Modern day conversational agents are trained to emulate the manner in which humans communicate. To emotionally bond with the user, these virtual agents need to be aware of the affective state of the user. Transformers are the recent state…

Sound · Computer Science 2022-04-26 Raman Goel , Seba Susan , Sachin Vashisht , Armaan Dhanda

Empathy involves understanding other people's situation, perspective, and feelings. In clinical interactions, it helps clinicians establish rapport with a patient and support patient-centered care and decision making. Understanding…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-03 Zhuohao Chen , James Gibson , Ming-Chang Chiu , Qiaohong Hu , Tara K Knight , Daniella Meeker , James A Tulsky , Kathryn I Pollak , Shrikanth Narayanan

Recent years have witnessed great progress on building emotional chatbots. Tremendous methods have been proposed for chatbots to generate responses with given emotions. However, the emotion changes of the user during the conversation has…

Computation and Language · Computer Science 2021-05-19 Hao Jiang , Yutao Zhu , Xinyu Zhang , Zhicheng Dou , Pan Du , Te Pi , Yantao Jia

Speech Emotion Recognition (SER) is the task of identifying the emotion expressed in a spoken utterance. Emotion recognition is essential in building robust conversational agents in domains such as law, healthcare, education, and customer…

Artificial Intelligence · Computer Science 2023-08-08 N V S Abhishek , Pushpak Bhattacharyya

Emotions are reactions that can be expressed through a variety of social signals. For example, anger can be expressed through a scowl, narrowed eyes, a long stare, or many other expressions. This complexity is problematic when attempting to…

Robotics · Computer Science 2021-03-09 Ghazal Saheb Jam , Jimin Rhim , Angelica Lim

Effective and safe human-machine collaboration requires the regulated and meaningful exchange of emotions between humans and artificial intelligence (AI). Current AI systems based on large language models (LLMs) can provide feedback that…

Computation and Language · Computer Science 2025-06-18 Xiuwen Wu , Hao Wang , Zhiang Yan , Xiaohan Tang , Pengfei Xu , Wai-Ting Siok , Ping Li , Jia-Hong Gao , Bingjiang Lyu , Lang Qin