English
Related papers

Related papers: Exploring Emotion Expression Recognition in Older …

200 papers

Humans use a host of signals to infer the emotional state of others. In general, computer systems that leverage signals from multiple modalities will be more robust and accurate in the same task. We present a multimodal affect and context…

Human-Computer Interaction · Computer Science 2019-03-29 Daniel McDuff , Kael Rowan , Piali Choudhury , Jessica Wolk , ThuVan Pham , Mary Czerwinski

Emotion recognition has the potential to play a pivotal role in enhancing human-computer interaction by enabling systems to accurately interpret and respond to human affect. Yet, capturing emotions in face-to-face contexts remains…

Speech Emotion Recognition (SER) systems rely on speech input and emotional labels annotated by humans. However, various emotion databases collect perceptional evaluations in different ways. For instance, the IEMOCAP dataset uses video…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-15 Huang-Cheng Chou , Haibin Wu , Hung-yi Lee , Chi-Chun Lee

The feeling of anxiety and loneliness among aging population has been recently amplified by the COVID-19 related lockdowns. Emotion-aware multimodal bot application combining voice and visual interface was developed to address the problem…

Human-Computer Interaction · Computer Science 2022-07-25 W. Mieleszczenko-Kowszewicz , K. Warpechowski , K. Zieliński , R. Nielek , A. Wierzbicki

Emotion Prediction in Conversation (EPC) aims to forecast the emotions of forthcoming utterances by utilizing preceding dialogues. Previous EPC approaches relied on simple context modeling for emotion extraction, overlooking fine-grained…

Multimedia · Computer Science 2024-08-09 Haoxiang Shi , Ziqi Liang , Jun Yu

Emotions play a key role in human communication and public presentations. Human emotions are usually expressed through multiple modalities. Therefore, exploring multimodal emotions and their coherence is of great value for understanding…

Computer Vision and Pattern Recognition · Computer Science 2019-10-10 Haipeng Zeng , Xingbo Wang , Aoyu Wu , Yong Wang , Quan Li , Alex Endert , Huamin Qu

Emotional expressiveness captures the extent to which a person tends to outwardly display their emotions through behavior. Due to the close relationship between emotional expressiveness and behavioral health, as well as the crucial role…

Human-Computer Interaction · Computer Science 2020-09-02 Victoria Lin , Jeffrey M. Girard , Michael A. Sayette , Louis-Philippe Morency

In the context of education technology, empathic interaction with the user and feedback by the learning system using multiple inputs such as video, voice and text inputs is an important area of research. In this paper, a nonintrusive,…

Computer Vision and Pattern Recognition · Computer Science 2018-07-16 S L Happy , A. Dasgupta , P. Patnaik , A. Routray

As artificial intelligence (AI) systems become increasingly embedded in everyday life, the ability of interactive agents to express empathy has become critical for effective human-AI interaction, particularly in emotionally sensitive…

Human-Computer Interaction · Computer Science 2025-12-24 Sung Park , Daeho Yoon , Jungmin Lee

Emotional Support Conversation (ESC) systems are pivotal in providing empathetic interactions, aiding users through negative emotional states by understanding and addressing their unique experiences. In this paper, we tackle two key…

Computation and Language · Computer Science 2024-04-04 Zhe Xu , Daoyuan Chen , Jiayi Kuang , Zihao Yi , Yaliang Li , Ying Shen

Traditionally, in paralinguistic analysis for emotion detection from speech, emotions have been identified with discrete or dimensional (continuous-valued) labels. Accordingly, models that have been proposed for emotion detection use one or…

Sound · Computer Science 2022-11-01 Roshan Sharma , Hira Dhamyal , Bhiksha Raj , Rita Singh

In our everyday lives and social interactions we often try to perceive the emotional states of people. There has been a lot of research in providing machines with a similar capacity of recognizing emotions. From a computer vision…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Ronak Kosti , Jose M. Alvarez , Adria Recasens , Agata Lapedriza

Empathy is critical to successful mental health support. Empathy measurement has predominantly occurred in synchronous, face-to-face settings, and may not translate to asynchronous, text-based contexts. Because millions of people use…

Computation and Language · Computer Science 2020-09-18 Ashish Sharma , Adam S. Miner , David C. Atkins , Tim Althoff

Emotional expressions are the behaviors that communicate our emotional state or attitude to others. They are expressed through verbal and non-verbal communication. Complex human behavior can be understood by studying physical features from…

Computer Vision and Pattern Recognition · Computer Science 2021-09-15 Liam Schoneveld , Alice Othmani , Hazem Abdelkawy

Automatic depression detection has attracted increasing amount of attention but remains a challenging task. Psychological research suggests that depressive mood is closely related with emotion expression and perception, which motivates the…

Computation and Language · Computer Science 2022-11-18 Wen Wu , Mengyue Wu , Kai Yu

Negotiation is a complex social interaction that encapsulates emotional encounters in human decision-making. Virtual agents that can negotiate with humans are useful in pedagogy and conversational AI. To advance the development of such…

Human-Computer Interaction · Computer Science 2021-07-29 Kushal Chawla , Rene Clever , Jaysa Ramirez , Gale Lucas , Jonathan Gratch

Emotion recognition in multi-speaker conversations faces significant challenges due to speaker ambiguity and severe class imbalance. We propose a novel framework that addresses these issues through three key innovations: (1) a speaker…

Sound · Computer Science 2025-11-19 Xiao Li , Kotaro Funakoshi , Manabu Okumura

Previous studies regarding the perception of emotions for embodied virtual agents have shown the effectiveness of using virtual characters in conveying emotions through interactions with humans. However, creating an autonomous embodied…

Human-Computer Interaction · Computer Science 2023-12-08 Che-Jui Chang , Samuel S. Sohn , Sen Zhang , Rajath Jayashankar , Muhammad Usman , Mubbasir Kapadia

Emotions are one of the important components of the human being, thus they are a valuable part of daily activities such as interaction with people, decision making and learning. For this reason, it is important to detect, recognize and…

Human-Computer Interaction · Computer Science 2025-12-30 Ricardo Vasquez , Diego Riofrío-Luzcando , Joe Carrion-Jumbo , Cesar Guevara

Empathy, as defined in behavioral sciences, expresses the ability of human beings to recognize, understand and react to emotions, attitudes and beliefs of others. The lack of an operational definition of empathy makes it difficult to…

Computation and Language · Computer Science 2018-01-01 Firoj Alam , Morena Danieli , Giuseppe Riccardi