English
Related papers

Related papers: Spatial and Temporal Attention-based emotion estim…

200 papers

Emotions play an essential role in human communication. Developing computer vision models for automatic recognition of emotion expression can aid in a variety of domains, including robotics, digital behavioral healthcare, and media…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Yang Qian , Ali Kargarandehkordi , Onur Cezmi Mutlu , Saimourya Surabhi , Mohammadmahdi Honarmand , Dennis Paul Wall , Peter Washington

Valence-arousal (VA) estimation is crucial for capturing the nuanced nature of human emotions in naturalistic environments. While pre-trained Vision-Language models like CLIP have shown remarkable semantic alignment capabilities, their…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Byeongjin Jung , Chanyeong Park , Sejoon Lim

Emotion detection in textual data has received growing interest in recent years, as it is pivotal for developing empathetic human-computer interaction systems. This paper introduces a method for categorizing emotions from text, which…

The technical report presents our emotion recognition pipeline for high-dimensional emotion task (A-VB High) in The ACII Affective Vocal Bursts (A-VB) 2022 Workshop \& Competition. Our proposed method contains three stages. Firstly, we…

Sound · Computer Science 2022-09-27 Dang-Linh Trinh , Minh-Cong Vo , Guee-Sang Lee

Video-based Emotional Reaction Intensity (ERI) estimation measures the intensity of subjects' reactions to stimuli along several emotional dimensions from videos of the subject as they view the stimuli. We propose a multi-modal architecture…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Yini Fang , Liang Wu , Frederic Jumelle , Bertram Shi

Applications of an efficient emotion recognition system can be found in several domains such as medicine, driver fatigue surveillance, social robotics, and human-computer interaction. Appraising human emotional states, behaviors, and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Savinay Nagendra , Prapti Panigrahi

While pre-trained language models excel at semantic understanding, they often struggle to capture nuanced affective information critical for affective recognition tasks. To address these limitations, we propose a novel framework for…

Computation and Language · Computer Science 2025-03-03 Seungah Son , Andrez Saurez , Dongsoo Har

In the context of HCI, building an automatic system to recognize affect of human facial expression in real-world condition is very crucial to make machine interact naturallisticaly with a man. However, existing facial emotion databases…

Machine Learning · Computer Science 2019-12-17 Mengyao Liu , Dimitrios Kollias

Temporal context is key to the recognition of expressions of emotion. Existing methods, that rely on recurrent or self-attention models to enforce temporal consistency, work on the feature level, ignoring the task-specific temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Enrique Sanchez , Mani Kumar Tellamekala , Michel Valstar , Georgios Tzimiropoulos

Automatic emotion recognition for real-life appli-cations is a challenging task. Human emotion expressions aresubtle, and can be conveyed by a combination of several emo-tions. In most existing emotion recognition studies, each…

Sound · Computer Science 2022-03-08 Jay Desai , Houwei Cao , Ravi Shah

Attention level estimation systems have a high potential in many use cases, such as human-robot interaction, driver modeling and smart home systems, since being able to measure a person's attention level opens the possibility to natural…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Andrea Coifman , Péter Rohoska , Miklas S. Kristoffersen , Sven E. Shepstone , Zheng-Hua Tan

Emotion recognition from biometrics is relevant to a wide range of application domains, including healthcare. Existing approaches usually adopt multi-electrodes sensors that could be expensive or uncomfortable to be used in real-life…

Human-Computer Interaction · Computer Science 2018-01-19 Daniela Girardi , Filippo Lanubile , Nicole Novielli

In recent years, the demand for social robots has grown, requiring them to adapt their behaviors based on users' states. Accurately assessing user experience (UX) in human-robot interaction (HRI) is crucial for achieving this adaptability.…

Robotics · Computer Science 2025-08-01 Ryo Miyoshi , Yuki Okafuji , Takuya Iwamoto , Junya Nakanishi , Jun Baba

Human emotion recognition plays a crucial role in facilitating seamless interactions between humans and computers. In this paper, we present our innovative methodology for tackling the Valence-Arousal (VA) Estimation Challenge, the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Weiwei Zhou , Chenkun Ling , Zefeng Cai

This paper presents our method for the estimation of valence-arousal (VA) in the 8th Affective Behavior Analysis in-the-Wild (ABAW) competition. Our approach integrates visual and audio information through a multimodal framework. The visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Jun Yu , Yongqi Wang , Lei Wang , Yang Zheng , Shengfan Xu

Emotions are subjective constructs. Recent end-to-end speech emotion recognition systems are typically agnostic to the subjective nature of emotions, despite their state-of-the-art performance. In this work, we introduce an end-to-end…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Navin Raj Prabhu , Guillaume Carbajal , Nale Lehmann-Willenbrock , Timo Gerkmann

Decades of research indicate that emotion recognition is more effective when drawing information from multiple modalities. But what if some modalities are sometimes missing? To address this problem, we propose a novel Transformer-based…

Machine Learning · Computer Science 2023-11-20 Juan Vazquez-Rodriguez , Grégoire Lefebvre , Julien Cumin , James L. Crowley

In the domain of human-computer interaction, accurately recognizing and interpreting human emotions is crucial yet challenging due to the complexity and subtlety of emotional expressions. This study explores the potential for detecting a…

Multimedia · Computer Science 2025-05-13 Jiehui Jia , Huan Zhang , Jinhua Liang

Most automatic emotion recognition systems exploit time-continuous annotations of emotion to provide fine-grained descriptions of spontaneous expressions as observed in real-life interactions. As emotion is rather subjective, its annotation…

Sound · Computer Science 2022-09-22 Sina Alisamir , Fabien Ringeval , Francois Portet

Understanding the emotional impact of videos is crucial for applications in content creation, advertising, and Human-Computer Interaction (HCI). Traditional affective computing methods rely on self-reported emotions, facial expression…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Akhila Yaragoppa , Siddharth