English
Related papers

Related papers: Realtime Multimodal Emotion Estimation using Behav…

200 papers

Emotion recognition has the potential to play a pivotal role in enhancing human-computer interaction by enabling systems to accurately interpret and respond to human affect. Yet, capturing emotions in face-to-face contexts remains…

Affective Behavior Analysis aims to facilitate technology emotionally smart, creating a world where devices can understand and react to our emotions as humans do. To comprehensively evaluate the authenticity and applicability of emotional…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Wei Zhang , Feng Qiu , Chen Liu , Lincheng Li , Heming Du , Tiancheng Guo , Xin Yu

Emotion recognition is essential for applications in affective computing and behavioral prediction, but conventional systems relying on single-modality data often fail to capture the complexity of affective states. To address this…

Multimedia · Computer Science 2025-09-08 Jianlu Wang , Yanan Wang , Tong Liu

Humans use a host of signals to infer the emotional state of others. In general, computer systems that leverage signals from multiple modalities will be more robust and accurate in the same task. We present a multimodal affect and context…

Human-Computer Interaction · Computer Science 2019-03-29 Daniel McDuff , Kael Rowan , Piali Choudhury , Jessica Wolk , ThuVan Pham , Mary Czerwinski

Emotion is an experience associated with a particular pattern of physiological activity along with different physiological, behavioral and cognitive changes. One behavioral change is facial expression, which has been studied extensively…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Xiaotian Li , Xiang Zhang , Huiyuan Yang , Wenna Duan , Weiying Dai , Lijun Yin

This paper proposes a system capable of recognizing a speaker's utterance-level emotion through multimodal cues in a video. The system seamlessly integrates multiple AI models to first extract and pre-process multimodal information from the…

Human-Computer Interaction · Computer Science 2023-08-29 Sun-Kyung Lee , Jong-Hwan Kim

Emotional expressiveness captures the extent to which a person tends to outwardly display their emotions through behavior. Due to the close relationship between emotional expressiveness and behavioral health, as well as the crucial role…

Human-Computer Interaction · Computer Science 2020-09-02 Victoria Lin , Jeffrey M. Girard , Michael A. Sayette , Louis-Philippe Morency

This paper introduces our method for the Emotional Reaction Intensity (ERI) Estimation Challenge, in CVPR 2023: 5th Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW). Based on the multimodal data provided by the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Shangfei Wang , Jiaqiang Wu , Feiyi Zheng , Xin Li , Xuewei Li , Suwen Wang , Yi Wu , Yanan Chang , Xiangyu Miao

In the domain of human-computer interaction, accurately recognizing and interpreting human emotions is crucial yet challenging due to the complexity and subtlety of emotional expressions. This study explores the potential for detecting a…

Multimedia · Computer Science 2025-05-13 Jiehui Jia , Huan Zhang , Jinhua Liang

Automatic emotion recognition has become increasingly important with the rise of AI, especially in fields like healthcare, education, and automotive systems. However, there is a lack of multimodal datasets, particularly involving body…

Artificial Intelligence · Computer Science 2025-09-09 Seyed Muhammad Hossein Mousavi , Atiye Ilanloo

We present a glasses type wearable device to detect emotions from a human face in an unobtrusive manner. The device is designed to gather multi channel responses from the user face naturally and continuously while the user is wearing it.…

Human-Computer Interaction · Computer Science 2024-10-30 Jangho Kwon , Laehyun Kim

Emotion detection in older adults is crucial for understanding their cognitive and emotional well-being, especially in hospital and assisted living environments. In this work, we investigate an edge-based, non-obtrusive approach to emotion…

Human-Computer Interaction · Computer Science 2025-07-14 Md. Saif Hassan Onim , Andrew M. Kiselica , Himanshu Thapliyal

Virtual Reality (VR) has emerged as a promising tool for enhancing social skills and emotional well-being in individuals with Autism Spectrum Disorder (ASD). Through a technical exploration, this study employs a multiplayer serious gaming…

In the field of affective computing, researchers in the community have promoted the performance of models and algorithms by using the complementarity of multimodal information. However, the emergence of more and more modal information makes…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Binqiang Wang , Gang Dong , Yaqian Zhao , Rengang Li , Lu Cao , Lihua Lu

Automatic emotion recognition is a challenging task. In this paper, we present our effort for the audio-video based sub-challenge of the Emotion Recognition in the Wild (EmotiW) 2018 challenge, which requires participants to assign a single…

Computer Vision and Pattern Recognition · Computer Science 2018-09-18 Zheng Lian , Ya Li , Jianhua Tao , Jian Huang

Temporal context is key to the recognition of expressions of emotion. Existing methods, that rely on recurrent or self-attention models to enforce temporal consistency, work on the feature level, ignoring the task-specific temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Enrique Sanchez , Mani Kumar Tellamekala , Michel Valstar , Georgios Tzimiropoulos

This paper proposes a multimodal emotion recognition system based on hybrid fusion that classifies the emotions depicted by speech utterances and corresponding images into discrete classes. A new interpretability technique has been…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Puneet Kumar , Sarthak Malik , Balasubramanian Raman

Emotional expressions are the behaviors that communicate our emotional state or attitude to others. They are expressed through verbal and non-verbal communication. Complex human behavior can be understood by studying physical features from…

Computer Vision and Pattern Recognition · Computer Science 2021-09-15 Liam Schoneveld , Alice Othmani , Hazem Abdelkawy

The project leverages advanced machine and deep learning techniques to address the challenge of emotion recognition by focusing on non-facial cues, specifically hands, body gestures, and gestures. Traditional emotion recognition systems…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Haoyang Liu

Human emotions entail a complex set of behavioral, physiological and cognitive changes. Current state-of-the-art models fuse the behavioral and physiological components using classic machine learning, rather than recent deep learning…