English
Related papers

Related papers: A Multi-term and Multi-task Analyzing Framework fo…

200 papers

Accurate emotion recognition is pivotal for nuanced and engaging human-computer interactions, yet remains difficult to achieve, especially in dynamic, conversation-like settings. In this study, we showcase how integrating eye-tracking data,…

Human-Computer Interaction · Computer Science 2025-11-03 Meisam Jamshidi Seikavandi , Jostein Fimland , Maria Barrett , Paolo Burelli

In this paper, we present our contribution to ABAW facial expression challenge. We report the proposed system and the official challenge results adhering to the challenge protocol. Using end-to-end deep learning and benefiting from transfer…

Machine Learning · Computer Science 2020-11-03 Denis Dresvyanskiy , Elena Ryumina , Heysem Kaya , Maxim Markitantov , Alexey Karpov , Wolfgang Minker

In our multicultural world, affect-aware AI systems that support humans need the ability to perceive affect across variations in emotion expression patterns across cultures. These systems must perform well in cultural contexts without…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Leena Mathur , Ralph Adolphs , Maja J Matarić

Diversity of the features extracted by deep neural networks is important for enhancing the model generalization ability and accordingly its performance in different learning tasks. Facial expression recognition in the wild has attracted…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Negar Heidari , Alexandros Iosifidis

We propose a framework for multimodal sentiment analysis and emotion recognition using convolutional neural network-based feature extraction from text and visual modalities. We obtain a performance improvement of 10% over the state of the…

Multimedia · Computer Science 2017-08-01 Erik Cambria , Devamanyu Hazarika , Soujanya Poria , Amir Hussain , R. B. V. Subramaanyam

This paper discusses a novel method for Facial Expression Recognition System which performs facial expression analysis in a near real time from a live web cam feed. Primary objectives were to get results in a near real time with light…

Computer Vision and Pattern Recognition · Computer Science 2012-06-18 Saumil Srivastava

Facial action unit recognition is an important task for facial analysis. Owing to the complex collection environment, facial action unit recognition in the wild is still challenging. The 3rd competition on affective behavior analysis…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shangfei Wang , Yanan Chang , Jiahe Wang

This paper addresses the question of emotion classification. The task consists in predicting emotion labels (taken among a set of possible labels) best describing the emotions contained in short video clips. Building on a standard framework…

Computer Vision and Pattern Recognition · Computer Science 2017-09-22 Valentin Vielzeuf , Stéphane Pateux , Frédéric Jurie

Emotion recognition in dynamic social contexts requires an understanding of the complex interaction between facial expressions and situational cues. This paper presents a salience-adjusted framework for context-aware emotion recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Bin Han , Jonathan Gratch

Automatic affect recognition is a challenging task due to the various modalities emotions can be expressed with. Applications can be found in many domains including multimedia retrieval and human computer interaction. In recent years, deep…

Computer Vision and Pattern Recognition · Computer Science 2018-02-14 Panagiotis Tzirakis , George Trigeorgis , Mihalis A. Nicolaou , Björn Schuller , Stefanos Zafeiriou

In this study, we present our methodology for two tasks: the Emotional Mimicry Intensity (EMI) Estimation Challenge and the Behavioural Ambivalence/Hesitancy (BAH) Recognition Challenge, both conducted as part of the 8th Workshop and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Tobias Hallmen , Robin-Nico Kampa , Fabian Deuser , Norbert Oswald , Elisabeth André

Research in automatic affect recognition has seldom addressed the issue of computational resource utilization. With the advent of ambient intelligence technology which employs a variety of low-power, resource-constrained devices, this issue…

Machine Learning · Computer Science 2020-06-01 Fasih Haider , Senja Pollak , Pierre Albert , Saturnino Luz

Due to its ability to accurately predict emotional state using multimodal features, audiovisual emotion recognition has recently gained more interest from researchers. This paper proposes two methods to predict emotional attributes from…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-22 Bagus Tris Atmaja , Masato Akagi

Current FER (Facial Expression Recognition) dataset is mostly labeled by emotion categories, such as happy, angry, sad, fear, disgust, surprise, and neutral which are limited in expressiveness. However, future affective computing requires…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Yi Huo , Yun Ge

Emotions play an important role in people's life. Understanding and recognising is not only important for interpersonal communication, but also has promising applications in Human-Computer Interaction, automobile safety and medical…

Machine Learning · Computer Science 2019-12-17 Xia Yicheng , Dimitrios Kollias

Emotion recognition has become a major problem in computer vision in recent years that made a lot of effort by researchers to overcome the difficulties in this task. In the field of affective computing, emotion recognition has a wide range…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Hoang Manh Hung , Hyung-Jeong Yang , Soo-Hyung Kim , Guee-Sang Lee

Many individuals especially those with autism spectrum disorder (ASD), alexithymia, or other neurodivergent profiles face challenges in recognizing, expressing, or interpreting emotions. To support more inclusive and personalized emotion…

Human-Computer Interaction · Computer Science 2025-08-14 Von Ralph Dane Marquez Herbuela , Yukie Nagai

Compared with facial emotion recognition on categorical model, the dimensional emotion recognition can describe numerous emotions of the real world more accurately. Most prior works of dimensional emotion estimation only considered…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Xiaohua Wang , Muzi Peng , Lijuan Pan , Min Hu , Chunhua Jin , Fuji Ren

Some of the most severe bottlenecks preventing widespread development of machine learning models for human behavior include a dearth of labeled training data and difficulty of acquiring high quality labels. Active learning is a paradigm for…

Facial Expression Recognition (FER) is a critical task within computer vision with diverse applications across various domains. Addressing the challenge of limited FER datasets, which hampers the generalization capability of expression…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Bach Nguyen-Xuan , Thien Nguyen-Hoang , Thanh-Huy Nguyen , Nhu Tai-Do