English
Related papers

Related papers: Affective Behaviour Analysis via Progressive Learn…

200 papers

Emotional Reaction Intensity(ERI) estimation is an important task in multimodal scenarios, and has fundamental applications in medicine, safe driving and other fields. In this paper, we propose a solution to the ERI challenge of the fifth…

Artificial Intelligence · Computer Science 2023-03-17 Jun Yu , Jichao Zhu , Wangyuan Zhu , Zhongpeng Cai , Guochen Xie , Renda Li , Gongpeng Zhao

Emotional expressions are the behaviors that communicate our emotional state or attitude to others. They are expressed through verbal and non-verbal communication. Complex human behavior can be understood by studying physical features from…

Computer Vision and Pattern Recognition · Computer Science 2021-09-15 Liam Schoneveld , Alice Othmani , Hazem Abdelkawy

Analyzing individual emotions during group conversation is crucial in developing intelligent agents capable of natural human-machine interaction. While reliable emotion recognition techniques depend on different modalities (text, audio,…

A multi-modal emotion recognition method was established by combining two-channel convolutional neural network with ring network. This method can extract emotional information effectively and improve learning efficiency. The words were…

Artificial Intelligence · Computer Science 2023-11-21 Jiazhen Wang

Related tasks often have inter-dependence on each other and perform better when solved in a joint framework. In this paper, we present a deep multi-task learning framework that jointly performs sentiment and emotion analysis both. The…

Computation and Language · Computer Science 2019-05-16 Md Shad Akhtar , Dushyant Singh Chauhan , Deepanway Ghosal , Soujanya Poria , Asif Ekbal , Pushpak Bhattacharyya

In this paper, we describe our algorithmic approach, which was used for submissions in the fifth Emotion Recognition in the Wild (EmotiW 2017) group-level emotion recognition sub-challenge. We extracted feature vectors of detected faces…

Computer Vision and Pattern Recognition · Computer Science 2017-11-07 Alexandr G. Rassadin , Alexey S. Gruzdev , Andrey V. Savchenko

In this paper we introduce AFFDEX 2.0 - a toolkit for analyzing facial expressions in the wild, that is, it is intended for users aiming to; a) estimate the 3D head pose, b) detect facial Action Units (AUs), c) recognize basic emotions and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Mina Bishay , Kenneth Preston , Matthew Strafuss , Graham Page , Jay Turcot , Mohammad Mavadati

Task-specific pre-training is essential when task representations diverge from generic pre-training features. Existing task-general pre-training EEG models struggle with complex tasks like emotion recognition due to mismatches between…

Machine Learning · Computer Science 2025-10-28 Qingzhu Zhang , Jiani Zhong , Zongsheng Li , Xinke Shen , Quanying Liu

We propose to use a ResNet-18 architecture that was pre-trained on the FER+ dataset for tackling the problem of affective behavior analysis in-the-wild (ABAW) for classification of the seven basic expressions, namely, neutral, anger,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Satnam Singh , Doris Schicker

Human behavior expression and experience are inherently multi-modal, and characterized by vast individual and contextual heterogeneity. To achieve meaningful human-computer and human-robot interactions, multi-modal models of the users…

Machine Learning · Computer Science 2019-06-10 Ognjen Rudovic , Meiru Zhang , Bjorn Schuller , Rosalind W. Picard

Facial Action Units (AUs) detection is a cornerstone of objective facial expression analysis and a critical focus in affective computing. Despite its importance, AU detection faces significant challenges, such as the high cost of AU…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Bohao Xing , Kaishen Yuan , Zitong Yu , Xin Liu , Heikki Kälviäinen

Automated emotion recognition in the wild from facial images remains a challenging problem. Although recent advances in Deep Learning have supposed a significant breakthrough in this topic, strong changes in pose, orientation and point of…

Computer Vision and Pattern Recognition · Computer Science 2018-02-20 Gerard Pons , David Masip

The audio-video based emotion recognition aims to classify a given video into basic emotions. In this paper, we describe our approaches in EmotiW 2019, which mainly explores emotion features and feature fusion strategies for audio and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Hengshun Zhou , Debin Meng , Yuanyuan Zhang , Xiaojiang Peng , Jun Du , Kai Wang , Yu Qiao

Learning from synthetic images plays an important role in facial expression recognition task due to the difficulties of labeling the real images, and it is challenging because of the gap between the synthetic images and real images. The…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Xiangyu Miao , Jiahe Wang , Yanan Chang , Yi Wu , Shangfei Wang

LLM-based multimodal emotion recognition relies on static parametric memory and often hallucinates when interpreting nuanced affective states. In this paper, given that single-round retrieval-augmented generation is highly susceptible to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Zeheng Wang , Zitong Yu , Yijie Zhu , Bo Zhao , Haochen Liang , Taorui Wang , Wei Xia , Jiayu Zhang , Zhishu Liu , Hui Ma , Fei Ma , Qi Tian

Facial Expression Recognition (FER) plays a crucial role in computer vision and finds extensive applications across various fields. This paper aims to present our approach for the upcoming 6th Affective Behavior Analysis in-the-Wild (ABAW)…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Jun Yu , Zhihong Wei , Zhongpeng Cai , Gongpeng Zhao , Zerui Zhang , Yongqi Wang , Guochen Xie , Jichao Zhu , Wangyuan Zhu

In the field of affective computing, traditional methods for generating emotions predominantly rely on deep learning techniques and large-scale emotion datasets. However, deep learning techniques are often complex and difficult to…

Human-Computer Interaction · Computer Science 2025-03-24 Haidong Wang , Qia Shan , JianHua Zhang , PengFei Xiao , Ao Liu

Recognising expressive behaviours in face videos is a long-standing challenge in Affective Computing. Despite significant advancements in recent years, it still remains a challenge to build a robust and reliable system for naturalistic and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Mani Kumar Tellamekala , Shashank Jaiswal , Thomas Smith , Timur Alamev , Gary McKeown , Anthony Brown , Michel Valstar

We participated in the 10th ABAW Challenge, focusing on the Emotional Mimicry Intensity (EMI) Estimation track on the Hume-Vidmimic2 dataset. This task aims to predict six continuous emotion dimensions: Admiration, Amusement, Determination,…

Artificial Intelligence · Computer Science 2026-03-17 Jiawen Huang , Chenxi Huang , Zhuofan Wen , Hailiang Yao , Shun Chen , Longjiang Yang , Cong Yu , Fengyu Zhang , Ran Liu , Bin Liu

As artificial intelligence (AI) systems become increasingly embedded in our daily life, the ability to recognize and adapt to human emotions is essential for effective human-computer interaction. Facial expression recognition (FER) provides…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Thibault Geoffroy , Myriam Maumy , Lionel Prevost