English
Related papers

Related papers: The 6th Affective Behavior Analysis in-the-wild (A…

200 papers

Compound Expression Recognition (CER) is vital for effective interpersonal interactions. Human emotional expressions are inherently complex due to the presence of compound expressions, requiring the consideration of both local and global…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Xuxiong Liu , Kang Shen , Jun Yao , Boyan Wang , Minrui Liu , Liuwei An , Zishun Cui , Weijie Feng , Xiao Sun

Recognising expressive behaviours in face videos is a long-standing challenge in Affective Computing. Despite significant advancements in recent years, it still remains a challenge to build a robust and reliable system for naturalistic and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Mani Kumar Tellamekala , Shashank Jaiswal , Thomas Smith , Timur Alamev , Gary McKeown , Anthony Brown , Michel Valstar

Facial Expression Recognition (FER) is a critical task within computer vision with diverse applications across various domains. Addressing the challenge of limited FER datasets, which hampers the generalization capability of expression…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Bach Nguyen-Xuan , Thien Nguyen-Hoang , Thanh-Huy Nguyen , Nhu Tai-Do

The technical report presents our emotion recognition pipeline for high-dimensional emotion task (A-VB High) in The ACII Affective Vocal Bursts (A-VB) 2022 Workshop \& Competition. Our proposed method contains three stages. Firstly, we…

Sound · Computer Science 2022-09-27 Dang-Linh Trinh , Minh-Cong Vo , Guee-Sang Lee

The task of predicting affective information in the wild such as seven basic emotions or action units from human faces has gradually become more interesting due to the accessibility and availability of massive annotated datasets. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Phan Tran Dac Thinh , Hoang Manh Hung , Hyung-Jeong Yang , Soo-Hyung Kim , Guee-Sang Lee

In affective neuroscience and emotion-aware AI, understanding how complex auditory stimuli drive emotion arousal dynamics remains unresolved. This study introduces a computational framework to model the brain's encoding of naturalistic…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-29 Guandong Pan , Yaqian Yang , Shi Chen , Xin Wang , Longzhao Liu , Hongwei Zheng , Shaoting Tang

This paper explores privacy-compliant group-level emotion recognition ''in-the-wild'' within the EmotiW Challenge 2023. Group-level emotion recognition can be useful in many fields including social robotics, conversational agents,…

Artificial Intelligence · Computer Science 2023-12-12 Anderson Augusma , Dominique Vaufreydaz , Frédérique Letué

As a common way of emotion signaling via non-linguistic vocalizations, vocal burst (VB) plays an important role in daily social interaction. Understanding and modeling human vocal bursts are indispensable for developing robust and general…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-15 Jinchao Li , Xixin Wu , Kaitao Song , Dongsheng Li , Xunying Liu , Helen Meng

Multimodal Sentiment Analysis (MuSe) 2021 is a challenge focusing on the tasks of sentiment and emotion, as well as physiological-emotion and emotion-based stress recognition through more comprehensively integrating the audio-visual,…

We used two multimodal models for continuous valence-arousal recognition using visual, audio, and linguistic information. The first model is the same as we used in ABAW2 and ABAW3, which employs the leader-follower attention. The second…

Multimedia · Computer Science 2023-04-18 Su Zhang , Ziyuan Zhao , Cuntai Guan

Among human affective behavior research, facial expression recognition research is improving in performance along with the development of deep learning. However, for improved performance, not only past images but also future images should…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Geesung Oh , Euiseok Jeong , Sejoon Lim

Emotion detection is an established NLP task of demonstrated utility for text understanding. However, basic emotion detection leaves out key information, namely, who is experiencing the emotion in question. For example, it may be the…

Computation and Language · Computer Science 2022-02-17 Samira Zad , Joshuan Jimenez , Mark A. Finlayson

The task of the emotion recognition in the wild (EmotiW) Challenge is to assign one of seven emotions to short video clips extracted from Hollywood style movies. The videos depict acted-out emotions under realistic conditions with a large…

We propose a cross-modal co-attention model for continuous emotion recognition using visual-audio-linguistic information. The model consists of four blocks. The visual, audio, and linguistic blocks are used to learn the spatial-temporal…

Multimedia · Computer Science 2022-03-31 Su Zhang , Ruyi An , Yi Ding , Cuntai Guan

Facial expressions play a fundamental role in human communication. Indeed, they typically reveal the real emotional status of people beyond the spoken language. Moreover, the comprehension of human affect based on visual patterns is a key…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Fabio Valerio Massoli , Donato Cafarelli , Giuseppe Amato , Fabrizio Falchi

Understanding emotions in natural language is inherently a multi-dimensional reasoning problem, where multiple affective signals interact through context, interpersonal relations, and situational cues. However, most existing emotion…

Computation and Language · Computer Science 2026-04-02 Hemanth Kotaprolu , Kishan Maharaj , Raey Zhao , Abhijit Mishra , Pushpak Bhattacharyya

Detecting emotions in languages is important to accomplish a complete interaction between humans and machines. This paper describes our contribution to the WASSA 2022 shared task which handles this crucial task of emotion detection. We have…

Computation and Language · Computer Science 2022-04-12 Aditya Kane , Shantanu Patankar , Sahil Khose , Neeraja Kirtane

The increasing integration of machine learning algorithms in daily life underscores the critical need for fairness and equity in their deployment. As these technologies play a pivotal role in decision-making, addressing biases across…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Guanyu Hu , Eleni Papadopoulou , Dimitrios Kollias , Paraskevi Tzouveli , Jie Wei , Xinyu Yang

The Multimodal Sentiment Analysis Challenge (MuSe) 2024 addresses two contemporary multimodal affect and sentiment analysis problems: In the Social Perception Sub-Challenge (MuSe-Perception), participants will predict 16 different social…

In the context of HCI, building an automatic system to recognize affect of human facial expression in real-world condition is very crucial to make machine interact naturallisticaly with a man. However, existing facial emotion databases…

Machine Learning · Computer Science 2019-12-17 Mengyao Liu , Dimitrios Kollias