English
Related papers

Related papers: From Affect to Complex Behavior: Advancing Multimo…

200 papers

Facial valence/arousal, expression and action unit are related tasks in facial affective analysis. However, the tasks only have limited performance in the wild due to the various collected conditions. The 4th competition on affective…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Yanan Chang , Yi Wu , Xiangyu Miao , Jiahe Wang , Shangfei Wang

In this paper, we present our advanced solutions to the two sub-challenges of Affective Behavior Analysis in the wild (ABAW) 2023: the Emotional Reaction Intensity (ERI) Estimation Challenge and Expression (Expr) Classification Challenge.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Jia Li , Yin Chen , Xuesong Zhang , Jiantao Nie , Ziqiang Li , Yangchen Yu , Yan Zhang , Richang Hong , Meng Wang

This article presents our results for the 10th Affective Behavior Analysis in-the-Wild (ABAW) competition. For frame-wise facial emotion understanding tasks (frame-wise facial expression recognition, valence-arousal estimation, action unit…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Andrey V. Savchenko , Kseniia Tsypliakova

As emotions play a central role in human communication, automatic emotion recognition has attracted increasing attention in the last two decades. While multimodal systems enjoy high performances on lab-controlled data, they are still far…

Machine Learning · Computer Science 2024-03-20 Denis Dresvyanskiy , Maxim Markitantov , Jiawei Yu , Peitong Li , Heysem Kaya , Alexey Karpov

Facial affect analysis remains a challenging task with its setting transitioned from lab-controlled to in-the-wild situations. In this paper, we present novel frameworks to handle the two challenges in the 4th Affective Behavior Analysis…

Machine Learning · Computer Science 2022-07-21 Siyang Li , Yifan Xu , Huanyu Wu , Dongrui Wu , Yingjie Yin , Jiajiong Cao , Jingting Ding

Multimodal affective computing has gained increasing attention due to its broad applications in understanding human behavior and intentions, particularly in text-centric multimodal scenarios. Existing research spans diverse tasks,…

Computation and Language · Computer Science 2026-04-08 Guimin Hu , Weimin Lyu , Chang Sun , Zhihong Zhu , Lin Gui , Ruichu Cai , Erik Cambria , Hasti Seifi

In this paper, we present our submission to 3rd Affective Behavior Analysis in-the-wild (ABAW) challenge. Learningcomplex interactions among multimodal sequences is critical to recognise dimensional affect from in-the-wild audiovisual data.…

Continuous emotion recognition in terms of valence and arousal under in-the-wild (ITW) conditions remains a challenging problem due to large variations in appearance, head pose, illumination, occlusions, and subject-specific patterns of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Elena Ryumina , Maxim Markitantov , Alexandr Axyonov , Dmitry Ryumin , Mikhail Dolgushin , Denis Dresvyanskiy , Alexey Karpov

This article presents our results for the eighth Affective Behavior Analysis in-the-Wild (ABAW) competition. We combine facial emotional descriptors extracted by pre-trained models, namely, our EmotiEffLib library, with acoustic features…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Andrey V. Savchenko

The fifth Affective Behavior Analysis in-the-wild (ABAW) competition has multiple challenges such as Valence-Arousal Estimation Challenge, Expression Classification Challenge, Action Unit Detection Challenge, Emotional Reaction Intensity…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Darshan Gera , Badveeti Naveen Siva Kumar , Bobbili Veerendra Raj Kumar , S Balasubramanian

The in-the-wild affective behavior analysis has been an important study. In this paper, we submit our solutions for the 5th Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW), which includes V-A Estimation, Facial…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Peng Zou , Rui Wang , Kehua Wen , Yasi Peng , Xiao Sun

This paper details the sixth Emotion Recognition in the Wild (EmotiW) challenge. EmotiW 2018 is a grand challenge in the ACM International Conference on Multimodal Interaction 2018, Colorado, USA. The challenge aims at providing a common…

Computer Vision and Pattern Recognition · Computer Science 2018-08-24 Abhinav Dhall , Amanjot Kaur , Roland Goecke , Tom Gedeon

With the advent of deep learning, expression recognition has made significant advancements. However, due to the limited availability of annotated compound expression datasets and the subtle variations of compound expressions, Compound…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Chen Liu , Feng Qiu , Wei Zhang , Lincheng Li , Dadong Wang , Xin Yu

In this work, we introduce our submission to the 2nd Affective Behavior Analysis in-the-wild (ABAW) 2021 competition. We train a unified deep learning model on multi-databases to perform two tasks: seven basic facial expressions prediction…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Manh Tu Vu , Marie Beurton-Aimar

Human affective recognition is an important factor in human-computer interaction. However, the method development with in-the-wild data is not yet accurate enough for practical usage. In this paper, we introduce the affective recognition…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Sachihiro Youoku , Yuushi Toyoda , Takahisa Yamamoto , Junya Saito , Ryosuke Kawamura , Xiaoyu Mi , Kentaro Murase

Affective behavior analysis plays an important role in human-computer interaction, customer marketing, health monitoring. ABAW Challenge and Aff-Wild2 dataset raise the new challenge for classifying basic emotions and regression…

Computer Vision and Pattern Recognition · Computer Science 2020-03-06 Nhu-Tai Do , Tram-Tran Nguyen-Quynh , Soo-Hyung Kim

Facial Action Coding System is an approach for modeling the complexity of human emotional expression. Automatic action unit (AU) detection is a crucial research area in human-computer interaction. This paper describes our submission to the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Duy Le Hoai , Eunchae Lim , Eunbin Choi , Sieun Kim , Sudarshan Pant , Guee-Sang Lee , Soo-Huyng Kim , Hyung-Jeong Yang

In this paper, we present our solution and experiment result for the Multi-Task Learning Challenge of the 7th Affective Behavior Analysis in-the-wild(ABAW7) Competition. This challenge consists of three tasks: action unit detection, facial…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Xiaodong Li , Wenchao Du , Hongyu Yang

Human affective recognition is an important factor in human-computer interaction. However, the method development with in-the-wild data is not yet accurate enough for practical usage. In this paper, we introduce the affective recognition…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Sachihiro Youoku , Takahisa Yamamoto , Junya Saito , Akiyoshi Uchida , Xiaoyu Mi , Ziqiang Shi , Liu Liu , Zhongling Liu , Osafumi Nakayama , Kentaro Murase

Continuous affect prediction in the wild is a very interesting problem and is challenging as continuous prediction involves heavy computation. This paper presents the methodologies and techniques used in our contribution to predict…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-02 Sowmya Rasipuram , Junaid Hamid Bhat , Anutosh Maitra