中文
相关论文

相关论文: Multi-modal Emotion Estimation for in-the-wild Vid…

200 篇论文

In this paper, we present our solution and experiment result for the Multi-Task Learning Challenge of the 7th Affective Behavior Analysis in-the-wild(ABAW7) Competition. This challenge consists of three tasks: action unit detection, facial…

计算机视觉与模式识别 · 计算机科学 2024-07-17 Xiaodong Li , Wenchao Du , Hongyu Yang

Multimodal affective computing analyzes user-generated social media content to predict emotional states. However, a critical gap remains in understanding how visual content shapes cognitive interpretations and elicits specific affective…

人工智能 · 计算机科学 2026-04-28 Nastaran Dab , Raziyeh Zall , Mohammadreza Kangavari

This article presents our unimodal privacy-safe and non-individual proposal for the audio-video group emotion recognition subtask at the Emotion Recognition in the Wild (EmotiW) Challenge 2020 1. This sub challenge aims to classify in the…

计算机视觉与模式识别 · 计算机科学 2020-09-16 Anastasia Petrova , Dominique Vaufreydaz , Philippe Dessus

The integration of information across multiple modalities and across time is a promising way to enhance the emotion recognition performance of affective systems. Much previous work has focused on instantaneous emotion recognition. The 2018…

图像与视频处理 · 电气工程与系统科学 2018-05-07 Didan Deng , Yuqian Zhou , Jimin Pi , Bertram E. Shi

This paper details the sixth Emotion Recognition in the Wild (EmotiW) challenge. EmotiW 2018 is a grand challenge in the ACM International Conference on Multimodal Interaction 2018, Colorado, USA. The challenge aims at providing a common…

计算机视觉与模式识别 · 计算机科学 2018-08-24 Abhinav Dhall , Amanjot Kaur , Roland Goecke , Tom Gedeon

Although media content is increasingly produced, distributed, and consumed in multiple combinations of modalities, how individual modalities contribute to the perceived emotion of a media item remains poorly understood. In this paper we…

计算机视觉与模式识别 · 计算机科学 2022-02-23 Phoebe Chua , Dimos Makris , Dorien Herremans , Gemma Roig , Kat Agres

Ambivalence/hesitancy recognition in unconstrained videos is a challenging problem due to the subtle, multimodal, and context-dependent nature of this behavioral state. In this paper, a multimodal approach for video-level…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Elena Ryumina , Alexandr Axyonov , Dmitry Sysoev , Timur Abdulkadirov , Kirill Almetov , Yulia Morozova , Dmitry Ryumin

This paper describes the fourth Affective Behavior Analysis in-the-wild (ABAW) Competition, held in conjunction with European Conference on Computer Vision (ECCV), 2022. The 4th ABAW Competition is a continuation of the Competitions held at…

计算机视觉与模式识别 · 计算机科学 2022-07-06 Dimitrios Kollias

The Affective Behavior Analysis in-the-wild (ABAW) 2020 Competition is the first Competition aiming at automatic analysis of the three main behavior tasks of valence-arousal estimation, basic expression recognition and action unit…

机器学习 · 计算机科学 2020-04-16 Dimitrios Kollias , Attila Schulc , Elnar Hajiyev , Stefanos Zafeiriou

The task of the emotion recognition in the wild (EmotiW) Challenge is to assign one of seven emotions to short video clips extracted from Hollywood style movies. The videos depict acted-out emotions under realistic conditions with a large…

In this paper, we present the results of the HSE-NN team in the 4th competition on Affective Behavior Analysis in-the-wild (ABAW). The novel multi-task EfficientNet model is trained for simultaneous recognition of facial expressions and…

计算机视觉与模式识别 · 计算机科学 2022-10-21 Andrey V. Savchenko

This paper describes the 7th Affective Behavior Analysis in-the-wild (ABAW) Competition, which is part of the respective Workshop held in conjunction with ECCV 2024. The 7th ABAW Competition addresses novel challenges in understanding human…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Dimitrios Kollias , Stefanos Zafeiriou , Irene Kotsia , Abhinav Dhall , Shreya Ghosh , Chunchang Shao , Guanyu Hu

Facial behavior analysis is a broad topic with various categories such as facial emotion recognition, age, and gender recognition. Many studies focus on individual tasks while the multi-task learning approach is still an open research issue…

计算机视觉与模式识别 · 计算机科学 2022-10-04 Dang-Khanh Nguyen , Sudarshan Pant , Ngoc-Huynh Ho , Guee-Sang Lee , Soo-Huyng Kim , Hyung-Jeong Yang

This paper addresses the expression (EXPR) recognition challenge in the 10th Affective Behavior Analysis in-the-Wild (ABAW) workshop and competition, which requires frame-level classification of eight facial emotional expressions from…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Jiajun Sun , Zhe Gao

Facial expression recognition is a challenging classification task that holds broad application prospects in the field of human-computer interaction. This paper aims to introduce the method we will adopt in the 8th Affective and Behavioral…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Jun Yu , Yang Zheng , Lei Wang , Yongqi Wang , Shengfan Xu

Continuous valence-arousal estimation in real-world environments is challenging due to inconsistent modality reliability and interaction-dependent variability in audio-visual signals. Existing approaches primarily focus on modeling temporal…

多媒体 · 计算机科学 2026-03-13 Yubeen Lee , Sangeun Lee , Junyeop Cha , Eunil Park

In this paper, we present the solution to the Emotional Mimicry Intensity (EMI) Estimation challenge, which is part of 6th Affective Behavior Analysis in-the-wild (ABAW) Competition.The EMI Estimation challenge task aims to evaluate the…

多媒体 · 计算机科学 2024-03-21 Jun Yu , Wangyuan Zhu , Jichao Zhu

In this paper we propose a fusion approach to continuous emotion recognition that combines visual and auditory modalities in their representation spaces to predict the arousal and valence levels. The proposed approach employs a pre-trained…

机器学习 · 计算机科学 2019-06-26 Juan D. S. Ortega , Patrick Cardinal , Alessandro L. Koerich

In the latest social networks, more and more people prefer to express their emotions in videos through text, speech, and rich facial expressions. Multimodal video emotion analysis techniques can help understand users' inner world…

计算机视觉与模式识别 · 计算机科学 2022-09-22 Qinglan Wei , Xuling Huang , Yuan Zhang

Facial Expression Recognition (FER) plays a crucial role in human affective analysis and has been widely applied in computer vision tasks such as human-computer interaction and psychological assessment. The 8th Affective Behavior Analysis…

计算机视觉与模式识别 · 计算机科学 2025-05-13 JunGyu Lee , Kunyoung Lee , Haesol Park , Ig-Jae Kim , Gi Pyo Nam