English
Related papers

Related papers: Feature-Based Dual Visual Feature Extraction Model…

200 papers

The audio-video based emotion recognition aims to classify a given video into basic emotions. In this paper, we describe our approaches in EmotiW 2019, which mainly explores emotion features and feature fusion strategies for audio and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Hengshun Zhou , Debin Meng , Yuanyuan Zhang , Xiaojiang Peng , Jun Du , Kai Wang , Yu Qiao

This article presents our results for the sixth Affective Behavior Analysis in-the-wild (ABAW) competition. To improve the trustworthiness of facial analysis, we study the possibility of using pre-trained deep models that extract reliable…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Andrey V. Savchenko

With the advancement of artificial intelligence and computer vision technologies, multimodal emotion recognition has become a prominent research topic. However, existing methods face challenges such as heterogeneous data fusion and the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Wei Dai , Dequan Zheng , Feng Yu , Yanrong Zhang , Yaohui Hou

The task of the emotion recognition in the wild (EmotiW) Challenge is to assign one of seven emotions to short video clips extracted from Hollywood style movies. The videos depict acted-out emotions under realistic conditions with a large…

Facial expression recognition is a challenging classification task that holds broad application prospects in the field of human-computer interaction. This paper aims to introduce the method we will adopt in the 8th Affective and Behavioral…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Jun Yu , Yang Zheng , Lei Wang , Yongqi Wang , Shengfan Xu

Multimodal emotion analysis performed better in emotion recognition depending on more comprehensive emotional clues and multimodal emotion dataset. In this paper, we developed a large multimodal emotion dataset, named "HED" dataset, to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Zhongyu Fang , Aoyun He , Qihui Yu , Baopeng Gao , Weiping Ding , Tong Zhang , Lei Ma

This paper presents a neural network based method Multi-Task Affect Net(MTANet) submitted to the Affective Behavior Analysis in-the-Wild Challenge in FG2020. This method is a multi-task network and based on SE-ResNet modules. By utilizing…

Computer Vision and Pattern Recognition · Computer Science 2020-02-06 Zihang Zhang , Jianping Gu

In this paper, we present the results of the HSE-NN team in the 4th competition on Affective Behavior Analysis in-the-wild (ABAW). The novel multi-task EfficientNet model is trained for simultaneous recognition of facial expressions and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Andrey V. Savchenko

Emotion Recognition (ER) is the process of analyzing and identifying human emotions from sensing data. Currently, the field heavily relies on facial expression recognition (FER) because visual channel conveys rich emotional cues. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Kejun Liu , Yuanyuan Liu , Lin Wei , Chang Tang , Yibing Zhan , Zijing Chen , Zhe Chen

This paper presents our method for the estimation of valence-arousal (VA) in the 8th Affective Behavior Analysis in-the-Wild (ABAW) competition. Our approach integrates visual and audio information through a multimodal framework. The visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Jun Yu , Yongqi Wang , Lei Wang , Yang Zheng , Shengfan Xu

The Affective Behavior Analysis in-the-wild (ABAW) 2022 Competition gives Affective Computing a large promotion. In this paper, we present our method of AU challenge in this Competition. We use improved IResnet100 as backbone. Then we train…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Wenqiang Jiang , Yannan Wu , Fengsheng Qiao , Liyu Meng , Yuanyuan Deng , Chuanhe Liu

Analyzing human affect is vital for human-computer interaction systems. Most methods are developed in restricted scenarios which are not practical for in-the-wild settings. The Affective Behavior Analysis in-the-wild (ABAW) 2021 Contest…

Computer Vision and Pattern Recognition · Computer Science 2021-07-16 Yue Jin , Tianqing Zheng , Chao Gao , Guoqiang Xu

Facial Expression Recognition is a vital research topic in most fields ranging from artificial intelligence and gaming to Human-Computer Interaction (HCI) and Psychology. This paper proposes a hybrid model for Facial Expression recognition,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Ozioma Collins Oguine , Kanyifeechukwu Jane Oguine , Hashim Ibrahim Bisallah , Daniel Ofuani

Facial expressions play a fundamental role in human communication. Indeed, they typically reveal the real emotional status of people beyond the spoken language. Moreover, the comprehension of human affect based on visual patterns is a key…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Fabio Valerio Massoli , Donato Cafarelli , Giuseppe Amato , Fabrizio Falchi

Automatic emotion recognition is one of the central concerns of the Human-Computer Interaction field as it can bridge the gap between humans and machines. Current works train deep learning models on low-level data representations to solve…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-22 Mariana Rodrigues Makiuchi , Kuniaki Uto , Koichi Shinoda

Affective behaviour analysis has aroused researchers' attention due to its broad applications. However, it is labor exhaustive to obtain accurate annotations for massive face images. Thus, we propose to utilize the prior facial information…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Yifan Li , Haomiao Sun , Zhaori Liu , Hu Han

Automatic emotion recognition has recently gained significant attention due to the growing popularity of deep learning algorithms. One of the primary challenges in emotion recognition is effectively utilizing the various cues (modalities)…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Mijanur Palash , Bharat Bhargava

In video-based emotion recognition (ER), it is important to effectively leverage the complementary relationship among audio (A) and visual (V) modalities, while retaining the intra-modal characteristics of individual modalities. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 R Gnana Praveen , Eric Granger , Patrick Cardinal

Multimodal fusion is a significant method for most multimodal tasks. With the recent surge in the number of large pre-trained models, combining both multimodal fusion methods and pre-trained model features can achieve outstanding…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Zhuofan Wen , Fengyu Zhang , Siyuan Zhang , Haiyang Sun , Mingyu Xu , Licai Sun , Zheng Lian , Bin Liu , Jianhua Tao

This paper reports the analysis of audio and visual features in predicting the continuous emotion dimensions under the seventh Audio/Visual Emotion Challenge (AVEC 2017), which was done as part of a B.Tech. 2nd year internship project. For…

Computer Vision and Pattern Recognition · Computer Science 2017-10-25 Narotam Singh , Nittin Singh , Abhinav Dhall