English
Related papers

Related papers: Multi-modal Facial Affective Analysis based on Mas…

200 papers

The in-the-wild affective behavior analysis has been an important study. In this paper, we submit our solutions for the 5th Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW), which includes V-A Estimation, Facial…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Peng Zou , Rui Wang , Kehua Wen , Yasi Peng , Xiao Sun

Human affective behavior analysis plays a vital role in human-computer interaction (HCI) systems. In this paper, we introduce our submission to the CVPR 2023 Competition on Affective Behavior Analysis in-the-wild (ABAW). We propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Jun Yu , Renda Li , Zhongpeng Cai , Gongpeng Zhao , Guochen Xie , Jichao Zhu , Wangyuan Zhu

Facial Action Units (AUs) represent a set of facial muscular activities and various combinations of AUs can represent a wide range of emotions. AU recognition is often used in many applications, including marketing, healthcare, education,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Junya Saito , Xiaoyu Mi , Akiyoshi Uchida , Sachihiro Youoku , Takahisa Yamamoto , Kentaro Murase , Osafumi Nakayama

Facial expression in-the-wild is essential for various interactive computing domains. In this paper, we proposed an extended version of DAN model to address the VA estimation and facial expression challenges introduced in ABAW 2022. Our…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Jae-Yeop Jeong , Yeong-Gi Hong , Daun Kim , Yuchul Jung , Jin-Woo Jeong

Facial Action Coding System is an important approach of facial expression analysis.This paper describes our submission to the third Affective Behavior Analysis (ABAW) 2022 competition. We proposed a transfomer based model to detect facial…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Lingfeng Wang , Shisen Wang , Jin Qi

In this work, we introduce our submission to the 2nd Affective Behavior Analysis in-the-wild (ABAW) 2021 competition. We train a unified deep learning model on multi-databases to perform two tasks: seven basic facial expressions prediction…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Manh Tu Vu , Marie Beurton-Aimar

In this work we tackle the task of video-based audio-visual emotion recognition, within the premises of the 2nd Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW2). Poor illumination conditions, head/body orientation…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Panagiotis Antoniadis , Ioannis Pikoulis , Panagiotis P. Filntisis , Petros Maragos

Emotion recognition has the potential to play a pivotal role in enhancing human-computer interaction by enabling systems to accurately interpret and respond to human affect. Yet, capturing emotions in face-to-face contexts remains…

Throughout the past decade, many studies have classified human emotions using only a single sensing modality such as face video, electroencephalogram (EEG), electrocardiogram (ECG), galvanic skin response (GSR), etc. The results of these…

Human-Computer Interaction · Computer Science 2018-06-22 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski

Facial Expression Recognition(FER) is one of the most important topic in Human-Computer interactions(HCI). In this work we report details and experimental results about a facial expression recognition method based on state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2021-01-25 Donato Cafarelli , Fabio Valerio Massoli , Fabrizio Falchi , Claudio Gennaro , Giuseppe Amato

In this paper, we present our contribution to ABAW facial expression challenge. We report the proposed system and the official challenge results adhering to the challenge protocol. Using end-to-end deep learning and benefiting from transfer…

Machine Learning · Computer Science 2020-11-03 Denis Dresvyanskiy , Elena Ryumina , Heysem Kaya , Maxim Markitantov , Alexey Karpov , Wolfgang Minker

Facial expression in-the-wild is essential for various interactive computing domains. Especially, "Emotional Reaction Intensity" (ERI) is an important topic in the facial expression recognition task. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 JiYeon Oh , Daun Kim , Jae-Yeop Jeong , Yeong-Gi Hong , Jin-Woo Jeong

The importance of automated Facial Emotion Recognition (FER) grows the more common human-machine interactions become, which will only continue to increase dramatically with time. A common method to describe human sentiment or feeling is the…

Computer Vision and Pattern Recognition · Computer Science 2019-11-14 Carl Norman

Facial expression recognition(FER) in the wild is crucial for building reliable human-computer interactive systems. However, current FER systems fail to perform well under various natural and un-controlled conditions. This report presents…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Darshan Gera , S Balasubramanian

Emotions play an essential role in human communication. Developing computer vision models for automatic recognition of emotion expression can aid in a variety of domains, including robotics, digital behavioral healthcare, and media…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Yang Qian , Ali Kargarandehkordi , Onur Cezmi Mutlu , Saimourya Surabhi , Mohammadmahdi Honarmand , Dennis Paul Wall , Peter Washington

Compound Expression Recognition (CER), a subfield of affective computing, aims to detect complex emotional states formed by combinations of basic emotions. In this work, we present a novel zero-shot multimodal approach for CER that combines…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Elena Ryumina , Maxim Markitantov , Alexandr Axyonov , Dmitry Ryumin , Mikhail Dolgushin , Alexey Karpov

Facial Expression Recognition (FER) plays a crucial role in human affective analysis and has been widely applied in computer vision tasks such as human-computer interaction and psychological assessment. The 8th Affective Behavior Analysis…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 JunGyu Lee , Kunyoung Lee , Haesol Park , Ig-Jae Kim , Gi Pyo Nam

This paper presents our Facial Action Units (AUs) detection submission to the fifth Affective Behavior Analysis in-the-wild Competition (ABAW). Our approach consists of three main modules: (i) a pre-trained facial representation encoder…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Zihan Wang , Siyang Song , Cheng Luo , Yuzhi Zhou , Shiling Wu , Weicheng Xie , Linlin Shen

This report describes a multi-modal multi-task ($M^3$T) approach underlying our submission to the valence-arousal estimation track of the Affective Behavior Analysis in-the-wild (ABAW) Challenge, held in conjunction with the IEEE…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Yuan-Hang Zhang , Rulin Huang , Jiabei Zeng , Shiguang Shan , Xilin Chen

Facial affect analysis remains a challenging task with its setting transitioned from lab-controlled to in-the-wild situations. In this paper, we present novel frameworks to handle the two challenges in the 4th Affective Behavior Analysis…

Machine Learning · Computer Science 2022-07-21 Siyang Li , Yifan Xu , Huanyu Wu , Dongrui Wu , Yingjie Yin , Jiajiong Cao , Jingting Ding