English
Related papers

Related papers: Action Unit Detection with Joint Adaptive Attentio…

200 papers

The detection of micro-expression Action Units (AUs) is a formidable challenge in affective computing, pivotal for decoding subtle, involuntary human emotions. While Large Language Models (LLMs) demonstrate profound reasoning abilities,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Zhishu Liu , Kaishen Yuan , Bo Zhao , Yong Xu , Zitong Yu

Facial attribute analysis in the real world scenario is very challenging mainly because of complex face variations. Existing works of analyzing face attributes are mostly based on the cropped and aligned face images. However, this result in…

Computer Vision and Pattern Recognition · Computer Science 2017-07-28 Keke He , Yanwei Fu , Xiangyang Xue

Recent progress on action recognition has mainly focused on RGB and optical flow features. In this paper, we approach the problem of joint-based action recognition. Unlike other modalities, constellation of joints and their motion generate…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Anshul Shah , Shlok Mishra , Ankan Bansal , Jun-Cheng Chen , Rama Chellappa , Abhinav Shrivastava

Facial action unit (FAU) intensities are popular descriptors for the analysis of facial behavior. However, FAUs are sparsely represented when only a few are activated at a time. In this study, we explore the possibility of representing the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Minh Tran , Ellen Bradley , Michelle Matvey , Joshua Woolley , Mohammad Soleymani

In this paper, we address the problem of joint detection of objects like dog and its semantic parts like face, leg, etc. Our model is created on top of two Faster-RCNN models that share their features to perform a novel Attention-based…

Computer Vision and Pattern Recognition · Computer Science 2020-07-08 Keval Morabia , Jatin Arora , Tara Vijaykumar

Facial expression in-the-wild is essential for various interactive computing domains. In this paper, we proposed an extended version of DAN model to address the VA estimation and facial expression challenges introduced in ABAW 2022. Our…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Jae-Yeop Jeong , Yeong-Gi Hong , Daun Kim , Yuchul Jung , Jin-Woo Jeong

People naturally understand emotions, thus permitting a machine to do the same could open new paths for human-computer interaction. Facial expressions can be very useful for emotion recognition techniques, as these are the biggest…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Pietro B. S. Masur , Willams Costa , Lucas S. Figueredo , Veronica Teichrieb

In this paper, we propose a deep learning based approach for facial action unit detection by enhancing and cropping the regions of interest. The approach is implemented by adding two novel nets (layers): the enhancing layers and the…

Computer Vision and Pattern Recognition · Computer Science 2017-02-10 Wei Li , Farnaz Abtahi , Zhigang Zhu , Lijun Yin

The quantified measurement of facial expressiveness is crucial to analyze human affective behavior at scale. Unfortunately, methods for expressiveness quantification at the video frame-level are largely unexplored, unlike the study of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-08 Md Taufeeq Uddin , Shaun Canavan

The paper describes our proposed methodology for the seven basic expression classification track of Affective Behavior Analysis in-the-wild (ABAW) Competition 2021. In this task, facial expression recognition (FER) methods aim to classify…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Shuyi Mao , Xinqi Fan , Xiaojiang Peng

Facial expression recognition (FER) has emerged as a promising approach to the development of emotion-aware intelligent agents and systems. However, key challenges remain in utilizing FER in real-world contexts, including ensuring user…

Human-Computer Interaction · Computer Science 2025-07-31 Sanjeev Nahulanthran , Leimin Tian , Dana Kulić , Mor Vered

The field of Automatic Facial Expression Analysis has grown rapidly in recent years. However, despite progress in new approaches as well as benchmarking efforts, most evaluations still focus on either posed expressions, near-frontal…

Computer Vision and Pattern Recognition · Computer Science 2017-02-15 Michel F. Valstar , Enrique Sánchez-Lozano , Jeffrey F. Cohn , László A. Jeni , Jeffrey M. Girard , Zheng Zhang , Lijun Yin , Maja Pantic

Active Appearance Model (AAM) is a commonly used method for facial image analysis with applications in face identification and facial expression recognition. This paper proposes a new approach based on image alignment for AAM fitting called…

Computer Vision and Pattern Recognition · Computer Science 2015-11-23 Ali Mollahosseini , Mohammad H. Mahoor

In this paper, we describe the results of the HSEmotion team in two tasks of the seventh Affective Behavior Analysis in-the-wild (ABAW) competition, namely, multi-task learning for simultaneous prediction of facial expression, valence,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Andrey V. Savchenko

Leveraging the synergy of both audio data and visual data is essential for understanding human emotions and behaviors, especially in in-the-wild setting. Traditional methods for integrating such multimodal information often stumble, leading…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Jun Yu , Zerui Zhang , Zhihong Wei , Gongpeng Zhao , Zhongpeng Cai , Yongqi Wang , Guochen Xie , Jichao Zhu , Wangyuan Zhu

Balancing methods for single-label data cannot be applied to multi-label problems as they would also resample the samples with high occurrences. We propose to reformulate this problem as an optimization problem in order to balance…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Ines Rieger , Jaspar Pahl , Dominik Seuss

Automatic affective recognition has been an important research topic in human computer interaction (HCI) area. With recent development of deep learning techniques and large scale in-the-wild annotated datasets, the facial emotion analysis…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Wei Zhang , Zunhu Guo , Keyu Chen , Lincheng Li , Zhimeng Zhang , Yu Ding

The Affective Behavior Analysis in-the-wild (ABAW) 2020 Competition is the first Competition aiming at automatic analysis of the three main behavior tasks of valence-arousal estimation, basic expression recognition and action unit…

Machine Learning · Computer Science 2020-04-16 Dimitrios Kollias , Attila Schulc , Elnar Hajiyev , Stefanos Zafeiriou

This paper presents our submission to the Expression Classification Challenge of the fifth Affective Behavior Analysis in-the-wild (ABAW) Competition. In our method, multimodal feature combinations extracted by several different pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Chuanhe Liu , Xinjie Zhang , Xiaolong Liu , Tenggan Zhang , Liyu Meng , Yuchen Liu , Yuanyuan Deng , Wenqiang Jiang

Studies have proven that domain bias and label bias exist in different Facial Expression Recognition (FER) datasets, making it hard to improve the performance of a specific dataset by adding other datasets. For the FER bias issue, recent…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Shuyi Mao , Xinpeng Li , Qingyang Wu , Xiaojiang Peng