English
Related papers

Related papers: Multi-Label Class Balancing Algorithm for Action U…

200 papers

Precisely naming the action depicted in a video can be a challenging and oftentimes ambiguous task. In contrast to object instances represented as nouns (e.g. dog, cat, chair, etc.), in the case of actions, human annotators typically lack a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Kiyoon Kim , Davide Moltisanti , Oisin Mac Aodha , Laura Sevilla-Lara

This paper presents our submission to the Expression Classification Challenge of the fifth Affective Behavior Analysis in-the-wild (ABAW) Competition. In our method, multimodal feature combinations extracted by several different pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Chuanhe Liu , Xinjie Zhang , Xiaolong Liu , Tenggan Zhang , Liyu Meng , Yuchen Liu , Yuanyuan Deng , Wenqiang Jiang

In this report, we present our solution for the Action Unit (AU) Detection Challenge, in 8th Competition on Affective Behavior Analysis in-the-wild. In order to achieve robust and accurate classification of facial action unit in the wild…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Jun Yu , Yunxiang Zhang , Xilong Lu , Yang Zheng , Yongqi Wang , Lingsi Zhu

This paper describes the 7th Affective Behavior Analysis in-the-wild (ABAW) Competition, which is part of the respective Workshop held in conjunction with ECCV 2024. The 7th ABAW Competition addresses novel challenges in understanding human…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Dimitrios Kollias , Stefanos Zafeiriou , Irene Kotsia , Abhinav Dhall , Shreya Ghosh , Chunchang Shao , Guanyu Hu

Deep models for facial expression recognition achieve high performance by training on large-scale labeled data. However, publicly available datasets contain uncertain facial expressions caused by ambiguous annotations or confusing emotions,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Yang Liu , Xingming Zhang , Janne Kauttonen , Guoying Zhao

In this paper, we describe the results of the HSEmotion team in two tasks of the seventh Affective Behavior Analysis in-the-wild (ABAW) competition, namely, multi-task learning for simultaneous prediction of facial expression, valence,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Andrey V. Savchenko

Most recent work focused on affect from facial expressions, and not as much on body. This work focuses on body affect analysis. Affect does not occur in isolation. Humans usually couple affect with an action in natural interactions; for…

Computer Vision and Pattern Recognition · Computer Science 2016-03-22 Timothy J. Shields , Mohamed R. Amer , Max Ehrlich , Amir Tamrakar

Facial Action Unit (AU) detection is a crucial task in affective computing and social robotics as it helps to identify emotions expressed through facial expressions. Anatomically, there are innumerable correlations between AUs, which…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Xin Liu , Kaishen Yuan , Xuesong Niu , Jingang Shi , Zitong Yu , Huanjing Yue , Jingyu Yang

In this article, the results of our team for the fifth Affective Behavior Analysis in-the-wild (ABAW) competition are presented. The usage of the pre-trained convolutional networks from the EmotiEffNet family for frame-level feature…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Andrey V. Savchenko

Face based affective computing consists in detecting emotions from face images. It is useful to unlock better automatic comprehension of human behaviours and could pave the way toward improved human-machines interactions. However it comes…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Gauthier Tallec , Jules Bonnard , Arnaud Dapogny , Kévin Bailly

Facial Action Coding System consists of 44 action units (AUs) and more than 7000 combinations. Hidden Markov models (HMMs) classifier has been used successfully to recognize facial action units (AUs) and expressions due to its ability to…

Computer Vision and Pattern Recognition · Computer Science 2010-04-06 Mahmoud Khademi , Mohammad T. Manzuri-Shalmani , Mohammad H. Kiapour , Ali A. Kiaei

Facial affect analysis remains a challenging task with its setting transitioned from lab-controlled to in-the-wild situations. In this paper, we present novel frameworks to handle the two challenges in the 4th Affective Behavior Analysis…

Machine Learning · Computer Science 2022-07-21 Siyang Li , Yifan Xu , Huanyu Wu , Dongrui Wu , Yingjie Yin , Jiajiong Cao , Jingting Ding

High-quality annotated images are significant to deep facial expression recognition (FER) methods. However, uncertain labels, mostly existing in large-scale public datasets, often mislead the training process. In this paper, we achieve…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Yang Liu , Xingming Zhang , Janne Kauttonen , Guoying Zhao

Human affective behavior analysis focuses on analyzing human expressions or other behaviors to enhance the understanding of human psychology. The CVPR 2023 Competition on Affective Behavior Analysis in-the-wild (ABAW) is dedicated to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Wei Zhang , Bowen Ma , Feng Qiu , Yu Ding

This paper presents our Facial Action Units (AUs) detection submission to the fifth Affective Behavior Analysis in-the-wild Competition (ABAW). Our approach consists of three main modules: (i) a pre-trained facial representation encoder…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Zihan Wang , Siyang Song , Cheng Luo , Yuzhi Zhou , Shiling Wu , Weicheng Xie , Linlin Shen

Micro-expressions are brief spontaneous facial expressions that appear on a face when a person conceals an emotion, making them different to normal facial expressions in subtlety and duration. Currently, emotion classes within the CASME II…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Adrian K. Davison , Walied Merghani , Moi Hoon Yap

This paper presents a neural network based method Multi-Task Affect Net(MTANet) submitted to the Affective Behavior Analysis in-the-Wild Challenge in FG2020. This method is a multi-task network and based on SE-ResNet modules. By utilizing…

Computer Vision and Pattern Recognition · Computer Science 2020-02-06 Zihang Zhang , Jianping Gu

This paper presents our system for the Multi-Task Learning (MTL) Challenge in the 4th Affective Behavior Analysis in-the-wild (ABAW) competition. We explore the research problems of this challenge from three aspects: 1) For obtaining…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Tenggan Zhang , Chuanhe Liu , Xiaolong Liu , Yuchen Liu , Liyu Meng , Lei Sun , Wenqiang Jiang , Fengyuan Zhang , Jinming Zhao , Qin Jin

Imbalanced datasets pose significant challenges in areas including neuroscience, cognitive science, and medical diagnostics, where accurately detecting minority classes is essential for robust model performance. This study addresses the…

Machine Learning · Computer Science 2025-06-12 Minheng Xiao

Recognition of facial expression is a challenge when it comes to computer vision. The primary reasons are class imbalance due to data collection and uncertainty due to inherent noise such as fuzzy facial expressions and inconsistent labels.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Jiaxiang Fan , Jian Zhou , Xiaoyu Deng , Huabin Wang , Liang Tao , Hon Keung Kwan