English
Related papers

Related papers: Spatial-temporal Transformer for Affective Behavio…

200 papers

This paper describes the third Affective Behavior Analysis in-the-wild (ABAW) Competition, held in conjunction with IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2022. The 3rd ABAW Competition is a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Dimitrios Kollias

The paper describes our proposed methodology for the six basic expression classification track of Affective Behavior Analysis in-the-wild (ABAW) Competition 2022. In Learing from Synthetic Data(LSD) task, facial expression recognition (FER)…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Shuyi Mao , Xinpeng Li , Junyao Chen , Xiaojiang Peng

In this work, we introduce our submission to the 2nd Affective Behavior Analysis in-the-wild (ABAW) 2021 competition. We train a unified deep learning model on multi-databases to perform two tasks: seven basic facial expressions prediction…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Manh Tu Vu , Marie Beurton-Aimar

The 10th Affective & Behavior Analysis in-the-Wild (ABAW) Workshop and Competition, held at CVPR 2026, continues to advance research on modelling, analysis, understanding of human affect and behavior in real-world, unconstrained…

This paper describes the fourth Affective Behavior Analysis in-the-wild (ABAW) Competition, held in conjunction with European Conference on Computer Vision (ECCV), 2022. The 4th ABAW Competition is a continuation of the Competitions held at…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Dimitrios Kollias

This report describes a multi-modal multi-task ($M^3$T) approach underlying our submission to the valence-arousal estimation track of the Affective Behavior Analysis in-the-wild (ABAW) Challenge, held in conjunction with the IEEE…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Yuan-Hang Zhang , Rulin Huang , Jiabei Zeng , Shiguang Shan , Xilin Chen

This article presents our results for the sixth Affective Behavior Analysis in-the-wild (ABAW) competition. To improve the trustworthiness of facial analysis, we study the possibility of using pre-trained deep models that extract reliable…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Andrey V. Savchenko

Facial Expression Recognition(FER) is one of the most important topic in Human-Computer interactions(HCI). In this work we report details and experimental results about a facial expression recognition method based on state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2021-01-25 Donato Cafarelli , Fabio Valerio Massoli , Fabrizio Falchi , Claudio Gennaro , Giuseppe Amato

The fifth Affective Behavior Analysis in-the-wild (ABAW) Competition is part of the respective ABAW Workshop which will be held in conjunction with IEEE Computer Vision and Pattern Recognition Conference (CVPR), 2023. The 5th ABAW…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Dimitrios Kollias , Panagiotis Tzirakis , Alice Baird , Alan Cowen , Stefanos Zafeiriou

This paper describes the proposed methodology, data used and the results of our participation in the ChallengeTrack 2 (Expr Challenge Track) of the Affective Behavior Analysis in-the-wild (ABAW) Competition 2020. In this competition, we…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Hafiq Anas , Bacha Rehman , Wee Hong Ong

Personality computing and affective computing have gained recent interest in many research areas. The datasets for the task generally have multiple modalities like video, audio, language and bio-signals. In this paper, we propose a flexible…

Computer Vision and Pattern Recognition · Computer Science 2023-01-13 Tanay Agrawal , Dhruv Agarwal , Michal Balazia , Neelabh Sinha , Francois Bremond

Facial expression recognition is a challenging classification task that holds broad application prospects in the field of human-computer interaction. This paper aims to introduce the method we will adopt in the 8th Affective and Behavioral…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Jun Yu , Yang Zheng , Lei Wang , Yongqi Wang , Shengfan Xu

Temporal context is key to the recognition of expressions of emotion. Existing methods, that rely on recurrent or self-attention models to enforce temporal consistency, work on the feature level, ignoring the task-specific temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Enrique Sanchez , Mani Kumar Tellamekala , Michel Valstar , Georgios Tzimiropoulos

This paper presents a novel spatiotemporal transformer network that introduces several original components to detect actions in untrimmed videos. First, the multi-feature selective semantic attention model calculates the correlations…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Matthew Korban , Peter Youngs , Scott T. Acton

Developing machine learning algorithms to understand person-to-person engagement can result in natural user experiences for communal devices such as Amazon Alexa. Among other cues such as voice activity and gaze, a person's audio-visual…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-02 Srinivas Parthasarathy , Shiva Sundaram

Audio-visual emotion recognition (AVER) methods typically fuse utterance-level features, and even frame-level attention models seldom address the frame-rate mismatch across modalities. In this paper, we propose a Transformer-based framework…

Multimedia · Computer Science 2026-03-13 Inyong Koo , yeeun Seong , Minseok Son , Jaehyuk Jang , Changick Kim

Action Quality Assessment(AQA) is important for action understanding and resolving the task poses unique challenges due to subtle visual differences. Existing state-of-the-art methods typically rely on the holistic video representations for…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Yang Bai , Desen Zhou , Songyang Zhang , Jian Wang , Errui Ding , Yu Guan , Yang Long , Jingdong Wang

In this paper, we present our contribution to ABAW facial expression challenge. We report the proposed system and the official challenge results adhering to the challenge protocol. Using end-to-end deep learning and benefiting from transfer…

Machine Learning · Computer Science 2020-11-03 Denis Dresvyanskiy , Elena Ryumina , Heysem Kaya , Maxim Markitantov , Alexey Karpov , Wolfgang Minker

In this paper, we propose the solution to the Multi-Task Learning (MTL) Challenge of the 4th Affective Behavior Analysis in-the-wild (ABAW) competition. The task of ABAW is to predict frame-level emotion descriptors from videos: discrete…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Haiyang Sun , Zheng Lian , Bin Liu , Jianhua Tao , Licai Sun , Cong Cai

This article presents our results for the 10th Affective Behavior Analysis in-the-Wild (ABAW) competition. For frame-wise facial emotion understanding tasks (frame-wise facial expression recognition, valence-arousal estimation, action unit…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Andrey V. Savchenko , Kseniia Tsypliakova