English
Related papers

Related papers: Deep Affect Prediction in-the-wild: Aff-Wild Datab…

200 papers

Dynamic emotion recognition in the wild remains challenging due to the transient nature of emotional expressions and temporal misalignment of multi-modal cues. Traditional approaches predict valence and arousal and often overlook the…

Machine Learning · Computer Science 2025-05-05 Vrushank Ahire , Kunal Shah , Mudasir Nazir Khan , Nikhil Pakhale , Lownish Rai Sookha , M. A. Ganaie , Abhinav Dhall

This paper describes the proposed methodology, data used and the results of our participation in the ChallengeTrack 2 (Expr Challenge Track) of the Affective Behavior Analysis in-the-wild (ABAW) Competition 2020. In this competition, we…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Hafiq Anas , Bacha Rehman , Wee Hong Ong

Multimodal fusion is a significant method for most multimodal tasks. With the recent surge in the number of large pre-trained models, combining both multimodal fusion methods and pre-trained model features can achieve outstanding…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Zhuofan Wen , Fengyu Zhang , Siyuan Zhang , Haiyang Sun , Mingyu Xu , Licai Sun , Zheng Lian , Bin Liu , Jianhua Tao

Vision-language models (VLMs) show promise as tools for inferring affect from visual stimuli at scale; it is not yet clear how closely their outputs align with human affective ratings. We benchmarked nine VLMs, ranging from state-of-the-art…

Facial expression recognition (FER) in the wild is crucial for building reliable human-computer interactive systems. However, annotations of large scale datasets in FER has been a key challenge as these datasets suffer from noise due to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Darshan Gera , S Balasubramanian

Developing machine learning algorithms to understand person-to-person engagement can result in natural user experiences for communal devices such as Amazon Alexa. Among other cues such as voice activity and gaze, a person's audio-visual…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-02 Srinivas Parthasarathy , Shiva Sundaram

In this paper, we consider the problem of real-time video-based facial emotion analytics, namely, facial expression recognition, prediction of valence and arousal and detection of action unit points. We propose the novel frame-level emotion…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Andrey V. Savchenko

For many years, the emotion recognition task has remained one of the most interesting and important problems in the field of human-computer interaction. In this study, we consider the emotion recognition task as a classification as well as…

Computer Vision and Pattern Recognition · Computer Science 2020-06-22 Denis Rangulov , Muhammad Fahim

Facial Expression Recognition(FER) is one of the most important topic in Human-Computer interactions(HCI). In this work we report details and experimental results about a facial expression recognition method based on state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2021-01-25 Donato Cafarelli , Fabio Valerio Massoli , Fabrizio Falchi , Claudio Gennaro , Giuseppe Amato

Emotions play an essential role in human communication. Developing computer vision models for automatic recognition of emotion expression can aid in a variety of domains, including robotics, digital behavioral healthcare, and media…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Yang Qian , Ali Kargarandehkordi , Onur Cezmi Mutlu , Saimourya Surabhi , Mohammadmahdi Honarmand , Dennis Paul Wall , Peter Washington

Facial affective behavior analysis is important for human-computer interaction. 5th ABAW competition includes three challenges from Aff-Wild2 database. Three common facial affective analysis tasks are involved, i.e. valence-arousal…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Shangfei Wang , Yanan Chang , Yi Wu , Xiangyu Miao , Jiaqiang Wu , Zhouan Zhu , Jiahe Wang , Yufei Xiao

Affective Analysis is not a single task, and the valence-arousal value, expression class, and action unit can be predicted at the same time. Previous researches did not pay enough attention to the entanglement and hierarchical relation of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Ruian He , Zhen Xing , Weimin Tan , Bo Yan

Human behavior refers to the way humans act and interact. Understanding human behavior is a cornerstone of observational practice, especially in psychotherapy. An important cue of behavior analysis is the dynamical changes of emotions…

Machine Learning · Computer Science 2019-10-10 Haoqi Li , Brian Baucom , Panayiotis Georgiou

Some of the most severe bottlenecks preventing widespread development of machine learning models for human behavior include a dearth of labeled training data and difficulty of acquiring high quality labels. Active learning is a paradigm for…

Current FER (Facial Expression Recognition) dataset is mostly labeled by emotion categories, such as happy, angry, sad, fear, disgust, surprise, and neutral which are limited in expressiveness. However, future affective computing requires…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Yi Huo , Yun Ge

A novel procedure is presented in this paper, for training a deep convolutional and recurrent neural network, taking into account both the available training data set and some information extracted from similar networks trained with other…

Machine Learning · Computer Science 2018-09-13 Dimitrios Kollias , Stefanos Zafeiriou

The 10th Affective & Behavior Analysis in-the-Wild (ABAW) Workshop and Competition, held at CVPR 2026, continues to advance research on modelling, analysis, understanding of human affect and behavior in real-world, unconstrained…

The Affective Behavior Analysis in-the-wild (ABAW2) 2021 Competition is the second -- following the first very successful ABAW Competition held in conjunction with IEEE FG 2020- Competition that aims at automatically analyzing affect. ABAW2…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Dimitrios Kollias , Irene Kotsia , Elnar Hajiyev , Stefanos Zafeiriou

This paper presents a novel CNN-RNN based approach, which exploits multiple CNN features for dimensional emotion recognition in-the-wild, utilizing the One-Minute Gradual-Emotion (OMG-Emotion) dataset. Our approach includes first…

Machine Learning · Computer Science 2020-04-13 Dimitrios Kollias , Stefanos Zafeiriou

This paper presents a novel approach for synthesizing facial affect; either in terms of the six basic expressions (i.e., anger, disgust, fear, joy, sadness and surprise), or in terms of valence (i.e., how positive or negative is an emotion)…

Computer Vision and Pattern Recognition · Computer Science 2019-07-18 Dimitrios Kollias , Shiyang Cheng , Evangelos Ververas , Irene Kotsia , Stefanos Zafeiriou