English
Related papers

Related papers: Aff-Wild2: Extending the Aff-Wild Database for Aff…

200 papers

The process of human affect understanding involves the ability to infer person specific emotional states from various sources including images, speech, and language. Affect perception from images has predominantly focused on expressions…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Digbalay Bose , Rajat Hebbar , Krishna Somandepalli , Shrikanth Narayanan

The 10th Affective & Behavior Analysis in-the-Wild (ABAW) Workshop and Competition, held at CVPR 2026, continues to advance research on modelling, analysis, understanding of human affect and behavior in real-world, unconstrained…

Emotions play an important role in people's life. Understanding and recognising is not only important for interpersonal communication, but also has promising applications in Human-Computer Interaction, automobile safety and medical…

Machine Learning · Computer Science 2019-12-17 Xia Yicheng , Dimitrios Kollias

Understanding emotions and expressions is a task of interest across multiple disciplines, especially for improving user experiences. Contrary to the common perception, it has been shown that emotions are not discrete entities but instead…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Niklas Wagner , Felix Mätzler , Samed R. Vossberg , Helen Schneider , Svetlana Pavlitska , J. Marius Zöllner

Emotion recognition has become an important field of research in the human-computer interactions domain. The latest advancements in the field show that combining visual with audio information lead to better results if compared to the case…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Nicolae-Catalin Ristea , Liviu Cristian Dutu , Anamaria Radoi

This article presents our results for the eighth Affective Behavior Analysis in-the-wild (ABAW) competition.Multimodal emotion recognition (ER) has important applications in affective computing and human-computer interaction. However, in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Ran Liu , Fengyu Zhang , Cong Yu , Longjiang Yang , Zhuofan Wen , Siyuan Zhang , Hailiang Yao , Shun Chen , Zheng Lian , Bin Liu

This paper presents an audiovisual-based emotion recognition hybrid network. While most of the previous work focuses either on using deep models or hand-engineered features extracted from images, we explore multiple deep models built on…

Computer Vision and Pattern Recognition · Computer Science 2020-02-24 Xin Guo , Luisa F. Polanía , Kenneth E. Barner

Affective computing stands at the forefront of artificial intelligence (AI), seeking to imbue machines with the ability to comprehend and respond to human emotions. Central to this field is emotion recognition, which endeavors to identify…

Machine Learning · Computer Science 2024-07-08 Fei Ma , Yucheng Yuan , Yifan Xie , Hongwei Ren , Ivan Liu , Ying He , Fuji Ren , Fei Richard Yu , Shiguang Ni

This paper presents a neural network based method Multi-Task Affect Net(MTANet) submitted to the Affective Behavior Analysis in-the-Wild Challenge in FG2020. This method is a multi-task network and based on SE-ResNet modules. By utilizing…

Computer Vision and Pattern Recognition · Computer Science 2020-02-06 Zihang Zhang , Jianping Gu

In this paper, we present our solution and experiment result for the Multi-Task Learning Challenge of the 7th Affective Behavior Analysis in-the-wild(ABAW7) Competition. This challenge consists of three tasks: action unit detection, facial…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Xiaodong Li , Wenchao Du , Hongyu Yang

The goal of emotional brain state classification on functional MRI (fMRI) data is to recognize brain activity patterns related to specific emotion tasks performed by subjects during an experiment. Distinguishing emotional brain states from…

Image and Video Processing · Electrical Eng. & Systems 2022-11-01 Maxime Tchibozo , Donggeun Kim , Zijing Wang , Xiaofu He

The human face conveys a significant amount of information. Through facial expressions, the face is able to communicate numerous sentiments without the need for verbalisation. Visual emotion recognition has been extensively studied.…

Computer Vision and Pattern Recognition · Computer Science 2022-01-20 Liam Schoneveld , Alice Othmani

Nearly all existing Facial Action Coding System-based datasets that include facial action unit (AU) intensity information annotate the intensity values hierarchically using A--E levels. However, facial expressions change continuously and…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Wei Gan , Jian Xue , Ke Lu , Yanfu Yan , Pengcheng Gao , Jiayi Lyu

Facial emotion recognition has been typically cast as a single-label classification problem of one out of six prototypical emotions. However, that is an oversimplification that is unsuitable for representing the multifaceted spectrum of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Joao Baptista Cardia Neto , Claudio Ferrari , Stefano Berretti

One of the challenges in virtual environments is the difficulty users have in interacting with these increasingly complex systems. Ultimately, endowing machines with the ability to perceive users emotions will enable a more intuitive and…

Human-Computer Interaction · Computer Science 2022-10-26 M. L. Menezes , A. Samara , L. Galway , A. Sant'anna , A. Verikas , F. Alonso-Fernandez , H. Wang , R. Bond

This paper presents a novel approach for synthesizing facial affect, which is based on our annotating 600,000 frames of the 4DFAB database in terms of valence and arousal. The input of this approach is a pair of these emotional state…

Graphics · Computer Science 2018-11-21 Dimitrios Kollias , Shiyang Cheng , Maja Pantic , Stefanos Zafeiriou

We present Affect2MM, a learning method for time-series emotion prediction for multimedia content. Our goal is to automatically capture the varying emotions depicted by characters in real-life human-centric situations and behaviors. We use…

Computer Vision and Pattern Recognition · Computer Science 2021-03-12 Trisha Mittal , Puneet Mathur , Aniket Bera , Dinesh Manocha

We present AMIGOS-- A dataset for Multimodal research of affect, personality traits and mood on Individuals and GrOupS. Different to other databases, we elicited affect using both short and long videos in two social contexts, one with…

Neurons and Cognition · Quantitative Biology 2017-04-14 Juan Abdon Miranda-Correa , Mojtaba Khomami Abadi , Nicu Sebe , Ioannis Patras

Understanding emotions is a fundamental ability for intelligent systems to be able to interact with humans. Vision-language models (VLMs) have made tremendous progress in the last few years for many visual tasks, potentially offering a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Madhav Agarwal , Sotirios A. Tsaftaris , Laura Sevilla-Lara , Steven McDonagh

This paper describes the 6th Affective Behavior Analysis in-the-wild (ABAW) Competition, which is part of the respective Workshop held in conjunction with IEEE CVPR 2024. The 6th ABAW Competition addresses contemporary challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Dimitrios Kollias , Panagiotis Tzirakis , Alan Cowen , Stefanos Zafeiriou , Irene Kotsia , Alice Baird , Chris Gagne , Chunchang Shao , Guanyu Hu