English
Related papers

Related papers: Deep Affect Prediction in-the-wild: Aff-Wild Datab…

200 papers

Automatic affect recognition using visual cues is an important task towards a complete interaction between humans and machines. Applications can be found in tutoring systems and human computer interaction. A critical step towards that…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Panagiotis Tzirakis , Dénes Boros , Elnar Hajiyev , Björn W. Schuller

In recent times, there has been significant interest in the machine recognition of human emotions, due to the suite of applications to which this knowledge can be applied. A number of different modalities, such as speech or facial…

Human-Computer Interaction · Computer Science 2018-03-06 Jonny O'Dwyer , Ronan Flynn , Niall Murray

The humans are affective and cognitive beings relying on memories for their individual and social identities. Also, human dyadic bonds require some common beliefs such as empathetic behaviour for better interaction. In this sense, research…

Computers and Society · Computer Science 2020-03-11 Nuno A. C. Henriques , Helder Coelho , Leonel Garcia-Marques

AI assistants that interact with users over time need to interpret the user's current emotional state in order to respond appropriately and personally. However, this capability remains insufficiently evaluated. Existing emotion datasets…

Artificial Intelligence · Computer Science 2026-04-09 Deliang Wen , Ke Sun , Yu Wang

Facial behavior analysis is a broad topic with various categories such as facial emotion recognition, age, and gender recognition. Many studies focus on individual tasks while the multi-task learning approach is still an open research issue…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Dang-Khanh Nguyen , Sudarshan Pant , Ngoc-Huynh Ho , Guee-Sang Lee , Soo-Huyng Kim , Hyung-Jeong Yang

Deep convolutional neural networks are being actively investigated in a wide range of speech and audio processing applications including speech recognition, audio event detection and computational paralinguistics, owing to their ability to…

Machine Learning · Computer Science 2018-01-16 Che-Wei Huang , Shrikanth. S. Narayanan

Advertisements (ads) often include strongly emotional content to leave a lasting impression on the viewer. This work (i) compiles an affective ad dataset capable of evoking coherent emotions across users, as determined from the affective…

Human-Computer Interaction · Computer Science 2017-09-07 Abhinav Shukla , Shruti Shriya Gullapuram , Harish Katti , Karthik Yadati , Mohan Kankanhalli , Ramanathan Subramanian

We present a model to predict fine-grained emotions along the continuous dimensions of valence, arousal, and dominance (VAD) with a corpus with categorical emotion annotations. Our model is trained by minimizing the EMD (Earth Mover's…

Computation and Language · Computer Science 2021-09-13 Sungjoon Park , Jiseon Kim , Seonghyeon Ye , Jaeyeol Jeon , Hee Young Park , Alice Oh

Human affects are complex paradox and an active research domain in affective computing. Affects are traditionally determined through a self-report based psychometric questionnaire or through facial expression recognition. However, few…

Human-Computer Interaction · Computer Science 2021-02-16 Md. Mahbubur Rahman , Akash Poddar , Md. Golam Rabiul Alam , Samrat Kumar Dey

How can we reliably transfer affect models trained in controlled laboratory conditions (in-vitro) to uncontrolled real-world settings (in-vivo)? The information gap between in-vitro and in-vivo applications defines a core challenge of…

Human-Computer Interaction · Computer Science 2023-05-19 Konstantinos Makantasis , Kosmas Pinitas , Antonios Liapis , Georgios N. Yannakakis

The process of human affect understanding involves the ability to infer person specific emotional states from various sources including images, speech, and language. Affect perception from images has predominantly focused on expressions…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Digbalay Bose , Rajat Hebbar , Krishna Somandepalli , Shrikanth Narayanan

Emotions are very important for human intelligence. For example, emotions are closely related to the appraisal of the internal bodily state and external stimuli. This helps us to respond quickly to the environment. Another important…

Artificial Intelligence · Computer Science 2018-08-28 Chie Hieida , Takato Horii , Takayuki Nagai

In this article, the results of our team for the fifth Affective Behavior Analysis in-the-wild (ABAW) competition are presented. The usage of the pre-trained convolutional networks from the EmotiEffNet family for frame-level feature…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Andrey V. Savchenko

In this work, we describe our method for tackling the valence-arousal estimation challenge from ABAW2 ICCV-2021 Competition. The competition organizers provide an in-the-wild Aff-Wild2 dataset for participants to analyze affective behavior…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Hong-Xia Xie , I-Hsuan Li , Ling Lo , Hong-Han Shuai , Wen-Huang Cheng

Interpersonal relation defines the association, e.g., warm, friendliness, and dominance, between two or more people. Motivated by psychological studies, we investigate if such fine-grained and high-level relation traits can be characterized…

Computer Vision and Pattern Recognition · Computer Science 2017-11-07 Zhanpeng Zhang , Ping Luo , Chen Change Loy , Xiaoou Tang

Automated systems that detect the social behavior of deception can enhance human well-being across medical, social work, and legal domains. Labeled datasets to train supervised deception detection models can rarely be collected for…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Leena Mathur , Maja J Matarić

Agents must monitor their partners' affective states continuously in order to understand and engage in social interactions. However, methods for evaluating affect recognition do not account for changes in classification performance that may…

Human-Computer Interaction · Computer Science 2025-09-08 Allen Chang , Lauren Klein , Marcelo R. Rosales , Weiyang Deng , Beth A. Smith , Maja J. Matarić

In this work, we describe our method for tackling the valence-arousal estimation challenge from ABAW FG-2020 Competition. The competition organizers provide an in-the-wild Aff-Wild2 dataset for participants to analyze affective behavior in…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 I-Hsuan Li

This paper details the methodology and results of the EmotioNet challenge. This challenge is the first to test the ability of computer vision algorithms in the automatic analysis of a large number of images of facial expressions of emotion…

Computer Vision and Pattern Recognition · Computer Science 2017-03-06 C. Fabian Benitez-Quiroz , Ramprakash Srinivasan , Qianli Feng , Yan Wang , Aleix M. Martinez

In this paper, we briefly introduce our submission to the Valence-Arousal Estimation Challenge of the 3rd Affective Behavior Analysis in-the-wild (ABAW) competition. Our method utilizes the multi-modal information, i.e., the visual and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Liyu Meng , Yuchen Liu , Xiaolong Liu , Zhaopei Huang , Yuan Cheng , Meng Wang , Chuanhe Liu , Qin Jin