English
Related papers

Related papers: Spatial and Temporal Attention-based emotion estim…

200 papers

In this research, an emotion recognition system is developed based on valence/arousal model using electroencephalography (EEG) signals. EEG signals are decomposed into the gamma, beta, alpha and theta frequency bands using discrete wavelet…

Machine Learning · Computer Science 2019-06-04 Omid Bazgir , Zeynab Mohammadi , Seyed Amir Hassan Habibi

Emotion prediction is the field of study to understand human emotions. Existing methods focus on modalities like text, audio, facial expressions, etc., which could be private to the user. Emotion can be derived from the subject's…

Signal Processing · Electrical Eng. & Systems 2023-08-25 Dhruv Limbani , Daketi Yatin , Nitish Chaturvedi , Vaishnavi Moorthy , Pushpalatha M , Harichandana BSS , Sumit Kumar

Emotion recognition in dynamic social contexts requires an understanding of the complex interaction between facial expressions and situational cues. This paper presents a salience-adjusted framework for context-aware emotion recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Bin Han , Jonathan Gratch

This report describes a multi-modal multi-task ($M^3$T) approach underlying our submission to the valence-arousal estimation track of the Affective Behavior Analysis in-the-wild (ABAW) Challenge, held in conjunction with the IEEE…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Yuan-Hang Zhang , Rulin Huang , Jiabei Zeng , Shiguang Shan , Xilin Chen

In this work, we describe our method for tackling the valence-arousal estimation challenge from ABAW2 ICCV-2021 Competition. The competition organizers provide an in-the-wild Aff-Wild2 dataset for participants to analyze affective behavior…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Hong-Xia Xie , I-Hsuan Li , Ling Lo , Hong-Han Shuai , Wen-Huang Cheng

Most current affect scales and sentiment analysis on written text focus on quantifying valence (sentiment) -- the most primary dimension of emotion. However, emotions are broader and more complex than valence. Distinguishing negative…

Computers and Society · Computer Science 2021-10-27 Asra Fatima , Li Ying , Thomas Hills , Massimo Stella

Human emotion recognition holds a pivotal role in facilitating seamless human-computer interaction. This paper delineates our methodology in tackling the Valence-Arousal (VA) Estimation Challenge, Expression (Expr) Classification Challenge,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Weiwei Zhou , Jiada Lu , Chenkun Ling , Weifeng Wang , Shaowei Liu

In order to develop more precise and functional affective applications, it is necessary to achieve a balance between the psychology and the engineering applied to emotions. Signals from the central and peripheral nervous systems have been…

Human-Computer Interaction · Computer Science 2019-05-02 Jennifer Sorinas , Jose Manuel Ferrández , Eduardo Fernandez

Recent work has shown that a person's sympathetic arousal can be estimated from facial videos alone using basic signal processing. This opens up new possibilities in the field of telehealth and stress management, providing a non-invasive…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Björn Braun , Daniel McDuff , Tadas Baltrusaitis , Paul Streli , Max Moebus , Christian Holz

Human-Computer Interaction (HCI) is a multi-modal, interdisciplinary field focused on designing, studying, and improving the interactions between people and computer systems. This involves the design of systems that can recognize,…

Human-Computer Interaction · Computer Science 2025-08-15 Paul Schreiber , Beyza Cinar , Lennart Mackert , Maria Maleshkova

Researchers since at least Darwin have debated whether and to what extent emotions are universal or culture-dependent. However, previous studies have primarily focused on facial expressions and on a limited set of emotions. Given that…

Computation and Language · Computer Science 2013-04-30 Eugene Yuta Bann , Joanna J. Bryson

Emotion plays an essential role in human-to-human communication, enabling us to convey feelings such as happiness, frustration, and sincerity. While modern speech technologies rely heavily on speech recognition and natural language…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-05 Vasudha Kowtha , Vikramjit Mitra , Chris Bartels , Erik Marchi , Sue Booker , William Caruso , Sachin Kajarekar , Devang Naik

Facial expression analysis has long been an active research area of computer vision. Traditional methods mainly analyse images for prototypical discrete emotions; as a result, they do not provide an accurate depiction of the complex…

Computer Vision and Pattern Recognition · Computer Science 2022-06-29 Calvin Chen , Stefan Winkler

Emotions recognition is the task of recognizing people's emotions. Usually it is achieved by analyzing expression of peoples faces. There are two ways for representing emotions: The categorical approach and the dimensional approach by using…

Machine Learning · Computer Science 2019-12-17 Alvertos Benroumpi , Dimitrios Kollias

Numerous models describing the human emotional states have been built by the psychology community. Alongside, Deep Neural Networks (DNN) are reaching excellent performances and are becoming interesting features extraction tools in many…

Artificial Intelligence · Computer Science 2019-04-22 Corentin Kervadec , Valentin Vielzeuf , Stéphane Pateux , Alexis Lechervy , Frédéric Jurie

We present a real-time algorithm for emotion-aware navigation of a robot among pedestrians. Our approach estimates time-varying emotional behaviors of pedestrians from their faces and trajectories using a combination of Bayesian-inference,…

Robotics · Computer Science 2019-03-11 Aniket Bera , Tanmay Randhavane , Rohan Prinja , Kyra Kapsaskis , Austin Wang , Kurt Gray , Dinesh Manocha

During the last decade, the applications of signal processing have drastically improved with deep learning. However areas of affecting computing such as emotional speech synthesis or emotion recognition from spoken language remains…

Audio and Speech Processing · Electrical Eng. & Systems 2018-06-04 Noé Tits , Kevin El Haddad , Thierry Dutoit

This article presents our results for the sixth Affective Behavior Analysis in-the-wild (ABAW) competition. To improve the trustworthiness of facial analysis, we study the possibility of using pre-trained deep models that extract reliable…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Andrey V. Savchenko

As different people perceive others' emotional expressions differently, their annotation in terms of arousal and valence are per se subjective. To address this, these emotion annotations are typically collected by multiple annotators and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-26 Navin Raj Prabhu , Nale Lehmann-Willenbrock , Timo Gerkmann

In this paper, we briefly introduce our submission to the Valence-Arousal Estimation Challenge of the 3rd Affective Behavior Analysis in-the-wild (ABAW) competition. Our method utilizes the multi-modal information, i.e., the visual and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Liyu Meng , Yuchen Liu , Xiaolong Liu , Zhaopei Huang , Yuan Cheng , Meng Wang , Chuanhe Liu , Qin Jin