English
Related papers

Related papers: Spatial and Temporal Attention-based emotion estim…

200 papers

Previous active inference accounts of emotion translate fluctuations in free energy to a sense of emotion, mainly focusing on valence. However, in affective science, emotions are often represented as multi-dimensional. In this paper, we…

Artificial Intelligence · Computer Science 2024-07-03 Candice Pattisapu , Tim Verbelen , Riddhi J. Pitliya , Alex B. Kiefer , Mahault Albarracin

Emotion recognition plays a crucial role in various domains of human-robot interaction. In long-term interactions with humans, robots need to respond continuously and accurately, however, the mainstream emotion recognition methods mostly…

Human-Computer Interaction · Computer Science 2024-01-23 Zihan Lin , Francisco Cruz , Eduardo Benitez Sandoval

Current state-of-the-art approaches for spatio-temporal action localization rely on detections at the frame level and model temporal context with 3D ConvNets. Here, we go one step further and model spatio-temporal relations to capture the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Chen Sun , Abhinav Shrivastava , Carl Vondrick , Kevin Murphy , Rahul Sukthankar , Cordelia Schmid

The valence analysis of speakers' utterances or written posts helps to understand the activation and variations of the emotional state throughout the conversation. More recently, the concept of Emotion Carriers (EC) has been introduced to…

Computation and Language · Computer Science 2023-11-01 Gabriel Roccabruna , Seyed Mahed Mousavi , Giuseppe Riccardi

Recognizing the patient's emotions using deep learning techniques has attracted significant attention recently due to technological advancements. Automatically identifying the emotions can help build smart healthcare centers that can detect…

Machine Learning · Computer Science 2021-07-14 Marwan Dhuheir , Abdullatif Albaseer , Emna Baccour , Aiman Erbad , Mohamed Abdallah , Mounir Hamdi

In recent years, great strides have been made in the field of affective computing. Several models have been developed to represent and quantify emotions. Two popular ones include (i) categorical models which represent emotions as discrete…

Artificial Intelligence · Computer Science 2020-12-01 Surabhi S. Nath , Vishaal Udandarao , Jainendra Shukla

Mapping discrete and dimensional models of emotion remains a persistent challenge in affective science and computing. This incompatibility hinders the combination of valuable data sets, creating a significant bottleneck for training robust…

Human-Computer Interaction · Computer Science 2025-11-18 Michal R. Wrobel

Our paper focuses on making use of deep neural network models to accurately predict the range of human emotions experienced during watching movies. In this certain setup, there exist three clear-cut input modalities that considerably…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Sogand Mehrpour Mohammadi , Meysam Gouran Orimi , Hamidreza Rabiee

Recent works have demonstrated the effectiveness of machine learning (ML) techniques in detecting anxiety and stress using physiological signals, but it is unclear whether ML models are learning physiological features specific to stress. To…

Multimedia · Computer Science 2024-02-27 Emily Zhou , Mohammad Soleymani , Maja J. Matarić

Speech emotion recognition (SER) plays a vital role in improving the interactions between humans and machines by inferring human emotion and affective states from speech signals. Whereas recent works primarily focus on mining spatiotemporal…

Sound · Computer Science 2023-10-03 Jiaxin Ye , Xin-cheng Wen , Yujie Wei , Yong Xu , Kunhong Liu , Hongming Shan

Stories can have tremendous power -- not only useful for entertainment, they can activate our interests and mobilize our actions. The degree to which a story resonates with its audience may be in part reflected in the emotional journey it…

Computer Vision and Pattern Recognition · Computer Science 2017-12-11 Eric Chu , Deb Roy

Emotions play an important role in people's life. Understanding and recognising is not only important for interpersonal communication, but also has promising applications in Human-Computer Interaction, automobile safety and medical…

Machine Learning · Computer Science 2019-12-17 Xia Yicheng , Dimitrios Kollias

Human visual attention is a complex phenomenon. A computational modeling of this phenomenon must take into account where people look in order to evaluate which are the salient locations (spatial distribution of the fixations), when they…

Computer Vision and Pattern Recognition · Computer Science 2020-05-08 Dario Zanca , Stefano Melacci , Marco Gori

Emotions are one of the important components of the human being, thus they are a valuable part of daily activities such as interaction with people, decision making and learning. For this reason, it is important to detect, recognize and…

Human-Computer Interaction · Computer Science 2025-12-30 Ricardo Vasquez , Diego Riofrío-Luzcando , Joe Carrion-Jumbo , Cesar Guevara

Emotion recognition and understanding is a vital component in human-machine interaction. Dimensional models of affect such as those using valence and arousal have advantages over traditional categorical ones due to the complexity of…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Vassilios Vonikakis , Dexter Neo , Stefan Winkler

Humans process visual scenes selectively and sequentially using attention. Central to models of human visual attention is the saliency map. We propose a hierarchical visual architecture that operates on a saliency map and uses a novel…

Computer Vision and Pattern Recognition · Computer Science 2017-11-15 Sean Welleck , Jialin Mao , Kyunghyun Cho , Zheng Zhang

Emotion recognition in videos is a pivotal task in affective computing, where identifying subtle psychological states such as Ambivalence and Hesitancy holds significant value for behavioral intervention and digital health. Ambivalence and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Liang Tang , Hongda Li , Jiayu Zhang , Long Chen , Shuxian Li , Siqi Pei , Tiaonan Duan , Yuhao Cheng

In the recent past, psychological stress has been increasingly observed in humans, and early detection is crucial to prevent health risks. Stress detection using on-device deep learning algorithms has been on the rise owing to advancements…

Machine Learning · Computer Science 2020-12-07 Abhijith Ragav , Gautham Krishna Gudur

Emotions are reactions that can be expressed through a variety of social signals. For example, anger can be expressed through a scowl, narrowed eyes, a long stare, or many other expressions. This complexity is problematic when attempting to…

Robotics · Computer Science 2021-03-09 Ghazal Saheb Jam , Jimin Rhim , Angelica Lim

Automatic detection and tracking of emotional states has the potential for helping individuals with various mental health conditions. While previous studies have captured physiological signals using wearable devices in laboratory settings,…

Signal Processing · Electrical Eng. & Systems 2024-01-12 Michal K. Grzeszczyk , Anna Lisowska , Arkadiusz Sitek , Aneta Lisowska