English
Related papers

Related papers: Speech, Head, and Eye-based Cues for Continuous Af…

200 papers

Understanding emotions and expressions is a task of interest across multiple disciplines, especially for improving user experiences. Contrary to the common perception, it has been shown that emotions are not discrete entities but instead…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Niklas Wagner , Felix Mätzler , Samed R. Vossberg , Helen Schneider , Svetlana Pavlitska , J. Marius Zöllner

The focus of the efforts for defining and modelling emotion is broadly shifting from classical definite marker theory to statistically context situated conceptual theory. However, the role of context processing and its interaction with the…

Neurons and Cognition · Quantitative Biology 2020-05-05 Sudhakar Mishra , U. S. Tiwary

Emotion evoked by an advertisement plays a key role in influencing brand recall and eventual consumer choices. Automatic ad affect recognition has several useful applications. However, the use of content-based feature representations does…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Abhinav Shukla , Harish Katti , Mohan Kankanhalli , Ramanathan Subramanian

Automated co-located human-human interaction analysis has been addressed by the use of nonverbal communication as measurable evidence of social and psychological phenomena. We survey the computing studies (since 2010) detecting phenomena…

Human-Computer Interaction · Computer Science 2023-10-05 Cigdem Beyan , Alessandro Vinciarelli , Alessio Del Bue

The rise of AI conversational agents has broadened opportunities to enhance human capabilities across various domains. As these agents become more prevalent, it is crucial to investigate the impact of different affective abilities on their…

Human-Computer Interaction · Computer Science 2023-10-20 Javier Hernandez , Jina Suh , Judith Amores , Kael Rowan , Gonzalo Ramos , Mary Czerwinski

In recent years, extensive research has emerged in affective computing on topics like automatic emotion recognition and determining the signals that characterize individual emotions. Much less studied, however, is expressiveness, or the…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Victoria Lin , Jeffrey M. Girard , Louis-Philippe Morency

Emotions widely affect human decision-making. This fact is taken into account by affective computing with the goal of tailoring decision support to the emotional states of individuals. However, the accurate recognition of emotions within…

Computation and Language · Computer Science 2018-11-14 Bernhard Kratzwald , Suzana Ilic , Mathias Kraus , Stefan Feuerriegel , Helmut Prendinger

A short and simple text carrying no emotion can represent some strong emotions when reading along with its context, i.e., the same sentence can express extreme anger as well as happiness depending on its context. In this paper, we propose a…

Computation and Language · Computer Science 2020-02-06 Kumar Shikhar Deep , Asif Ekbal , Pushpak Bhattacharyya

Automated deception detection systems can enhance health, justice, and security in society by helping humans detect deceivers in high-stakes situations across medical and legal domains, among others. This paper presents a novel analysis of…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Leena Mathur , Maja J Matarić

We propose an end-to-end affect recognition approach using a Convolutional Neural Network (CNN) that handles multiple languages, with applications to emotion and personality recognition from speech. We lay the foundation of a universal…

Computation and Language · Computer Science 2019-01-28 Dario Bertero , Onno Kampman , Pascale Fung

Psychological studies observe that emotions are rarely expressed in isolation and are typically influenced by the surrounding context. While recent studies effectively harness uni- and multimodal cues for emotion inference, hardly any study…

Human-Computer Interaction · Computer Science 2024-02-14 Soujanya Narayana , Ibrahim Radwan , Ramanathan Subramanian , Roland Goecke

Accurate emotion recognition is pivotal for nuanced and engaging human-computer interactions, yet remains difficult to achieve, especially in dynamic, conversation-like settings. In this study, we showcase how integrating eye-tracking data,…

Human-Computer Interaction · Computer Science 2025-11-03 Meisam Jamshidi Seikavandi , Jostein Fimland , Maria Barrett , Paolo Burelli

In the past, several models of consciousness have become popular and have led to the development of models for machine consciousness with varying degrees of success and challenges for simulation and implementations. Moreover, affective…

Artificial Intelligence · Computer Science 2017-01-03 Rohitash Chandra

Affective computing is a field of great interest in many computer vision applications, including video surveillance, behaviour analysis, and human-robot interaction. Most of the existing literature has addressed this field by analysing…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Danilo Avola , Luigi Cinque , Alessio Fagioli , Gian Luca Foresti , Cristiano Massaroni

Autism spectrum disorder (ASD) is a developmental disorder that influences the communication and social behavior of a person in a way that those in the spectrum have difficulty in perceiving other people's facial expressions, as well as…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Jicheng Li , Anjana Bhat , Roghayeh Barmaki

Emotion recognition,as a step toward mind reading,seeks to infer internal states from external cues.Most existing methods rely on explicit signals-such as facial expressions,speech,or gestures-that reflect only bodily responses and overlook…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Mengke Song , Yuge Xie , Qi Cui , Luming Li , Xinyu Liu , Guotao Wang , Chenglizhao Chen , Shanchen Pang

Traditionally, in paralinguistic analysis for emotion detection from speech, emotions have been identified with discrete or dimensional (continuous-valued) labels. Accordingly, models that have been proposed for emotion detection use one or…

Sound · Computer Science 2022-11-01 Roshan Sharma , Hira Dhamyal , Bhiksha Raj , Rita Singh

Affect recognition, encompassing emotions, moods, and feelings, plays a pivotal role in human communication. In the realm of conversational artificial intelligence, the ability to discern and respond to human affective cues is a critical…

Computation and Language · Computer Science 2024-08-06 Shutong Feng , Guangzhi Sun , Nurul Lubis , Wen Wu , Chao Zhang , Milica Gašić

Foundation Models (FMs) are rapidly transforming Affective Computing (AC), with Vision Language Models (VLMs) now capable of recognising emotions in zero shot settings. This paper probes a critical but underexplored question: what visual…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Iosif Tsangko , Andreas Triantafyllopoulos , Adem Abdelmoula , Adria Mallol-Ragolta , Bjoern W. Schuller

Deep convolutional neural networks are being actively investigated in a wide range of speech and audio processing applications including speech recognition, audio event detection and computational paralinguistics, owing to their ability to…

Machine Learning · Computer Science 2018-01-16 Che-Wei Huang , Shrikanth. S. Narayanan