English
Related papers

Related papers: Speech, Head, and Eye-based Cues for Continuous Af…

200 papers

Automatic prediction of continuous-level emotional state requires selection of suitable affective features to develop a regression system based on supervised machine learning. This paper investigates the performance of features…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Ramesh Basnet , Mohammad Tariqul Islam , Tamanna Howlader , S. M. Mahbubur Rahman , Dimitrios Hatzinakos

Affective computing has made significant strides in emotion recognition and generation, yet current approaches mainly focus on short-term pattern recognition and lack a comprehensive framework to guide affective agents toward long-term…

Human-Computer Interaction · Computer Science 2025-02-26 Bin Yin , Chong-Yi Liu , Liya Fu , Jinkun Zhang

Affective computing - combining sensor technology, machine learning, and psychology - have been studied for over three decades and is employed in AI-powered technologies to enhance emotional awareness in AI systems, and detect symptoms of…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-21 Anders Rolighed Larsen , Sneha Das , Nicole Nadine Lønfeldt , Paula Petcu , Line Clemmensen

Saliency prediction refers to the computational task of modeling overt attention. Social cues greatly influence our attention, consequently altering our eye movements and behavior. To emphasize the efficacy of such features, we present a…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Fares Abawi , Tom Weber , Stefan Wermter

The process of human affect understanding involves the ability to infer person specific emotional states from various sources including images, speech, and language. Affect perception from images has predominantly focused on expressions…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Digbalay Bose , Rajat Hebbar , Krishna Somandepalli , Shrikanth Narayanan

The quantified measurement of facial expressiveness is crucial to analyze human affective behavior at scale. Unfortunately, methods for expressiveness quantification at the video frame-level are largely unexplored, unlike the study of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-08 Md Taufeeq Uddin , Shaun Canavan

In this paper the task of emotion recognition from speech is considered. Proposed approach uses deep recurrent neural network trained on a sequence of acoustic features calculated over small speech intervals. At the same time special…

Computation and Language · Computer Science 2018-07-06 Vladimir Chernykh , Pavel Prikhodko

Humans express feelings or emotions via different channels. Take language as an example, it entails different sentiments under different visual-acoustic contexts. To precisely understand human intentions as well as reduce the…

Artificial Intelligence · Computer Science 2021-11-17 Ting Wu , Junjie Peng , Wenqiang Zhang , Huiran Zhang , Chuanshuai Ma , Yansong Huang

Advertisements (ads) often contain strong affective content to capture viewer attention and convey an effective message to the audience. However, most computational affect recognition (AR) approaches examine ads via the text modality, and…

Human-Computer Interaction · Computer Science 2019-06-04 Abhinav Shukla , Shruti Shriya Gullapuram , Harish Katti , Mohan Kankanhalli , Stefan Winkler , Ramanathan Subramanian

Understanding human affect from facial behavior requires not only accurate recognition but also structured reasoning over the latent dependencies that drive muscle activations and their expressive outcomes. Although Action Units (AUs) have…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Guanyu Hu , Tangzheng Lian , Dimitrios Kollias , Oya Celiktutan , Xinyu Yang

Expressing and identifying emotions through facial and physical expressions is a significant part of social interaction. Emotion recognition is an essential task in computer vision due to its various applications and mainly for allowing a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Willams Costa , David Macêdo , Cleber Zanchettin , Lucas S. Figueiredo , Veronica Teichrieb

Collaborating in a group, whether face-to-face or virtually, involves continuously expressing emotions and interpreting those of other group members. Therefore, understanding group affect is essential to comprehending how groups interact…

Human-Computer Interaction · Computer Science 2024-10-22 Navin Raj Prabhu , Maria Tsfasman , Catharine Oertel , Timo Gerkmann , Nale Lehmann-Willenbrock

As one of the most important affective signals, facial affect analysis (FAA) is essential for developing human-computer interaction systems. Early methods focus on extracting appearance and geometry features associated with human affects…

Computer Vision and Pattern Recognition · Computer Science 2022-02-14 Yang Liu , Xingming Zhang , Yante Li , Jinzhao Zhou , Xin Li , Guoying Zhao

While emotion and mood interchangeably used, they differ in terms of duration, intensity and attributes. Even as multiple psychology studies examine the mood-emotion relationship, mood prediction has barely been studied. Recent machine…

Human-Computer Interaction · Computer Science 2023-03-14 Soujanya Narayana , Ramanathan Subramanian , Ibrahim Radwan , Roland Goecke

Our paper focuses on making use of deep neural network models to accurately predict the range of human emotions experienced during watching movies. In this certain setup, there exist three clear-cut input modalities that considerably…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Sogand Mehrpour Mohammadi , Meysam Gouran Orimi , Hamidreza Rabiee

In human-to-computer interaction, facial animation in synchrony with affective speech can deliver more naturalistic conversational agents. In this paper, we present a two-stage deep learning approach for affective speech driven facial shape…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-13 Rizwan Sadiq , Sasan AsadiAbadi , Engin Erzin

Automatic emotion recognition has become a trending research topic in the past decade. While works based on facial expressions or speech abound, recognizing affect from body gestures remains a less explored topic. We present a new…

Computer Vision and Pattern Recognition · Computer Science 2018-01-24 Fatemeh Noroozi , Ciprian Adrian Corneanu , Dorota Kamińska , Tomasz Sapiński , Sergio Escalera , Gholamreza Anbarjafari

There is a perceived controversy as to whether the cognitive representation of affect is better modelled using a dimensional or categorical theory. This paper first suggests that these views are, in fact, compatible. The paper then…

Human-Computer Interaction · Computer Science 2017-08-01 Michael J. Lyons

Unlike the six basic emotions of happiness, sadness, fear, anger, disgust and surprise, modelling and predicting dimensional affect in terms of valence (positivity - negativity) and arousal (intensity) has proven to be more flexible,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 Chaudhary Muhammad Aqdus Ilyas , Siyang Song , Hatice Gunes

Recent advances in neurosciences and psychology have provided evidence that affective phenomena pervade intelligence at many levels, being inseparable from the cognitionaction loop. Perception, attention, memory, learning, decisionmaking,…

Artificial Intelligence · Computer Science 2008-09-30 Luis Paulo Reis , Daria Barteneva , Nuno Lau