English
Related papers

Related papers: Continuous Affect Prediction using Eye Gaze

200 papers

Learning the latent representation of data in unsupervised fashion is a very interesting process that provides relevant features for enhancing the performance of a classifier. For speech emotion recognition tasks, generating effective…

Sound · Computer Science 2020-07-29 Siddique Latif , Rajib Rana , Junaid Qadir , Julien Epps

Speech emotion recognition is a challenging task for three main reasons: 1) human emotion is abstract, which means it is hard to distinguish; 2) in general, human emotion can only be detected in some specific moments during a long…

Sound · Computer Science 2019-05-03 Yuanyuan Zhang , Jun Du , Zirui Wang , Jianshu Zhang

Video content is rich in semantics and has the ability to evoke various emotions in viewers. In recent years, with the rapid development of affective computing and the explosive growth of visual data, affective video content analysis (AVCA)…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Junxiao Xue , Jie Wang , Xuecheng Wu , Qian Zhang

Human communication includes information, opinions, and reactions. Reactions are often captured by the affective-messages in written as well as verbal communications. While there has been work in affect modeling and to some extent affective…

Computation and Language · Computer Science 2018-05-22 Sopan Khosla , Niyati Chhaya , Kushal Chawla

This paper investigates the influence of different acoustic features, audio-events based features and automatic speech translation based lexical features in complex emotion recognition such as curiosity. Pretrained networks, namely,…

Sound · Computer Science 2018-11-05 Bhalaji Nagarajan , V Ramana Murthy Oruganti

Traditional psychological evaluations rely heavily on human observation and interpretation, which are prone to subjectivity, bias, fatigue, and inconsistency. To address these limitations, this work presents a multimodal emotion recognition…

Human-Computer Interaction · Computer Science 2024-12-25 Kris Kraack

Non-speech emotion recognition has a wide range of applications including healthcare, crime control and rescue, and entertainment, to name a few. Providing these applications using edge computing has great potential, however, recent studies…

Sound · Computer Science 2023-05-02 Ibrahim Malik , Siddique Latif , Sanaullah Manzoor , Muhammad Usama , Junaid Qadir , Raja Jurdak

In this research, an emotion recognition system is developed based on valence/arousal model using electroencephalography (EEG) signals. EEG signals are decomposed into the gamma, beta, alpha and theta frequency bands using discrete wavelet…

Machine Learning · Computer Science 2019-06-04 Omid Bazgir , Zeynab Mohammadi , Seyed Amir Hassan Habibi

Multimodal speech emotion recognition aims to detect speakers' emotions from audio and text. Prior works mainly focus on exploiting advanced networks to model and fuse different modality information to facilitate performance, while…

Computation and Language · Computer Science 2023-04-11 Zhen Wu , Yizhe Lu , Xinyu Dai

Machine learning is frequently used in affective computing, but presents challenges due the opacity of state-of-the-art machine learning methods. Because of the impact affective machine learning systems may have on an individual's life, it…

Machine Learning · Computer Science 2025-10-07 David S. Johnson , Olya Hakobyan , Hanna Drimalla

Due to the complex and resource-intensive nature of diagnosing Autism Spectrum Condition (ASC), several computer-aided diagnostic support methods have been proposed to detect autism by analyzing behavioral cues in patient video data. While…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 William Saakyan , Matthias Norden , Lola Eversmann , Simon Kirsch , Muyu Lin , Simon Guendelman , Isabel Dziobek , Hanna Drimalla

Expressing and identifying emotions through facial and physical expressions is a significant part of social interaction. Emotion recognition is an essential task in computer vision due to its various applications and mainly for allowing a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Willams Costa , David Macêdo , Cleber Zanchettin , Lucas S. Figueiredo , Veronica Teichrieb

In emotion recognition from speech, a key challenge lies in identifying speech signal segments that carry the most relevant acoustic variations for discerning specific emotions. Traditional approaches compute functionals for features such…

Computation and Language · Computer Science 2025-06-04 Sofoklis Kakouros

Predicting human motion is critical for assistive robots and AR/VR applications, where the interaction with humans needs to be safe and comfortable. Meanwhile, an accurate prediction depends on understanding both the scene context and human…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Yang Zheng , Yanchao Yang , Kaichun Mo , Jiaman Li , Tao Yu , Yebin Liu , C. Karen Liu , Leonidas J. Guibas

A short and simple text carrying no emotion can represent some strong emotions when reading along with its context, i.e., the same sentence can express extreme anger as well as happiness depending on its context. In this paper, we propose a…

Computation and Language · Computer Science 2020-02-06 Kumar Shikhar Deep , Asif Ekbal , Pushpak Bhattacharyya

For a long time, images have proved perfect at both storing and conveying rich semantics, especially human emotions. A lot of research has been conducted to provide machines with the ability to recognize emotions in photos of people.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Quoc-Bao Ninh , Hai-Chan Nguyen , Triet Huynh , Trung-Nghia Le

We introduce a novel multimodal emotion recognition dataset that enhances the precision of Valence-Arousal Model while accounting for individual differences. This dataset includes electroencephalography (EEG), electrocardiography (ECG), and…

Human-Computer Interaction · Computer Science 2025-03-24 Xin Huang , Shiyao Zhu , Ziyu Wang , Yaping He , Hao Jin , Zhengkui Liu

Facial emotion recognition is the task to classify human emotions in face images. It is a difficult task due to high aleatoric uncertainty and visual ambiguity. A large part of the literature aims to show progress by increasing accuracy on…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Maryam Matin , Matias Valdenegro-Toro

The development of agents with emotional intelligence is becoming increasingly vital due to their significant role in human-computer interaction and the growing integration of computer systems across various sectors of society. Affective…

Human-Computer Interaction · Computer Science 2026-05-05 Raziyeh Zall , Alireza Kheyrkhah , Erik Cambria , Zahra Naseri , M. Reza Kangavari

Saliency prediction refers to the computational task of modeling overt attention. Social cues greatly influence our attention, consequently altering our eye movements and behavior. To emphasize the efficacy of such features, we present a…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Fares Abawi , Tom Weber , Stefan Wermter