English
Related papers

Related papers: Datasets for Valence and Arousal Inference: A Surv…

200 papers

A cluster of research in Affective Computing suggests that it is possible to infer some characteristics of users' affective states by analyzing their electrophysiological activity in real-time. However, it is not clear how to use the…

Human-Computer Interaction · Computer Science 2022-11-22 Andres Pinilla , Jaime Garcia , William Raffe , Jan-Niklas Voigt-Antons , Robert Spang , Sebastian Möller

This paper conducts an intricate analysis of musical emotions and trends using Spotify music data, encompassing audio features and valence scores extracted through the Spotipi API. Employing regression modeling, temporal analysis, mood…

Sound · Computer Science 2023-10-31 Shruti Dutta , Shashwat Mookherjee

Emotions are subjective constructs. Recent end-to-end speech emotion recognition systems are typically agnostic to the subjective nature of emotions, despite their state-of-the-art performance. In this work, we introduce an end-to-end…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Navin Raj Prabhu , Guillaume Carbajal , Nale Lehmann-Willenbrock , Timo Gerkmann

Affective computing has made significant strides in emotion recognition and generation, yet current approaches mainly focus on short-term pattern recognition and lack a comprehensive framework to guide affective agents toward long-term…

Human-Computer Interaction · Computer Science 2025-02-26 Bin Yin , Chong-Yi Liu , Liya Fu , Jinkun Zhang

Studying psychiatric illness has often been limited by difficulties in connecting symptoms and behavior to neurobiology. Computational psychiatry approaches promise to bridge this gap by providing formal accounts of the latent information…

Influence diagnostics such as influence functions and approximate maximum influence perturbations are popular in machine learning and in AI domain applications. Influence diagnostics are powerful statistical tools to identify influential…

Machine Learning · Statistics 2023-09-21 Jillian Fisher , Lang Liu , Krishna Pillutla , Yejin Choi , Zaid Harchaoui

Visual Emotion Analysis (VEA) aims at predicting people's emotional responses to visual stimuli. This is a promising, yet challenging, task in affective computing, which has drawn increasing attention in recent years. Most of the existing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Jingyuan Yang , Qirui Huang , Tingting Ding , Dani Lischinski , Daniel Cohen-Or , Hui Huang

Understanding and estimating driver trust and comfort are essential for the safety and widespread acceptance of autonomous vehicles. Existing works analyze user trust and comfort separately, with limited real-time assessment and…

Human-Computer Interaction · Computer Science 2025-08-26 Aditi Bhalla , Christian Hellert , Enkelejda Kasneci , Nastassja Becker

This paper addresses the often overlooked issue of fairness in the autonomous driving domain, particularly in vision-based perception and prediction systems, which play a pivotal role in the overall functioning of Autonomous Vehicles (AVs).…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 David Fernández Llorca , Pedro Frau , Ignacio Parra , Rubén Izquierdo , Emilia Gómez

Portraying emotion and trustworthiness is known to increase the appeal of video content. However, the causal relationship between these signals and online user engagement is not well understood. This limited understanding is partly due to a…

Multimedia · Computer Science 2021-05-05 Lukas Stappen , Alice Baird , Michelle Lienhart , Annalena Bätz , Björn Schuller

This paper explores public perceptions around the role of affective computing in the workplace. It uses a series of design fictions with 46 UK based participants, unpacking their perspectives on the advantages and disadvantages of tracking…

Human-Computer Interaction · Computer Science 2022-05-18 Lachlan Urquhart , Alex Laffer , Diana Miranda

While the field of affective computing has contributed to greatly improving the seamlessness of human-robot interactions, the focus has primarily been on the emotional processing of the self, rather than the perception of the other. To…

Human-Computer Interaction · Computer Science 2023-11-17 Maria Teresa Parreira , Michael J. Sack , Malte Jung

Music accompaniment generation is a crucial aspect in the composition process. Deep neural networks have made significant strides in this field, but it remains a challenge for AI to effectively incorporate human emotions to create beautiful…

Sound · Computer Science 2023-07-11 Qi Wang , Shubing Zhang , Li Zhou

Despite the abundance of current researches working on the sentiment analysis from videos and audios, finding the best model that gives the highest accuracy rate is still considered a challenge for researchers in this field. The main…

Sound · Computer Science 2024-12-13 Antonio Fernandez , Suzan Awinat

Unlike the six basic emotions of happiness, sadness, fear, anger, disgust and surprise, modelling and predicting dimensional affect in terms of valence (positivity - negativity) and arousal (intensity) has proven to be more flexible,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 Chaudhary Muhammad Aqdus Ilyas , Siyang Song , Hatice Gunes

Continuous affect prediction involves the discrete time-continuous regression of affect dimensions. Dimensions to be predicted often include arousal and valence. Continuous affect prediction researchers are now embracing multimodal model…

Human-Computer Interaction · Computer Science 2020-01-24 Jonny O'Dwyer

While machine learning approaches to visual emotion recognition offer great promise, current methods consider training and testing models on small scale datasets covering limited visual emotion concepts. Our analysis identifies an important…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Rameswar Panda , Jianming Zhang , Haoxiang Li , Joon-Young Lee , Xin Lu , Amit K. Roy-Chowdhury

Continuous valence-arousal estimation in real-world environments is challenging due to inconsistent modality reliability and interaction-dependent variability in audio-visual signals. Existing approaches primarily focus on modeling temporal…

Multimedia · Computer Science 2026-03-13 Yubeen Lee , Sangeun Lee , Junyeop Cha , Eunil Park

Sentiment analysis has become a very important tool for analysis of social media data. There are several methods developed for this research field, many of them working very differently from each other, covering distinct aspects of the…

Computation and Language · Computer Science 2017-11-22 Philipe F. Melo , Daniel H. Dalip , Manoel M. Junior , Marcos A. Gonçalves , Fabrício Benevenuto

As different people perceive others' emotional expressions differently, their annotation in terms of arousal and valence are per se subjective. To address this, these emotion annotations are typically collected by multiple annotators and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-26 Navin Raj Prabhu , Nale Lehmann-Willenbrock , Timo Gerkmann