English
Related papers

Related papers: Neuromorphic Valence and Arousal Estimation

200 papers

Decades of research indicate that emotion recognition is more effective when drawing information from multiple modalities. But what if some modalities are sometimes missing? To address this problem, we propose a novel Transformer-based…

Machine Learning · Computer Science 2023-11-20 Juan Vazquez-Rodriguez , Grégoire Lefebvre , Julien Cumin , James L. Crowley

Emotions recognition is commonly employed for health assessment. However, the typical metric for evaluation in therapy is based on patient-doctor appraisal. This process can fall into the issue of subjectivity, while also requiring…

Human-Computer Interaction · Computer Science 2021-01-21 Jumana Almahmoud , Kruthika Kikkeri

For many years, the emotion recognition task has remained one of the most interesting and important problems in the field of human-computer interaction. In this study, we consider the emotion recognition task as a classification as well as…

Computer Vision and Pattern Recognition · Computer Science 2020-06-22 Denis Rangulov , Muhammad Fahim

Emotions play an essential role in human communication. Developing computer vision models for automatic recognition of emotion expression can aid in a variety of domains, including robotics, digital behavioral healthcare, and media…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Yang Qian , Ali Kargarandehkordi , Onur Cezmi Mutlu , Saimourya Surabhi , Mohammadmahdi Honarmand , Dennis Paul Wall , Peter Washington

Throughout the past decade, many studies have classified human emotions using only a single sensing modality such as face video, electroencephalogram (EEG), electrocardiogram (ECG), galvanic skin response (GSR), etc. The results of these…

Human-Computer Interaction · Computer Science 2018-06-22 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski

Event cameras, also known as neuromorphic cameras, are an emerging technology that offer advantages over traditional shutter and frame-based cameras, including high temporal resolution, low power consumption, and selective data acquisition.…

Image and Video Processing · Electrical Eng. & Systems 2023-09-22 Aniket Jagtap , RamaKrishna Venkatesh Saripalli , Joe Lemley , Waseem Shariff , Alan F. Smeaton

Facial emotion recognition has been typically cast as a single-label classification problem of one out of six prototypical emotions. However, that is an oversimplification that is unsuitable for representing the multifaceted spectrum of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Joao Baptista Cardia Neto , Claudio Ferrari , Stefano Berretti

The automatic recognition of a person's emotional state has become a very active research field that involves scientists specialized in different areas such as artificial intelligence, computer vision or psychology, among others. Our main…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Eduardo Paluzo-Hidalgo , Guillermo Aguirre-Carrazana , Rocio Gonzalez-Diaz

We introduce Multimodal Matching based on Valence and Arousal (MMVA), a tri-modal encoder framework designed to capture emotional content across images, music, and musical captions. To support this framework, we expand the…

Sound · Computer Science 2025-11-21 Suhwan Choi , Kyu Won Kim , Myungjoo Kang

The project leverages advanced machine and deep learning techniques to address the challenge of emotion recognition by focusing on non-facial cues, specifically hands, body gestures, and gestures. Traditional emotion recognition systems…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Haoyang Liu

Continuous Emotion Recognition (CER) plays a crucial role in intelligent human-computer interaction, mental health monitoring, and autonomous driving. Emotion modeling based on the Valence-Arousal (VA) space enables a more nuanced…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Yuheng Liang , Zheyu Wang , Feng Liu , Mingzhou Liu , Yu Yao

Facial emotion recognition is the task to classify human emotions in face images. It is a difficult task due to high aleatoric uncertainty and visual ambiguity. A large part of the literature aims to show progress by increasing accuracy on…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Maryam Matin , Matias Valdenegro-Toro

Emotions play an important role in people's life. Understanding and recognising is not only important for interpersonal communication, but also has promising applications in Human-Computer Interaction, automobile safety and medical…

Machine Learning · Computer Science 2019-12-17 Xia Yicheng , Dimitrios Kollias

Despite the abundance of current researches working on the sentiment analysis from videos and audios, finding the best model that gives the highest accuracy rate is still considered a challenge for researchers in this field. The main…

Sound · Computer Science 2024-12-13 Antonio Fernandez , Suzan Awinat

Facial expressions vary from person to person, and the brightness, contrast, and resolution of every random image are different. This is why recognizing facial expressions is very difficult. This article proposes an efficient system for…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Faisal Ghaffar

Second-person neuroscience holds social cognition as embodied meaning co-regulation through reciprocal interaction, modeled here as coupled active inference with affect emerging as inference over identity-relevant surprise. Each agent…

Neurons and Cognition · Quantitative Biology 2025-09-25 Nicolas Hinrichs , Mahault Albarracin , Dimitris Bolis , Yuyue Jiang , Leonardo Christov-Moore , Leonhard Schilbach

Recognising continuous emotions and action unit (AU) intensities from face videos requires a spatial and temporal understanding of expression dynamics. Existing works primarily rely on 2D face appearances to extract such dynamics. This work…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Mani Kumar Tellamekala , Ömer Sümer , Björn W. Schuller , Elisabeth André , Timo Giesbrecht , Michel Valstar

Recent work has shown that a person's sympathetic arousal can be estimated from facial videos alone using basic signal processing. This opens up new possibilities in the field of telehealth and stress management, providing a non-invasive…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Björn Braun , Daniel McDuff , Tadas Baltrusaitis , Paul Streli , Max Moebus , Christian Holz

Affect (emotion) recognition has gained significant attention from researchers in the past decade. Emotion-aware computer systems and devices have many applications ranging from interactive robots, intelligent online tutor to emotion based…

Human-Computer Interaction · Computer Science 2016-07-12 Amol Patwardhan , Gerald Knapp

In this research, an emotion recognition system is developed based on valence/arousal model using electroencephalography (EEG) signals. EEG signals are decomposed into the gamma, beta, alpha and theta frequency bands using discrete wavelet…

Machine Learning · Computer Science 2019-06-04 Omid Bazgir , Zeynab Mohammadi , Seyed Amir Hassan Habibi