English
Related papers

Related papers: Ensemble emotion recognizing with multiple modal p…

200 papers

To enhance the performance of affective models and reduce the cost of acquiring physiological signals for real-world applications, we adopt multimodal deep learning approach to construct affective models from multiple physiological signals.…

Human-Computer Interaction · Computer Science 2016-02-29 Wei Liu , Wei-Long Zheng , Bao-Liang Lu

Recent works have demonstrated the effectiveness of machine learning (ML) techniques in detecting anxiety and stress using physiological signals, but it is unclear whether ML models are learning physiological features specific to stress. To…

Multimedia · Computer Science 2024-02-27 Emily Zhou , Mohammad Soleymani , Maja J. Matarić

Automatic recognition of affective state from wearable physiology has clear societal impact for public health, preventive care, and stress-aware interventions, but real deployments require robustness to non-stationary dynamics, artefacts,…

Multiagent Systems · Computer Science 2026-05-15 Lokesh Singh , Athina Georgara , Jayati Deshmukh , Tan Viet Tuyen Nguyen , Sarvapali D. Ramchurn

Emotion Prediction in Conversation (EPC) aims to forecast the emotions of forthcoming utterances by utilizing preceding dialogues. Previous EPC approaches relied on simple context modeling for emotion extraction, overlooking fine-grained…

Multimedia · Computer Science 2024-08-09 Haoxiang Shi , Ziqi Liang , Jun Yu

Traditionally, in paralinguistic analysis for emotion detection from speech, emotions have been identified with discrete or dimensional (continuous-valued) labels. Accordingly, models that have been proposed for emotion detection use one or…

Sound · Computer Science 2022-11-01 Roshan Sharma , Hira Dhamyal , Bhiksha Raj , Rita Singh

Affective brain-computer interfaces are a relatively new area of research in affective computing. Estimation of affective states can improve human-computer interaction as well as improve the care of people with severe disabilities. To…

Signal Processing · Electrical Eng. & Systems 2020-09-28 Md Rakibul Mowla , Rachael I. Cano , Katie J. Dhuyvetter , David E. Thompson

The large range of potential applications, not only for patients but also for healthy people, that could be achieved by affective BCI (aBCI) makes more latent the necessity of finding a commonly accepted protocol for real-time EEG-based…

Signal Processing · Electrical Eng. & Systems 2020-05-21 Jennifer Sorinasa , Juan C. Fernandez-Troyano , Mikel Val-Calvo , Jose Manuel Ferrández , Eduardo Fernandez

We present a new data-driven model and algorithm to identify the perceived emotions of individuals based on their walking styles. Given an RGB video of an individual walking, we extract his/her walking gait in the form of a series of 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-01-13 Tanmay Randhavane , Uttaran Bhattacharya , Kyra Kapsaskis , Kurt Gray , Aniket Bera , Dinesh Manocha

Affective computing has garnered the attention and interest of researchers in recent years, as there is a need for AI systems to better understand and react to human emotions. However, analyzing human emotions, such as mood or stress, is…

The integration of emotional intelligence in machines is an important step in advancing human-computer interaction. This demands the development of reliable end-to-end emotion recognition systems. However, the scarcity of public affective…

Human-Computer Interaction · Computer Science 2023-06-07 Alireza F. Nia , Vanessa Tang , Gonzalo Maso Talou , Mark Billinghurst

This study introduces a parameter-efficient Hierarchical Spatial Temporal Network (HiSTN) specifically designed for the task of emotion classification using multi-channel electroencephalogram data. The network incorporates a graph hierarchy…

Signal Processing · Electrical Eng. & Systems 2024-08-29 Dongyang Kuang , Xinyue Song , Craig Michoski

Imbalanced datasets pose significant challenges in areas including neuroscience, cognitive science, and medical diagnostics, where accurately detecting minority classes is essential for robust model performance. This study addresses the…

Machine Learning · Computer Science 2025-06-12 Minheng Xiao

In this paper, we address the problem of multimodal emotion recognition from multiple physiological signals. We demonstrate that a Transformer-based approach is suitable for this task. In addition, we present how such models may be…

Signal Processing · Electrical Eng. & Systems 2022-12-29 Juan Vazquez-Rodriguez , Grégoire Lefebvre , Julien Cumin , James L Crowley

Multimodal emotion recognition is a challenging research area that aims to fuse different modalities to predict human emotion. However, most existing models that are based on attention mechanisms have difficulty in learning emotionally…

Computation and Language · Computer Science 2023-03-08 Zihan Zhao , Yu Wang , Yanfeng Wang

In recent years, emotion recognition based on electroencephalography (EEG) has received growing interests in the brain-computer interaction (BCI) field. The neuroscience researches indicate that the left and right brain hemispheres…

Neurons and Cognition · Quantitative Biology 2022-07-12 Yihan Wu , Min Xia , Li Nie , Yangsong Zhang , Andong Fan

This paper proposes a multimodal emotion recognition system based on hybrid fusion that classifies the emotions depicted by speech utterances and corresponding images into discrete classes. A new interpretability technique has been…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Puneet Kumar , Sarthak Malik , Balasubramanian Raman

Use of the electroencephalogram (EEG) and machine learning approaches to recognize emotions can facilitate affective human computer interactions. However, the type of EEG data constitutes an obstacle for cross-individual EEG feature…

Machine Learning · Computer Science 2021-05-26 Xiaolong Zhong , Zhong Yin

Emotional expressiveness captures the extent to which a person tends to outwardly display their emotions through behavior. Due to the close relationship between emotional expressiveness and behavioral health, as well as the crucial role…

Human-Computer Interaction · Computer Science 2020-09-02 Victoria Lin , Jeffrey M. Girard , Michael A. Sayette , Louis-Philippe Morency

Emotion recognition from biometrics is relevant to a wide range of application domains, including healthcare. Existing approaches usually adopt multi-electrodes sensors that could be expensive or uncomfortable to be used in real-life…

Human-Computer Interaction · Computer Science 2018-01-19 Daniela Girardi , Filippo Lanubile , Nicole Novielli

Multi-label sentiment classification plays a vital role in natural language processing by detecting multiple emotions within a single text. However, existing datasets like GoEmotions often suffer from severe class imbalance, which hampers…

Computation and Language · Computer Science 2026-03-31 Zijin Su , Huanzhu Lyu , Yuren Niu , Yiming Liu