English
Related papers

Related papers: EmoSphere-SER: Enhancing Speech Emotion Recognitio…

200 papers

Facial Expression Recognition (FER) is a crucial task in affective computing, but its conventional focus on the seven basic emotions limits its applicability to the complex and expanding emotional spectrum. To address the issue of new and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Niki Maria Foteinopoulou , Ioannis Patras

There are two paradigms of emotion representation, categorical labeling and dimensional description in continuous space. Therefore, the emotion recognition task can be treated as a classification or regression. The main aim of this study is…

Sound · Computer Science 2022-10-17 Meysam Shamsi , Marie Tahon

When recognizing emotions from speech, we encounter two common problems: how to optimally capture emotion-relevant information from the speech signal and how to best quantify or categorize the noisy subjective emotion labels.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-04 Sofoklis Kakouros , Themos Stafylakis , Ladislav Mosner , Lukas Burget

This paper presents our contributions to the Speech Emotion Recognition in Naturalistic Conditions (SERNC) Challenge, where we address categorical emotion recognition and emotional attribute prediction. To handle the complexities of natural…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-15 Hyo Jin Jon , Longbin Jin , Hyuntaek Jung , Hyunseo Kim , Donghun Min , Eun Yi Kim

This work explores the effect of gender and linguistic-based vocal variations on the accuracy of emotive expression classification. Emotive expressions are considered from the perspective of spectral features in speech (Mel-frequency…

Sound · Computer Science 2022-10-28 Zachary Dair , Ryan Donovan , Ruairi O'Reilly

Traditional pet emotion recognition from vocalizations, based on discrete classification, struggles with ambiguity and capturing intensity variations. We propose a continuous Valence-Arousal (VA) model that represents emotions in a…

Sound · Computer Science 2025-10-16 Junyao Huang , Rumin Situ

Speech is a natural means of conveying emotions, making it an effective method for understanding and representing human feelings. Reliable speech emotion recognition (SER) is central to applications in human-computer interaction,…

Sound · Computer Science 2026-03-03 Faria Ahmed , Rafi Hassan Chowdhury , Fatema Tuz Zohora Moon , Sabbir Ahmed

The purpose of emotion recognition in conversation (ERC) is to identify the emotion category of an utterance based on contextual information. Previous ERC methods relied on simple connections for cross-modal fusion and ignored the…

Computation and Language · Computer Science 2024-05-29 Haoxiang Shi , Xulong Zhang , Ning Cheng , Yong Zhang , Jun Yu , Jing Xiao , Jianzong Wang

Non-speech emotion recognition has a wide range of applications including healthcare, crime control and rescue, and entertainment, to name a few. Providing these applications using edge computing has great potential, however, recent studies…

Sound · Computer Science 2023-05-02 Ibrahim Malik , Siddique Latif , Sanaullah Manzoor , Muhammad Usama , Junaid Qadir , Raja Jurdak

Speech deepfake detection (SDD) systems perform well on standard benchmarks datasets but often fail to generalize to expressive and emotional spoofing attacks. Many methods rely on spoof-heavy training data, learning dataset-specific…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-16 Aurosweta Mahapatra , Ismail Rasim Ulgen , Kong Aik Lee , Nicholas Andrews , Berrak Sisman

Speech emotion recognition (SER) has attracted great attention in recent years due to the high demand for emotionally intelligent speech interfaces. Deriving speaker-invariant representations for speech emotion recognition is crucial. In…

Audio and Speech Processing · Electrical Eng. & Systems 2019-03-25 Ming Tu , Yun Tang , Jing Huang , Xiaodong He , Bowen Zhou

Traditionally, in paralinguistic analysis for emotion detection from speech, emotions have been identified with discrete or dimensional (continuous-valued) labels. Accordingly, models that have been proposed for emotion detection use one or…

Sound · Computer Science 2022-11-01 Roshan Sharma , Hira Dhamyal , Bhiksha Raj , Rita Singh

Previous work on emotion recognition demonstrated a synergistic effect of combining several modalities such as auditory, visual, and transcribed text to estimate the affective state of a speaker. Among these, the linguistic modality is…

Computation and Language · Computer Science 2019-03-01 Egor Lakomkin , Mohammad Ali Zamani , Cornelius Weber , Sven Magg , Stefan Wermter

Multimodal Emotion Recognition (MER) is a critical research area that seeks to decode human emotions from diverse data modalities. However, existing machine learning methods predominantly rely on predefined emotion taxonomies, which fail to…

Human-Computer Interaction · Computer Science 2025-05-08 Zheng Lian , Haiyang Sun , Licai Sun , Haoyu Chen , Lan Chen , Hao Gu , Zhuofan Wen , Shun Chen , Siyuan Zhang , Hailiang Yao , Bin Liu , Rui Liu , Shan Liang , Ya Li , Jiangyan Yi , Jianhua Tao

Research on Speech Emotion Recognition (SER) often faces challenges such as the lack of large-scale public datasets and limited generalization capability when dealing with data from different distributions. To solve this problem, this paper…

Sound · Computer Science 2024-12-02 Xiang minjie

In this paper, we investigate the impact of incorporating timestamp-based alignment between Automatic Speech Recognition (ASR) transcripts and Speaker Diarization (SD) outputs on Speech Emotion Recognition (SER) accuracy. Misalignment…

Computation and Language · Computer Science 2025-07-28 Hsuan-Yu Wang , Pei-Ying Lee , Berlin Chen

Speech emotion recognition (SER) remains a challenging yet crucial task due to the inherent complexity and diversity of human emotions. To address this problem, researchers attempt to fuse information from other modalities via multimodal…

Sound · Computer Science 2024-12-10 Feng Li , Jiusong Luo , Wanjun Xia

Speech Emotion Recognition (SER) systems have growing applications in sensitive domains such as mental health and education, where biased predictions can cause harm. Traditional fairness metrics, such as Equalised Odds and Demographic…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-23 Tomisin Ogunnubi , Yupei Li , Björn Schuller

Using mel-spectrograms over conventional MFCCs features, we assess the abilities of convolutional neural networks to accurately recognize and classify emotions from speech data. We introduce FSER, a speech emotion recognition model trained…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-17 Bonaventure F. P. Dossou , Yeno K. S. Gbenou

Cross-subject EEG-based emotion recognition (EER) remains challenging due to strong inter-subject variability, which induces substantial distribution shifts in EEG signals, as well as the high complexity of emotion-related neural…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Weiwei Wu , Yueyang Li , Yuhu Shi , Weiming Zeng , Lang Qin , Yang Yang , Ke Zhou , Zhiguo Zhang , Wai Ting Siok , Nizhuan Wang