English
Related papers

Related papers: SEER: The Span-based Emotion Evidence Retrieval Be…

200 papers

Speech Emotion Recognition (SER) has been traditionally formulated as a classification task. However, emotions are generally a spectrum whose distribution varies from situation to situation leading to poor Out-of-Domain (OOD) performance.…

Sound · Computer Science 2024-07-23 Hazim Bukhari , Soham Deshmukh , Hira Dhamyal , Bhiksha Raj , Rita Singh

In Speech Emotion Recognition (SER), textual data is often used alongside audio signals to address their inherent variability. However, the reliance on human annotated text in most research hinders the development of practical SER systems.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-30 Yuanchao Li , Zeyu Zhao , Ondrej Klejch , Peter Bell , Catherine Lai

Affective computing is very important in the relationship between man and machine. In this paper, a system for speech emotion recognition (SER) based on speech signal is proposed, which uses new techniques in different stages of processing.…

Sound · Computer Science 2021-11-16 Fatemeh Daneshfar , Seyed Jahanshah Kabudian

Emotion Recognition in Conversation is a core component of affective computing, while current resources of sign language emotion datasets primarily focus on isolated sentences and lack conversational context. Models trained exclusively on…

Computation and Language · Computer Science 2026-05-25 Yusong Wang , Keyu Mao , Takao Obi , Minghao Shao , Kotaro Funakoshi

Speech emotion recognition (SER) systems are constrained by existing datasets that typically cover only 6-10 basic emotions, lack scale and diversity, and face ethical challenges when collecting sensitive emotional states. We introduce…

Multimodal Emotion Recognition (MER) focuses on identifying and interpreting emotions from modality-compound inputs. Closely mirroring human cognitive processes in real-world environments, MER has drawn substantial attention from both…

Multimedia · Computer Science 2026-05-21 Hongrui Zhang , Daiqing Wu , Yangyang Li , Kuien Liu , Yuhui Wang , Yu Zhou , Sicheng Zhao

Emotion recognition in speech is a challenging multimodal task that requires understanding both verbal content and vocal nuances. This paper introduces a novel approach to emotion detection using Large Language Models (LLMs), which have…

Computation and Language · Computer Science 2024-12-24 Zehui Wu , Ziwei Gong , Lin Ai , Pengyuan Shi , Kaan Donbekci , Julia Hirschberg

Emotion is a core paralinguistic feature in voice interaction. It is widely believed that emotion understanding models learn fundamental representations that transfer to synthesized speech, making emotion understanding results a plausible…

Computation and Language · Computer Science 2026-03-18 Yuan Ge , Haishu Zhao , Aokai Hao , Junxiang Zhang , Bei Li , Xiaoqian Liu , Chenglong Wang , Jianjin Wang , Bingsen Zhou , Bingyu Liu , Jingbo Zhu , Zhengtao Yu , Tong Xiao

Speech emotion recognition (SER) has made significant strides with the advent of powerful self-supervised learning (SSL) models. However, the generalization of these models to diverse languages and emotional expressions remains a challenge.…

Computation and Language · Computer Science 2024-08-16 Mohamed Osman , Daniel Z. Kaplan , Tamer Nadeem

Speech Emotion Recognition (SER) is typically trained and evaluated on majority-voted labels, which simplifies benchmarking but masks subjectivity and provides little transparency into why predictions are made. This neglects valid minority…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-06 Bo-Hao Su , Hui-Ying Shih , Jinchuan Tian , Jiatong Shi , Chi-Chun Lee , Carlos Busso , Shinji Watanabe

Multimodal emotion analysis is shifting from static classification to generative reasoning. Beyond simple label prediction, robust affective reasoning must synthesize fine-grained signals such as facial micro-expressions and prosodic which…

Multimedia · Computer Science 2026-02-05 Zhixian Zhao , Wenjie Tian , Lei Xie

Speech emotion recognition (SER) has many challenges, but one of the main challenges is that each framework does not have a unified standard. In this paper, we propose SpeechEQ, a framework for unifying SER tasks based on a multi-scale…

Sound · Computer Science 2022-07-29 Zuheng Kang , Junqing Peng , Jianzong Wang , Jing Xiao

Sentiment analysis on software engineering (SE) texts has been widely used in the SE research, such as evaluating app reviews or analyzing developers sentiments in commit messages. To better support the use of automated sentiment analysis…

Software Engineering · Computer Science 2021-03-25 Kexin Sun , Hui Gao , Hongyu Kuang , Xiaoxing Ma , Guoping Rong , Dong Shao , He Zhang

In recent years, speech emotion recognition (SER) has been used in wide ranging applications, from healthcare to the commercial sector. In addition to signal processing approaches, methods for SER now also use deep learning techniques.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-06 Sneha Das , Nicole Nadine Lønfeldt , Anne Katrine Pagsberg , Line H. Clemmensen

Detecting emotions across different languages is challenging due to the varied and culturally nuanced ways of emotional expressions. The \textit{Semeval 2025 Task 11: Bridging the Gap in Text-Based emotion} shared task was organised to…

Computation and Language · Computer Science 2025-08-05 Jiyu Chen , Necva Bölücü , Sarvnaz Karimi , Diego Mollá , Cécile L. Paris

Emotion Recognition (ER) is the process of analyzing and identifying human emotions from sensing data. Currently, the field heavily relies on facial expression recognition (FER) because visual channel conveys rich emotional cues. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Kejun Liu , Yuanyuan Liu , Lin Wei , Chang Tang , Yibing Zhan , Zijing Chen , Zhe Chen

The process of identifying human emotion and affective states from speech is known as speech emotion recognition (SER). This is based on the observation that tone and pitch in the voice frequently convey underlying emotion. Speech…

Sound · Computer Science 2024-06-18 Nishargo Nigar

Large audio-language models (LALMs) have achieved near-human performance in sentence-level transcription and emotion recognition. However, existing evaluations focus mainly on surface-level perception, leaving the capacity of models for…

Computation and Language · Computer Science 2025-08-05 Wanqi Yang , Yanda Li , Yunchao Wei , Meng Fang , Ling Chen

Speech emotion recognition (SER) is a pivotal technology for human-computer interaction systems. However, 80.77% of SER papers yield results that cannot be reproduced. We develop EMO-SUPERB, short for EMOtion Speech Universal PERformance…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-13 Haibin Wu , Huang-Cheng Chou , Kai-Wei Chang , Lucas Goncalves , Jiawei Du , Jyh-Shing Roger Jang , Chi-Chun Lee , Hung-Yi Lee

Speech Self-Supervised Learning (SSL) has demonstrated considerable efficacy in various downstream tasks. Nevertheless, prevailing self-supervised models often overlook the incorporation of emotion-related prior information, thereby…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-12 Rui Liu , Zening Ma