中文
相关论文

相关论文: Multimodal Emotion Recognition from Raw Audio with…

200 篇论文

Speech emotion recognition is a crucial problem manifesting in a multitude of applications such as human computer interaction and education. Although several advancements have been made in the recent years, especially with the advent of…

声音 · 计算机科学 2021-03-05 Panagiotis Tzirakis , Anh Nguyen , Stefanos Zafeiriou , Björn W. Schuller

Speech emotion recognition (SER) has drawn increasing attention for its applications in human-machine interaction. However, existing SER methods ignore the information gap between the pre-training speech recognition task and the downstream…

声音 · 计算机科学 2023-10-03 Dongyuan Li , Yusong Wang , Kotaro Funakoshi , Manabu Okumura

Music emotion recognition (MER) aims to identify the emotions conveyed in a given musical piece. However, currently, in the field of MER, the available public datasets have limited sample sizes. Recently, segment-based methods for…

声音 · 计算机科学 2025-04-23 Yifu Sun , Xulong Zhang , Monan Zhou , Wei Li

Data-driven models achieve successful results in Speech Emotion Recognition (SER). However, these models, which are often based on general acoustic features or end-to-end approaches, show poor performance when the testing set has a…

音频与语音处理 · 电气工程与系统科学 2025-12-15 Duowei Tang , Peter Kuppens , Lucca Geurts , Toon van Waterschoot

Speech Emotion Recognition (SER) is a crucial component in developing general-purpose AI agents capable of natural human-computer interaction. However, building robust multilingual SER systems remains challenging due to the scarcity of…

音频与语音处理 · 电气工程与系统科学 2025-01-08 Hsi-Che Lin , Yi-Cheng Lin , Huang-Cheng Chou , Hung-yi Lee

Speech Emotion Recognition (SER) is fundamental to affective computing and human-computer interaction, yet existing models struggle to generalize across diverse acoustic conditions. While Contrastive Language-Audio Pretraining (CLAP)…

声音 · 计算机科学 2025-07-08 Jiacheng Shi , Yanfu Zhang , Ye Gao

Speech Emotion Recognition (SER) systems often degrade in performance when exposed to the unpredictable acoustic interference found in real-world environments. Additionally, the opacity of deep learning models hinders their adoption in…

声音 · 计算机科学 2025-12-23 Sudip Chakrabarty , Pappu Bishwas , Rajdeep Chatterjee

Speech Emotion Recognition (SER) is a challenging task. In this paper, we introduce a modality conversion concept aimed at enhancing emotion recognition performance on the MELD dataset. We assess our approach through two experiments: first,…

声音 · 计算机科学 2023-07-24 Zeinab Sadat Taghavi , Ali Satvaty , Hossein Sameti

Facial expressions are one of the most powerful ways for depicting specific patterns in human behavior and describing human emotional state. Despite the impressive advances of affective computing over the last decade, automatic video-based…

计算机视觉与模式识别 · 计算机科学 2021-01-18 Thomas Teixeira , Eric Granger , Alessandro Lameiras Koerich

Speech Emotion Recognition (SER) involves analyzing vocal expressions to determine the emotional state of speakers, where the comprehensive and thorough utilization of audio information is paramount. Therefore, we propose a novel approach…

音频与语音处理 · 电气工程与系统科学 2025-04-29 Zixiang Wan , Ziyue Qiu , Yiyang Liu , Wei-Qiang Zhang

Speech Emotion Recognition (SER) plays a crucial role in enhancing human-computer interaction. Cross-Linguistic SER (CLSER) has been a challenging research problem due to significant variability in linguistic and acoustic features of…

音频与语音处理 · 电气工程与系统科学 2025-01-22 Ruoyu Zhao , Xiantao Jiang , F. Richard Yu , Victor C. M. Leung , Tao Wang , Shaohu Zhang

Speech emotion recognition (SER) in naturalistic conditions presents a significant challenge for the speech processing community. Challenges include disagreement in labeling among annotators and imbalanced data distributions. This paper…

机器学习 · 计算机科学 2025-06-13 Thanathai Lertpetchpun , Tiantian Feng , Dani Byrd , Shrikanth Narayanan

Speech Emotion Recognition (SER) often operates on speech segments detected by a Voice Activity Detection (VAD) model. However, VAD models may output flawed speech segments, especially in noisy environments, resulting in degraded…

声音 · 计算机科学 2024-10-18 Natsuo Yamashita , Masaaki Yamamoto , Yohei Kawaguchi

Cross-lingual Speech Emotion Recognition (CLSER) aims to identify emotional states in unseen languages. However, existing methods heavily rely on the semantic synchrony of complete labels and static feature stability, hindering low-resource…

声音 · 计算机科学 2026-04-10 Ya Zhao , Yinfeng Yu , Liejun Wang

In this paper, we propose a new methodology for emotional speech recognition using visual deep neural network models. We employ the transfer learning capabilities of the pre-trained computer vision deep models to have a mandate for the…

计算机视觉与模式识别 · 计算机科学 2022-04-08 Waleed Ragheb , Mehdi Mirzapour , Ali Delfardi , Hélène Jacquenet , Lawrence Carbon

During the last decade, the applications of signal processing have drastically improved with deep learning. However areas of affecting computing such as emotional speech synthesis or emotion recognition from spoken language remains…

音频与语音处理 · 电气工程与系统科学 2018-06-04 Noé Tits , Kevin El Haddad , Thierry Dutoit

Emotion is a core paralinguistic feature in voice interaction. It is widely believed that emotion understanding models learn fundamental representations that transfer to synthesized speech, making emotion understanding results a plausible…

Discrete speech tokens offer significant advantages for storage and language model integration, but their application in speech emotion recognition (SER) is limited by paralinguistic information loss during quantization. This paper presents…

音频与语音处理 · 电气工程与系统科学 2026-01-27 Esther Sun , Abinay Reddy Naini , Carlos Busso

Speech emotion recognition (SER) systems often struggle in real-world environments, where ambient noise severely degrades their performance. This paper explores a novel approach that exploits prior knowledge of testing environments to…

声音 · 计算机科学 2025-11-11 Seong-Gyun Leem , Daniel Fulford , Jukka-Pekka Onnela , David Gard , Carlos Busso

In this paper, we propose to utilise diffusion models for data augmentation in speech emotion recognition (SER). In particular, we present an effective approach to utilise improved denoising diffusion probabilistic models (IDDPM) to…

声音 · 计算机科学 2023-05-22 Ibrahim Malik , Siddique Latif , Raja Jurdak , Björn Schuller