中文
相关论文

相关论文: Multimodal Emotion Recognition from Raw Audio with…

200 篇论文

We propose a novel multi-task pre-training method for Speech Emotion Recognition (SER). We pre-train SER model simultaneously on Automatic Speech Recognition (ASR) and sentiment classification tasks to make the acoustic ASR model more…

计算与语言 · 计算机科学 2022-01-31 Ayoub Ghriss , Bo Yang , Viktor Rozgic , Elizabeth Shriberg , Chao Wang

This paper presents a transfer learning method in speech emotion recognition based on a Time-Delay Neural Network (TDNN) architecture. A major challenge in the current speech-based emotion detection research is data scarcity. The proposed…

音频与语音处理 · 电气工程与系统科学 2020-08-18 Sitong Zhou , Homayoon Beigi

Current state-of-the-art speech recognition systems build on recurrent neural networks for acoustic and/or language modeling, and rely on feature extraction pipelines to extract mel-filterbanks or cepstral coefficients. In this paper we…

计算与语言 · 计算机科学 2019-04-10 Neil Zeghidour , Qiantong Xu , Vitaliy Liptchinsky , Nicolas Usunier , Gabriel Synnaeve , Ronan Collobert

Speech emotion recognition (SER) is pivotal for enhancing human-machine interactions. This paper introduces "EmoHRNet", a novel adaptation of High-Resolution Networks (HRNet) tailored for SER. The HRNet structure is designed to maintain…

声音 · 计算机科学 2025-10-08 Akshay Muppidi , Martin Radfar

Emotion recognition from speech is a challenging task that requires capturing both linguistic and paralinguistic cues, with critical applications in human-computer interaction and mental health monitoring. Recent works have highlighted the…

音频与语音处理 · 电气工程与系统科学 2025-08-21 Hugo Thimonier , Antony Perzo , Renaud Seguier

Recognizing emotional signals in speech has a significant impact on enhancing the effectiveness of human-computer interaction (HCI). This study introduces EmoAugNet, a hybrid deep learning framework, that incorporates Long Short-Term Memory…

声音 · 计算机科学 2025-08-11 Durjoy Chandra Paul , Gaurob Saha , Md Amjad Hossain

Speech emotion recognition (SER) classifies audio into emotion categories such as Happy, Angry, Fear, Disgust and Neutral. While Speech Emotion Recognition (SER) is a common application for popular languages, it continues to be a problem…

声音 · 计算机科学 2022-11-17 Zihan Wang , Qi Meng , HaiFeng Lan , XinRui Zhang , KeHao Guo , Akshat Gupta

Large, pre-trained neural networks consisting of self-attention layers (transformers) have recently achieved state-of-the-art results on several speech emotion recognition (SER) datasets. These models are typically pre-trained in…

Speech emotion recognition (SER), the task of identifying the expression of emotion from spoken content, is challenging due to the difficulty in extracting representations that capture emotional attributes from speech. The scarcity of…

音频与语音处理 · 电气工程与系统科学 2025-08-27 Soumya Dutta , Sriram Ganapathy

Speech emotion recognition (SER) has advanced significantly for the sake of deep-learning methods, while textual information further enhances its performance. However, few studies have focused on the physiological information during speech…

声音 · 计算机科学 2025-11-12 Ziqian Zhang , Min Huang , Zhongzhe Xiao

Sound event detection systems typically consist of two stages: extracting hand-crafted features from the raw audio waveform, and learning a mapping between these features and the target sound events using a classifier. Recently, the focus…

声音 · 计算机科学 2018-05-11 Emre Çakır , Tuomas Virtanen

Multimodal Emotion Recognition (MER) aims to automatically identify and understand human emotional states by integrating information from various modalities. However, the scarcity of annotated multimodal data significantly hinders the…

人机交互 · 计算机科学 2024-09-11 Zhixian Zhao , Haifeng Chen , Xi Li , Dongmei Jiang , Lei Xie

Speech emotion recognition (SER) has traditionally relied on categorical or dimensional labels. However, this technique is limited in representing both the diversity and interpretability of emotions. To overcome this limitation, we focus on…

音频与语音处理 · 电气工程与系统科学 2026-02-19 Ryotaro Nagase , Ryoichi Takashima , Yoichi Yamashita

Speech emotion recognition (SER) has been a popular research topic in human-computer interaction (HCI). As edge devices are rapidly springing up, applying SER to edge devices is promising for a huge number of HCI applications. Although deep…

声音 · 计算机科学 2023-05-12 Yi Chang , Zhao Ren , Thanh Tam Nguyen , Kun Qian , Björn W. Schuller

Emotion recognition from audio signals has been regarded as a challenging task in signal processing as it can be considered as a collection of static and dynamic classification tasks. Recognition of emotions from speech data has been…

声音 · 计算机科学 2020-09-21 Soham Chattopadhyay , Arijit Dey , Hritam Basak

In this study, we revisit key training strategies in machine learning often overlooked in favor of deeper architectures. Specifically, we explore balancing strategies, activation functions, and fine-tuning techniques to enhance speech…

音频与语音处理 · 电气工程与系统科学 2025-09-26 Jing-Tong Tzeng , Bo-Hao Su , Ya-Tse Wu , Hsing-Hang Chou , Chi-Chun Lee

Although paralinguistic cues are often considered the primary drivers of speech emotion recognition (SER), we investigate the role of lexical content extracted from speech and show that it can achieve competitive and in some cases higher…

音频与语音处理 · 电气工程与系统科学 2025-09-09 David Combei

Speech Emotion Recognition (SER) is a fundamental task to predict the emotion label from speech data. Recent works mostly focus on using convolutional neural networks~(CNNs) to learn local attention map on fixed-scale feature representation…

声音 · 计算机科学 2022-04-13 Wenjing Zhu , Xiang Li

Speech emotion recognition (SER) has attracted great attention in recent years due to the high demand for emotionally intelligent speech interfaces. Deriving speaker-invariant representations for speech emotion recognition is crucial. In…

音频与语音处理 · 电气工程与系统科学 2019-03-25 Ming Tu , Yun Tang , Jing Huang , Xiaodong He , Bowen Zhou

Speech Emotion Recognition (SER) plays a crucial role in advancing human-computer interaction and speech processing capabilities. We introduce a novel deep-learning architecture designed specifically for the functional data model known as…

声音 · 计算机科学 2024-03-27 Matthieu Saumard , Abir El Haj , Thibault Napoleon