中文
相关论文

相关论文: SERAB: A multi-lingual benchmark for speech emotio…

200 篇论文

Speech Emotion Recognition (SER) is a fundamental task to predict the emotion label from speech data. Recent works mostly focus on using convolutional neural networks~(CNNs) to learn local attention map on fixed-scale feature representation…

声音 · 计算机科学 2022-04-13 Wenjing Zhu , Xiang Li

Significant advances are being made in speech emotion recognition (SER) using deep learning models. Nonetheless, training SER systems remains challenging, requiring both time and costly resources. Like many other machine learning tasks,…

声音 · 计算机科学 2023-09-18 Tiantian Feng , Shrikanth Narayanan

Emotion recognition in conversations (ERC) is vital to the advancements of conversational AI and its applications. Therefore, the development of an automated ERC model using the concepts of machine learning (ML) would be beneficial.…

计算与语言 · 计算机科学 2023-06-06 Amitabha Dey , Shan Suthaharan

Conversational emotion recognition (CER) has attracted increasing interests in the natural language processing (NLP) community. Different from the vanilla emotion recognition, effective speaker-sensitive utterance representation is one…

计算与语言 · 计算机科学 2020-03-06 Jingye Li , Meishan Zhang , Donghong Ji , Yijiang Liu

Recent studies have explored the use of pre-trained embeddings for speech emotion recognition (SER), achieving comparable performance to conventional methods that rely on low-level knowledge-inspired acoustic features. These embeddings are…

声音 · 计算机科学 2023-05-22 Tiantian Feng , Rajat Hebbar , Shrikanth Narayanan

Continuous dimensional speech emotion recognition captures affective variation along valence, arousal, and dominance, providing finer-grained representations than categorical approaches. Yet most multimodal methods rely solely on global…

声音 · 计算机科学 2026-01-27 Haoxun Li , Yuqing Sun , Hanlei Shi , Yu Liu , Leyuan Qu , Taihao Li

The goal of speech emotion recognition (SER) is to identify the emotional aspects of speech. The SER challenge for Brazilian Portuguese speech was proposed with short snippets of Portuguese which are classified as neutral, non-neutral…

声音 · 计算机科学 2022-10-27 Marcelo Matheus Gauy , Marcelo Finger

This study investigates the key characteristics and suitability of widely used Facial Expression Recognition (FER) datasets for training deep learning models. In the field of affective computing, FER is essential for interpreting human…

计算机视觉与模式识别 · 计算机科学 2025-03-27 F. Xavier Gaya-Morey , Cristina Manresa-Yee , Célia Martinie , Jose M. Buades-Rubio

In this paper, we propose to use pre-trained features from end-to-end ASR models to solve speech sentiment analysis as a down-stream task. We show that end-to-end ASR features, which integrate both acoustic and text information from speech,…

计算与语言 · 计算机科学 2020-03-06 Zhiyun Lu , Liangliang Cao , Yu Zhang , Chung-Cheng Chiu , James Fan

Robust speech emotion recognition relies on the quality of the speech features. We present speech features enhancement strategy that improves speech emotion recognition. We used the INTERSPEECH 2010 challenge feature-set. We identified…

信号处理 · 电气工程与系统科学 2022-08-22 Sofia Kanwal , Sohail Asghar , Hazrat Ali

Many recent studies have focused on fine-tuning pre-trained models for speech emotion recognition (SER), resulting in promising performance compared to traditional methods that rely largely on low-level, knowledge-inspired acoustic…

声音 · 计算机科学 2024-02-15 Tiantian Feng , Shrikanth Narayanan

In this paper, we propose an iterative framework for self-supervised speaker representation learning based on a deep neural network (DNN). The framework starts with training a self-supervision speaker embedding network by maximizing…

音频与语音处理 · 电气工程与系统科学 2020-10-29 Danwei Cai , Weiqing Wang , Ming Li

Although speech recognition has become a widespread technology, inferring emotion from speech signals still remains a challenge. To address this problem, this paper proposes a quaternion convolutional neural network (QCNN) based speech…

声音 · 计算机科学 2021-11-02 Aneesh Muppidi , Martin Radfar

Speech emotion recognition systems have high prediction latency because of the high computational requirements for deep learning models and low generalizability mainly because of the poor reliability of emotional measurements across…

声音 · 计算机科学 2023-02-23 Abdul Rehman , Zhen-Tao Liu , Min Wu , Wei-Hua Cao , Cheng-Shan Jiang

Speech emotion recognition (SER) systems can exhibit gender-related performance disparities, but how such bias manifests in multilingual speech LLMs across languages and modalities is unclear. We introduce a novel multilingual, multimodal…

声音 · 计算机科学 2026-03-24 Zi Haur Pang , Xiaoxue Gao , Tatsuya Kawahara , Nancy F. Chen

Speech Emotion Recognition (SER) has become a growing focus of research in human-computer interaction. Spatiotemporal features play a crucial role in SER, yet current research lacks comprehensive spatiotemporal feature learning. This paper…

声音 · 计算机科学 2023-12-29 Mengbo Li , Yuanzhong Zheng , Dichucheng Li , Yulun Wu , Yaoxuan Wang , Haojun Fei

Distant speech recognition is a challenge, particularly due to the corruption of speech signals by reverberation caused by large distances between the speaker and microphone. In order to cope with a wide range of reverberations in…

计算与语言 · 计算机科学 2016-08-18 Jeehye Lee , Myungin Lee , Joon-Hyuk Chang

In practical applications for emotion recognition, users do not always exist in the training corpus. The mismatch between training speakers and testing speakers affects the performance of the trained model. To deal with this problem, we…

音频与语音处理 · 电气工程与系统科学 2019-10-31 Zheng Lian , Jianhua Tao , Bin Liu , Jian Huang

Speech emotion recognition is a challenging task and an important step towards more natural human-machine interaction. We show that pre-trained language models can be fine-tuned for text emotion recognition, achieving an accuracy of 69.5%…

音频与语音处理 · 电气工程与系统科学 2019-12-06 Verena Heusser , Niklas Freymuth , Stefan Constantin , Alex Waibel

In speech emotion recognition (SER), using predefined features without considering their practical importance may lead to high dimensional datasets, including redundant and irrelevant information. Consequently, high-dimensional learning…

声音 · 计算机科学 2024-06-07 Alaa Nfissi , Wassim Bouachir , Nizar Bouguila , Brian Mishara