中文
相关论文

相关论文: Active Learning with Task Adaptation Pre-training …

200 篇论文

Speech Emotion Recognition (SER) is a challenging task. In this paper, we introduce a modality conversion concept aimed at enhancing emotion recognition performance on the MELD dataset. We assess our approach through two experiments: first,…

声音 · 计算机科学 2023-07-24 Zeinab Sadat Taghavi , Ali Satvaty , Hossein Sameti

In Speech Emotion Recognition (SER), emotional characteristics often appear in diverse forms of energy patterns in spectrograms. Typical attention neural network classifiers of SER are usually optimized on a fixed attention granularity. In…

声音 · 计算机科学 2021-02-04 Mingke Xu , Fan Zhang , Xiaodong Cui , Wei Zhang

Speech Emotion Recognition (SER) is fundamental to affective computing and human-computer interaction, yet existing models struggle to generalize across diverse acoustic conditions. While Contrastive Language-Audio Pretraining (CLAP)…

声音 · 计算机科学 2025-07-08 Jiacheng Shi , Yanfu Zhang , Ye Gao

While speech emotion recognition (SER) research has made significant progress, achieving generalization across various corpora continues to pose a problem. We propose a novel domain adaptation technique that embodies a multitask framework…

计算与语言 · 计算机科学 2023-10-10 Chung-Soo Ahn , Jagath C. Rajapakse , Rajib Rana

Speech Emotion Recognition (SER) traditionally relies on auditory data analysis for emotion classification. Several studies have adopted different methods for SER. However, existing SER methods often struggle to capture subtle emotional…

声音 · 计算机科学 2026-01-23 HyeYoung Lee , Muhammad Nadeem

Speech emotion recognition is a challenging task and an important step towards more natural human-machine interaction. We show that pre-trained language models can be fine-tuned for text emotion recognition, achieving an accuracy of 69.5%…

音频与语音处理 · 电气工程与系统科学 2019-12-06 Verena Heusser , Niklas Freymuth , Stefan Constantin , Alex Waibel

Speech emotion recognition (SER) is a pivotal technology for human-computer interaction systems. However, 80.77% of SER papers yield results that cannot be reproduced. We develop EMO-SUPERB, short for EMOtion Speech Universal PERformance…

音频与语音处理 · 电气工程与系统科学 2024-03-13 Haibin Wu , Huang-Cheng Chou , Kai-Wei Chang , Lucas Goncalves , Jiawei Du , Jyh-Shing Roger Jang , Chi-Chun Lee , Hung-Yi Lee

Existing speech emotion recognition (SER) methods commonly suffer from the lack of high-quality large-scale corpus, partly due to the complex, psychological nature of emotion which makes accurate labeling difficult and time consuming.…

声音 · 计算机科学 2025-09-30 Haoyu Song , Ian McLoughlin , Qing Gu , Nan Jiang , Yan Song

Data augmentation is a widely used strategy for training robust machine learning models. It partially alleviates the problem of limited data for tasks like speech emotion recognition (SER), where collecting data is expensive and…

Despite the increasing research interest in end-to-end learning systems for speech emotion recognition, conventional systems either suffer from the overfitting due in part to the limited training data, or do not explicitly consider the…

计算与语言 · 计算机科学 2019-04-01 Zixing Zhang , Bingwen Wu , Bjoern Schuller

Automatic speech emotion recognition (SER) is a challenging task that plays a crucial role in natural human-computer interaction. One of the main challenges in SER is data scarcity, i.e., insufficient amounts of carefully labeled data to…

声音 · 计算机科学 2021-08-17 Sarala Padi , Seyed Omid Sadjadi , Dinesh Manocha , Ram D. Sriram

Multimodal Emotion Recognition (MER) aims to automatically identify and understand human emotional states by integrating information from various modalities. However, the scarcity of annotated multimodal data significantly hinders the…

人机交互 · 计算机科学 2024-09-11 Zhixian Zhao , Haifeng Chen , Xi Li , Dongmei Jiang , Lei Xie

Significant advances are being made in speech emotion recognition (SER) using deep learning models. Nonetheless, training SER systems remains challenging, requiring both time and costly resources. Like many other machine learning tasks,…

声音 · 计算机科学 2023-09-18 Tiantian Feng , Shrikanth Narayanan

Emotion and intent recognition from speech is essential and has been widely investigated in human-computer interaction. The rapid development of social media platforms, chatbots, and other technologies has led to a large volume of speech…

声音 · 计算机科学 2025-07-11 Zhao Ren , Rathi Adarshi Rammohan , Kevin Scheck , Sheng Li , Tanja Schultz

The advent of Large Language Models (LLM) has reformed the Automatic Speech Recognition (ASR). Prompting LLM with audio embeddings to generate transcriptions becomes the new state-of-the-art ASR. Despite LLMs being trained with an extensive…

计算与语言 · 计算机科学 2024-12-11 Yingyi Ma , Zhe Liu , Ozlem Kalinli

In speech emotion recognition (SER), using predefined features without considering their practical importance may lead to high dimensional datasets, including redundant and irrelevant information. Consequently, high-dimensional learning…

声音 · 计算机科学 2024-06-07 Alaa Nfissi , Wassim Bouachir , Nizar Bouguila , Brian Mishara

Integrating Automatic Speech Recognition (ASR) into Speech Emotion Recognition (SER) enhances modeling by providing linguistic context. However, conventional feature fusion faces performance bottlenecks, and multi-task learning often…

音频与语音处理 · 电气工程与系统科学 2026-03-27 Chia-Yu Lee , Huang-Cheng Chou , Tzu-Quan Lin , Yuanchao Li , Ya-Tse Wu , Shrikanth Narayanan , Chi-Chun Lee

Speech emotion recognition (SER) has long benefited from the adoption of deep learning methodologies. Deeper models -- with more layers and more trainable parameters -- are generally perceived as being `better' by the SER community. This…

声音 · 计算机科学 2025-08-05 Andreas Triantafyllopoulos , Anton Batliner , Björn W. Schuller

Automatic emotion recognition plays a key role in computer-human interaction as it has the potential to enrich the next-generation artificial intelligence with emotional intelligence. It finds applications in customer and/or representative…

声音 · 计算机科学 2022-02-21 Sarala Padi , Seyed Omid Sadjadi , Dinesh Manocha , Ram D. Sriram

Previous work on emotion recognition demonstrated a synergistic effect of combining several modalities such as auditory, visual, and transcribed text to estimate the affective state of a speaker. Among these, the linguistic modality is…

计算与语言 · 计算机科学 2019-03-01 Egor Lakomkin , Mohammad Ali Zamani , Cornelius Weber , Sven Magg , Stefan Wermter