中文
相关论文

相关论文: Enhancing Speech Emotion Recognition via Fine-Tuni…

200 篇论文

This paper introduces HEPPO-GAE, an FPGA-based accelerator designed to optimize the Generalized Advantage Estimation (GAE) stage in Proximal Policy Optimization (PPO). Unlike previous approaches that focused on trajectory collection and…

硬件体系结构 · 计算机科学 2025-07-22 Hazem Taha , Ameer M. S. Abdelhadi

Speech emotion recognition (SER) systems are constrained by existing datasets that typically cover only 6-10 basic emotions, lack scale and diversity, and face ethical challenges when collecting sensitive emotional states. We introduce…

Existing speech emotion recognition (SER) methods commonly suffer from the lack of high-quality large-scale corpus, partly due to the complex, psychological nature of emotion which makes accurate labeling difficult and time consuming.…

声音 · 计算机科学 2025-09-30 Haoyu Song , Ian McLoughlin , Qing Gu , Nan Jiang , Yan Song

Research on Speech Emotion Recognition (SER) often faces challenges such as the lack of large-scale public datasets and limited generalization capability when dealing with data from different distributions. To solve this problem, this paper…

声音 · 计算机科学 2024-12-02 Xiang minjie

Multimodal Emotion Recognition (MER) aims to automatically identify and understand human emotional states by integrating information from various modalities. However, the scarcity of annotated multimodal data significantly hinders the…

人机交互 · 计算机科学 2024-09-11 Zhixian Zhao , Haifeng Chen , Xi Li , Dongmei Jiang , Lei Xie

Speech emotion recognition is a challenging task, and extensive reliance has been placed on models that use audio features in building well-performing classifiers. In this paper, we propose a novel deep dual recurrent encoder model that…

计算与语言 · 计算机科学 2018-10-11 Seunghyun Yoon , Seokhyun Byun , Kyomin Jung

This paper presents a transfer learning method in speech emotion recognition based on a Time-Delay Neural Network (TDNN) architecture. A major challenge in the current speech-based emotion detection research is data scarcity. The proposed…

音频与语音处理 · 电气工程与系统科学 2020-08-18 Sitong Zhou , Homayoon Beigi

The performance of speech and events recognition systems significantly improved recently thanks to deep learning methods. However, some of these tasks remain challenging when algorithms are deployed on robots due to the unseen mechanical…

音频与语音处理 · 电气工程与系统科学 2023-03-08 Pierre-Olivier Lagacé , François Ferland , François Grondin

In this paper, we propose a multimodal framework for speech emotion recognition that leverages entropy-aware score selection to combine speech and textual predictions. The proposed method integrates a primary pipeline that consists of an…

声音 · 计算机科学 2025-08-29 ChenYi Chua , JunKai Wong , Chengxin Chen , Xiaoxiao Miao

In this paper, we propose to utilise diffusion models for data augmentation in speech emotion recognition (SER). In particular, we present an effective approach to utilise improved denoising diffusion probabilistic models (IDDPM) to…

声音 · 计算机科学 2023-05-22 Ibrahim Malik , Siddique Latif , Raja Jurdak , Björn Schuller

Emotion recognition from speech is a challenging task. Re-cent advances in deep learning have led bi-directional recur-rent neural network (Bi-RNN) and attention mechanism as astandard method for speech emotion recognition, extractingand…

声音 · 计算机科学 2021-06-09 Zixuan Peng , Yu Lu , Shengfeng Pan , Yunfeng Liu

Large language models show potential in task-oriented dialogue systems, yet existing training methods often rely on token-level likelihood or preference optimization, which poorly align with long-horizon task success. To address this, we…

计算与语言 · 计算机科学 2026-02-23 Jingyi Xu , Xingyu Ren , Zhoupeng Shou , Yumeng Zhang , Zhiqiang You

We propose EmoDistill, a novel speech emotion recognition (SER) framework that leverages cross-modal knowledge distillation during training to learn strong linguistic and prosodic representations of emotion from speech. During inference,…

计算与语言 · 计算机科学 2024-03-18 Debaditya Shome , Ali Etemad

In this paper, we present an end-to-end training framework for building state-of-the-art end-to-end speech recognition systems. Our training system utilizes a cluster of Central Processing Units(CPUs) and Graphics Processing Units (GPUs).…

Speech recognition applications cover a range of different audio and text distributions, with different speaking styles, background noise, transcription punctuation and character casing. However, many speech recognition systems require…

计算与语言 · 计算机科学 2022-10-25 Sanchit Gandhi , Patrick von Platen , Alexander M. Rush

We propose emotion2vec, a universal speech emotion representation model. emotion2vec is pre-trained on open-source unlabeled emotion data through self-supervised online distillation, combining utterance-level loss and frame-level loss…

计算与语言 · 计算机科学 2023-12-27 Ziyang Ma , Zhisheng Zheng , Jiaxin Ye , Jinchao Li , Zhifu Gao , Shiliang Zhang , Xie Chen

In this study, we revisit key training strategies in machine learning often overlooked in favor of deeper architectures. Specifically, we explore balancing strategies, activation functions, and fine-tuning techniques to enhance speech…

音频与语音处理 · 电气工程与系统科学 2025-09-26 Jing-Tong Tzeng , Bo-Hao Su , Ya-Tse Wu , Hsing-Hang Chou , Chi-Chun Lee

Hyperparameter optimization (HPO) is a critical component of machine learning pipelines, significantly affecting model robustness, stability, and generalization. However, HPO is often a time-consuming and computationally intensive task.…

机器学习 · 计算机科学 2025-03-10 Ruinan Wang , Ian Nabney , Mohammad Golbabaee

In affective computing, the task of Emotion Recognition in Conversations (ERC) has emerged as a focal area of research. The primary objective of this task is to predict emotional states within conversations by analyzing multimodal data…

多媒体 · 计算机科学 2024-11-22 Xiaomin Yu , Feiyang Wang , Ziyue Qiao

The emotion detection technology to enhance human decision-making is an important research issue for real-world applications, but real-life emotion datasets are relatively rare and small. The experiments conducted in this paper use the…

计算与语言 · 计算机科学 2023-06-13 Théo Deschamps-Berger , Lori Lamel , Laurence Devillers