中文
相关论文

相关论文: SeQuiFi: Mitigating Catastrophic Forgetting in Spe…

200 篇论文

The creation of large-scale open domain reading comprehension data sets in recent years has enabled the development of end-to-end neural comprehension models with promising results. To use these models for domains with limited training…

计算与语言 · 计算机科学 2020-11-23 Y. Xu , X. Zhong , A. J. J. Yepes , J. H. Lau

Continual learning aims to provide intelligent agents capable of learning multiple tasks sequentially with neural networks. One of its main challenging, catastrophic forgetting, is caused by the neural networks non-optimal ability to learn…

机器学习 · 计算机科学 2021-01-29 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

In continual time series analysis using neural networks, catastrophic forgetting (CF) of previously learned models when training on new data domains has always been a significant challenge. This problem is especially challenging in vehicle…

机器学习 · 计算机科学 2025-04-08 Arvin Hosseinzadeh , Ladan Khoshnevisan , Mohammad Pirani , Shojaeddin Chenouri , Amir Khajepour

In human-computer interaction (HCI), Speech Emotion Recognition (SER) is a key technology for understanding human intentions and emotions. Traditional SER methods struggle to effectively capture the long-term temporal correla-tions and…

音频与语音处理 · 电气工程与系统科学 2024-07-18 Xincheng Wang , Liejun Wang , Yinfeng Yu , Xinxin Jiao

Attention mechanisms have emerged as important tools that boost the performance of deep models by allowing them to focus on key parts of learned embeddings. However, current attention mechanisms used in speaker recognition tasks fail to…

声音 · 计算机科学 2022-07-21 Amirhossein Hajavi , Ali Etemad

Automatic speech emotion recognition (SER) is a challenging task that plays a crucial role in natural human-computer interaction. One of the main challenges in SER is data scarcity, i.e., insufficient amounts of carefully labeled data to…

声音 · 计算机科学 2021-08-17 Sarala Padi , Seyed Omid Sadjadi , Dinesh Manocha , Ram D. Sriram

Recently, data-driven based Automatic Speech Recognition (ASR) systems have achieved state-of-the-art results. And transfer learning is often used when those existing systems are adapted to the target domain, e.g., fine-tuning, retraining.…

声音 · 计算机科学 2019-04-18 Jiabin Xue , Jiqing Han , Tieran Zheng , Xiang Gao , Jiaxing Guo

In this work, we present compelling evidence that controlling model capacity during fine-tuning can effectively mitigate memorization in diffusion models. Specifically, we demonstrate that adopting Parameter-Efficient Fine-Tuning (PEFT)…

计算机视觉与模式识别 · 计算机科学 2024-10-30 Raman Dutt , Pedro Sanchez , Ondrej Bohdal , Sotirios A. Tsaftaris , Timothy Hospedales

Incremental brain tumor segmentation is critical for models that must adapt to evolving clinical datasets without retraining on all prior data. However, catastrophic forgetting, where models lose previously acquired knowledge, remains a…

图像与视频处理 · 电气工程与系统科学 2025-10-09 Sashank Makanaboyina

Automatic speech emotion recognition (SER) by a computer is a critical component for more natural human-machine interaction. As in human-human interaction, the capability to perceive emotion correctly is essential to take further steps in a…

声音 · 计算机科学 2022-10-27 Bagus Tris Atmaja , Masato Akagi

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

计算机视觉与模式识别 · 计算机科学 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

Continual learning on sequential data is critical for many machine learning (ML) deployments. Unfortunately, LSTM networks, which are commonly used to learn on sequential data, suffer from catastrophic forgetting and are limited in their…

机器学习 · 计算机科学 2023-05-30 Ketaki Joshi , Raghavendra Pradyumna Pothukuchi , Andre Wibisono , Abhishek Bhattacharjee

Catastrophic forgetting(CF) is a significant challenge in continual learning (CL). In regularization-based approaches to mitigate CF, modifications to important training parameters are penalized in subsequent tasks using an appropriate loss…

机器学习 · 计算机科学 2023-12-18 Sahil Nokhwal , Nirman Kumar

We introduce Speech-IFeval, an evaluation framework designed to assess instruction-following capabilities and quantify catastrophic forgetting in speech-aware language models (SLMs). Recent SLMs integrate speech perception with large…

音频与语音处理 · 电气工程与系统科学 2025-05-27 Ke-Han Lu , Chun-Yi Kuan , Hung-yi Lee

Speech Emotion Recognition (SER) is crucial for improving human-computer interaction. Despite strides in monolingual SER, extending them to build a multilingual system remains challenging. Our goal is to train a single model capable of…

计算与语言 · 计算机科学 2026-01-27 Mehedi Hasan Bijoy , Dejan Porjazovski , Tamás Grósz , Mikko Kurimo

Task-incremental continual learning refers to continually training a model in a sequence of tasks while overcoming the problem of catastrophic forgetting (CF). The issue arrives for the reason that the learned representations are forgotten…

机器学习 · 计算机科学 2023-05-23 Yun Luo , Xiaotian Lin , Zhen Yang , Fandong Meng , Jie Zhou , Yue Zhang

Training SER models in natural, spontaneous speech is especially challenging due to the subtle expression of emotions and the unpredictable nature of real-world audio. In this paper, we present a robust system for the INTERSPEECH 2025…

Fine-grained emotion recognition (FER) plays a vital role in various fields, such as disease diagnosis, personalized recommendations, and multimedia mining. However, existing FER methods face three key challenges in real-world applications:…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Jingyao Wang , Wenwen Qiang , Changwen Zheng , Fuchun Sun

Speech Emotion Recognition (SER) is an important research topic in human-computer interaction. Many recent works focus on directly extracting emotional cues through pre-trained knowledge, frequently overlooking considerations of…

音频与语音处理 · 电气工程与系统科学 2024-06-27 Haiyang Sun , Fulin Zhang , Yingying Gao , Zheng Lian , Shilei Zhang , Junlan Feng

Convolutional neural networks (CNN) are widely used for speech emotion recognition (SER). In such cases, the short time fourier transform (STFT) spectrogram is the most popular choice for representing speech, which is fed as input to the…

音频与语音处理 · 电气工程与系统科学 2019-08-09 Shruti Gupta , Md. Shah Fahad , Akshay Deepak