English
Related papers

Related papers: Continual learning using lattice-free MMI for spee…

200 papers

We investigate the effectiveness of using a large ensemble of advanced neural language models (NLMs) for lattice rescoring on automatic speech recognition (ASR) hypotheses. Previous studies have reported the effectiveness of combining a…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-21 Atsunori Ogawa , Naohiro Tawara , Marc Delcroix , Shoko Araki

The ability to learn in dynamic, nonstationary environments without forgetting previous knowledge, also known as Continual Learning (CL), is a key enabler for scalable and trustworthy deployments of adaptive solutions. While the importance…

Machine Learning · Computer Science 2021-03-25 Andrea Cossu , Antonio Carta , Davide Bacciu

This paper considers continual learning of large-scale pretrained neural machine translation model without accessing the previous training data or introducing model separation. We argue that the widely used regularization-based methods,…

Computation and Language · Computer Science 2022-11-07 Shuhao Gu , Bojie Hu , Yang Feng

Acoustic model adaptation to unseen test recordings aims to reduce the mismatch between training and testing conditions. Most adaptation schemes for neural network models require the use of an initial one-best transcription for the test…

Computation and Language · Computer Science 2019-06-28 Ondrej Klejch , Joachim Fainberg , Peter Bell , Steve Renals

In this paper, we propose a continual learning (CL) technique that is beneficial to sequential task learners by improving their retained accuracy and reducing catastrophic forgetting. The principal target of our approach is the automatic…

Machine Learning · Computer Science 2021-01-19 Ammar Shaker , Shujian Yu , Francesco Alesiani

Current Multilingual ASR models only support a fraction of the world's languages. Continual Learning (CL) aims to tackle this problem by adding new languages to pre-trained models while avoiding the loss of performance on existing…

Computation and Language · Computer Science 2025-01-15 Chin Yuen Kwok , Jia Qi Yip , Eng Siong Chng

Foundation Models (FMs) have become the hallmark of modern AI, however, these models are trained on massive data, leading to financially expensive training. Updating FMs as new data becomes available is important, however, can lead to…

Machine Learning · Computer Science 2024-04-22 James Seale Smith , Lazar Valkov , Shaunak Halbe , Vyshnavi Gutta , Rogerio Feris , Zsolt Kira , Leonid Karlinsky

Language models (LMs) have been commonly adopted to boost the performance of automatic speech recognition (ASR) particularly in domain adaptation tasks. Conventional way of LM training treats all the words in corpora equally, resulting in…

Computation and Language · Computer Science 2023-10-18 Yingyi Ma , Zhe Liu , Ozlem Kalinli

How to adapt a pre-trained model continuously for sequential tasks with different prediction class labels and domains and finally learn a generalizable model across diverse tasks is a long-lasting challenge. Continual learning (CL) has…

Machine Learning · Computer Science 2025-04-15 Xiaobing Yu , Jin Yang , Xiao Wu , Peijie Qiu , Xiaofeng Liu

Automatic speech recognition (ASR) systems have achieved strong performance on general transcription tasks. However, they continue to struggle with recognizing rare named entities and adapting to domain mismatches. In contrast, large…

Computation and Language · Computer Science 2025-08-21 Shaoshi Ling , Guoli Ye

Continual Learning (CL) in Automatic Speech Recognition (ASR) suffers from catastrophic forgetting when adapting to new tasks, domains, or speakers. A common strategy to mitigate this is to store a subset of past data in memory for…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-06 Steven Vander Eeckt , Hugo Van hamme

Learning from changing tasks and sequential experience without forgetting the obtained knowledge is a challenging problem for artificial neural networks. In this work, we focus on two challenging problems in the paradigm of Continual…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Tao Feng , Hangjie Yuan , Mang Wang , Ziyuan Huang , Ang Bian , Jianzhou Zhang

Training acoustic models with sequentially incoming data -- while both leveraging new data and avoiding the forgetting effect-- is an essential obstacle to achieving human intelligence level in speech recognition. An obvious approach to…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-02 Shahram Ghorbani , Soheil Khorram , John H. L. Hansen

Recently, foundation language models (LMs) have marked significant achievements in the domains of natural language processing (NLP) and computer vision (CV). Unlike traditional neural network models, foundation LMs obtain a great ability…

Computation and Language · Computer Science 2024-12-02 Yutao Yang , Jie Zhou , Xuanwen Ding , Tianyu Huai , Shunyu Liu , Qin Chen , Yuan Xie , Liang He

Continual learning (CL) is crucial for deploying large language models (LLMs) in dynamic real-world environments without costly retraining. While recent model ensemble and model merging methods guided by parameter importance have gained…

Machine Learning · Computer Science 2025-06-02 Yujie Feng , Xujia Wang , Zexin Lu , Shenghong Fu , Guangyuan Shi , Yongxin Xu , Yasha Wang , Philip S. Yu , Xu Chu , Xiao-Ming Wu

Recurrent neural network (RNN) language models (LMs) and Long Short Term Memory (LSTM) LMs, a variant of RNN LMs, have been shown to outperform traditional N-gram LMs on speech recognition tasks. However, these models are computationally…

Machine Learning · Statistics 2017-11-16 Shankar Kumar , Michael Nirschl , Daniel Holtmann-Rice , Hank Liao , Ananda Theertha Suresh , Felix Yu

Continual fine-tuning of large language models (LLMs) is becoming increasingly crucial as these models are deployed in dynamic environments where tasks and data distributions evolve over time. While strong adaptability enables rapid…

Machine Learning · Computer Science 2026-03-11 Yiyang Lu , Yu He , Jianlong Chen , Hongyuan Zha

Scenarios in which restrictions in data transfer and storage limit the possibility to compose a single dataset -- also exploiting different data sources -- to perform a batch-based training procedure, make the development of robust models…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Lorenzo Pellegrini , Guido Borghi , Annalisa Franco , Davide Maltoni

The ability of neural networks to continuously learn and adapt to new tasks while retaining prior knowledge is crucial for many applications. However, current neural networks tend to forget previously learned tasks when trained on new ones,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-04 Sinan Özgür Özgün , Anne-Marie Rickmann , Abhijit Guha Roy , Christian Wachinger

Recently, data-driven based Automatic Speech Recognition (ASR) systems have achieved state-of-the-art results. And transfer learning is often used when those existing systems are adapted to the target domain, e.g., fine-tuning, retraining.…

Sound · Computer Science 2019-04-18 Jiabin Xue , Jiqing Han , Tieran Zheng , Xiang Gao , Jiaxing Guo