English
Related papers

Related papers: Improving Scheduled Sampling with Elastic Weight C…

200 papers

In most of neural machine translation distillation or stealing scenarios, the goal is to preserve the performance of the target model (teacher). The highest-scoring hypothesis of the teacher model is commonly used to train a new model…

Computation and Language · Computer Science 2021-04-02 Vilém Zouhar

Adapting a trained Automatic Speech Recognition (ASR) model to new tasks results in catastrophic forgetting of old tasks, limiting the model's ability to learn continually and to be extended to new speakers, dialects, languages, etc.…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-22 Steven Vander Eeckt , Hugo Van hamme

In general class-incremental learning, researchers typically use sample sets as a tool to avoid catastrophic forgetting during continuous learning. At the same time, researchers have also noted the differences between class-incremental…

Machine Learning · Computer Science 2024-08-16 Weimin Yin , Bin Chen adn Chunzhao Xie , Zhenhao Tan

We lack a systematic understanding of the effects of fine-tuning (via methods such as instruction-tuning or reinforcement learning from human feedback), particularly on tasks outside the narrow fine-tuning distribution. In a simplified…

Computation and Language · Computer Science 2024-04-16 Suhas Kotha , Jacob Mitchell Springer , Aditi Raghunathan

Federated Bayesian neural networks require fixing a prior on the model parameters together with a likelihood. Eliciting meaningful priors on the weight space of modern overparameterized models is notoriously difficult, and misspecification…

Machine Learning · Computer Science 2026-05-19 Boning Zhang , Matteo Zecchin , Mingzhao Guo , Dongzhu Liu , Osvaldo Simeone

Recently, very large pre-trained models achieve state-of-the-art results in various natural language processing (NLP) tasks, but their size makes it more challenging to apply them in resource-constrained environments. Compression techniques…

Computation and Language · Computer Science 2023-06-28 Alireza Mohammadshahi , Vassilina Nikoulina , Alexandre Berard , Caroline Brun , James Henderson , Laurent Besacier

Continual Learning research typically focuses on tackling the phenomenon of catastrophic forgetting in neural networks. Catastrophic forgetting is associated with an abrupt loss of knowledge previously learned by a model when the task, or…

Machine Learning · Computer Science 2022-04-06 MohammadReza Davari , Nader Asadi , Sudhir Mudur , Rahaf Aljundi , Eugene Belilovsky

We propose Neural Priming, a technique for adapting large pretrained models to distribution shifts and downstream tasks given few or no labeled examples. Presented with class names or unlabeled test samples, Neural Priming enables the model…

Incrementally fine-tuning foundational models on new tasks or domains is now the de facto approach in NLP. A known pitfall of this approach is the \emph{catastrophic forgetting} of prior knowledge that happens during fine-tuning. A common…

Machine Learning · Computer Science 2025-02-12 Andrew Bai , Chih-Kuan Yeh , Cho-Jui Hsieh , Ankur Taly

Finetuning is a common practice widespread across different communities to adapt pretrained models to particular tasks. Text classification is one of these tasks for which many pretrained models are available. On the other hand, ensembles…

Computation and Language · Computer Science 2024-10-29 Sebastian Pineda Arango , Maciej Janowski , Lennart Purucker , Arber Zela , Frank Hutter , Josif Grabocka

Sequential learning of multiple tasks in artificial neural networks using gradient descent leads to catastrophic forgetting, whereby previously learned knowledge is erased during learning of new, disjoint knowledge. Here, we propose a new…

Machine Learning · Computer Science 2018-05-22 Shixian Wen , Laurent Itti

Exposure bias describes the phenomenon that a language model trained under the teacher forcing schema may perform poorly at the inference stage when its predictions are conditioned on its previous predictions unseen from the training…

Computation and Language · Computer Science 2020-04-02 Yifan Xu , Kening Zhang , Haoyu Dong , Yuezhou Sun , Wenlong Zhao , Zhuowen Tu

Neural networks tend to gradually forget the previously learned knowledge when learning multiple tasks sequentially from dynamic data distributions. This problem is called \textit{catastrophic forgetting}, which is a fundamental challenge…

Computation and Language · Computer Science 2022-03-21 Chenze Shao , Yang Feng

We investigate automatic interlinear glossing in low-resource settings. We augment a hard-attentional neural model with embedded translation information extracted from interlinear glossed text. After encoding these translations using large…

Computation and Language · Computer Science 2024-03-14 Changbing Yang , Garrett Nicolai , Miikka Silfverberg

Relation extraction has been widely studied to extract new relational facts from open corpus. Previous relation extraction methods are faced with the problem of wrong labels and noisy data, which substantially decrease the performance of…

Information Retrieval · Computer Science 2018-05-01 Dongdong Yang , Senzhang Wang , Zhoujun Li

Aggregating multiple learners through an ensemble of models aim to make better predictions by capturing the underlying distribution of the data more accurately. Different ensembling methods, such as bagging, boosting, and stacking/blending,…

Machine Learning · Statistics 2020-11-03 Mohsen Shahhosseini , Guiping Hu , Hieu Pham

Continual learning seeks to enable machine learning systems to solve an increasing corpus of tasks sequentially. A critical challenge for continual learning is forgetting, where the performance on previously learned tasks decreases as new…

Machine Learning · Computer Science 2025-06-06 Yasaman Mahdaviyeh , James Lucas , Mengye Ren , Andreas S. Tolias , Richard Zemel , Toniann Pitassi

Fine-tuning pre-trained models is a popular approach in machine learning for solving complex tasks with moderate data. However, fine-tuning the entire pre-trained model is ineffective in federated data scenarios where local data…

Machine Learning · Computer Science 2025-02-28 Pei-Yau Weng , Minh Hoang , Lam M. Nguyen , My T. Thai , Tsui-Wei Weng , Trong Nghia Hoang

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

Word-embeddings are vital components of Natural Language Processing (NLP) models and have been extensively explored. However, they consume a lot of memory which poses a challenge for edge deployment. Embedding matrices, typically, contain…

Computation and Language · Computer Science 2020-11-12 Vasileios Lioutas , Ahmad Rashid , Krtin Kumar , Md Akmal Haidar , Mehdi Rezagholizadeh