English
Related papers

Related papers: Latent Spectral Regularization for Continual Learn…

200 papers

Meta-reinforcement learning (Meta-RL) facilitates rapid adaptation to unseen tasks but faces challenges in long-horizon environments. Skill-based approaches tackle this by decomposing state-action sequences into reusable skills and…

Machine Learning · Computer Science 2026-05-21 Sanghyeon Lee , Sangjun Bae , Yisak Park , Seungyul Han

Continual learning aims to empower artificial intelligence (AI) with strong adaptability to the real world. For this purpose, a desirable solution should properly balance memory stability with learning plasticity, and acquire sufficient…

Machine Learning · Computer Science 2023-11-10 Liyuan Wang , Xingxing Zhang , Qian Li , Mingtian Zhang , Hang Su , Jun Zhu , Yi Zhong

Biological agents learn and act intelligently in spite of a highly limited capacity to process and store information. Many real-world problems involve continuous control, which represents a difficult task for artificial intelligence agents.…

Machine Learning · Computer Science 2025-05-16 Tailia Malloy , Chris R. Sims , Tim Klinger , Miao Liu , Matthew Riemer , Gerald Tesauro

Deep neural networks have shown remarkable performance when trained on independent and identically distributed data from a fixed set of classes. However, in real-world scenarios, it can be desirable to train models on a continuous stream of…

Machine Learning · Computer Science 2023-09-04 Nicolas Michel , Giovanni Chierchia , Romain Negrel , Jean-François Bercher , Toshihiko Yamasaki

Generalisation to unseen subjects in EEG-based emotion classification remains a challenge due to high inter-and intra-subject variability. Continual learning (CL) poses a promising solution by learning from a sequence of tasks while…

Machine Learning · Computer Science 2026-01-14 Nina Peire , Yupei Li , Björn Schuller

Fine-tuning an Automatic Speech Recognition (ASR) model to new domains results in degradation on original domains, referred to as Catastrophic Forgetting (CF). Continual Learning (CL) attempts to train ASR models without suffering from CF.…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-22 Steven Vander Eeckt , Hugo Van hamme

We propose a general, yet simple patch that can be applied to existing regularization-based continual learning methods called classifier-projection regularization (CPR). Inspired by both recent results on neural networks with wide local…

Machine Learning · Computer Science 2021-04-20 Sungmin Cha , Hsiang Hsu , Taebaek Hwang , Flavio P. Calmon , Taesup Moon

Continual Learning (CL) algorithms incrementally learn a predictor or representation across multiple sequentially observed tasks. Designing CL algorithms that perform reliably and avoid so-called catastrophic forgetting has proven a…

Machine Learning · Computer Science 2020-06-11 Jeremias Knoblauch , Hisham Husain , Tom Diethe

Continual learning aims to improve the ability of modern learning systems to deal with non-stationary distributions, typically by attempting to learn a series of tasks sequentially. Prior art in the field has largely considered supervised…

Machine Learning · Computer Science 2019-11-01 Dushyant Rao , Francesco Visin , Andrei A. Rusu , Yee Whye Teh , Razvan Pascanu , Raia Hadsell

Continual learning is a promising machine learning paradigm to learn new tasks while retaining previously learned knowledge over streaming training data. Till now, rehearsal-based methods, keeping a small part of data from old tasks as a…

Machine Learning · Computer Science 2023-08-04 Quanziang Wang , Renzhen Wang , Yuexiang Li , Dong Wei , Kai Ma , Yefeng Zheng , Deyu Meng

We consider a continual learning (CL) problem with two linear regression tasks in the fixed design setting, where the feature vectors are assumed fixed and the labels are assumed to be random variables. We consider an $\ell_2$-regularized…

Machine Learning · Computer Science 2024-06-19 Haoran Li , Jingfeng Wu , Vladimir Braverman

Large language models (LLMs) exhibit remarkable capabilities in natural language processing but face catastrophic forgetting when learning new tasks, where adaptation to a new domain leads to a substantial decline in performance on previous…

Computation and Language · Computer Science 2025-03-24 Yuheng Lu , Bingshuo Qian , Caixia Yuan , Huixing Jiang , Xiaojie Wang

Invariant Contrastive Learning (ICL) methods have achieved impressive performance across various domains. However, the absence of latent space representation for distortion (augmentation)-related information in the latent space makes ICL…

Machine Learning · Computer Science 2024-10-11 Sifan Song , Jinfeng Wang , Qiaochu Zhao , Xiang Li , Dufan Wu , Angelos Stefanidis , Jionglong Su , S. Kevin Zhou , Quanzheng Li

Continual learning of deep neural networks is a key requirement for scaling them up to more complex applicative scenarios and for achieving real lifelong learning of these architectures. Previous approaches to the problem have considered…

Machine Learning · Computer Science 2020-06-25 Jary Pomponi , Simone Scardapane , Vincenzo Lomonaco , Aurelio Uncini

Class-Incremental Learning (CIL) aims to learn new classes sequentially while retaining the knowledge of previously learned classes. Recently, pre-trained models (PTMs) combined with parameter-efficient fine-tuning (PEFT) have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Jiangpeng He , Zhihao Duan , Fengqing Zhu

The reinforcement learning (RL) problem is rife with sources of non-stationarity, making it a notoriously difficult problem domain for the application of neural networks. We identify a mechanism by which non-stationary prediction targets…

Machine Learning · Computer Science 2022-05-05 Clare Lyle , Mark Rowland , Will Dabney

Fine-tuning pre-trained language models such as BERT has become a common practice dominating leaderboards across various NLP tasks. Despite its recent success and wide adoption, this process is unstable when there are only a small number of…

Computation and Language · Computer Science 2021-07-13 Hang Hua , Xingjian Li , Dejing Dou , Cheng-Zhong Xu , Jiebo Luo

Contrastive Learning (CL) performances as a rising approach to address the challenge of sparse and noisy recommendation data. Although having achieved promising results, most existing CL methods only perform either hand-crafted data or…

Information Retrieval · Computer Science 2023-11-22 Xiuyuan Qin , Huanhuan Yuan , Pengpeng Zhao , Junhua Fang , Fuzhen Zhuang , Guanfeng Liu , Victor Sheng

The ability of deep neural networks to continually learn and adapt to a sequence of tasks has remained challenging due to catastrophic forgetting of previously learned tasks. Humans, on the other hand, have a remarkable ability to acquire,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Kishaan Jeeveswaran , Prashant Bhat , Bahram Zonooz , Elahe Arani

Continual learning (CL) has emerged as a dominant paradigm for acquiring knowledge from sequential tasks while avoiding catastrophic forgetting. Although many CL methods have been proposed to show impressive empirical performance, the…

Machine Learning · Computer Science 2026-01-07 Wen Wen , Tieliang Gong , Zeyu Gao , Yunjiao Zhang , Weizhan Zhang , Yong-Jin Liu