English
Related papers

Related papers: Watch Your Step: Optimal Retrieval for Continual L…

200 papers

Continual learning consists in incrementally training a model on a sequence of datasets and testing on the union of all datasets. In this paper, we examine continual learning for the problem of sound classification, in which we wish to…

Machine Learning · Computer Science 2019-06-04 Zhepei Wang , Cem Subakan , Efthymios Tzinis , Paris Smaragdis , Laurent Charlin

Continual learning refers to the ability to acquire and transfer knowledge without catastrophically forgetting what was previously learned. In this work, we consider \emph{few-shot} continual learning in classification tasks, and we propose…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Mengmi Zhang , Tao Wang , Joo Hwee Lim , Gabriel Kreiman , Jiashi Feng

Despite remarkable successes achieved by modern neural networks in a wide range of applications, these networks perform best in domain-specific stationary environments where they are trained only once on large-scale controlled data…

Neural and Evolutionary Computing · Computer Science 2019-04-23 Pouya Bashivan , Martin Schrimpf , Robert Ajemian , Irina Rish , Matthew Riemer , Yuhai Tu

Continual Learning (CL) aims at incrementally learning new tasks without forgetting the knowledge acquired from old ones. Experience Replay (ER) is a simple and effective rehearsal-based strategy, which optimizes the model with current…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Tao Zhuo , Zhiyong Cheng , Zan Gao , Hehe Fan , Mohan Kankanhalli

Continual learning aims to enable a single model to learn a sequence of tasks without catastrophic forgetting. Top-performing methods usually require a rehearsal buffer to store past pristine examples for experience replay, which, however,…

Algorithm selection is commonly used to predict the best solver from a portfolio per per-instance. In many real scenarios, instances arrive in a stream: new instances become available over time, while the number of class labels can also…

Machine Learning · Computer Science 2025-06-03 Mate Botond Nemeth , Emma Hart , Kevin Sim , Quentin Renau

Continual learning strives to ensure stability in solving previously seen tasks while demonstrating plasticity in a novel domain. Recent advances in continual learning are mostly confined to a supervised learning setting, especially in NLP…

Machine Learning · Computer Science 2024-06-03 Stella Ho , Ming Liu , Shang Gao , Longxiang Gao

Most artificial intelligence models have limiting ability to solve new tasks faster, without forgetting previously acquired knowledge. The recently emerging paradigm of continual learning aims to solve this issue, in which the model learns…

Machine Learning · Computer Science 2018-06-01 Ju Xu , Zhanxing Zhu

Experience replay \citep{lin1993reinforcement, mnih2015human} is a widely used technique to achieve efficient use of data and improved performance in RL algorithms. In experience replay, past transitions are stored in a memory buffer and…

Machine Learning · Computer Science 2021-12-09 Liran Szlak , Ohad Shamir

Experience replay is a key component in reinforcement learning for stabilizing learning and improving sample efficiency. Its typical implementation samples transitions with replacement from a replay buffer. In contrast, in supervised…

Machine Learning · Computer Science 2025-12-05 Yasuhiro Fujita

We propose a novel continual learning method called Residual Continual Learning (ResCL). Our method can prevent the catastrophic forgetting phenomenon in sequential learning of multiple tasks, without any source task information except the…

Machine Learning · Computer Science 2020-02-18 Janghyeon Lee , Donggyu Joo , Hyeong Gwon Hong , Junmo Kim

Continual learning techniques employ simple replay sample selection processes and use them during subsequent tasks. Typically, they rely on labeled data. In this paper, we depart from this by automatically selecting prototypes stored…

Machine Learning · Computer Science 2025-04-11 Agil Aghasanli , Yi Li , Plamen Angelov

Catastrophic forgetting remains a key challenge in Continual Learning (CL). In replay-based CL with severe memory constraints, performance critically depends on the sample selection strategy for the replay buffer. Most existing approaches…

Machine Learning · Computer Science 2026-04-10 Danit Yanowsky , Daphna Weinshall

Data streams are rarely static in dynamic environments like Industry 4.0. Instead, they constantly change, making traditional offline models outdated unless they can quickly adjust to the new data. This need can be adequately addressed by…

Continual Semantic Segmentation (CSS) extends static semantic segmentation by incrementally introducing new classes for training. To alleviate the catastrophic forgetting issue in CSS, a memory buffer that stores a small number of samples…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Lanyun Zhu , Tianrun Chen , Jianxiong Yin , Simon See , Jun Liu

Continual Learning (CL) is a field dedicated to devise algorithms able to achieve lifelong learning. Overcoming the knowledge disruption of previously acquired concepts, a drawback affecting deep learning models and that goes by the name of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Francesco Pelosin

This paper introduces a novel perspective to significantly mitigate catastrophic forgetting in continuous learning (CL), which emphasizes models' capacity to preserve existing knowledge and assimilate new information. Current replay-based…

Machine Learning · Computer Science 2024-04-10 Jianshu Zhang , Yankai Fu , Ziheng Peng , Dongyu Yao , Kun He

Continual learning approaches help deep neural network models adapt and learn incrementally by trying to solve catastrophic forgetting. However, whether these existing approaches, applied traditionally to image-based tasks, work with the…

Machine Learning · Computer Science 2022-06-27 Young D. Kwon , Jagmohan Chauhan , Abhishek Kumar , Pan Hui , Cecilia Mascolo

Continual learning is inherently a constrained learning problem. The goal is to learn a predictor under a no-forgetting requirement. Although several prior studies formulate it as such, they do not solve the constrained problem explicitly.…

Machine Learning · Computer Science 2024-06-03 Juan Elenter , Navid NaderiAlizadeh , Tara Javidi , Alejandro Ribeiro

Catastrophic forgetting - the tendency of neural networks to forget previously learned data when learning new information - remains a central challenge in continual learning. In this work, we adopt a behavioral approach, observing a…

Machine Learning · Computer Science 2025-07-08 Guy Hacohen , Tinne Tuytelaars