English
Related papers

Related papers: Reviewing continual learning from the perspective …

200 papers

Continual learning (CL) aims to learn new tasks without forgetting previous tasks. However, existing CL methods require a large amount of raw data, which is often unavailable due to copyright considerations and privacy risks. Instead,…

Machine Learning · Computer Science 2024-09-13 Enneng Yang , Zhenyi Wang , Li Shen , Nan Yin , Tongliang Liu , Guibing Guo , Xingwei Wang , Dacheng Tao

Continual learning (CL), which aims to learn a sequence of tasks, has attracted significant recent attention. However, most work has focused on the experimental performance of CL, and theoretical studies of CL are still limited. In…

Machine Learning · Computer Science 2023-02-14 Sen Lin , Peizhong Ju , Yingbin Liang , Ness Shroff

Continual learning (CL) studies the problem of learning a sequence of tasks, one at a time, such that the learning of each new task does not lead to the deterioration in performance on the previously seen ones while exploiting previously…

Machine Learning · Computer Science 2020-11-03 Ammar Shaker , Francesco Alesiani , Shujian Yu , Wenzhe Yin

One weakness of machine learning algorithms is the poor ability of models to solve new problems without forgetting previously acquired knowledge. The Continual Learning (CL) paradigm has emerged as a protocol to systematically investigate…

Machine Learning · Computer Science 2022-03-02 Heinke Hihn , Daniel A. Braun

Curriculum learning (CL) is a training strategy that trains a machine learning model from easier data to harder data, which imitates the meaningful learning order in human curricula. As an easy-to-use plug-in, the CL strategy has…

Machine Learning · Computer Science 2021-03-26 Xin Wang , Yudong Chen , Wenwu Zhu

Continual learning (CL) refers to an agent's capability to learn from a continuous stream of data and transfer knowledge without forgetting old information. One crucial aspect of CL is forward transfer, i.e., improved and faster learning on…

Neurons and Cognition · Quantitative Biology 2025-01-24 Rajat Saxena , Bruce L. McNaughton

Continual learning (CL) enables deep neural networks to adapt to ever-changing data distributions. In practice, there may be scenarios where annotation is costly, leading to active continual learning (ACL), which performs active learning…

Machine Learning · Computer Science 2025-04-22 Jaehyun Park , Dongmin Park , Jae-Gil Lee

Continual learning (CL) empowers AI systems to progressively acquire knowledge from non-stationary data streams. However, catastrophic forgetting remains a critical challenge. In this work, we identify attention drift in Vision Transformers…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Yue Lu , Xiangyu Zhou , Shizhou Zhang , Yinghui Xing , Guoqiang Liang , Wencong Zhang

Continual learning (CL) refers to the ability of an algorithm to continuously and incrementally acquire new knowledge from its environment while retaining previously learned information. A model trained on one data modality often fails when…

Machine Learning · Computer Science 2025-08-22 Nilay Kushawaha , Egidio Falotico

Deep neural networks, despite their remarkable success, remain fundamentally limited in their ability to perform Continual Learning (CL). While most current methods aim to enhance the capabilities of a single model, Inspired by the…

Machine Learning · Computer Science 2025-08-01 Aojun Lu , Junchao Ke , Chunhui Ding , Jiahao Fan , Jiancheng Lv , Yanan Sun

Continual learning (CL) is an approach to address catastrophic forgetting, which refers to forgetting previously learned knowledge by neural networks when trained on new tasks or data distributions. The adversarial robustness has decomposed…

Machine Learning · Computer Science 2023-07-04 Hikmat Khan , Nidhal C. Bouaynaya , Ghulam Rasool

Continual learning (CL) enables animals to learn new tasks without erasing prior knowledge. CL in artificial neural networks (NNs) is challenging due to catastrophic forgetting, where new learning degrades performance on older tasks. While…

Machine Learning · Computer Science 2025-01-28 Haozhe Shan , Qianyi Li , Haim Sompolinsky

A major goal of artificial intelligence (AI) is to create an agent capable of acquiring a general understanding of the world. Such an agent would require the ability to continually accumulate and build upon its knowledge as it encounters…

Machine Learning · Computer Science 2023-06-14 Jorge A. Mendez , Eric Eaton

Continual learning is a subfield of machine learning, which aims to allow machine learning models to continuously learn on new data, by accumulating knowledge without forgetting what was learned in the past. In this work, we take a step…

In continual learning (CL), a learner is faced with a sequence of tasks, arriving one after the other, and the goal is to remember all the tasks once the continual learning experience is finished. The prior art in CL uses episodic memory,…

Machine Learning · Computer Science 2020-12-09 Arslan Chaudhry , Naeemullah Khan , Puneet K. Dokania , Philip H. S. Torr

Continual learning, or lifelong learning, is a formidable current challenge to machine learning. It requires the learner to solve a sequence of $k$ different learning tasks, one after the other, while retaining its aptitude for earlier…

Machine Learning · Computer Science 2022-04-25 Xi Chen , Christos Papadimitriou , Binghui Peng

The rapid advancement of artificial intelligence (AI) has brought significant challenges to the education and workforce skills required to take advantage of AI for human-AI collaboration in the workplace. As AI continues to reshape…

Artificial Intelligence · Computer Science 2024-05-31 Margarida Romero

Continual Learning (CL) is an emerging machine learning paradigm that aims to learn from a continuous stream of tasks without forgetting knowledge learned from the previous tasks. To avoid performance decrease caused by forgetting, prior…

Machine Learning · Computer Science 2023-01-02 Soobee Lee , Minindu Weerakoon , Jonghyun Choi , Minjia Zhang , Di Wang , Myeongjae Jeon

Continual Learning (CL) aims to sequentially train models on streams of incoming data that vary in distribution by preserving previous knowledge while adapting to new data. Current CL literature focuses on restricted access to previously…

Continual learning (CL) is a new online learning technique over sequentially generated streaming data from different tasks, aiming to maintain a small forgetting loss on previously-learned tasks. Existing work focuses on reducing the…

Machine Learning · Computer Science 2024-12-25 Shugang Hao , Lingjie Duan