English
Related papers

Related papers: Continual Learning Should Move Beyond Incremental …

200 papers

The goal of continual learning is to improve the performance of recognition models in learning sequentially arrived data. Although most existing works are established on the premise of learning from scratch, growing efforts have been…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Gengwei Zhang , Liyuan Wang , Guoliang Kang , Ling Chen , Yunchao Wei

Continual Learning aims to learn from a stream of tasks, being able to remember at the same time both new and old tasks. While many approaches were proposed for single-class classification, multi-label classification in the continual…

Machine Learning · Computer Science 2022-08-09 Davide Dalle Pezze , Denis Deronjic , Chiara Masiero , Diego Tosato , Alessandro Beghi , Gian Antonio Susto

Motivated by the efficiency and rapid convergence of pre-trained models for solving downstream tasks, this paper extensively studies the impact of Continual Learning (CL) models as pre-trainers. In both supervised and unsupervised CL, we…

Machine Learning · Computer Science 2023-06-22 Jaehong Yoon , Sung Ju Hwang , Yue Cao

In this paper, we propose a continual learning (CL) technique that is beneficial to sequential task learners by improving their retained accuracy and reducing catastrophic forgetting. The principal target of our approach is the automatic…

Machine Learning · Computer Science 2021-01-19 Ammar Shaker , Shujian Yu , Francesco Alesiani

Continual learning is essential for all real-world applications, as frozen pre-trained models cannot effectively deal with non-stationary data distributions. The purpose of this study is to review the state-of-the-art methods that allow…

Machine Learning · Computer Science 2022-02-28 Khadija Shaheen , Muhammad Abdullah Hanif , Osman Hasan , Muhammad Shafique

Continual learning (CL) is designed to learn new tasks while preserving existing knowledge. Replaying samples from earlier tasks has proven to be an effective method to mitigate the forgetting of previously acquired knowledge. However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Ruiqi Liu , Boyu Diao , Libo Huang , Zijia An , Zhulin An , Yongjun Xu

Continual Learning, also known as Lifelong or Incremental Learning, has recently gained renewed interest among the Artificial Intelligence research community. Recent research efforts have quickly led to the design of novel algorithms able…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Lorenzo Pellegrini , Chenchen Zhu , Fanyi Xiao , Zhicheng Yan , Antonio Carta , Matthias De Lange , Vincenzo Lomonaco , Roshan Sumbaly , Pau Rodriguez , David Vazquez

Continual learning (CL) aims to enable learning systems to acquire new knowledge constantly without forgetting previously learned information. CL faces the challenge of mitigating catastrophic forgetting while maintaining interpretability…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Lu Yu , Haoyu Han , Zhe Tao , Hantao Yao , Changsheng Xu

Scenarios in which restrictions in data transfer and storage limit the possibility to compose a single dataset -- also exploiting different data sources -- to perform a batch-based training procedure, make the development of robust models…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Lorenzo Pellegrini , Guido Borghi , Annalisa Franco , Davide Maltoni

Continual learning is an emerging paradigm in machine learning, wherein a model is exposed in an online fashion to data from multiple different distributions (i.e. environments), and is expected to adapt to the distribution change.…

Machine Learning · Computer Science 2022-03-29 Binghui Peng , Andrej Risteski

Continual learning (CL) aims to train deep neural networks efficiently on streaming data while limiting the forgetting caused by new tasks. However, learning transferable knowledge with less interference between tasks is difficult, and…

Machine Learning · Computer Science 2023-10-31 Saurav Jha , Dong Gong , He Zhao , Lina Yao

Deep learning techniques have become one of the main propellers for solving engineering problems effectively and efficiently. For instance, Predictive Maintenance methods have been used to improve predictions of when maintenance is needed…

Machine Learning · Computer Science 2023-06-30 Julio Hurtado , Dario Salvati , Rudy Semola , Mattia Bosio , Vincenzo Lomonaco

Dynamical systems that evolve continuously over time are ubiquitous throughout science and engineering. Machine learning (ML) provides data-driven approaches to model and predict the dynamics of such systems. A core issue with this approach…

Machine Learning · Computer Science 2023-11-23 Aditi S. Krishnapriyan , Alejandro F. Queiruga , N. Benjamin Erichson , Michael W. Mahoney

Continual learning refers to the ability of a biological or artificial system to seamlessly learn from continuous streams of information while preventing catastrophic forgetting, i.e., a condition in which new incoming information strongly…

Machine Learning · Computer Science 2019-07-04 German I. Parisi , Christopher Kanan

Continual learning--the ability to acquire, retain, and refine knowledge over time--has always been fundamental to intelligence, both human and artificial. Historically, different AI paradigms have acknowledged this need, albeit with…

Machine Learning · Computer Science 2025-06-05 Jack Bell , Luigi Quarantiello , Eric Nuertey Coleman , Lanpei Li , Malio Li , Mauro Madeddu , Elia Piccoli , Vincenzo Lomonaco

The goal of continual learning (CL) is to train a model that can solve multiple tasks presented sequentially. Recent CL approaches have achieved strong performance by leveraging large pre-trained models that generalize well to downstream…

Machine Learning · Computer Science 2025-05-20 Liangzu Peng , Juan Elenter , Joshua Agterberg , Alejandro Ribeiro , René Vidal

In-Context Learning (ICL) empowers Large Language Models (LLMs) with the ability to learn from a few examples provided in the prompt, enabling downstream generalization without the requirement for gradient updates. Despite encouragingly…

Computation and Language · Computer Science 2025-01-28 Haitao Mao , Guangliang Liu , Yao Ma , Rongrong Wang , Kristen Johnson , Jiliang Tang

Place recognition is an essential and challenging task in loop closing and global localization for robotics and autonomous driving applications. Benefiting from the recent advances in deep learning techniques, the performance of LiDAR place…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Jiafeng Cui , Xieyuanli Chen

Many applications of computer vision require the ability to adapt to novel data distributions after deployment. Adaptation requires algorithms capable of continual learning (CL). Continual learners must be plastic to adapt to novel tasks…

Machine Learning · Computer Science 2025-04-24 Edison Mucllari , Aswin Raghavan , Zachary Alan Daniels

Deep Learning has advanced significantly in medical applications, aiding disease diagnosis in Chest X-ray images. However, expanding model capabilities with new data remains a challenge, which Continual Learning (CL) aims to address.…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Marina Ceccon , Davide Dalle Pezze , Alessandro Fabris , Gian Antonio Susto