English
Related papers

Related papers: Generative Feature Replay For Class-Incremental Le…

200 papers

Continual learning for Semantic Segmentation (CSS) is a rapidly emerging field, in which the capabilities of the segmentation model are incrementally improved by learning new classes or new domains. A central challenge in Continual Learning…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Tobias Kalb , Björn Mauthe , Jürgen Beyerer

Continual learning in deep neural networks often suffers from catastrophic forgetting, where representations for previous tasks are overwritten during subsequent training. We propose a novel sample retrieval strategy from the memory buffer…

Machine Learning · Computer Science 2024-12-20 Hongye Xu , Jan Wasilewski , Bartosz Krawczyk

Continual learning (CL) aims to constantly learn new knowledge over time while avoiding catastrophic forgetting on old tasks. In this work, we focus on continual text classification under the class-incremental setting. Recent CL studies…

Computation and Language · Computer Science 2023-05-15 Yifan Song , Peiyi Wang , Dawei Zhu , Tianyu Liu , Zhifang Sui , Sujian Li

Most existing works on continual learning (CL) focus on overcoming the catastrophic forgetting (CF) problem, with dynamic models and replay methods performing exceptionally well. However, since current works tend to assume exclusivity or…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Sijia Wang , Yoojin Choi , Junya Chen , Mostafa El-Khamy , Ricardo Henao

Artificial neural networks thrive in solving the classification problem for a particular rigid task, acquiring knowledge through generalized learning behaviour from a distinct training phase. The resulting network resembles a static entity…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Matthias De Lange , Rahaf Aljundi , Marc Masana , Sarah Parisot , Xu Jia , Ales Leonardis , Gregory Slabaugh , Tinne Tuytelaars

We propose a new method for exemplar-free class incremental training of ViTs. The main challenge of exemplar-free continual learning is maintaining plasticity of the learner without causing catastrophic forgetting of previously learned…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Marco Cotogni , Fei Yang , Claudio Cusano , Andrew D. Bagdanov , Joost van de Weijer

Although well-trained deep neural networks have shown remarkable performance on numerous tasks, they rapidly forget what they have learned as soon as they begin to learn with additional data with the previous data stop being provided. In…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Byungju Kim , Jaeyoung Lee , Kyungsu Kim , Sungjin Kim , Junmo Kim

Catastrophic forgetting (CF) happens whenever a neural network overwrites past knowledge while being trained on new tasks. Common techniques to handle CF include regularization of the weights (using, e.g., their importance on past tasks),…

Machine Learning · Computer Science 2022-12-29 Jary Pomponi , Simone Scardapane , Aurelio Uncini

Continual learning is the process of training machine learning models on a sequence of tasks where data distributions change over time. A well-known obstacle in this setting is catastrophic forgetting, a phenomenon in which a model…

Machine Learning · Computer Science 2025-02-18 Andrii Krutsylo

We tackle catastrophic forgetting problem in the context of class-incremental learning for video recognition, which has not been explored actively despite the popularity of continual learning. Our framework addresses this challenging task…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Jaeyoo Park , Minsoo Kang , Bohyung Han

Machine unlearning has emerged as a new paradigm to deliberately forget data samples from a given model in order to adhere to stringent regulations. However, existing machine unlearning methods have been primarily focused on classification…

Machine Learning · Computer Science 2024-02-05 Guihong Li , Hsiang Hsu , Chun-Fu Chen , Radu Marculescu

Continual learning (CL) aims to develop techniques by which a single model adapts to an increasing number of tasks encountered sequentially, thereby potentially leveraging learnings across tasks in a resource-efficient manner. A major…

Machine Learning · Computer Science 2022-04-18 Rishabh Tiwari , Krishnateja Killamsetty , Rishabh Iyer , Pradeep Shenoy

Although data-free incremental learning methods are memory-friendly, accurately estimating and counteracting representation shifts is challenging in the absence of historical data. This paper addresses this thorny problem by proposing a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Zhiheng Ma , Xiaopeng Hong , Beinan Liu , Yabin Wang , Pinyue Guo , Huiyun Li

Continual learning aims to create artificial neural networks capable of accumulating knowledge and skills through incremental training on a sequence of tasks. The main challenge of continual learning is catastrophic interference, wherein…

Artificial Intelligence · Computer Science 2023-11-01 Anton Lee , Yaqian Zhang , Heitor Murilo Gomes , Albert Bifet , Bernhard Pfahringer

Continual Learning entails progressively acquiring knowledge from new data while retaining previously acquired knowledge, thereby mitigating ``Catastrophic Forgetting'' in neural networks. Our work presents a novel uncertainty-driven…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Sriram Mandalika , Harsha Vardhan , Athira Nambiar

Deep learning models suffer from catastrophic forgetting when learning new tasks incrementally. Incremental learning has been proposed to retain the knowledge of old classes while learning to identify new classes. A typical approach is to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Huitong Chen , Yu Wang , Qinghua Hu

Continual Learning is considered a key step toward next-generation Artificial Intelligence. Among various methods, replay-based approaches that maintain and replay a small episodic memory of previous samples are one of the most successful…

Machine Learning · Computer Science 2022-12-27 Guangji Bai , Chen Ling , Yuyang Gao , Liang Zhao

Continual learning aims to provide intelligent agents that are capable of learning continually a sequence of tasks, building on previously learned knowledge. A key challenge in this learning paradigm is catastrophically forgetting…

Machine Learning · Computer Science 2021-01-18 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

The two main impediments to continual learning are catastrophic forgetting and memory limitations on the storage of data. To cope with these challenges, we propose a novel, cognitively-inspired approach which trains autoencoders with Neural…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Ali Ayub , Alan R. Wagner

The ability to learn new concepts continually is necessary in this ever-changing world. However, deep neural networks suffer from catastrophic forgetting when learning new categories. Many works have been proposed to alleviate this…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Fu-Yun Wang , Da-Wei Zhou , Han-Jia Ye , De-Chuan Zhan