English
Related papers

Related papers: Self-Sustaining Representation Expansion for Non-E…

200 papers

In class-incremental learning, the objective is to learn a number of classes sequentially without having access to the whole training data. However, due to a problem known as catastrophic forgetting, neural networks suffer substantial…

Machine Learning · Computer Science 2021-06-01 Sobirdzhon Bobiev , Adil Khan , Syed Muhammad Ahsan Raza Kazmi

For future learning systems, incremental learning is desirable because it allows for: efficient resource usage by eliminating the need to retrain from scratch at the arrival of new data; reduced memory usage by preventing or limiting the…

Machine Learning · Computer Science 2022-10-12 Marc Masana , Xialei Liu , Bartlomiej Twardowski , Mikel Menta , Andrew D. Bagdanov , Joost van de Weijer

Plasticity and stability are needed in class-incremental learning in order to learn from new data while preserving past knowledge. Due to catastrophic forgetting, finding a compromise between these two properties is particularly challenging…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Grégoire Petit , Adrian Popescu , Eden Belouadah , David Picard , Bertrand Delezoide

Incrementally training deep neural networks to recognize new classes is a challenging problem. Most existing class-incremental learning methods store data or use generative replay, both of which have drawbacks, while 'rehearsal-free'…

Machine Learning · Computer Science 2023-11-10 Gido M. van de Ven , Zhe Li , Andreas S. Tolias

In this paper, we address the problem of distillation-based class-incremental learning with a single head. A central theme of this task is to learn new classes that arrive in sequential phases over time while keeping the model's capability…

Computer Vision and Pattern Recognition · Computer Science 2021-01-25 Cheng-Hsun Lei , Yi-Hsin Chen , Wen-Hsiao Peng , Wei-Chen Chiu

In this paper, we consider the problem of fine-grained image retrieval in an incremental setting, when new categories are added over time. On the one hand, repeatedly training the representation on the extended dataset is time-consuming. On…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Wei Chen , Yu Liu , Weiping Wang , Tinne Tuytelaars , Erwin M. Bakker , Michael Lew

In Continual learning (CL) balancing effective adaptation while combating catastrophic forgetting is a central challenge. Many of the recent best-performing methods utilize various forms of prior task data, e.g. a replay buffer, to tackle…

Machine Learning · Computer Science 2023-06-07 Nader Asadi , MohammadReza Davari , Sudhir Mudur , Rahaf Aljundi , Eugene Belilovsky

This paper investigates the problem of class-incremental object detection for agricultural applications where a model needs to learn new plant species and diseases incrementally without forgetting the previously learned ones. We adapt two…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Mathieu Pagé Fortin

Class-incremental continual learning is a core step towards developing artificial intelligence systems that can continuously adapt to changes in the environment by learning new concepts without forgetting those previously learned. This is…

Machine Learning · Computer Science 2023-07-07 Evelyn Chee , Mong Li Lee , Wynne Hsu

In class-incremental learning, a learning agent faces a stream of data with the goal of learning new classes while not forgetting previous ones. Neural networks are known to suffer under this setting, as they forget previously acquired…

Machine Learning · Computer Science 2023-08-08 Federico Pernici , Matteo Bruni , Claudio Baecchi , Francesco Turchini , Alberto Del Bimbo

Successful continual learning of new knowledge would enable intelligent systems to recognize more and more classes of objects. However, current intelligent systems often fail to correctly recognize previously learned classes of objects when…

Computer Vision and Pattern Recognition · Computer Science 2021-08-21 Changhong Zhong , Zhiying Cui , Ruixuan Wang , Wei-Shi Zheng

Exemplar-Free Class Incremental Learning is a highly challenging setting where replay memory is unavailable. Methods relying on frozen feature extractors have drawn attention recently in this setting due to their impressive performances and…

Machine Learning · Computer Science 2025-02-28 Quentin Jodelet , Xin Liu , Yin Jun Phua , Tsuyoshi Murata

Recent self-supervised learning methods are able to learn high-quality image representations and are closing the gap with supervised approaches. However, these methods are unable to acquire new knowledge incrementally -- they are, in fact,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Alex Gomez-Villa , Bartlomiej Twardowski , Lu Yu , Andrew D. Bagdanov , Joost van de Weijer

Few-shot class incremental learning implies the model to learn new classes while retaining knowledge of previously learned classes with a small number of training instances. Existing frameworks typically freeze the parameters of the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Parinita Nema , Vinod K Kurmi

Class incremental learning consists in training discriminative models to classify an increasing number of classes over time. However, doing so using only the newly added class data leads to the known problem of catastrophic forgetting of…

Machine Learning · Computer Science 2024-05-15 Quentin Ferdinand , Gilles Le Chenadec , Benoit Clement , Panagiotis Papadakis , Quentin Oliveau

We propose a novel class incremental learning approach by incorporating a feature augmentation technique motivated by adversarial attacks. We employ a classifier learned in the past to complement training examples rather than simply play a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Taehoon Kim , Jaeyoo Park , Bohyung Han

Class-incremental learning (CIL) aims to recognize new classes incrementally while maintaining the discriminability of old classes. Most existing CIL methods are exemplar-based, i.e., storing a part of old data for retraining. Without…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Fei Zhu , Xu-Yao Zhang , Zhen Cheng , Cheng-Lin Liu

In incremental classification tasks for hyperspectral images, catastrophic forgetting is an unavoidable challenge. While memory recall methods can mitigate this issue, they heavily rely on samples from old categories. This paper proposes a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Songfeng Zhu

With the memory-resource-limited constraints, class-incremental learning (CIL) usually suffers from the "catastrophic forgetting" problem when updating the joint classification model on the arrival of newly added classes. To cope with the…

Machine Learning · Computer Science 2021-05-19 Hanbin Zhao , Hui Wang , Yongjian Fu , Fei Wu , Xi Li

The field of continual deep learning is an emerging field and a lot of progress has been made. However, concurrently most of the approaches are only tested on the task of image classification, which is not relevant in the field of…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Tobias Kalb , Masoud Roschani , Miriam Ruf , Jürgen Beyerer