English
Related papers

Related papers: Joint Input and Output Coordination for Class-Incr…

200 papers

Continual learning of new knowledge over time is one desirable capability for intelligent systems to recognize more and more classes of objects. Without or with very limited amount of old data stored, an intelligent system often…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Zhuoyun Li , Changhong Zhong , Sijia Liu , Ruixuan Wang , Wei-Shi Zheng

The rehearsal strategy is widely used to alleviate the catastrophic forgetting problem in class incremental learning (CIL) by preserving limited exemplars from previous tasks. With imbalanced sample numbers between old and new classes, the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Xiuwei Chen , Xiaobin Chang

Non-exemplar class incremental learning aims to learn both the new and old tasks without accessing any training data from the past. This strict restriction enlarges the difficulty of alleviating catastrophic forgetting since all techniques…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Jiang-Tian Zhai , Xialei Liu , Lu Yu , Ming-Ming Cheng

Deep convolutional neural networks have made significant breakthroughs in medical image classification, under the assumption that training samples from all classes are simultaneously available. However, in real-world medical scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Xuze Hao , Wenqian Ni , Xuhao Jiang , Weimin Tan , Bo Yan

Traditional learning systems are trained in closed-world for a fixed number of classes, and need pre-collected datasets in advance. However, new classes often emerge in real-world applications and should be learned incrementally. For…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Da-Wei Zhou , Han-Jia Ye , De-Chuan Zhan

Instance-incremental learning (IIL) focuses on learning continually with data of the same classes. Compared to class-incremental learning (CIL), the IIL is seldom explored because IIL suffers less from catastrophic forgetting (CF). However,…

Machine Learning · Computer Science 2024-06-06 Qiang Nie , Weifu Fu , Yuhuan Lin , Jialin Li , Yifeng Zhou , Yong Liu , Lei Zhu , Chengjie Wang

The task of Long-tailed Class Incremental Learning (LT-CIL) addresses the sequential learning of new classes from datasets with imbalanced class distributions. This scenario intensifies the fundamental problem of catastrophic forgetting,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Taigo Sakai , Kazuhiro Hotta

Contemporary neural networks are limited in their ability to learn from evolving streams of training data. When trained sequentially on new or evolving tasks, their accuracy drops sharply, making them unsuitable for many real-world…

Computer Vision and Pattern Recognition · Computer Science 2021-02-19 Sudhanshu Mittal , Silvio Galesso , Thomas Brox

One of the key differences between the learning mechanism of humans and Artificial Neural Networks (ANNs) is the ability of humans to learn one task at a time. ANNs, on the other hand, can only learn multiple tasks simultaneously. Any…

Machine Learning · Computer Science 2019-03-26 Khurram Javed , Faisal Shafait

This paper investigates the problem of class-incremental object detection for agricultural applications where a model needs to learn new plant species and diseases incrementally without forgetting the previously learned ones. We adapt two…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Mathieu Pagé Fortin

The ability to learn more and more concepts over time from incrementally arriving data is essential for the development of a life-long learning system. However, deep neural networks often suffer from forgetting previously learned concepts…

Machine Learning · Computer Science 2019-07-08 Huaiyu Li , Weiming Dong , Bao-Gang Hu

Humans are capable of acquiring new knowledge and transferring learned knowledge into different domains, incurring a small forgetting. The same ability, called Continual Learning, is challenging to achieve when operating with neural…

Machine Learning · Computer Science 2024-05-24 Jary Pomponi , Alessio Devoto , Simone Scardapane

In the realm of class-incremental learning (CIL), alleviating the catastrophic forgetting problem is a pivotal challenge. This paper discovers a counter-intuitive observation: by incorporating domain shift into CIL tasks, the forgetting…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Wei Chen , Yi Zhou

Large language models have achieved remarkable success in various tasks. However, it is challenging for them to learn new tasks incrementally due to catastrophic forgetting. Existing approaches rely on experience replay, optimization…

Computation and Language · Computer Science 2026-04-15 Yukun Zhao , Lingyong Yan , Zhenyang Li , Shuaiqiang Wang , Zhumin Chen , Zhaochun Ren , Dawei Yin

We propose an algorithm for incremental learning of classifiers. The proposed method enables an ensemble of classifiers to learn incrementally by accommodating new training data. We use an effective mechanism to overcome the…

Machine Learning · Computer Science 2019-02-11 Shivang Agarwal , C. Ravindranath Chowdary , Shripriya Maheshwari

This paper studies class incremental learning (CIL) of continual learning (CL). Many approaches have been proposed to deal with catastrophic forgetting (CF) in CIL. Most methods incrementally construct a single classifier for all classes of…

Machine Learning · Computer Science 2022-08-23 Gyuhak Kim , Zixuan Ke , Bing Liu

Traditional object detection are ill-equipped for incremental learning. However, fine-tuning directly on a well-trained detection model with only new data will leads to catastrophic forgetting. Knowledge distillation is a straightforward…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Tao Feng , Mang Wang

In class-incremental learning, a learning agent faces a stream of data with the goal of learning new classes while not forgetting previous ones. Neural networks are known to suffer under this setting, as they forget previously acquired…

Machine Learning · Computer Science 2023-08-08 Federico Pernici , Matteo Bruni , Claudio Baecchi , Francesco Turchini , Alberto Del Bimbo

One of the major limitations of deep learning models is that they face catastrophic forgetting in an incremental learning scenario. There have been several approaches proposed to tackle the problem of incremental learning. Most of these…

Machine Learning · Computer Science 2021-02-04 Vinod K Kurmi , Badri N. Patro , Venkatesh K. Subramanian , Vinay P. Namboodiri

Class incremental learning consists in training discriminative models to classify an increasing number of classes over time. However, doing so using only the newly added class data leads to the known problem of catastrophic forgetting of…

Machine Learning · Computer Science 2024-05-15 Quentin Ferdinand , Gilles Le Chenadec , Benoit Clement , Panagiotis Papadakis , Quentin Oliveau