English
Related papers

Related papers: Rotation Augmented Distillation for Exemplar-Free …

200 papers

Continual learning aims to accumulate knowledge over a data stream while mitigating catastrophic forgetting. In Non-exemplar Class Incremental Learning (NECIL), forgetting arises during incremental optimization because old classes are…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Haori Lu , Xusheng Cao , Linlan Huang , Enguang Wang , Fei Yang , Xialei Liu

Class incremental learning (CIL) aims to incrementally update a trained model with the new classes of samples (plasticity) while retaining previously learned ability (stability). To address the most challenging issue in this goal, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Yuhang Zhou , Jiangchao Yao , Feng Hong , Ya Zhang , Yanfeng Wang

Rehearsal-based techniques are commonly used to mitigate catastrophic forgetting (CF) in Incremental learning (IL). The quality of the exemplars selected is important for this purpose and most methods do not ensure the appropriate diversity…

Machine Learning · Computer Science 2023-12-18 Sahil Nokhwal , Nirman Kumar

Class-incremental learning (CIL) has emerged as a means to learn new classes incrementally without catastrophic forgetting of previous classes. Recently, CIL has undergone a paradigm shift towards dynamic architectures due to their superior…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Sunyuan Qiang , Yanyan Liang , Jun Wan , Du Zhang

Existing continual learning techniques focus on either task incremental learning (TIL) or class incremental learning (CIL) problem, but not both. CIL and TIL differ mainly in that the task-id is provided for each test sample during testing…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Gyuhak Kim , Sepideh Esmaeilpour , Changnan Xiao , Bing Liu

Incremental learning methods can learn new classes continually by distilling knowledge from the last model (as a teacher model) to the current model (as a student model) in the sequentially learning process. However, these methods cannot…

Computer Vision and Pattern Recognition · Computer Science 2022-02-25 Longhui Yu , Zhenyu Weng , Yuqing Wang , Yuesheng Zhu

This work explores class-incremental learning (CIL) for sound event detection (SED), advancing adaptability towards real-world scenarios. CIL's success in domains like computer vision inspired our SED-tailored method, addressing the unique…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-14 Yang Xiao , Rohan Kumar Das

Class-Incremental Learning (CIL) aims to continuously acquire new categories while preserving previously learned knowledge. Recently, Contrastive Language-Image Pre-trained (CLIP) models have shown strong potential for CIL due to their…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Tianqi Wang , Jingcai Guo

Intelligent fault diagnosis has made extraordinary advancements currently. Nonetheless, few works tackle class-incremental learning for fault diagnosis under limited fault data, i.e., imbalanced and long-tailed fault diagnosis, which brings…

Machine Learning · Computer Science 2023-02-14 Peng Peng , Hanrong Zhang , Mengxuan Li , Gongzhuang Peng , Hongwei Wang , Weiming Shen

Exemplar-Free Class Incremental Learning (EFCIL) aims to learn from a sequence of tasks without having access to previous task data. In this paper, we consider the challenging Cold Start scenario in which insufficient data is available in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Simone Magistri , Tomaso Trinci , Albin Soutif-Cormerais , Joost van de Weijer , Andrew D. Bagdanov

In general class-incremental learning, researchers typically use sample sets as a tool to avoid catastrophic forgetting during continuous learning. At the same time, researchers have also noted the differences between class-incremental…

Machine Learning · Computer Science 2024-08-16 Weimin Yin , Bin Chen adn Chunzhao Xie , Zhenhao Tan

In class-incremental learning (CIL), effective incremental learning strategies are essential to mitigate task confusion and catastrophic forgetting, especially as the number of tasks $t$ increases. Current exemplar replay strategies impose…

Machine Learning · Computer Science 2025-05-19 Milad Khademi Nori , Il-Min Kim , Guanghui Wang

Online class-incremental learning (OCIL) focuses on gradually learning new classes (called plasticity) from a stream of data in a single-pass, while concurrently preserving knowledge of previously learned classes (called stability). The…

Machine Learning · Computer Science 2025-12-12 Shunjie Wen , Thomas Heinis , Dong-Wan Choi

Class-incremental learning (CIL) aims to train a model to learn new classes from non-stationary data streams without forgetting old ones. In this paper, we propose a new kind of connectionist model by tailoring neural unit dynamics that…

Machine Learning · Computer Science 2024-06-05 Depeng Li , Tianqi Wang , Junwei Chen , Wei Dai , Zhigang Zeng

Incremental learning attempts to develop a classifier which learns continuously from a stream of data segregated into different classes. Deep learning approaches suffer from catastrophic forgetting when learning classes incrementally, while…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Ali Ayub , Alan Wagner

Modern object detection methods based on convolutional neural network suffer from severe catastrophic forgetting in learning new classes without original data. Due to time consumption, storage burden and privacy of old data, it is…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Dongbao Yang , Yu Zhou , Dayan Wu , Can Ma , Fei Yang , Weiping Wang

In a real-world setting, object instances from new classes can be continuously encountered by object detectors. When existing object detectors are applied to such scenarios, their performance on old classes deteriorates significantly. A few…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 K J Joseph , Jathushan Rajasegaran , Salman Khan , Fahad Shahbaz Khan , Vineeth N Balasubramanian

Class-incremental learning (CIL) enables models to learn new classes continually without forgetting previously acquired knowledge. Multi-label CIL (MLCIL) extends CIL to a real-world scenario where each sample may belong to multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Xiang Zhang , Run He , Jiao Chen , Di Fang , Ming Li , Ziqian Zeng , Cen Chen , Huiping Zhuang

In this paper, we consider the problem of fine-grained image retrieval in an incremental setting, when new categories are added over time. On the one hand, repeatedly training the representation on the extended dataset is time-consuming. On…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Wei Chen , Yu Liu , Weiping Wang , Tinne Tuytelaars , Erwin M. Bakker , Michael Lew

Continual learning aims to provide intelligent agents that are capable of learning continually a sequence of tasks, building on previously learned knowledge. A key challenge in this learning paradigm is catastrophically forgetting…

Machine Learning · Computer Science 2021-01-18 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy