English
Related papers

Related papers: Knowledge Restore and Transfer for Multi-label Cla…

200 papers

In the realm of class-incremental learning (CIL), alleviating the catastrophic forgetting problem is a pivotal challenge. This paper discovers a counter-intuitive observation: by incorporating domain shift into CIL tasks, the forgetting…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Wei Chen , Yi Zhou

Incremental learning is a form of online learning. Incremental learning can modify the parameters and structure of the deep learning model so that the model does not forget the old knowledge while learning new knowledge. Preventing…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Sheng Ren , Yan He , Neal N. Xiong , Kehua Guo

Continual Learning (CL) aims to learn new data while remembering previously acquired knowledge. In contrast to CL for image classification, CL for Object Detection faces additional challenges such as the missing annotations problem. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Riccardo De Monte , Davide Dalle Pezze , Marina Ceccon , Francesco Pasti , Francesco Paissan , Elisabetta Farella , Gian Antonio Susto , Nicola Bellotto

Exemplar-Free Class Incremental Learning (efCIL) aims to continuously incorporate the knowledge from new classes while retaining previously learned information, without storing any old-class exemplars (i.e., samples). For this purpose,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Libo Huang , Zhulin An , Yan Zeng , Chuanguang Yang , Xinqiang Yu , Yongjun Xu

Existing research on continual learning (CL) of a sequence of tasks focuses mainly on dealing with catastrophic forgetting (CF) to balance the learning plasticity of new tasks and the memory stability of old tasks. However, an ideal CL…

Machine Learning · Computer Science 2026-01-12 Zhi Wang , Zhongbin Wu , Yanni Li , Bing Liu , Guangxi Li , Yuping Wang

Despite their success for object detection, convolutional neural networks are ill-equipped for incremental learning, i.e., adapting the original model trained on a set of classes to additionally detect objects of new classes, in the absence…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Konstantin Shmelkov , Cordelia Schmid , Karteek Alahari

This paper studies class incremental learning (CIL) of continual learning (CL). Many approaches have been proposed to deal with catastrophic forgetting (CF) in CIL. Most methods incrementally construct a single classifier for all classes of…

Machine Learning · Computer Science 2022-08-23 Gyuhak Kim , Zixuan Ke , Bing Liu

Class-Incremental Learning (CIL) struggles with catastrophic forgetting when learning new knowledge, and Data-Free CIL (DFCIL) is even more challenging without access to the training data of previously learned classes. Though recent DFCIL…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Qiankun Gao , Chen Zhao , Bernard Ghanem , Jian Zhang

Instance-incremental learning (IIL) focuses on learning continually with data of the same classes. Compared to class-incremental learning (CIL), the IIL is seldom explored because IIL suffers less from catastrophic forgetting (CF). However,…

Machine Learning · Computer Science 2024-06-06 Qiang Nie , Weifu Fu , Yuhuan Lin , Jialin Li , Yifeng Zhou , Yong Liu , Lei Zhu , Chengjie Wang

Multi-label classification (MLC) is an important class of machine learning problems that come with a wide spectrum of applications, each demanding a possibly different evaluation criterion. When solving the MLC problems, we generally expect…

Machine Learning · Computer Science 2019-10-08 Yao-Yuan Yang , Yi-An Lin , Hong-Min Chu , Hsuan-Tien Lin

Multimodal Continual Instruction Tuning (MCIT) enables Multimodal Large Language Models (MLLMs) to meet continuously emerging requirements without expensive retraining. MCIT faces two major obstacles: catastrophic forgetting (where old…

Machine Learning · Computer Science 2024-06-28 Junhao Zheng , Qianli Ma , Zhen Liu , Binquan Wu , Huawen Feng

Continual learning has been a major problem in the deep learning community, where the main challenge is how to effectively learn a series of newly arriving tasks without forgetting the knowledge of previous tasks. Initiated by Learning…

Machine Learning · Computer Science 2021-07-06 Jong-Yeong Kim , Dong-Wan Choi

The primary goal of continual learning (CL) task in medical image segmentation field is to solve the "catastrophic forgetting" problem, where the model totally forgets previously learned features when it is extended to new categories…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Qian Chen , Lei Zhu , Hangzhou He , Xinliang Zhang , Shuang Zeng , Qiushi Ren , Yanye Lu

When learning new tasks in a sequential manner, deep neural networks tend to forget tasks that they previously learned, a phenomenon called catastrophic forgetting. Class incremental learning methods aim to address this problem by keeping a…

Machine Learning · Computer Science 2022-06-20 Jinlin Xiang , Eli Shlizerman

Incremental learning attempts to develop a classifier which learns continuously from a stream of data segregated into different classes. Deep learning approaches suffer from catastrophic forgetting when learning classes incrementally, while…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Ali Ayub , Alan Wagner

Despite the critical importance of the medical domain in Deep Learning, most of the research in this area solely focuses on training models in static environments. It is only in recent years that research has begun to address dynamic…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Marina Ceccon , Davide Dalle Pezze , Alessandro Fabris , Gian Antonio Susto

Continual learning (CL) aims to train models that can learn a sequence of tasks without forgetting previously acquired knowledge. A core challenge in CL is balancing stability -- preserving performance on old tasks -- and plasticity --…

Machine Learning · Computer Science 2025-05-14 Zhenrong Liu , Janne M. J. Huttunen , Mikko Honkala

Multi-task learns multiple tasks, while sharing knowledge and computation among them. However, it suffers from catastrophic forgetting of previous knowledge when learned incrementally without access to the old data. Most existing object…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Xialei Liu , Hao Yang , Avinash Ravichandran , Rahul Bhotika , Stefano Soatto

Multi-task Learning (MTL) for classification with disjoint datasets aims to explore MTL when one task only has one labeled dataset. In existing methods, for each task, the unlabeled datasets are not fully exploited to facilitate this task.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Yan Hong , Li Niu , Jianfu Zhang , Liqing Zhang

In class-incremental semantic segmentation, we have no access to the labeled data of previous tasks. Therefore, when incrementally learning new classes, deep neural networks suffer from catastrophic forgetting of previously learned…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Lu Yu , Xialei Liu , Joost van de Weijer