English
Related papers

Related papers: Dual Consolidation for Pre-Trained Model-Based Dom…

200 papers

Class-Incremental Learning (CIL) enables learning systems to continuously adapt to evolving data streams. With the advancement of pre-training, leveraging pre-trained vision-language models (e.g., CLIP) offers a promising starting point for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Da-Wei Zhou , Kai-Wen Li , Jingyi Ning , Han-Jia Ye , Lijun Zhang , De-Chuan Zhan

Class Incremental Learning (CIL) aims at learning a multi-class classifier in a phase-by-phase manner, in which only data of a subset of the classes are provided at each phase. Previous works mainly focus on mitigating forgetting in phases…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Yujun Shi , Kuangqi Zhou , Jian Liang , Zihang Jiang , Jiashi Feng , Philip Torr , Song Bai , Vincent Y. F. Tan

Class-Incremental Learning (CIL) struggles with catastrophic forgetting when learning new knowledge, and Data-Free CIL (DFCIL) is even more challenging without access to the training data of previously learned classes. Though recent DFCIL…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Qiankun Gao , Chen Zhao , Bernard Ghanem , Jian Zhang

Prompt learning has recently become a very efficient transfer learning paradigm for Contrastive Language Image Pretraining (CLIP) models. Compared with fine-tuning the entire encoder, prompt learning can obtain highly competitive results by…

Machine Learning · Computer Science 2024-08-30 Guoyizhe Wei , Feng Wang , Anshul Shah , Rama Chellappa

Significant advancements have been made in single label incremental learning (SLCIL),yet the more practical and challenging multi label class incremental learning (MLCIL) remains understudied. Recently,visual language models such as CLIP…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Haifeng Zhao , Yuguang Jin , Leilei Ma

Deep learning models dealing with image understanding in real-world settings must be able to adapt to a wide variety of tasks across different domains. Domain adaptation and class incremental learning deal with domain and task variability…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Marco Toldo , Umberto Michieli , Pietro Zanuttigh

Domain generalization (DG) intends to train a model on multiple source domains to ensure that it can generalize well to an arbitrary unseen target domain. The acquisition of domain-invariant representations is pivotal for DG as they possess…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Na Wang , Lei Qi , Jintao Guo , Yinghuan Shi , Yang Gao

Multi-instance learning (MIL) is a widely-applied technique in practical applications that involve complex data structures. MIL can be broadly categorized into two types: traditional methods and those based on deep learning. These…

Artificial Intelligence · Computer Science 2023-04-25 Yu-Xuan Zhang , Zhengchun Zhou , Xingxing He , Avik Ranjan Adhikary , Bapi Dutta

Class Incremental Learning (CIL) based on pre-trained models offers a promising direction for open-world continual learning. Existing methods typically rely on correlation-based strategies, where an image's classification feature is used as…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Libo Huang , Zhulin An , Chuanguang Yang , Boyu Diao , Fei Wang , Yan Zeng , Zhifeng Hao , Yongjun Xu

Class-incremental learning (CIL) aims to develop a learning system that can continually learn new classes from a data stream without forgetting previously learned classes. When learning classes incrementally, the classifier must be…

Computation and Language · Computer Science 2023-05-29 Minqian Liu , Lifu Huang

Dataset Condensation (DC) has emerged as a promising solution to mitigate the computational and storage burdens associated with training deep learning models. However, existing DC methods largely overlook the multi-domain nature of modern…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Jaehyun Choi , Gyojin Han , Dong-Jae Lee , Sunghyun Baek , Junmo Kim

Deep learning models, though having achieved great success in many different fields over the past years, are usually data hungry, fail to perform well on unseen samples, and lack of interpretability. Various prior knowledge often exists in…

Machine Learning · Computer Science 2022-12-02 Zijun Cui , Tian Gao , Kartik Talamadupula , Qiang Ji

We present a novel framework that can combine multi-domain learning (MDL), data imputation (DI) and multi-task learning (MTL) to improve performance for classification and regression tasks in different domains. The core of our method is an…

Machine Learning · Computer Science 2020-03-18 Andre Mendes , Julian Togelius , Leandro dos Santos Coelho

Class-Incremental Learning (CIL) aims to learn new classes sequentially while retaining the knowledge of previously learned classes. Recently, pre-trained models (PTMs) combined with parameter-efficient fine-tuning (PEFT) have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Jiangpeng He , Zhihao Duan , Fengqing Zhu

State-of-the-art deep neural networks are still struggling to address the catastrophic forgetting problem in continual learning. In this paper, we propose one simple paradigm (named as S-Prompting) and two concrete approaches to highly…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Yabin Wang , Zhiwu Huang , Xiaopeng Hong

Cross domain recommender system constitutes a powerful method to tackle the cold-start and sparsity problem by aggregating and transferring user preferences across multiple category domains. Therefore, it has great potential to improve…

Information Retrieval · Computer Science 2021-06-08 Pan Li , Zhichao Jiang , Maofei Que , Yao Hu , Alexander Tuzhilin

Class incremental learning (CIL) algorithms aim to continually learn new object classes from incrementally arriving data while not forgetting past learned classes. The common evaluation protocol for CIL algorithms is to measure the average…

Machine Learning · Computer Science 2024-06-26 Sungmin Cha , Jihwan Kwak , Dongsub Shim , Hyunwoo Kim , Moontae Lee , Honglak Lee , Taesup Moon

Multi-task learning promises better model generalization on a target task by jointly optimizing it with an auxiliary task. However, the current practice requires additional labeling efforts for the auxiliary task, while not guaranteeing…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Menelaos Kanakis , Thomas E. Huang , David Bruggemann , Fisher Yu , Luc Van Gool

Non-exemplar class Incremental Learning (NECIL) enables models to continuously acquire new classes without retraining from scratch and storing old task exemplars, addressing privacy and storage issues. However, the absence of data from…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Jiashuo Li , Shaokun Wang , Bo Qian , Yuhang He , Xing Wei , Qiang Wang , Yihong Gong

We address the problem of class incremental learning, which is a core step towards achieving adaptive vision intelligence. In particular, we consider the task setting of incremental learning with limited memory and aim to achieve better…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Shipeng Yan , Jiangwei Xie , Xuming He