中文
相关论文

相关论文: Incremental Prototype Tuning for Class Incremental…

200 篇论文

Class-Incremental Learning (CIL) is a critical capability for real-world applications, enabling learning systems to adapt to new tasks while retaining knowledge from previous ones. Recent advancements in pre-trained models (PTMs) have…

机器学习 · 计算机科学 2025-04-28 Kun He , Zijian Song , Shuoxi Zhang , John E. Hopcroft

The Contrastive Language-Image Pre-training (CLIP) Model is a recently proposed large-scale pre-train model which attracts increasing attention in the computer vision community. Benefiting from its gigantic image-text training set, the CLIP…

计算机视觉与模式识别 · 计算机科学 2022-07-21 Yuxuan Ding , Lingqiao Liu , Chunna Tian , Jingyuan Yang , Haoxuan Ding

The key challenge of cross-modal domain-incremental learning (DIL) is to enable the learning model to continuously learn from novel data with different feature distributions under the same task without forgetting old ones. However, existing…

计算与语言 · 计算机科学 2024-08-05 Yu Feng , Zhen Tian , Yifan Zhu , Zongfu Han , Haoran Luo , Guangwei Zhang , Meina Song

In class-incremental learning (CIL) scenarios, the phenomenon of catastrophic forgetting caused by the classifier's bias towards the current task has long posed a significant challenge. It is mainly caused by the characteristic of…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Xusheng Cao , Haori Lu , Linlan Huang , Xialei Liu , Ming-Ming Cheng

Vision-language models (VLMs) have demonstrated exceptional generalization capabilities for downstream tasks. Due to its efficiency, prompt learning has gradually become a more effective and efficient method for transferring VLMs to…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Chenhao Ding , Xinyuan Gao , Songlin Dong , Jizhou Han , Qiang Wang , Zhengdong Zhou , Yuhang He , Yihong Gong

Incremental learning (IL) is an important task aimed at increasing the capability of a trained model, in terms of the number of classes recognizable by the model. The key problem in this task is the requirement of storing data (e.g. images)…

计算机视觉与模式识别 · 计算机科学 2019-04-16 Prithviraj Dhar , Rajat Vikram Singh , Kuan-Chuan Peng , Ziyan Wu , Rama Chellappa

In our ever-evolving world, new data exhibits a long-tailed distribution, such as e-commerce platform reviews. This necessitates continuous model learning imbalanced data without forgetting, addressing the challenge of long-tailed…

机器学习 · 计算机科学 2024-09-12 Zhi-Hong Qi , Da-Wei Zhou , Yiran Yao , Han-Jia Ye , De-Chuan Zhan

Through in-context learning (ICL), large-scale language models are effective few-shot learners without additional model fine-tuning. However, the ICL performance does not scale well with the number of available training samples as it is…

计算与语言 · 计算机科学 2023-06-16 Hyunsoo Cho , Hyuhng Joon Kim , Junyeob Kim , Sang-Woo Lee , Sang-goo Lee , Kang Min Yoo , Taeuk Kim

With the excellent representation capabilities of Pre-Trained Models (PTMs), remarkable progress has been made in non-rehearsal Class-Incremental Learning (CIL) research. However, it remains an extremely challenging task due to three…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Jiawei Zhan , Jun Liu , Jinlong Peng , Xiaochen Chen , Bin-Bin Gao , Yong Liu , Chengjie Wang

Many applications of computer vision require the ability to adapt to novel data distributions after deployment. Adaptation requires algorithms capable of continual learning (CL). Continual learners must be plastic to adapt to novel tasks…

机器学习 · 计算机科学 2025-04-24 Edison Mucllari , Aswin Raghavan , Zachary Alan Daniels

Incremental learning remains a critical challenge in machine learning, as models often struggle with catastrophic forgetting -the tendency to lose previously acquired knowledge when learning new information. These challenges are even more…

Prompt tuning (PT) which only tunes the embeddings of an additional sequence of tokens per task, keeping the pre-trained language model (PLM) frozen, has shown remarkable performance in few-shot learning. Despite this, PT has been shown to…

计算与语言 · 计算机科学 2023-11-21 Chengwei Qin , Qian Li , Ruochen Zhao , Shafiq Joty

Class-incremental fault diagnosis requires a model to adapt to new fault classes while retaining previous knowledge. However, limited research exists for imbalanced and long-tailed data. Extracting discriminative features from few-shot…

机器学习 · 计算机科学 2025-01-22 Hanrong Zhang , Yifei Yao , Zixuan Wang , Jiayuan Su , Mengxuan Li , Peng Peng , Hongwei Wang

Exemplar-based class-incremental learning (CIL) finetunes the model with all samples of new classes but few-shot exemplars of old classes in each incremental phase, where the "few-shot" abides by the limited memory budget. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2023-04-11 Zilin Luo , Yaoyao Liu , Bernt Schiele , Qianru Sun

Contrastive Language-Image Pretraining (CLIP) model has exhibited remarkable efficacy in establishing cross-modal connections between texts and images, yielding impressive performance across a broad spectrum of downstream applications…

计算机视觉与模式识别 · 计算机科学 2024-01-17 Yi Zhang , Ce Zhang , Ke Yu , Yushun Tang , Zhihai He

With the widespread adoption of deep learning in visual tasks, Class-Incremental Learning (CIL) has become an important paradigm for handling dynamically evolving data distributions. However, CIL faces the core challenge of catastrophic…

机器学习 · 计算机科学 2026-03-04 Jinge Ma , Fengqing Zhu

Most incremental learners excessively prioritize coarse classes of objects while neglecting various kinds of states (e.g. color and material) attached to the objects. As a result, they are limited in the ability to reason fine-grained…

计算机视觉与模式识别 · 计算机科学 2025-03-28 Yanyi Zhang , Binglin Qiu , Qi Jia , Yu Liu , Ran He

Class-Incremental Learning (CIL) aims to learn new classes sequentially while retaining the knowledge of previously learned classes. Recently, pre-trained models (PTMs) combined with parameter-efficient fine-tuning (PEFT) have shown…

计算机视觉与模式识别 · 计算机科学 2025-06-02 Jiangpeng He , Zhihao Duan , Fengqing Zhu

Class-Incremental Learning (CIL) enables models to learn new classes continually while preserving past knowledge. Recently, vision-language models like CLIP offer transferable features via multi-modal pre-training, making them well-suited…

计算机视觉与模式识别 · 计算机科学 2025-11-20 Tao Hu , Lan Li , Zhen-Hao Xie , Da-Wei Zhou

In-context learning (ICL) has proven highly effective across diverse large language model (LLM) tasks. However, its potential for enhancing tasks that demand step-by-step logical deduction, such as mathematical reasoning, remains…

人工智能 · 计算机科学 2026-01-21 Ang Gao , Changshuo Zhang , Xiao Zhang , Deyang Li , Minjun Zhao , Fangchao Liu , Xinyu Zhang