English
Related papers

Related papers: Incremental Prototype Tuning for Class Incremental…

200 papers

Class-incremental learning (CIL) aims to train a classification model while the number of classes increases phase-by-phase. An inherent challenge of CIL is the stability-plasticity tradeoff, i.e., CIL models should keep stable to retain old…

Machine Learning · Computer Science 2023-06-30 Yaoyao Liu , Yingying Li , Bernt Schiele , Qianru Sun

Advances in medical imaging and deep learning have propelled progress in whole slide image (WSI) analysis, with multiple instance learning (MIL) showing promise for efficient and accurate diagnostics. However, conventional MIL models often…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Xianrui Li , Yufei Cui , Jun Li , Antoni B. Chan

Continual learning aims to provide intelligent agents that are capable of learning continually a sequence of tasks, building on previously learned knowledge. A key challenge in this learning paradigm is catastrophically forgetting…

Machine Learning · Computer Science 2021-01-18 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

In recent years, continual learning with pre-training (CLPT) has received widespread interest, instead of its traditional focus of training from scratch. The use of strong pre-trained models (PTMs) can greatly facilitate knowledge transfer…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Gengwei Zhang , Liyuan Wang , Guoliang Kang , Ling Chen , Yunchao Wei

Continual learning (CL) aims to constantly learn new knowledge over time while avoiding catastrophic forgetting on old tasks. We focus on continual text classification under the class-incremental setting. Recent CL studies have identified…

Computation and Language · Computer Science 2023-10-11 Yifan Song , Peiyi Wang , Weimin Xiong , Dawei Zhu , Tianyu Liu , Zhifang Sui , Sujian Li

Despite the advancements in in-context learning (ICL) for large language models (LLMs), current research centers on specific prompt engineering, such as demonstration selection, with the expectation that a single iteration of demonstrations…

Computation and Language · Computer Science 2024-06-05 Jiaxi Yang , Binyuan Hui , Min Yang , Bailin Wang , Bowen Li , Binhua Li , Fei Huang , Yongbin Li

Deep learning models in recommender systems are usually trained in the batch mode, namely iteratively trained on a fixed-size window of training data. Such batch mode training of deep learning models suffers from low training efficiency,…

Information Retrieval · Computer Science 2020-09-07 Yichao Wang , Huifeng Guo , Ruiming Tang , Zhirong Liu , Xiuqiang He

Class Incremental Learning (CIL) constitutes a pivotal subfield within continual learning, aimed at enabling models to progressively learn new classification tasks while retaining knowledge obtained from prior tasks. Although previous…

Machine Learning · Computer Science 2025-01-14 Jaeill Kim , Wonseok Lee , Moonjung Eo , Wonjong Rhee

Neural networks suffer from catastrophic forgetting in class-incremental learning (CIL) settings. Rehearsal$\unicode{x2013}$replaying a subset of past samples$\unicode{x2013}$is a well-established mitigation strategy. However, recent…

Machine Learning · Computer Science 2026-05-15 Alberto Tamajo , Srinandan Dasmahapatra , Rahman Attar

Class-Incremental Learning (CIL) aims to endow models with the ability to continuously adapt to evolving data streams. Recent advances in pre-trained vision-language models (e.g., CLIP) provide a powerful foundation for this task. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Zhen-Hao Wen , Yan Wang , Ji Feng , Han-Jia Ye , De-Chuan Zhan , Da-Wei Zhou

Class-incremental learning (CIL) learns a classification model with training data of different classes arising progressively. Existing CIL either suffers from serious accuracy loss due to catastrophic forgetting, or invades data privacy by…

Machine Learning · Computer Science 2022-12-13 Huiping Zhuang , Zhenyu Weng , Hongxin Wei , Renchunzi Xie , Kar-Ann Toh , Zhiping Lin

Continual learning (CL) aims to empower models to learn new tasks without forgetting previously acquired knowledge. Most prior works concentrate on the techniques of architectures, replay data, regularization, \etc. However, the category…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Bolin Ni , Hongbo Zhao , Chenghao Zhang , Ke Hu , Gaofeng Meng , Zhaoxiang Zhang , Shiming Xiang

Online Lifelong Learning (OLL) addresses the challenge of learning from continuous and non-stationary data streams. Existing online lifelong learning methods based on image classification models often require preset conditions such as the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Leyuan Wang , Liuyu Xiang , Yujie Wei , Yunlong Wang , Zhaofeng He

Citation intention Classification (CIC) tools classify citations by their intention (e.g., background, motivation) and assist readers in evaluating the contribution of scientific literature. Prior research has shown that pretrained language…

Computation and Language · Computer Science 2024-10-18 Zeren Shui , Petros Karypis , Daniel S. Karls , Mingjian Wen , Saurav Manchanda , Ellad B. Tadmor , George Karypis

In-context learning (ICL) is an emerging capability of large autoregressive language models where a few input-label demonstrations are appended to the input to enhance the model's understanding of downstream NLP tasks, without directly…

Computation and Language · Computer Science 2023-10-31 Zhuocheng Gong , Jiahao Liu , Qifan Wang , Jingang Wang , Xunliang Cai , Dongyan Zhao , Rui Yan

Class-Incremental Learning (CIL) is a practical and challenging problem for achieving general artificial intelligence. Recently, Pre-Trained Models (PTMs) have led to breakthroughs in both visual and natural language processing tasks.…

Machine Learning · Computer Science 2024-02-16 Junhao Zheng , Ruiyan Wang , Chongzhi Zhang , Huawen Feng , Qianli Ma

Few-shot class-incremental learning(FSCIL) focuses on designing learning algorithms that can continually learn a sequence of new tasks from a few samples without forgetting old ones. The difficulties are that training on a sequence of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Jinze Li , Yan Bai , Yihang Lou , Xiongkun Linghu , Jianzhong He , Shaoyun Xu , Tao Bai

Few-shot class-incremental learning (FSCIL) seeks to continuously learn new classes from very limited samples while preserving previously acquired knowledge. Traditional methods often utilize a frozen pre-trained feature extractor to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Shengqin Jiang , Xiaoran Feng , Yuankai Qi , Haokui Zhang , Renlong Hang , Qingshan Liu , Lina Yao , Quan Z. Sheng , Ming-Hsuan Yang

Automated program repair (APR) aims to fix software bugs automatically without human debugging efforts and plays a crucial role in software development and maintenance. Despite promising, APR is still challenged by a long-standing…

Software Engineering · Computer Science 2024-01-17 Quanjun Zhang , Chunrong Fang , Weisong Sun , Yan Liu , Tieke He , Xiaodong Hao , Zhenyu Chen

Contemporary neural networks are limited in their ability to learn from evolving streams of training data. When trained sequentially on new or evolving tasks, their accuracy drops sharply, making them unsuitable for many real-world…

Computer Vision and Pattern Recognition · Computer Science 2021-02-19 Sudhanshu Mittal , Silvio Galesso , Thomas Brox