English
Related papers

Related papers: Make Domain Shift a Catastrophic Forgetting Allevi…

200 papers

Class-incremental learning (CIL) seeks to enable a model to sequentially learn new classes while retaining knowledge of previously learned ones. Balancing flexibility and stability remains a significant challenge, particularly when the task…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Fangwen Wu , Lechao Cheng , Shengeng Tang , Xiaofeng Zhu , Chaowei Fang , Dingwen Zhang , Meng Wang

State-of-the-art deep neural networks are still struggling to address the catastrophic forgetting problem in continual learning. In this paper, we propose one simple paradigm (named as S-Prompting) and two concrete approaches to highly…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Yabin Wang , Zhiwu Huang , Xiaopeng Hong

In continual learning, there is a serious problem of catastrophic forgetting, in which previous knowledge is forgotten when a model learns new tasks. Various methods have been proposed to solve this problem. Replay methods which replay data…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Kotaro Nagata , Hiromu Ono , Kazuhiro Hotta

Invariance learning methods aim to learn invariant features in the hope that they generalize under distributional shifts. Although many tasks are naturally characterized by continuous domains, current invariance learning techniques…

Machine Learning · Computer Science 2024-04-24 Yong Lin , Fan Zhou , Lu Tan , Lintao Ma , Jiameng Liu , Yansu He , Yuan Yuan , Yu Liu , James Zhang , Yujiu Yang , Hao Wang

Class-Incremental learning (CIL) refers to the ability of artificial agents to integrate new classes as they appear in a stream. It is particularly interesting in evolving environments where agents have limited access to memory and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Eden Belouadah , Arnaud Dapogny , Kevin Bailly

Large Language Models (LLMs) often suffer from performance degradation when faced with domain shifts, primarily due to catastrophic forgetting. In this work, we propose KILO (Knowledge-Instructed Learning for Continual Adaptation), a novel…

Computation and Language · Computer Science 2025-08-06 Iing Muttakhiroh , Thomas Fevens

We introduce a rehearsal-free federated domain incremental learning framework, RefFiL, based on a global prompt-sharing paradigm to alleviate catastrophic forgetting challenges in federated domain-incremental learning, where unseen domains…

Machine Learning · Computer Science 2025-04-02 Rui Sun , Haoran Duan , Jiahua Dong , Varun Ojha , Tejal Shah , Rajiv Ranjan

Online Continual Learning (OCL) empowers machine learning models to acquire new knowledge online across a sequence of tasks. However, OCL faces a significant challenge: catastrophic forgetting, wherein the model learned in previous tasks is…

Machine Learning · Computer Science 2024-05-16 Fan Lyu , Daofeng Liu , Linglan Zhao , Zhang Zhang , Fanhua Shang , Fuyuan Hu , Wei Feng , Liang Wang

Class Incremental Learning (CIL) constitutes a pivotal subfield within continual learning, aimed at enabling models to progressively learn new classification tasks while retaining knowledge obtained from prior tasks. Although previous…

Machine Learning · Computer Science 2025-01-14 Jaeill Kim , Wonseok Lee , Moonjung Eo , Wonjong Rhee

Deep neural networks (DNNS) excel at learning from static datasets but struggle with continual learning, where data arrives sequentially. Catastrophic forgetting, the phenomenon of forgetting previously learned knowledge, is a primary…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 S Balasubramanian , M Sai Subramaniam , Sai Sriram Talasu , Yedu Krishna P , Manepalli Pranav Phanindra Sai , Ravi Mukkamala , Darshan Gera

Recommender systems are widely used in various real-world applications, but they often encounter the persistent challenge of the user cold-start problem. Cross-domain recommendation (CDR), which leverages user interactions from one domain…

Information Retrieval · Computer Science 2025-02-13 Hourun Li , Yifan Wang , Zhiping Xiao , Jia Yang , Changling Zhou , Ming Zhang , Wei Ju

Incremental learning attempts to develop a classifier which learns continuously from a stream of data segregated into different classes. Deep learning approaches suffer from catastrophic forgetting when learning classes incrementally, while…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Ali Ayub , Alan Wagner

Class-incremental learning (CIL) enables models to continuously learn new categories from sequential tasks without forgetting previously acquired knowledge. While recent advances in vision-language models such as CLIP have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Haoran Chen , Houze Xu , Micah Goldblum , Daoguo Dong , Zuxuan Wu

Class-incremental learning (CIL) has achieved remarkable successes in learning new classes consecutively while overcoming catastrophic forgetting on old categories. However, most existing CIL methods unreasonably assume that all old…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Jiahua Dong , Wenqi Liang , Yang Cong , Gan Sun

This paper studies class incremental learning (CIL) of continual learning (CL). Many approaches have been proposed to deal with catastrophic forgetting (CF) in CIL. Most methods incrementally construct a single classifier for all classes of…

Machine Learning · Computer Science 2022-08-23 Gyuhak Kim , Zixuan Ke , Bing Liu

Class incremental learning (CIL) is a challenging setting of continual learning, which learns a series of tasks sequentially. Each task consists of a set of unique classes. The key feature of CIL is that no task identifier (or task-id) is…

Machine Learning · Computer Science 2024-03-14 Haowei Lin , Yijia Shao , Weinan Qian , Ningxin Pan , Yiduo Guo , Bing Liu

Contrastive Language-Image Pretraining (CLIP) models excel at understanding image-text relationships but struggle with adapting to new data without forgetting prior knowledge. To address this, models are typically fine-tuned using both new…

Machine Learning · Computer Science 2026-05-06 Ryan King , Gang Li , Bobak Mortazavi , Tianbao Yang

Continual learning (CL) remains a significant challenge for deep neural networks, as it is prone to forgetting previously acquired knowledge. Several approaches have been proposed in the literature, such as experience rehearsal,…

Machine Learning · Computer Science 2024-05-24 Prashant Bhat , Bharath Renjith , Elahe Arani , Bahram Zonooz

Image-point class incremental learning helps the 3D-points-vision robots continually learn category knowledge from 2D images, improving their perceptual capability in dynamic environments. However, some incremental learning methods address…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Chao Qi , Jianqin Yin , Ren Zhang

Humans have the ability to accumulate knowledge of new tasks in varying conditions, but deep neural networks often suffer from catastrophic forgetting of previously learned knowledge after learning a new task. Many recent methods focus on…