English
Related papers

Related papers: Gradual Divergence for Seamless Adaptation: A Nove…

200 papers

When deep learning models are sequentially trained on new data, they tend to abruptly lose performance on previously learned tasks, a critical failure known as catastrophic forgetting. This challenge severely limits the deployment of AI in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Paraskevi-Antonia Theofilou , Anuhya Thota , Stefanos Kollias , Mamatha Thota

In recent years, we have witnessed the great advancement of Deep neural networks (DNNs) in image restoration. However, a critical limitation is that they cannot generalize well to real-world degradations with different degrees or types. In…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Xin Li , Bingchen Li , Xin Jin , Cuiling Lan , Zhibo Chen

Despite the recent progress in incremental learning, addressing catastrophic forgetting under distributional drift is still an open and important problem. Indeed, while state-of-the-art domain incremental learning (DIL) methods perform…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Julien Nicolas , Florent Chiaroni , Imtiaz Ziko , Ola Ahmad , Christian Desrosiers , Jose Dolz

Class incremental learning (CIL) aims to recognize both the old and new classes along the increment tasks. Deep neural networks in CIL suffer from catastrophic forgetting and some approaches rely on saving exemplars from previous tasks,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Xiuwei Chen , Xiaobin Chang

We introduce a novel unsupervised domain adaptation approach for object detection. We aim to alleviate the imperfect translation problem of pixel-level adaptations, and the source-biased discriminativity problem of feature-level adaptations…

Computer Vision and Pattern Recognition · Computer Science 2019-05-15 Taekyung Kim , Minki Jeong , Seunghyeon Kim , Seokeon Choi , Changick Kim

Domain-Incremental Learning (DIL) focuses on continual learning in non-stationary environments, requiring models to adjust to evolving domains while preserving historical knowledge. DIL faces two critical challenges in the context of…

Machine Learning · Computer Science 2025-07-10 Lan Li , Da-Wei Zhou , Han-Jia Ye , De-Chuan Zhan

Recovering reward function from expert demonstrations is a fundamental problem in reinforcement learning. The recovered reward function captures the motivation of the expert. Agents can imitate experts by following these reward functions in…

Machine Learning · Computer Science 2024-06-27 Fan-Ming Luo , Xingchen Cao , Rong-Jun Qin , Yang Yu

Continual learning aims to provide intelligent agents that are capable of learning continually a sequence of tasks, building on previously learned knowledge. A key challenge in this learning paradigm is catastrophically forgetting…

Machine Learning · Computer Science 2021-01-18 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

While training on samples drawn from independent and identical distribution has been a de facto paradigm for optimizing image classification networks, humans learn new concepts in an easy-to-hard manner and on the selected examples…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Bowen Cheng , Yunchao Wei , Jiahui Yu , Shiyu Chang , Jinjun Xiong , Wen-Mei Hwu , Thomas S. Huang , Humphrey Shi

Domain incremental learning aims to adapt to a sequence of domains with access to only a small subset of data (i.e., memory) from previous domains. Various methods have been proposed for this problem, but it is still unclear how they are…

Machine Learning · Computer Science 2023-10-20 Haizhou Shi , Hao Wang

Multi-modal deep metric learning is crucial for effectively capturing diverse representations in tasks such as face verification, fine-grained object recognition, and product search. Traditional approaches to metric learning, whether based…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Hadush Hailu Gebrerufael , Anil Kumar Tiwari , Gaurav Neupane , Goitom Ybrah Hailu

Domain-Incremental Learning (DIL) involves the progressive adaptation of a model to new concepts across different domains. While recent advances in pre-trained models provide a solid foundation for DIL, learning new concepts often results…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Da-Wei Zhou , Zi-Wen Cai , Han-Jia Ye , Lijun Zhang , De-Chuan Zhan

Lifelong Person Re-identification (LReID) suffers from a key challenge in preserving old knowledge while adapting to new information. The existing solutions include rehearsal-based and rehearsal-free methods to address this challenge.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Shiben Liu , Huijie Fan , Qiang Wang , Baojie Fan , Yandong Tang , Liangqiong Qu

We propose a novel offline reinforcement learning (offline RL) approach, introducing the Diffusion-model-guided Implicit Q-learning with Adaptive Revaluation (DIAR) framework. We address two key challenges in offline RL: out-of-distribution…

Machine Learning · Computer Science 2024-10-16 Jaehyun Park , Yunho Kim , Sejin Kim , Byung-Jun Lee , Sundong Kim

This paper presents a practical and simple yet efficient method to effectively deal with the catastrophic forgetting for Class Incremental Learning (CIL) tasks. CIL tends to learn new concepts perfectly, but not at the expense of…

Machine Learning · Computer Science 2021-03-30 Bahram Mohammadi , Mohammad Sabokrou

Deep learning models suffer from catastrophic forgetting when being fine-tuned with samples of new classes. This issue becomes even more pronounced when faced with the domain shift between training and testing data. In this paper, we study…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Can Peng , Piotr Koniusz , Kaiyu Guo , Brian C. Lovell , Peyman Moghadam

Incremental learning with concept drift has often been tackled by ensemble methods, where models built in the past can be re-trained to attain new models for the current data. Two design questions need to be addressed in developing ensemble…

Machine Learning · Computer Science 2017-02-14 Yu Sun , Ke Tang , Zexuan Zhu , Xin Yao

The rehearsal strategy is widely used to alleviate the catastrophic forgetting problem in class incremental learning (CIL) by preserving limited exemplars from previous tasks. With imbalanced sample numbers between old and new classes, the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Xiuwei Chen , Xiaobin Chang

Incremental learning (IL) aims to overcome catastrophic forgetting of previous tasks while learning new ones. Existing IL methods make strong assumptions that the incoming task type will either only increases new classes or domains (i.e.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Sheng Luo , Yi Zhou , Tao Zhou

In the scenario of class-incremental learning (CIL), deep neural networks have to adapt their model parameters to non-stationary data distributions, e.g., the emergence of new classes over time. However, CIL models are challenged by the…

Machine Learning · Computer Science 2023-06-22 Depeng Li , Zhigang Zeng