English
Related papers

Related papers: Overcoming Domain Drift in Online Continual Learni…

200 papers

Despite recent progress in enhancing the efficacy of Open-Domain Continual Learning (ODCL) in Vision-Language Models (VLM), failing to (1) correctly identify the Task-ID of a test image and (2) use only the category set corresponding to the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Yadong Lu , Shitian Zhao , Boxiang Yun , Dongsheng Jiang , Yin Li , Qingli Li , Yan Wang

The problem of Rehearsal-Free Continual Learning (RFCL) aims to continually learn new knowledge while preventing forgetting of the old knowledge, without storing any old samples and prototypes. The latest methods leverage large-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Xinyuan Gao , Songlin Dong , Yuhang He , Qiang Wang , Yihong Gong

Deep artificial neural networks famously struggle to learn from non-stationary streams of data. Without dedicated mitigation strategies, continual learning is associated with continuous forgetting of previous tasks and a progressive loss of…

Neurons and Cognition · Quantitative Biology 2025-12-29 Suzanne van der Veldt , Gido M. van de Ven , Sanne Moorman , Guillaume Etter

Recently, because of the high-quality representations of contrastive learning methods, rehearsal-based contrastive continual learning has been proposed to explore how to continually learn transferable representation embeddings to avoid the…

Machine Learning · Computer Science 2024-03-08 Jiyong Li , Dilshod Azizov , Yang Li , Shangsong Liang

Continual learning methods are known to suffer from catastrophic forgetting, a phenomenon that is particularly hard to counter for methods that do not store exemplars of previous tasks. Therefore, to reduce potential drift in the feature…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Dipam Goswami , Albin Soutif--Cormerais , Yuyang Liu , Sandesh Kamath , Bartłomiej Twardowski , Joost van de Weijer

In the realm of high-frequency data streams, achieving real-time learning within varying memory constraints is paramount. This paper presents Ferret, a comprehensive framework designed to enhance online accuracy of Online Continual Learning…

Machine Learning · Computer Science 2025-03-18 Yuhao Zhou , Yuxin Tian , Jindi Lv , Mingjia Shi , Yuanxi Li , Qing Ye , Shuhao Zhang , Jiancheng Lv

Given the inherent non-stationarity prevalent in real-world applications, continual Reinforcement Learning (RL) aims to equip the agent with the capability to address a series of sequentially presented decision-making tasks. Within this…

Machine Learning · Computer Science 2024-11-19 Feng Chen , Fuguang Han , Cong Guan , Lei Yuan , Zhilong Zhang , Yang Yu , Zongzhang Zhang

Offline reinforcement learning (RL) provides a promising direction to exploit massive amount of offline data for complex decision-making tasks. Due to the distribution shift issue, current offline RL algorithms are generally designed to be…

Machine Learning · Computer Science 2022-10-25 Rui Yang , Chenjia Bai , Xiaoteng Ma , Zhaoran Wang , Chongjie Zhang , Lei Han

Reinforcement learning (RL) excels in various applications but struggles in dynamic environments where the underlying Markov decision process evolves. Continual reinforcement learning (CRL) enables RL agents to continually learn and adapt…

Machine Learning · Computer Science 2025-12-23 Xue Yang , Michael Schukat , Junlin Lu , Patrick Mannion , Karl Mason , Enda Howley

Online Continual Learning (OCL) aims to learn from endless non\text{-}stationary data streams, yet most existing methods assume a flat label space and overlook the hierarchical organization of real\text{-}world concepts that evolves both…

Machine Learning · Computer Science 2026-05-13 Xinrui Wang , Shao-Yuan Li , Bartłomiej Twardowski , Alexandra Gomez-Villa , Songcan Chen

A machine learning method needs to adapt to over time changes in the environment. Such changes are known as concept drift. In this paper, we propose concept drift tackling method as an enhancement of Online Sequential Extreme Learning…

Artificial Intelligence · Computer Science 2016-10-10 Arif Budiman , Mohamad Ivan Fanany , Chan Basaruddin

Continual learning refers to the problem where the training data is available in sequential chunks, termed "tasks". The majority of progress in continual learning has been stunted by the problem of catastrophic forgetting, which is caused…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Rajas Chitale , Ankit Vaidya , Aditya Kane , Archana Ghotkar

Continual learning (CL) aims to train models that can learn a sequence of tasks without forgetting previously acquired knowledge. A core challenge in CL is balancing stability -- preserving performance on old tasks -- and plasticity --…

Machine Learning · Computer Science 2025-05-14 Zhenrong Liu , Janne M. J. Huttunen , Mikko Honkala

Cross-domain recommendation (CDR) aims to improve recommendation accuracy in sparse domains by transferring knowledge from data-rich domains. However, existing CDR approaches often assume that user-item interaction data across domains is…

Information Retrieval · Computer Science 2025-05-16 Li Wang , Qiang Wu , Min Xu

Effective planning in model-based reinforcement learning (MBRL) and model-predictive control (MPC) relies on the accuracy of the learned dynamics model. In many instances of MBRL and MPC, this model is assumed to be stationary and is…

Machine Learning · Computer Science 2026-05-27 Yizhou Huang , Kevin Xie , Homanga Bharadhwaj , Florian Shkurti

In the realm of class-incremental learning (CIL), alleviating the catastrophic forgetting problem is a pivotal challenge. This paper discovers a counter-intuitive observation: by incorporating domain shift into CIL tasks, the forgetting…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Wei Chen , Yi Zhou

This thesis makes considerable contributions to the realm of machine learning, specifically in the context of open-world scenarios where systems face previously unseen data and contexts. Traditional machine learning models are usually…

Machine Learning · Computer Science 2023-10-11 Yiyou Sun

Class-Incremental Learning (CIL) requires a learning system to learn new classes while retaining previously learned knowledge. However, in real-world scenarios such as autonomous driving, a system trained on urban roads in sunny weather may…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zhen-Hao Xie , Yan Wang , Hao Sun , Han-Jia Ye , De-Chuan Zhan , Da-Wei Zhou

Non-Exemplar Continual Graph Learning (NECGL) seeks to eliminate the privacy risks intrinsic to rehearsal-based paradigms by retaining solely class-level prototype representations rather than raw graph examples for mitigating catastrophic…

Machine Learning · Computer Science 2026-04-06 Lei Song , Shihan Guan , Youyong Kong

Continual learning (CL) is the sub-field of machine learning concerned with accumulating knowledge in dynamic environments. So far, CL research has mainly focused on incremental classification tasks, where models learn to classify new…