English
Related papers

Related papers: New Insights on Relieving Task-Recency Bias for On…

200 papers

The dynamic expansion architecture is becoming popular in class incremental learning, mainly due to its advantages in alleviating catastrophic forgetting. However, task confusion is not well assessed within this framework, e.g., the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Bingchen Huang , Zhineng Chen , Peng Zhou , Jiayin Chen , Zuxuan Wu

Graph continual learning (GCL) aims to learn from a continuous sequence of graph-based tasks. Regularization methods are vital for preventing catastrophic forgetting in GCL, particularly in the challenging replay-free, class-incremental…

Machine Learning · Computer Science 2025-09-17 Jie Yin , Ke Sun , Han Wu

Current AI/ML methods for data-driven engineering use models that are mostly trained offline. Such models can be expensive to build in terms of communication and computing cost, and they rely on data that is collected over extended periods…

Machine Learning · Computer Science 2021-12-16 Xiaoxuan Wang , Rolf Stadler

Class-incremental learning (CIL) is typically evaluated under predefined schedules with equal-sized tasks, leaving more realistic and complex cases unexplored. However, a practical CIL system should learns immediately when any number of new…

Machine Learning · Computer Science 2026-04-06 Zhiming Xu , Baile Xu , Jian Zhao , Furao Shen , Suorong Yang

The goal of continual learning is to provide intelligent agents that are capable of learning continually a sequence of tasks using the knowledge obtained from previous tasks while performing well on prior tasks. However, a key challenge in…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Ya-nan Han , Jian-wei Liu

This study focuses on incremental learning for image classification, exploring how to reduce catastrophic forgetting of all learned knowledge when access to old data is restricted. The challenge lies in balancing plasticity (learning new…

Machine Learning · Computer Science 2026-03-12 Zhiping Zhou , Xuchen Xie , Yiqiao Qiu , Run Lin , Weishi Zheng , Ruixuan Wang

Artificial neural networks thrive in solving the classification problem for a particular rigid task, acquiring knowledge through generalized learning behaviour from a distinct training phase. The resulting network resembles a static entity…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Matthias De Lange , Rahaf Aljundi , Marc Masana , Sarah Parisot , Xu Jia , Ales Leonardis , Gregory Slabaugh , Tinne Tuytelaars

Continual learning is an important problem for achieving human-level intelligence in real-world applications as an agent must continuously accumulate knowledge in response to streaming data/tasks. In this work, we consider a general and yet…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Jiangwei Xie , Shipeng Yan , Xuming He

In today's connected world, the generation of massive streaming data across diverse domains has become commonplace. In the presence of concept drift, class imbalance, label scarcity, and new class emergence, they jointly degrade…

Machine Learning · Computer Science 2026-02-11 Jin Li , Kleanthis Malialis , Marios Polycarpou

Adversarial Imitation Learning (AIL) methods, while effective in settings with limited expert demonstrations, are often considered unstable. These approaches typically decompose into two components: Density Ratio (DR) estimation…

Artificial Intelligence · Computer Science 2026-02-27 Shashank Reddy Chirra , Jayden Teoh , Praveen Paruchuri , Pradeep Varakantham

This paper studies class incremental learning (CIL) of continual learning (CL). Many approaches have been proposed to deal with catastrophic forgetting (CF) in CIL. Most methods incrementally construct a single classifier for all classes of…

Machine Learning · Computer Science 2022-08-23 Gyuhak Kim , Zixuan Ke , Bing Liu

Loss of plasticity refers to the progressive inability of a model to adapt to new tasks and poses a fundamental challenge for continual learning. While this phenomenon has been extensively studied in homogeneous neural architectures, such…

Machine Learning · Computer Science 2026-03-10 Caihao Sun , Mingqi Yuan , Shiyuan Wang , Jiayu Chen

The fairness-aware online learning framework has emerged as a potent tool within the context of continuous lifelong learning. In this scenario, the learner's objective is to progressively acquire new tasks as they arrive over time, while…

Machine Learning · Computer Science 2024-02-20 Chen Zhao , Feng Mi , Xintao Wu , Kai Jiang , Latifur Khan , Feng Chen

Contrastive representation learning has emerged as a promising technique for continual learning as it can learn representations that are robust to catastrophic forgetting and generalize well to unseen future tasks. Previous work in…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Rouzbeh Meshkinnejad , Jie Mei , Daniel Lizotte , Yalda Mohsenzadeh

Deep learning systems are prone to catastrophic forgetting when learning from a sequence of tasks, as old data from previous tasks is unavailable when learning a new task. To address this, some methods propose replaying data from previous…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Chenyang Wang , Junjun Jiang , Xingyu Hu , Xianming Liu , Xiangyang Ji

Vision systems mounted on home robots need to interact with unseen classes in changing environments. Robots have limited computational resources, labelled data and storage capability. These requirements pose some unique challenges: models…

Robotics · Computer Science 2023-07-20 Umberto Michieli , Mete Ozay

Exemplar-free class-incremental learning (EFCIL) poses significant challenges, primarily due to catastrophic forgetting, necessitating a delicate balance between stability and plasticity to accurately recognize both new and previous…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Eduard Hogea , Adrian Popescu , Darian Onchis , Grégoire Petit

Incremental Learning (IL) allows AI systems to adapt to streamed data. Most existing algorithms make two strong hypotheses which reduce the realism of the incremental scenario: (1) new data are assumed to be readily annotated when streamed…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Eden Belouadah , Adrian Popescu , Umang Aggarwal , Léo Saci

Online learning is a powerful tool for analyzing iterative algorithms. However, the classic adversarial setup sometimes fails to capture certain regularity in online problems in practice. Motivated by this, we establish a new setup, called…

Machine Learning · Computer Science 2022-04-06 Jonathan Lee , Ching-An Cheng , Ken Goldberg , Byron Boots

Offline-to-online reinforcement learning (RL) has emerged as a practical paradigm that leverages offline datasets for pretraining and online interactions for fine-tuning. However, its empirical behavior is highly inconsistent: design…

Machine Learning · Computer Science 2026-02-03 Lu Li , Tianwei Ni , Yihao Sun , Pierre-Luc Bacon