English
Related papers

Related papers: Randomized Neural Network with Adaptive Forward Re…

200 papers

With the rise of deep reinforcement learning (RL) methods, many complex robotic manipulation tasks are being solved. However, harnessing the full power of deep learning requires large datasets. Online-RL does not suit itself readily into…

Robotics · Computer Science 2024-11-20 Sudhir Pratap Yadav , Rajendra Nagar , Suril V. Shah

Online continual learning (OCL) aims to enable model learning from a non-stationary data stream to continuously acquire new knowledge as well as retain the learnt one, under the constraints of having limited system size and computational…

Computer Vision and Pattern Recognition · Computer Science 2023-01-16 Sheng-Feng Yu , Wei-Chen Chiu

The ability to learn in dynamic, nonstationary environments without forgetting previous knowledge, also known as Continual Learning (CL), is a key enabler for scalable and trustworthy deployments of adaptive solutions. While the importance…

Machine Learning · Computer Science 2021-03-25 Andrea Cossu , Antonio Carta , Davide Bacciu

Class-Incremental Learning (CIL) aims to sequentially learn new classes while mitigating catastrophic forgetting of previously learned knowledge. Conventional CIL approaches implicitly assume that classes are morphologically static,…

Machine Learning · Computer Science 2026-02-03 Zheng Zhang , Tao Hu , Xueheng Li , Yang Wang , Rui Li , Jie Zhang , Chengjun Xie

Online Continual Learning (OCL) empowers machine learning models to acquire new knowledge online across a sequence of tasks. However, OCL faces a significant challenge: catastrophic forgetting, wherein the model learned in previous tasks is…

Machine Learning · Computer Science 2024-05-16 Fan Lyu , Daofeng Liu , Linglan Zhao , Zhang Zhang , Fanhua Shang , Fuyuan Hu , Wei Feng , Liang Wang

New categories may be introduced over time, or existing categories may need to be reclassified. Class incremental learning (CIL) is employed for the gradual acquisition of knowledge about new categories while preserving information about…

Machine Learning · Computer Science 2024-01-08 Zhiwei Zuo , Zhuo Tang , Bin Wang , Kenli Li , Anwitaman Datta

We tackle the problem of class incremental learning (CIL) in the realm of landcover classification from optical remote sensing (RS) images in this paper. The paradigm of CIL has recently gained much prominence given the fact that data are…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 S Divakar Bhat , Biplab Banerjee , Subhasis Chaudhuri , Avik Bhattacharya

Despite the great success of pre-trained language models, it is still a challenge to use these models for continual learning, especially for the class-incremental learning (CIL) setting due to catastrophic forgetting (CF). This paper…

Computation and Language · Computer Science 2023-07-21 Yijia Shao , Yiduo Guo , Dongyan Zhao , Bing Liu

Federated Class-Incremental Learning (FCIL) refers to a scenario where a dynamically changing number of clients collaboratively learn an ever-increasing number of incoming tasks. FCIL is known to suffer from local forgetting due to class…

Machine Learning · Computer Science 2025-03-17 Milad Khademi Nori , Il-Min Kim , Guanghui Wang

This paper introduces a two-stage framework designed to enhance long-tail class incremental learning, enabling the model to progressively learn new classes, while mitigating catastrophic forgetting in the context of long-tailed data…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Jayateja Kalla , Soma Biswas

Few-shot class-incremental learning (FSCIL) aims to design machine learning algorithms that can continually learn new concepts from a few data points, without forgetting knowledge of old classes. The difficulty lies in that limited data…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Chi Zhang , Nan Song , Guosheng Lin , Yun Zheng , Pan Pan , Yinghui Xu

Class-Incremental Learning (CIL) aims to enable AI models to continuously learn from sequentially arriving data of different classes over time while retaining previously acquired knowledge. Recently, Parameter-Efficient Fine-Tuning (PEFT)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Huaijie Wang , De Cheng , Lingfeng He , Yan Li , Jie Li , Nannan Wang , Xinbo Gao

Regularization-based methods are beneficial to alleviate the catastrophic forgetting problem in class-incremental learning. With the absence of old task images, they often assume that old knowledge is well preserved if the classifier…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Xiaomeng Xin , Yiran Zhong , Yunzhong Hou , Jinjun Wang , Liang Zheng

Traditional online continual learning (OCL) research has primarily focused on mitigating catastrophic forgetting with fixed and limited storage allocation throughout an agent's lifetime. However, a broad range of real-world applications are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Ameya Prabhu , Zhipeng Cai , Puneet Dokania , Philip Torr , Vladlen Koltun , Ozan Sener

Continual learning (CL) aims to train models that can learn a sequence of tasks without forgetting previously acquired knowledge. A core challenge in CL is balancing stability -- preserving performance on old tasks -- and plasticity --…

Machine Learning · Computer Science 2025-05-14 Zhenrong Liu , Janne M. J. Huttunen , Mikko Honkala

Existing Class Incremental Learning (CIL) methods are based on a supervised classification framework sensitive to data labels. When updating them based on the new class data, they suffer from catastrophic forgetting: the model cannot…

Machine Learning · Computer Science 2021-11-23 Zixuan Ni , Siliang Tang , Yueting Zhuang

Memory, as the basis of learning, determines the storage, update and forgetting of knowledge and further determines the efficiency of learning. Featured with the mechanism of memory, a radial basis function neural network based learning…

Systems and Control · Electrical Eng. & Systems 2023-11-27 Yiming Fei , Jiangang Li , Yanan Li

The holy grail of machine learning is to enable Continual Federated Learning (CFL) to enhance the efficiency, privacy, and scalability of AI systems while learning from streaming data. The primary challenge of a CFL system is to overcome…

Machine Learning · Computer Science 2025-11-11 Satish Kumar Keshri , Nazreen Shah , Ranjitha Prasad

Despite notable successes of Reinforcement Learning (RL), the prevalent use of an online learning paradigm prevents its widespread adoption, especially in hazardous or costly scenarios. Offline RL has emerged as an alternative solution,…

Machine Learning · Computer Science 2024-05-08 Minjae Cho , Jonathan P. How , Chuangchuang Sun

The main challenge of continual learning is \textit{catastrophic forgetting}. Because of processing data in one pass, online continual learning (OCL) is one of the most difficult continual learning scenarios. To address catastrophic…

Machine Learning · Computer Science 2025-10-02 Aopeng Wang , Ke Deng , Yongli Ren , Jun Luo