English
Related papers

Related papers: AIR: Analytic Imbalance Rectifier for Continual Le…

200 papers

Incremental learning is useful if an AI agent needs to integrate data from a stream. The problem is non trivial if the agent runs on a limited computational budget and has a bounded memory of past data. In a deep learning approach, the…

Computer Vision and Pattern Recognition · Computer Science 2020-01-17 Eden Belouadah , Adrian Popescu

Algorithm selection is commonly used to predict the best solver from a portfolio per per-instance. In many real scenarios, instances arrive in a stream: new instances become available over time, while the number of class labels can also…

Machine Learning · Computer Science 2025-06-03 Mate Botond Nemeth , Emma Hart , Kevin Sim , Quentin Renau

Class incremental learning (CIL) trains a network on sequential tasks with separated categories in each task but suffers from catastrophic forgetting, where models quickly lose previously learned knowledge when acquiring new tasks. The…

Machine Learning · Computer Science 2024-11-05 Huiping Zhuang , Yizhu Chen , Di Fang , Run He , Kai Tong , Hongxin Wei , Ziqian Zeng , Cen Chen

Continual learning (or class incremental learning) is a realistic learning scenario for computer vision systems, where deep neural networks are trained on episodic data, and the data from previous episodes are generally inaccessible to the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Aditya R. Bhattacharya , Debanjan Goswami , Shayok Chakraborty

Class-incremental learning (CIL) aims to acquire new classes over time while retaining prior knowledge, yet most setups and methods assume balanced task streams. In practice, the number of classes per task often varies significantly. We…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Xiaoyan Zhang , Jiangpeng He

Deep learning approaches are successful in a wide range of AI problems and in particular for visual recognition tasks. However, there are still open problems among which is the capacity to handle streams of visual information and the…

Machine Learning · Computer Science 2022-02-02 Umang Aggarwal , Adrian Popescu , Eden Belouadah , Céline Hudelot

Batch Normalization (BN) and its variants has been extensively studied for neural nets in various computer vision tasks, but relatively little work has been dedicated to studying the effect of BN in continual learning. To that end, we…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Sungmin Cha , Sungjun Cho , Dasol Hwang , Sunwon Hong , Moontae Lee , Taesup Moon

This paper introduces an interactive continual learning paradigm where AI models dynamically learn new skills from real-time human feedback while retaining prior knowledge. This paradigm distinctively addresses two major limitations of…

Machine Learning · Computer Science 2025-05-16 Yutao Yang , Jie Zhou , Junsong Li , Qianjun Pan , Bihao Zhan , Qin Chen , Xipeng Qiu , Liang He

The explicit low-rank regularization, e.g., nuclear norm regularization, has been widely used in imaging sciences. However, it has been found that implicit regularization outperforms explicit ones in various image processing tasks. Another…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Zhemin Li , Tao Sun , Hongxia Wang , Bao Wang

In the scenario of class-incremental learning (CIL), deep neural networks have to adapt their model parameters to non-stationary data distributions, e.g., the emergence of new classes over time. However, CIL models are challenged by the…

Machine Learning · Computer Science 2023-06-22 Depeng Li , Zhigang Zeng

Purpose: CT image reconstruction techniques have two major categories: analytical reconstruction (AR) method and iterative reconstruction (IR) method. AR reconstructs images through analytical formulas, such as filtered backprojection (FBP)…

Medical Physics · Physics 2013-10-08 Liu Yang , Yu Gao , Sharon X. Qi , Hao Gao

Adversarial Imitation Learning (AIL) is a class of popular state-of-the-art Imitation Learning algorithms commonly used in robotics. In AIL, an artificial adversary's misclassification is used as a reward signal that is optimized by any…

Machine Learning · Computer Science 2022-12-01 Ankur Deka , Changliu Liu , Katia Sycara

To imitate the ability of keeping learning of human, continual learning which can learn from a never-ending data stream has attracted more interests recently. In all settings, the online class incremental learning (OCIL), where incoming…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Guoqiang Liang , Zhaojie Chen , Zhaoqiang Chen , Shiyu Ji , Yanning Zhang

Semantic segmentation requires pixel-level annotation, which is time-consuming. Active Learning (AL) is a promising method for reducing data annotation costs. Due to the gap between aerial and natural images, the previous AL methods are not…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Lianlei Shan , Weiqiang Wang , Ke Lv , Bin Luo

Traditional resampling methods for handling class imbalance typically uses fixed distributions, undersampling the majority or oversampling the minority. These static strategies ignore changes in class-wise learning difficulty, which can…

Machine Learning · Computer Science 2026-02-17 Arjun Basandrai , Shourya Jain , K. Ilanthenral

Lifelong or continual learning remains to be a challenge for artificial neural network, as it is required to be both stable for preservation of old knowledge and plastic for acquisition of new knowledge. It is common to see previous…

Machine Learning · Computer Science 2020-10-08 Song Zhang , Gehui Shen , Jinsong Huang , Zhi-Hong Deng

Class-incremental learning (CIL) has emerged as a means to learn new classes incrementally without catastrophic forgetting of previous classes. Recently, CIL has undergone a paradigm shift towards dynamic architectures due to their superior…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Sunyuan Qiang , Yanyan Liang , Jun Wan , Du Zhang

Class-incremental learning (CIL) under an exemplar-free constraint has presented a significant challenge. Existing methods adhering to this constraint are prone to catastrophic forgetting, far more so than replay-based techniques that…

Machine Learning · Computer Science 2024-03-27 Huiping Zhuang , Run He , Kai Tong , Ziqian Zeng , Cen Chen , Zhiping Lin

Continual learning is crucial for applying machine learning in challenging, dynamic, and often resource-constrained environments. However, catastrophic forgetting - overwriting previously learned knowledge when new information is acquired -…

Machine Learning · Computer Science 2025-05-30 Filip Szatkowski , Yaoyue Zheng , Fei Yang , Bartłomiej Twardowski , Tomasz Trzciński , Joost van de Weijer

Neural networks suffer from catastrophic forgetting in class-incremental learning (CIL) settings. Rehearsal$\unicode{x2013}$replaying a subset of past samples$\unicode{x2013}$is a well-established mitigation strategy. However, recent…

Machine Learning · Computer Science 2026-05-15 Alberto Tamajo , Srinandan Dasmahapatra , Rahman Attar