English
Related papers

Related papers: Task-recency bias strikes back: Adapting covarianc…

200 papers

A key challenge in the continual learning setting is to efficiently learn a sequence of tasks without forgetting how to perform previously learned tasks. Many existing approaches to this problem work by either retraining the model on…

Machine Learning · Computer Science 2024-01-12 Weijieying Ren , Vasant G Honavar

New classes arise frequently in our ever-changing world, e.g., emerging topics in social media and new types of products in e-commerce. A model should recognize new classes and meanwhile maintain discriminability over old classes. Under…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Da-Wei Zhou , Han-Jia Ye , Liang Ma , Di Xie , Shiliang Pu , De-Chuan Zhan

Class-incremental learning (CIL) is a particularly challenging variant of continual learning, where the goal is to learn to discriminate between all classes presented in an incremental fashion. Existing approaches often suffer from…

Machine Learning · Computer Science 2024-03-12 Michał Zając , Tinne Tuytelaars , Gido M. van de Ven

Continual learning (CL) remains a significant challenge for deep neural networks, as it is prone to forgetting previously acquired knowledge. Several approaches have been proposed in the literature, such as experience rehearsal,…

Machine Learning · Computer Science 2024-05-24 Prashant Bhat , Bharath Renjith , Elahe Arani , Bahram Zonooz

Despite significant progress in continual learning ranging from architectural novelty to clever strategies for mitigating catastrophic forgetting most existing methods rest on a strong but unrealistic assumption the availability of labeled…

Machine Learning · Computer Science 2025-11-25 Hari Chandana Kuchibhotla , K S Ananth , Vineeth N Balasubramanian

Deep learning systems are prone to catastrophic forgetting when learning from a sequence of tasks, as old data from previous tasks is unavailable when learning a new task. To address this, some methods propose replaying data from previous…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Chenyang Wang , Junjun Jiang , Xingyu Hu , Xianming Liu , Xiangyang Ji

Policy learning under action constraints plays a central role in ensuring safe behaviors in various robot control and resource allocation applications. In this paper, we study a new problem setting termed Action-Constrained Imitation…

Robotics · Computer Science 2025-08-21 Chia-Han Yeh , Tse-Sheng Nan , Risto Vuorio , Wei Hung , Hung-Yen Wu , Shao-Hua Sun , Ping-Chun Hsieh

This paper focuses on an under-explored yet important problem: Federated Class-Continual Learning (FCCL), where new classes are dynamically added in federated learning. Existing FCCL works suffer from various limitations, such as requiring…

Machine Learning · Computer Science 2023-08-21 Jie Zhang , Chen Chen , Weiming Zhuang , Lingjuan Lv

Class-Incremental Learning (CIL) aims to solve the neural networks' catastrophic forgetting problem, which refers to the fact that once the network updates on a new task, its performance on previously-learned tasks drops dramatically. Most…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Libo Huang , Yan Zeng , Chuanguang Yang , Zhulin An , Boyu Diao , Yongjun Xu

The ability to incrementally learn new classes is vital to all real-world artificial intelligence systems. A large portion of high-impact applications like social media, recommendation systems, E-commerce platforms, etc. can be represented…

Machine Learning · Computer Science 2021-12-28 Zhen Tan , Kaize Ding , Ruocheng Guo , Huan Liu

Exemplar-Free Class Incremental Learning is a highly challenging setting where replay memory is unavailable. Methods relying on frozen feature extractors have drawn attention recently in this setting due to their impressive performances and…

Machine Learning · Computer Science 2025-02-28 Quentin Jodelet , Xin Liu , Yin Jun Phua , Tsuyoshi Murata

We propose Exemplar-Condensed federated class-incremental learning (ECoral) to distil the training characteristics of real images from streaming data into informative rehearsal exemplars. The proposed method eliminates the limitations of…

Machine Learning · Computer Science 2025-06-04 Rui Sun , Yumin Zhang , Varun Ojha , Tejal Shah , Haoran Duan , Bo Wei , Rajiv Ranjan

In class-incremental learning, an agent with limited resources needs to learn a sequence of classification tasks, forming an ever growing classification problem, with the constraint of not being able to access data from previous tasks. The…

Machine Learning · Computer Science 2024-05-29 Albin Soutif--Cormerais , Marc Masana , Joost van de Weijer , Bartłomiej Twardowski

Few-shot class-incremental learning (FSCIL) seeks to continuously learn new classes from very limited samples while preserving previously acquired knowledge. Traditional methods often utilize a frozen pre-trained feature extractor to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Shengqin Jiang , Xiaoran Feng , Yuankai Qi , Haokui Zhang , Renlong Hang , Qingshan Liu , Lina Yao , Quan Z. Sheng , Ming-Hsuan Yang

The dynamic expansion architecture is becoming popular in class incremental learning, mainly due to its advantages in alleviating catastrophic forgetting. However, task confusion is not well assessed within this framework, e.g., the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Bingchen Huang , Zhineng Chen , Peng Zhou , Jiayin Chen , Zuxuan Wu

Modern computer vision applications suffer from catastrophic forgetting when incrementally learning new concepts over time. The most successful approaches to alleviate this forgetting require extensive replay of previously seen data, which…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 James Smith , Yen-Chang Hsu , Jonathan Balloch , Yilin Shen , Hongxia Jin , Zsolt Kira

Few-shot class-incremental learning (FSCIL) presents the primary challenge of balancing underfitting to a new session's task and forgetting the tasks from previous sessions. To address this challenge, we develop a simple yet powerful…

Computer Vision and Pattern Recognition · Computer Science 2023-05-29 In-Ug Yoon , Tae-Min Choi , Young-Min Kim , Jong-Hwan Kim

Traditional model-free feature selection methods treat each feature independently while disregarding the interrelationships among features, which leads to relatively poor performance compared with the model-aware methods. To address this…

Machine Learning · Computer Science 2025-06-10 Jianming Lv , Sijun Xia , Depin Liang , Wei Chen

Randomized Controlled Trials (RCTs) represent the gold standard for causal inference yet remain a scarce resource. While large-scale observational data is often available, it is utilized only for retrospective fusion, and remains discarded…

Machine Learning · Statistics 2026-03-05 Erdun Gao , Liang Zhang , Jake Fawkes , Aoqi Zuo , Wenqin Liu , Haoxuan Li , Mingming Gong , Dino Sejdinovic

Class incremental learning aims to solve a problem that arises when continuously adding unseen class instances to an existing model This approach has been extensively studied in the context of image classification; however its applicability…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Junsu Kim , Sumin Hong , Chanwoo Kim , Jihyeon Kim , Yihalem Yimolal Tiruneh , Jeongwan On , Jihyun Song , Sunhwa Choi , Seungryul Baek