English
Related papers

Related papers: Improving Forward Compatibility in Class Increment…

200 papers

Incremental Task learning (ITL) is a category of continual learning that seeks to train a single network for multiple tasks (one after another), where training data for each task is only available during the training of that task. Neural…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Rakib Hyder , Ken Shao , Boyu Hou , Panos Markopoulos , Ashley Prater-Bennette , M. Salman Asif

Feature Distillation (FD) strategies are proven to be effective in mitigating Catastrophic Forgetting (CF) seen in Class Incremental Learning (CIL). However, current FD approaches enforce strict alignment of feature magnitudes and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 S Balasubramanian , Yedu Krishna P , Talasu Sai Sriram , M Sai Subramaniam , Manepalli Pranav Phanindra Sai , Darshan Gera

Few-shot class-incremental learning (FSCIL) aims to continually fit new classes with limited training data, while maintaining the performance of previously learned classes. The main challenges are overfitting the rare new training samples…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Mingli Zhu , Zihao Zhu , Sihong Chen , Chen Chen , Baoyuan Wu

Inverse reinforcement learning (IRL) is typically formulated as maximizing entropy subject to matching the distribution of expert trajectories. Classical (dual-ascent) IRL guarantees monotonic performance improvement but requires fully…

Machine Learning · Computer Science 2026-05-13 Anish Diwan , Davide Tateo , Christopher E. Mower , Haitham Bou-Ammar , Jan Peters , Oleg Arenz

Class-Incremental learning (CIL) refers to the ability of artificial agents to integrate new classes as they appear in a stream. It is particularly interesting in evolving environments where agents have limited access to memory and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Eden Belouadah , Arnaud Dapogny , Kevin Bailly

Traditional model-based reinforcement learning (RL) methods generate forward rollout traces using the learnt dynamics model to reduce interactions with the real environment. The recent model-based RL method considers the way to learn a…

Machine Learning · Computer Science 2022-08-05 Yuxin Pan , Fangzhen Lin

In visual retrieval systems, updating the embedding model requires recomputing features for every piece of data. This expensive process is referred to as backfilling. Recently, the idea of backward compatible training (BCT) was proposed. To…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Vivek Ramanujan , Pavan Kumar Anasosalu Vasu , Ali Farhadi , Oncel Tuzel , Hadi Pouransari

As Facial Expression Recognition (FER) systems become integrated into our daily lives, these systems need to prioritise making fair decisions instead of aiming at higher individual accuracy scores. Ranging from surveillance systems to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Nikhil Churamani , Ozgur Kara , Hatice Gunes

Although the concept of catastrophic forgetting is straightforward, there is a lack of study on its causes. In this paper, we systematically explore and reveal three causes for catastrophic forgetting in Class Incremental Learning(CIL).…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Zixuan Ni , Haizhou Shi , Siliang Tang , Longhui Wei , Qi Tian , Yueting Zhuang

Approaches based on refinement operators have been successfully applied to class expression learning on RDF knowledge graphs. These approaches often need to explore a large number of concepts to find adequate hypotheses. This need arguably…

Artificial Intelligence · Computer Science 2021-06-30 Caglar Demir , Axel-Cyrille Ngonga Ngomo

We introduce EfficientCL, a memory-efficient continual pretraining method that applies contrastive learning with novel data augmentation and curriculum learning. For data augmentation, we stack two types of operation sequentially: cutoff…

Computation and Language · Computer Science 2021-10-19 Seonghyeon Ye , Jiseon Kim , Alice Oh

Deep reinforcement learning (DRL) has been widely applied in autonomous exploration and mapping tasks, but often struggles with the challenges of sampling efficiency, poor adaptability to unknown map sizes, and slow simulation speed. To…

Robotics · Computer Science 2023-02-28 Zhi Li , Jinghao Xin , Ning Li

3D perception plays a crucial role in real-world applications such as autonomous driving, robotics, and AR/VR. In practical scenarios, 3D perception models must continuously adapt to new data and emerging object categories, but retraining…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Jinge Ma , Jiangpeng He , Fengqing Zhu

In class-incremental learning, an agent with limited resources needs to learn a sequence of classification tasks, forming an ever growing classification problem, with the constraint of not being able to access data from previous tasks. The…

Machine Learning · Computer Science 2024-05-29 Albin Soutif--Cormerais , Marc Masana , Joost van de Weijer , Bartłomiej Twardowski

Class-Incremental Learning (CIL) aims to endow models with the ability to continuously adapt to evolving data streams. Recent advances in pre-trained vision-language models (e.g., CLIP) provide a powerful foundation for this task. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Zhen-Hao Wen , Yan Wang , Ji Feng , Han-Jia Ye , De-Chuan Zhan , Da-Wei Zhou

Most existing works on continual learning (CL) focus on overcoming the catastrophic forgetting (CF) problem, with dynamic models and replay methods performing exceptionally well. However, since current works tend to assume exclusivity or…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Sijia Wang , Yoojin Choi , Junya Chen , Mostafa El-Khamy , Ricardo Henao

Continuous Integration (CI) significantly reduces integration problems, speeds up development time, and shortens release time. However, it also introduces new challenges for quality assurance activities, including regression testing, which…

Software Engineering · Computer Science 2021-03-29 Mojtaba Bagherzadeh , Nafiseh Kahani , Lionel Briand

Many imitation learning (IL) algorithms use inverse reinforcement learning (IRL) to infer a reward function that aligns with the demonstration. However, the inferred reward functions often fail to capture the underlying task objectives. In…

Machine Learning · Computer Science 2024-11-01 Weichao Zhou , Wenchao Li

Class incremental learning (CIL) aims to incrementally update a trained model with the new classes of samples (plasticity) while retaining previously learned ability (stability). To address the most challenging issue in this goal, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Yuhang Zhou , Jiangchao Yao , Feng Hong , Ya Zhang , Yanfeng Wang

Exemplar-Free Class Incremental Learning is a highly challenging setting where replay memory is unavailable. Methods relying on frozen feature extractors have drawn attention recently in this setting due to their impressive performances and…

Machine Learning · Computer Science 2025-02-28 Quentin Jodelet , Xin Liu , Yin Jun Phua , Tsuyoshi Murata