English
Related papers

Related papers: Task-recency bias strikes back: Adapting covarianc…

200 papers

Aiming to incrementally learn new classes with only few samples while preserving the knowledge of base (old) classes, few-shot class-incremental learning (FSCIL) faces several challenges, such as overfitting and catastrophic forgetting.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Junghun Oh , Sungyong Baik , Kyoung Mu Lee

Continual learning aims to learn a sequence of tasks from dynamic data distributions. Without accessing to the old training samples, knowledge transfer from the old tasks to each new task is difficult to determine, which might be either…

Machine Learning · Computer Science 2021-11-08 Liyuan Wang , Mingtian Zhang , Zhongfan Jia , Qian Li , Chenglong Bao , Kaisheng Ma , Jun Zhu , Yi Zhong

Real-world scenarios are usually accompanied by continuously appearing classes with scare labeled samples, which require the machine learning model to incrementally learn new classes and maintain the knowledge of base classes. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Qi-Wei Wang , Da-Wei Zhou , Yi-Kai Zhang , De-Chuan Zhan , Han-Jia Ye

End-to-end vision-based imitation learning has demonstrated promising results in autonomous driving by learning control commands directly from expert demonstrations. However, traditional approaches rely on either regressionbased models,…

Robotics · Computer Science 2025-03-04 Elahe Delavari , Aws Khalil , Jaerock Kwon

Class-Incremental Learning (CIL) aims to learn new classes sequentially while retaining the knowledge of previously learned classes. Recently, pre-trained models (PTMs) combined with parameter-efficient fine-tuning (PEFT) have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Jiangpeng He , Zhihao Duan , Fengqing Zhu

Online task-free continual learning (OTFCL) is a more challenging variant of continual learning which emphasizes the gradual shift of task boundaries and learns in an online mode. Existing methods rely on a memory buffer composed of old…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Songlin Dong , Yingjie Chen , Yuhang He , Yuhan Jin , Alex C. Kot , Yihong Gong

In this paper, we revisited the role of data augmentation in contrastive learning for sequential recommendation, revealing its inherent bias against low-frequency items and sparse user behaviors. To address this limitation, we proposed…

Information Retrieval · Computer Science 2026-01-27 Zhikai Wang , Weihua Zhang

This paper studies the problem of class-incremental learning (CIL), a core setting within continual learning where a model learns a sequence of tasks, each containing a distinct set of classes. Traditional CIL methods, which do not leverage…

Machine Learning · Computer Science 2025-11-19 Saleh Momeni , Changnan Xiao , Bing Liu

Meta-learning for few-shot learning entails acquiring a prior over previous tasks and experiences, such that new tasks be learned from small amounts of data. However, a critical challenge in few-shot learning is task ambiguity: even when a…

Machine Learning · Computer Science 2019-10-18 Chelsea Finn , Kelvin Xu , Sergey Levine

Few-shot class-incremental learning (FSCIL) aims to learn progressively about new classes with very few labeled samples, without forgetting the knowledge of already learnt classes. FSCIL suffers from two major challenges: (i) over-fitting…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Jayateja Kalla , Soma Biswas

We propose a new method for exemplar-free class incremental training of ViTs. The main challenge of exemplar-free continual learning is maintaining plasticity of the learner without causing catastrophic forgetting of previously learned…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Marco Cotogni , Fei Yang , Claudio Cusano , Andrew D. Bagdanov , Joost van de Weijer

Recently, Transformer-based robotic manipulation methods utilize multi-view spatial representations and language instructions to learn robot motion trajectories by leveraging numerous robot demonstrations. However, the collection of robot…

Robotics · Computer Science 2025-04-23 Mingchen Song , Xiang Deng , Guoqiang Zhong , Qi Lv , Jia Wan , Yinchuan Li , Jianye Hao , Weili Guan

Autoregressive video diffusion models hold promise for world simulation but are vulnerable to exposure bias arising from the train-test mismatch. While recent works address this via post-training, they typically rely on a bidirectional…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Yuwei Guo , Ceyuan Yang , Hao He , Yang Zhao , Meng Wei , Zhenheng Yang , Weilin Huang , Dahua Lin

Few-shot class-incremental Learning (FSCIL) enables models to learn new classes from limited data while retaining performance on previously learned classes. Traditional FSCIL methods often require fine-tuning parameters with limited new…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Jizhou Han , Chenhao Ding , Yuhang He , Songlin Dong , Qiang Wang , Xinyuan Gao , Yihong Gong

Deep Neural Networks (or DNNs) must constantly cope with distribution changes in the input data when the task of interest or the data collection protocol changes. Retraining a network from scratch to combat this issue poses a significant…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Pengyu Yuan , Aryan Mobiny , Jahandar Jahanipour , Xiaoyang Li , Pietro Antonio Cicalese , Badrinath Roysam , Vishal Patel , Maric Dragan , Hien Van Nguyen

Continual Learning enables models to learn and adapt to new tasks while retaining prior knowledge. Introducing new tasks, however, can naturally lead to feature entanglement across tasks, limiting the model's capability to distinguish…

Machine Learning · Computer Science 2025-01-14 Zhongyi Zhou , Yaxin Peng , Pin Yi , Minjie Zhu , Chaomin Shen

The focus of this study is on Unsupervised Continual Learning (UCL), as it presents an alternative to Supervised Continual Learning which needs high-quality manual labeled data. The experiments under the UCL paradigm indicate a phenomenon…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Chen Cheng , Jingkuan Song , Xiaosu Zhu , Junchen Zhu , Lianli Gao , Hengtao Shen

Humans are capable of learning new tasks without forgetting previous ones, while neural networks fail due to catastrophic forgetting between new and previously-learned tasks. We consider a class-incremental setting which means that the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Xialei Liu , Chenshen Wu , Mikel Menta , Luis Herranz , Bogdan Raducanu , Andrew D. Bagdanov , Shangling Jui , Joost van de Weijer

Few-shot class-incremental learning (FSCIL) is designed to incrementally recognize novel classes with only few training samples after the (pre-)training on base classes with sufficient samples, which focuses on both base-class performance…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yixiong Zou , Shanghang Zhang , Yuhua Li , Ruixuan Li

Federated Class Incremental Learning (FCIL) is a critical yet largely underexplored issue that deals with the dynamic incorporation of new classes within federated learning (FL). Existing methods often employ generative adversarial networks…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Naibo Wang , Yuchen Deng , Wenjie Feng , Jianwei Yin , See-Kiong Ng