English
Related papers

Related papers: On the importance of cross-task features for class…

200 papers

Continual learning (CL) is the sub-field of machine learning concerned with accumulating knowledge in dynamic environments. So far, CL research has mainly focused on incremental classification tasks, where models learn to classify new…

Continual learning (CL) learns a sequence of tasks incrementally. This paper studies the challenging CL setting of class-incremental learning (CIL). CIL has two key challenges: catastrophic forgetting (CF) and inter-task class separation…

Machine Learning · Computer Science 2024-12-23 Saleh Momeni , Sahisnu Mazumder , Bing Liu

Contrastive representation learning has emerged as a promising technique for continual learning as it can learn representations that are robust to catastrophic forgetting and generalize well to unseen future tasks. Previous work in…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Rouzbeh Meshkinnejad , Jie Mei , Daniel Lizotte , Yalda Mohsenzadeh

This paper studies class incremental learning (CIL) of continual learning (CL). Many approaches have been proposed to deal with catastrophic forgetting (CF) in CIL. Most methods incrementally construct a single classifier for all classes of…

Machine Learning · Computer Science 2022-08-23 Gyuhak Kim , Zixuan Ke , Bing Liu

Multi-task learning is to improve the performance of the model by transferring and exploiting common knowledge among tasks. Existing MTL works mainly focus on the scenario where label sets among multiple tasks (MTs) are usually the same,…

Machine Learning · Computer Science 2022-01-10 Quan Feng , Songcan Chen

Class incremental learning aims to solve a problem that arises when continuously adding unseen class instances to an existing model This approach has been extensively studied in the context of image classification; however its applicability…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Junsu Kim , Sumin Hong , Chanwoo Kim , Jihyeon Kim , Yihalem Yimolal Tiruneh , Jeongwan On , Jihyun Song , Sunhwa Choi , Seungryul Baek

In order to mimic the human ability of continual acquisition and transfer of knowledge across various tasks, a learning system needs the capability for continual learning, effectively utilizing the previously acquired skills. As such, the…

Machine Learning · Computer Science 2019-08-02 Dan Teng , Sakyasingha Dasgupta

Continual learning (CL) enables the development of models and agents that learn from a sequence of tasks while addressing the limitations of standard deep learning approaches, such as catastrophic forgetting. In this work, we investigate…

Machine Learning · Computer Science 2023-05-19 Massimo Caccia , Jonas Mueller , Taesup Kim , Laurent Charlin , Rasool Fakoor

Class Incremental Learning (CIL) is challenging due to catastrophic forgetting. On top of that, Exemplar-free Class Incremental Learning is even more challenging due to forbidden access to previous task data. Recent exemplar-free CIL…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zichong Meng , Jie Zhang , Changdi Yang , Zheng Zhan , Pu Zhao , Yanzhi Wang

Continual Learning (CL) considers the problem of training an agent sequentially on a set of tasks while seeking to retain performance on all previous tasks. A key challenge in CL is catastrophic forgetting, which arises when performance on…

Machine Learning · Computer Science 2022-03-16 Samuel Kessler , Jack Parker-Holder , Philip Ball , Stefan Zohren , Stephen J. Roberts

Real-world environments are inherently non-stationary, frequently introducing new classes over time. This is especially common in time series classification, such as the emergence of new disease classification in healthcare or the addition…

Machine Learning · Computer Science 2024-08-06 Zhongzheng Qiao , Quang Pham , Zhen Cao , Hoang H Le , P. N. Suganthan , Xudong Jiang , Ramasamy Savitha

Class-incremental learning (CIL) seeks to enable a model to sequentially learn new classes while retaining knowledge of previously learned ones. Balancing flexibility and stability remains a significant challenge, particularly when the task…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Fangwen Wu , Lechao Cheng , Shengeng Tang , Xiaofeng Zhu , Chaowei Fang , Dingwen Zhang , Meng Wang

Class-incremental learning in the context of limited personal labeled samples (few-shot) is critical for numerous real-world applications, such as smart home devices. A key challenge in these scenarios is balancing the trade-off between…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Kirill Paramonov , Mete Ozay , Eunju Yang , Jijoong Moon , Umberto Michieli

Modern computer vision applications suffer from catastrophic forgetting when incrementally learning new concepts over time. The most successful approaches to alleviate this forgetting require extensive replay of previously seen data, which…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 James Smith , Yen-Chang Hsu , Jonathan Balloch , Yilin Shen , Hongxia Jin , Zsolt Kira

Incremental learning (IL) is an important task aimed at increasing the capability of a trained model, in terms of the number of classes recognizable by the model. The key problem in this task is the requirement of storing data (e.g. images)…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Prithviraj Dhar , Rajat Vikram Singh , Kuan-Chuan Peng , Ziyan Wu , Rama Chellappa

The emergence of in-context learning (ICL) is potentially attributed to two major abilities: task recognition (TR) for recognizing the task from demonstrations and utilizing pre-trained priors, and task learning (TL) for learning from…

Machine Learning · Computer Science 2024-06-21 Xiaolei Wang , Xinyu Tang , Wayne Xin Zhao , Ji-Rong Wen

We propose a novel approach for class incremental online learning in a limited data setting. This problem setting is challenging because of the following constraints: (1) Classes are given incrementally, which necessitates a class…

Machine Learning · Computer Science 2021-06-15 Mohammed Asad Karim , Vinay Kumar Verma , Pravendra Singh , Vinay Namboodiri , Piyush Rai

Continual learning of new knowledge over time is one desirable capability for intelligent systems to recognize more and more classes of objects. Without or with very limited amount of old data stored, an intelligent system often…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Zhuoyun Li , Changhong Zhong , Sijia Liu , Ruixuan Wang , Wei-Shi Zheng

Meta-learning enables algorithms to quickly learn a newly encountered task with just a few labeled examples by transferring previously learned knowledge. However, the bottleneck of current meta-learning algorithms is the requirement of a…

Machine Learning · Computer Science 2022-03-18 Huaxiu Yao , Linjun Zhang , Chelsea Finn

Humans have a remarkable ability to quickly and effectively learn new concepts in a continuous manner without forgetting old knowledge. Though deep learning has made tremendous successes on various computer vision tasks, it faces challenges…

Machine Learning · Computer Science 2022-07-26 Kun Wu , Chengxiang Yin , Jian Tang , Zhiyuan Xu , Yanzhi Wang , Dejun Yang