English
Related papers

Related papers: Class Impression for Data-free Incremental Learnin…

200 papers

In this paper, a progressive learning technique for multi-class classification is proposed. This newly developed learning technique is independent of the number of class constraints and it can learn new classes while still retaining the…

Machine Learning · Computer Science 2017-01-24 Rajasekar Venkatesan , Meng Joo Er

Exemplar-Free Class Incremental Learning (efCIL) aims to continuously incorporate the knowledge from new classes while retaining previously learned information, without storing any old-class exemplars (i.e., samples). For this purpose,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Libo Huang , Zhulin An , Yan Zeng , Chuanguang Yang , Xinqiang Yu , Yongjun Xu

Incremental learning aims to learn new tasks sequentially without forgetting the previously learned ones. Most of the existing incremental learning methods for audio focus on training the model from scratch on the initial task, and the same…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-29 Manjunath Mulimani , Annamaria Mesaros

Data augmentation plays a pivotal role in enhancing and diversifying training data. Nonetheless, consistently improving model performance in varied learning scenarios, especially those with inherent data biases, remains challenging. To…

Machine Learning · Computer Science 2024-06-04 Xiaoling Zhou , Wei Ye , Zhemg Lee , Rui Xie , Shikun Zhang

Scarcity of data and incremental learning of new tasks pose two major bottlenecks for many modern computer vision algorithms. The phenomenon of catastrophic forgetting, i.e., the model's inability to classify previously learned data after…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Sanchar Palit , Biplab Banerjee , Subhasis Chaudhuri

In many real-life tasks of application of supervised learning approaches, all the training data are not available at the same time. The examples are lifelong image classification or recognition of environmental objects during interaction of…

Machine Learning · Computer Science 2020-06-15 Miltiadis Poursanidis , Jenny Benois-Pineau , Akka Zemmari , Boris Mansenca , Aymar de Rugy

Multi-class supervised learning systems require the knowledge of the entire range of labels they predict. Often when learnt incrementally, they suffer from catastrophic forgetting. To avoid this, generous leeways have to be made to the…

Computer Vision and Pattern Recognition · Computer Science 2017-07-18 Ragav Venkatesan , Hemanth Venkateswara , Sethuraman Panchanathan , Baoxin Li

Despite extensive research spanning several decades, class imbalance is still considered a profound difficulty for both machine learning and deep learning models. While data oversampling is the foremost technique to address this issue,…

Machine Learning · Computer Science 2025-02-12 Sukumar Kishanthan , Asela Hevapathige

The main purpose of incremental learning is to learn new knowledge while not forgetting the knowledge which have been learned before. At present, the main challenge in this area is the catastrophe forgetting, namely the network will lose…

Machine Learning · Computer Science 2019-06-13 Qiuyu Zhu , Zikuang He , Xin Ye

Class-Incremental Learning (CIL) aims to build classification models from data streams. At each step of the CIL process, new classes must be integrated into the model. Due to catastrophic forgetting, CIL is particularly challenging when…

Machine Learning · Computer Science 2023-09-28 Grégoire Petit , Michael Soumm , Eva Feillet , Adrian Popescu , Bertrand Delezoide , David Picard , Céline Hudelot

Deep metric learning aims to learn an embedding space where the distance between data reflects their class equivalence, even when their classes are unseen during training. However, the limited number of classes available in training…

Computer Vision and Pattern Recognition · Computer Science 2022-01-05 Kyungmoon Lee , Sungyeon Kim , Seunghoon Hong , Suha Kwak

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

Although data-free incremental learning methods are memory-friendly, accurately estimating and counteracting representation shifts is challenging in the absence of historical data. This paper addresses this thorny problem by proposing a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Zhiheng Ma , Xiaopeng Hong , Beinan Liu , Yabin Wang , Pinyue Guo , Huiyun Li

Class-incremental learning (CIL) has been widely studied under the setting of starting from a small number of classes (base classes). Instead, we explore an understudied real-world setting of CIL that starts with a strong model pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Tz-Ying Wu , Gurumurthy Swaminathan , Zhizhong Li , Avinash Ravichandran , Nuno Vasconcelos , Rahul Bhotika , Stefano Soatto

We propose an algorithm for incremental learning of classifiers. The proposed method enables an ensemble of classifiers to learn incrementally by accommodating new training data. We use an effective mechanism to overcome the…

Machine Learning · Computer Science 2019-02-11 Shivang Agarwal , C. Ravindranath Chowdary , Shripriya Maheshwari

In Continual learning (CL) balancing effective adaptation while combating catastrophic forgetting is a central challenge. Many of the recent best-performing methods utilize various forms of prior task data, e.g. a replay buffer, to tackle…

Machine Learning · Computer Science 2023-06-07 Nader Asadi , MohammadReza Davari , Sudhir Mudur , Rahaf Aljundi , Eugene Belilovsky

Deep learning has emerged as a powerful method for extracting valuable information from large volumes of data. However, when new training data arrives continuously (i.e., is not fully available from the beginning), incremental training…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-06 Thomas Bouvier , Bogdan Nicolae , Hugo Chaugier , Alexandru Costan , Ian Foster , Gabriel Antoniu

Incremental learning (IL) is an important task aimed at increasing the capability of a trained model, in terms of the number of classes recognizable by the model. The key problem in this task is the requirement of storing data (e.g. images)…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Prithviraj Dhar , Rajat Vikram Singh , Kuan-Chuan Peng , Ziyan Wu , Rama Chellappa

Modern deep learning methods have achieved great success in machine learning and computer vision fields by learning a set of pre-defined datasets. Howerver, these methods perform unsatisfactorily when applied into real-world situations. The…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Kun Wei , Cheng Deng , Xu Yang , Maosen Li

Human intelligence gradually accepts new information and accumulates knowledge throughout the lifespan. However, deep learning models suffer from a catastrophic forgetting phenomenon, where they forget previous knowledge when acquiring new…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Jisu Han , Jaemin Na , Wonjun Hwang