English
Related papers

Related papers: EILearn: Learning Incrementally Using Previous Kno…

200 papers

In class-incremental learning, a learning agent faces a stream of data with the goal of learning new classes while not forgetting previous ones. Neural networks are known to suffer under this setting, as they forget previously acquired…

Machine Learning · Computer Science 2023-08-08 Federico Pernici , Matteo Bruni , Claudio Baecchi , Francesco Turchini , Alberto Del Bimbo

Plasticity and stability are needed in class-incremental learning in order to learn from new data while preserving past knowledge. Due to catastrophic forgetting, finding a compromise between these two properties is particularly challenging…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Grégoire Petit , Adrian Popescu , Eden Belouadah , David Picard , Bertrand Delezoide

A primary goal of class-incremental learning is to strike a balance between stability and plasticity, where models should be both stable enough to retain knowledge learned from previously seen classes, and plastic enough to learn concepts…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Dongwan Kim , Bohyung Han

A major open problem on the road to artificial intelligence is the development of incrementally learning systems that learn about more and more concepts over time from a stream of data. In this work, we introduce a new training strategy,…

Computer Vision and Pattern Recognition · Computer Science 2017-04-17 Sylvestre-Alvise Rebuffi , Alexander Kolesnikov , Georg Sperl , Christoph H. Lampert

In class-incremental learning, the objective is to learn a number of classes sequentially without having access to the whole training data. However, due to a problem known as catastrophic forgetting, neural networks suffer substantial…

Machine Learning · Computer Science 2021-06-01 Sobirdzhon Bobiev , Adil Khan , Syed Muhammad Ahsan Raza Kazmi

We propose a novel class incremental learning approach by incorporating a feature augmentation technique motivated by adversarial attacks. We employ a classifier learned in the past to complement training examples rather than simply play a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Taehoon Kim , Jaeyoo Park , Bohyung Han

The ability of a classifier to take on new information and classes by evolving the classifier without it having to be fully retrained is known as incremental learning. Incremental learning has been successfully applied to many…

Machine Learning · Computer Science 2007-09-26 Greg Hulley , Tshilidzi Marwala

Although deep learning approaches have stood out in recent years due to their state-of-the-art results, they continue to suffer from catastrophic forgetting, a dramatic decrease in overall performance when training with new classes added…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Francisco M. Castro , Manuel J. Marín-Jiménez , Nicolás Guil , Cordelia Schmid , Karteek Alahari

For future learning systems, incremental learning is desirable because it allows for: efficient resource usage by eliminating the need to retrain from scratch at the arrival of new data; reduced memory usage by preventing or limiting the…

Machine Learning · Computer Science 2022-10-12 Marc Masana , Xialei Liu , Bartlomiej Twardowski , Mikel Menta , Andrew D. Bagdanov , Joost van de Weijer

The main purpose of incremental learning is to learn new knowledge while not forgetting the knowledge which have been learned before. At present, the main challenge in this area is the catastrophe forgetting, namely the network will lose…

Machine Learning · Computer Science 2019-06-13 Qiuyu Zhu , Zikuang He , Xin Ye

Continual learning of new knowledge over time is one desirable capability for intelligent systems to recognize more and more classes of objects. Without or with very limited amount of old data stored, an intelligent system often…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Zhuoyun Li , Changhong Zhong , Sijia Liu , Ruixuan Wang , Wei-Shi Zheng

Human intelligence gradually accepts new information and accumulates knowledge throughout the lifespan. However, deep learning models suffer from a catastrophic forgetting phenomenon, where they forget previous knowledge when acquiring new…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Jisu Han , Jaemin Na , Wonjun Hwang

We address the problem of class incremental learning, which is a core step towards achieving adaptive vision intelligence. In particular, we consider the task setting of incremental learning with limited memory and aim to achieve better…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Shipeng Yan , Jiangwei Xie , Xuming He

Class-incremental continual learning is a core step towards developing artificial intelligence systems that can continuously adapt to changes in the environment by learning new concepts without forgetting those previously learned. This is…

Machine Learning · Computer Science 2023-07-07 Evelyn Chee , Mong Li Lee , Wynne Hsu

We introduce an approach for incremental learning that preserves feature descriptors of training images from previously learned classes, instead of the images themselves, unlike most existing work. Keeping the much lower-dimensional feature…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Ahmet Iscen , Jeffrey Zhang , Svetlana Lazebnik , Cordelia Schmid

Most modern neural networks for classification fail to take into account the concept of the unknown. Trained neural networks are usually tested in an unrealistic scenario with only examples from a closed set of known classes. In an attempt…

Machine Learning · Computer Science 2022-12-27 Justin Leo , Jugal Kalita

Incremental learning is useful if an AI agent needs to integrate data from a stream. The problem is non trivial if the agent runs on a limited computational budget and has a bounded memory of past data. In a deep learning approach, the…

Computer Vision and Pattern Recognition · Computer Science 2020-01-17 Eden Belouadah , Adrian Popescu

In this paper, we consider the problem of fine-grained image retrieval in an incremental setting, when new categories are added over time. On the one hand, repeatedly training the representation on the extended dataset is time-consuming. On…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Wei Chen , Yu Liu , Weiping Wang , Tinne Tuytelaars , Erwin M. Bakker , Michael Lew

Continual learning in online scenario aims to learn a sequence of new tasks from data stream using each data only once for training, which is more realistic than in offline mode assuming data from new task are all available. However, this…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Jiangpeng He , Fengqing Zhu

In this paper, a progressive learning technique for multi-class classification is proposed. This newly developed learning technique is independent of the number of class constraints and it can learn new classes while still retaining the…

Machine Learning · Computer Science 2017-01-24 Rajasekar Venkatesan , Meng Joo Er
‹ Prev 1 2 3 10 Next ›