中文
相关论文

相关论文: Memory-Free Generative Replay For Class-Incrementa…

200 篇论文

We study continual learning in the large scale setting where tasks in the input sequence are not limited to classification, and the outputs can be of high dimension. Among multiple state-of-the-art methods, we found vanilla experience…

机器学习 · 计算机科学 2020-10-07 Yogesh Balaji , Mehrdad Farajtabar , Dong Yin , Alex Mott , Ang Li

In this paper, we propose a general framework in continual learning for generative models: Feature-oriented Continual Learning (FoCL). Unlike previous works that aim to solve the catastrophic forgetting problem by introducing regularization…

计算机视觉与模式识别 · 计算机科学 2020-03-10 Qicheng Lao , Mehrzad Mortazavi , Marzieh Tahaei , Francis Dutil , Thomas Fevens , Mohammad Havaei

Exemplar-based class-incremental learning is to recognize new classes while not forgetting old ones, whose samples can only be saved in limited memory. The ratio fluctuation of new samples to old exemplars, which is caused by the variation…

计算机视觉与模式识别 · 计算机科学 2022-02-22 Zhiheng Liu , Kai Zhu , Yang Cao

Scarcity of data and incremental learning of new tasks pose two major bottlenecks for many modern computer vision algorithms. The phenomenon of catastrophic forgetting, i.e., the model's inability to classify previously learned data after…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Sanchar Palit , Biplab Banerjee , Subhasis Chaudhuri

Data streams are rarely static in dynamic environments like Industry 4.0. Instead, they constantly change, making traditional offline models outdated unless they can quickly adjust to the new data. This need can be adequately addressed by…

Meta-learning models have two objectives. First, they need to be able to make predictions over a range of task distributions while utilizing only a small amount of training data. Second, they also need to adapt to new novel unseen tasks at…

机器学习 · 计算机科学 2021-01-26 Edwin Pan , Pankaj Rajak , Shubham Shrivastava

Humans learn all their life long. They accumulate knowledge from a sequence of learning experiences and remember the essential concepts without forgetting what they have learned previously. Artificial neural networks struggle to learn…

机器学习 · 计算机科学 2020-12-09 Timothée Lesort

We introduce a novel continual learning problem: how to sequentially update the weights of a personalized 2D and 3D generative face model as new batches of photos in different appearances, styles, poses, and lighting are captured regularly.…

计算机视觉与模式识别 · 计算机科学 2024-12-04 Annie N. Wang , Luchao Qi , Roni Sengupta

Contemporary neural networks are limited in their ability to learn from evolving streams of training data. When trained sequentially on new or evolving tasks, their accuracy drops sharply, making them unsuitable for many real-world…

计算机视觉与模式识别 · 计算机科学 2021-02-19 Sudhanshu Mittal , Silvio Galesso , Thomas Brox

Plasticity and stability are needed in class-incremental learning in order to learn from new data while preserving past knowledge. Due to catastrophic forgetting, finding a compromise between these two properties is particularly challenging…

计算机视觉与模式识别 · 计算机科学 2023-07-06 Grégoire Petit , Adrian Popescu , Eden Belouadah , David Picard , Bertrand Delezoide

Rehearsal-based continual learning (CL) mitigates catastrophic forgetting by maintaining a subset of samples from previous tasks for replay. Existing studies primarily focus on optimizing memory storage through coreset selection strategies.…

机器学习 · 计算机科学 2026-04-13 Minh-Duong Nguyen , Thien-Thanh Dao , Le-Tuan Nguyen , Dung D. Le , Kok-Seng Wong

Incremental learning (IL) is an important task aimed at increasing the capability of a trained model, in terms of the number of classes recognizable by the model. The key problem in this task is the requirement of storing data (e.g. images)…

计算机视觉与模式识别 · 计算机科学 2019-04-16 Prithviraj Dhar , Rajat Vikram Singh , Kuan-Chuan Peng , Ziyan Wu , Rama Chellappa

Continual Learning requires the model to learn from a stream of dynamic, non-stationary data without forgetting previous knowledge. Several approaches have been developed in the literature to tackle the Continual Learning challenge. Among…

机器学习 · 计算机科学 2022-11-30 Gabriele Merlin , Vincenzo Lomonaco , Andrea Cossu , Antonio Carta , Davide Bacciu

Deep learning has shown its human-level performance in various applications. However, current deep learning models are characterised by catastrophic forgetting of old knowledge when learning new classes. This poses a challenge particularly…

机器学习 · 计算机科学 2022-04-29 Yang Yang , Zhiying Cui , Junjie Xu , Changhong Zhong , Wei-Shi Zheng , Ruixuan Wang

We tackle catastrophic forgetting problem in the context of class-incremental learning for video recognition, which has not been explored actively despite the popularity of continual learning. Our framework addresses this challenging task…

计算机视觉与模式识别 · 计算机科学 2022-03-28 Jaeyoo Park , Minsoo Kang , Bohyung Han

Incremental Learning (IL) is useful when artificial systems need to deal with streams of data and do not have access to all data at all times. The most challenging setting requires a constant complexity of the deep model and an incremental…

计算机视觉与模式识别 · 计算机科学 2020-09-01 Eden Belouadah , Adrian Popescu , Ioannis Kanellos

Class incremental learning consists in training discriminative models to classify an increasing number of classes over time. However, doing so using only the newly added class data leads to the known problem of catastrophic forgetting of…

机器学习 · 计算机科学 2024-05-15 Quentin Ferdinand , Gilles Le Chenadec , Benoit Clement , Panagiotis Papadakis , Quentin Oliveau

In spite of remarkable success of the convolutional neural networks on semantic segmentation, they suffer from catastrophic forgetting: a significant performance drop for the already learned classes when new classes are added on the data,…

机器学习 · 计算机科学 2019-11-28 Onur Tasar , Yuliya Tarabalka , Pierre Alliez

Continual learning refers to the ability to acquire and transfer knowledge without catastrophically forgetting what was previously learned. In this work, we consider \emph{few-shot} continual learning in classification tasks, and we propose…

计算机视觉与模式识别 · 计算机科学 2020-02-18 Mengmi Zhang , Tao Wang , Joo Hwee Lim , Gabriel Kreiman , Jiashi Feng

Deep neural networks struggle to continually learn multiple sequential tasks due to catastrophic forgetting of previously learned tasks. Rehearsal-based methods which explicitly store previous task samples in the buffer and interleave them…

机器学习 · 计算机科学 2022-07-12 Prashant Bhat , Bahram Zonooz , Elahe Arani