English
Related papers

Related papers: Future-Proofing Class-Incremental Learning

200 papers

In the scenario of class-incremental learning (CIL), deep neural networks have to adapt their model parameters to non-stationary data distributions, e.g., the emergence of new classes over time. However, CIL models are challenged by the…

Machine Learning · Computer Science 2023-06-22 Depeng Li , Zhigang Zeng

Text-to-image diffusion models are a class of deep generative models that have demonstrated an impressive capacity for high-quality image generation. However, these models are susceptible to implicit biases that arise from web-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Yinan Zhang , Eric Tzeng , Yilun Du , Dmitry Kislyuk

The recent wave of large-scale text-to-image diffusion models has dramatically increased our text-based image generation abilities. These models can generate realistic images for a staggering variety of prompts and exhibit impressive…

Machine Learning · Computer Science 2023-09-14 Alexander C. Li , Mihir Prabhudesai , Shivam Duggal , Ellis Brown , Deepak Pathak

Exemplar-Free Class Incremental Learning (EFCIL) aims to learn from a sequence of tasks without having access to previous task data. In this paper, we consider the challenging Cold Start scenario in which insufficient data is available in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Simone Magistri , Tomaso Trinci , Albin Soutif-Cormerais , Joost van de Weijer , Andrew D. Bagdanov

State-of-the-art techniques of artificial intelligence, in particular deep learning, are mostly data-driven. However, collecting and manually labeling a large scale dataset is both difficult and expensive. A promising alternative is to…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Qi Chen , Weichao Qiu , Yi Zhang , Lingxi Xie , Alan Yuille

The two main impediments to continual learning are catastrophic forgetting and memory limitations on the storage of data. To cope with these challenges, we propose a novel, cognitively-inspired approach which trains autoencoders with Neural…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Ali Ayub , Alan R. Wagner

Recent machine learning techniques have dramatically changed how we process digital images. However, the way in which we capture images is still largely driven by human intuition and experience. This restriction is in part due to the many…

Image and Video Processing · Electrical Eng. & Systems 2020-02-17 Amey Chaware , Colin L. Cooke , Kanghyun Kim , Roarke Horstmeyer

In machine learning applications, gradual data ingress is common, especially in audio processing where incremental learning is vital for real-time analytics. Few-shot class-incremental learning addresses challenges arising from limited…

Sound · Computer Science 2024-08-08 Riyansha Singh , Parinita Nema , Vinod K Kurmi

Continual Learning is an unresolved challenge, whose relevance increases when considering modern applications. Unlike the human brain, trained deep neural networks suffer from a phenomenon called catastrophic forgetting, wherein they…

Machine Learning · Computer Science 2025-02-18 Shahar Shaul-Ariel , Daphna Weinshall

In general, sufficient data is essential for the better performance and generalization of deep-learning models. However, lots of limitations(cost, resources, etc.) of data collection leads to lack of enough data in most of the areas. In…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Byeongjo Kim , Chanran Kim , Jaehoon Lee , Jein Song , Gyoungsoo Park

Recent progress with conditional image diffusion models has been stunning, and this holds true whether we are speaking about models conditioned on a text description, a scene layout, or a sketch. Unconditional image diffusion models are…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 William Harvey , Frank Wood

We tackle catastrophic forgetting problem in the context of class-incremental learning for video recognition, which has not been explored actively despite the popularity of continual learning. Our framework addresses this challenging task…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Jaeyoo Park , Minsoo Kang , Bohyung Han

This study addresses the actual behavior of the credit-card fraud detection environment where financial transactions containing sensitive data must not be amassed in an enormous amount to conduct learning. We introduce a new adaptive…

Machine Learning · Computer Science 2021-08-09 Armin Sadreddin , Samira Sadaoui

Incremental learning aims to enable machine learning models to continuously acquire new knowledge given new classes, while maintaining the knowledge already learned for old classes. Saving a subset of training samples of previously seen…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Jian Jiang , Edoardo Cetin , Oya Celiktutan

Pre-trained representation is one of the key elements in the success of modern deep learning. However, existing works on continual learning methods have mostly focused on learning models incrementally from scratch. In this paper, we explore…

Machine Learning · Computer Science 2022-08-18 Hyounguk Shon , Janghyeon Lee , Seung Hwan Kim , Junmo Kim

Continually learning new classes from fresh data without forgetting previous knowledge of old classes is a very challenging research problem. Moreover, it is imperative that such learning must respect certain memory and computational…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Michael Hersche , Geethan Karunaratne , Giovanni Cherubini , Luca Benini , Abu Sebastian , Abbas Rahimi

Continual learning of new knowledge over time is one desirable capability for intelligent systems to recognize more and more classes of objects. Without or with very limited amount of old data stored, an intelligent system often…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Zhuoyun Li , Changhong Zhong , Sijia Liu , Ruixuan Wang , Wei-Shi Zheng

Class-incremental learning (CIL) aims to develop a learning system that can continually learn new classes from a data stream without forgetting previously learned classes. When learning classes incrementally, the classifier must be…

Computation and Language · Computer Science 2023-05-29 Minqian Liu , Lifu Huang

In continual learning, there is a serious problem of catastrophic forgetting, in which previous knowledge is forgotten when a model learns new tasks. Various methods have been proposed to solve this problem. Replay methods which replay data…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Kotaro Nagata , Hiromu Ono , Kazuhiro Hotta

Class-Incremental Learning is a challenging problem in machine learning that aims to extend previously trained neural networks with new classes. This is especially useful if the system is able to classify new objects despite the original…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Karl Holmquist , Lena Klasén , Michael Felsberg