English
Related papers

Related papers: Class-Incremental Continual Learning for General P…

200 papers

While deep learning has led to remarkable advances across diverse applications, it struggles in domains where the data distribution changes over the course of learning. In stark contrast, biological neural networks continually adapt to…

Machine Learning · Computer Science 2017-06-14 Friedemann Zenke , Ben Poole , Surya Ganguli

Deep neural networks often severely forget previously learned knowledge when learning new knowledge. Various continual learning (CL) methods have been proposed to handle such a catastrophic forgetting issue from different perspectives and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Chao Wu , Xiaobin Chang , Ruixuan Wang

Continual learning refers to the ability to acquire and transfer knowledge without catastrophically forgetting what was previously learned. In this work, we consider \emph{few-shot} continual learning in classification tasks, and we propose…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Mengmi Zhang , Tao Wang , Joo Hwee Lim , Gabriel Kreiman , Jiashi Feng

White blood cell (WBC) classification plays a vital role in hematology for diagnosing various medical conditions. However, it faces significant challenges due to domain shifts caused by variations in sample sources (e.g., blood or bone…

Malaria remains a major global health challenge, particularly in low-resource settings where access to expert microscopy may be limited. Deep learning-based computer-aided diagnosis (CAD) systems have been developed and demonstrate…

Despite significant advances, continual learning models still suffer from catastrophic forgetting when exposed to incrementally available data from non-stationary distributions. Rehearsal approaches alleviate the problem by maintaining and…

Machine Learning · Statistics 2021-03-02 Binh Tang , David S. Matteson

Class-incremental learning aims to learn new classes in an incremental fashion without forgetting the previously learned ones. Several research works have shown how additional data can be used by incremental models to help mitigate…

Machine Learning · Computer Science 2023-10-11 Quentin Jodelet , Xin Liu , Yin Jun Phua , Tsuyoshi Murata

Medical image distributions shift constantly due to changes in patient population and discrepancies in image acquisition. These distribution changes result in performance deterioration; deterioration that continual learning aims to…

Image and Video Processing · Electrical Eng. & Systems 2024-08-01 Nick Lemke , Camila González , Anirban Mukhopadhyay , Martin Mundt

Multimodal representations and continual learning are two areas closely related to human intelligence. The former considers the learning of shared representation spaces where information from different modalities can be compared and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Kai Wang , Luis Herranz , Joost van de Weijer

Sequential learning of tasks using gradient descent leads to an unremitting decline in the accuracy of tasks for which training data is no longer available, termed catastrophic forgetting. Generative models have been explored as a means to…

Machine Learning · Computer Science 2020-09-30 Amanda Rios , Laurent Itti

As a subset of machine learning, meta-learning, or learning to learn, aims at improving the model's capabilities by employing prior knowledge and experience. A meta-learning paradigm can appropriately tackle the conventional challenges of…

Machine Learning · Computer Science 2024-08-14 Alireza Rafiei , Ronald Moore , Sina Jahromi , Farshid Hajati , Rishikesan Kamaleswaran

Medical imaging plays a vital role in modern diagnostics; however, interpreting high-resolution radiological data remains time-consuming and susceptible to variability among clinicians. Traditional image processing techniques often lack the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Melika Filvantorkaman , Maral Filvan Torkaman

Existing work on continual learning (CL) is primarily devoted to developing algorithms for models trained from scratch. Despite their encouraging performance on contrived benchmarks, these algorithms show dramatic performance drops in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Kuan-Ying Lee , Yuanyi Zhong , Yu-Xiong Wang

Continual Learning (CL) poses a significant challenge in Artificial Intelligence, aiming to mirror the human ability to incrementally acquire knowledge and skills. While extensive research has focused on CL within the context of…

Machine Learning · Computer Science 2024-06-10 Haotian Zhang , Junting Zhou , Haowei Lin , Hang Ye , Jianhua Zhu , Zihao Wang , Liangcai Gao , Yizhou Wang , Yitao Liang

Additional training of a deep learning model can cause negative effects on the results, turning an initially positive sample into a negative one (degradation). Such degradation is possible in real-world use cases due to the diversity of…

Machine Learning · Computer Science 2022-05-19 Akihito Yoshii , Susumu Tokumoto , Fuyuki Ishikawa

Online continual learning for image classification studies the problem of learning to classify images from an online stream of data and tasks, where tasks may include new classes (class incremental) or data nonstationarity (domain…

Machine Learning · Computer Science 2021-10-06 Zheda Mai , Ruiwen Li , Jihwan Jeong , David Quispe , Hyunwoo Kim , Scott Sanner

Algorithm selection is commonly used to predict the best solver from a portfolio per per-instance. In many real scenarios, instances arrive in a stream: new instances become available over time, while the number of class labels can also…

Machine Learning · Computer Science 2025-06-03 Mate Botond Nemeth , Emma Hart , Kevin Sim , Quentin Renau

This study presents a novel approach to Generative Class Incremental Learning (GCIL) by introducing the forgetting mechanism, aimed at dynamically managing class information for better adaptation to streaming data. GCIL is one of the hot…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Taro Togo , Ren Togo , Keisuke Maeda , Takahiro Ogawa , Miki Haseyama

Standard artificial neural networks suffer from the well-known issue of catastrophic forgetting, making continual or lifelong learning difficult for machine learning. In recent years, numerous methods have been proposed for continual…

Machine Learning · Computer Science 2019-04-18 Gido M. van de Ven , Andreas S. Tolias

In-context learning (ICL) derives its power from enabling Large Language Models to adapt to new tasks via prompt-based reasoning alone, entirely bypassing the need for parameter updates. Existing theories primarily study ICL in single-task…

Machine Learning · Computer Science 2026-05-28 Guangyu Li , Meng Ding , Lijie Hu