English
Related papers

Related papers: Class-Incremental Continual Learning for General P…

200 papers

Machine learning-based performance models are increasingly being used to build critical job scheduling and application optimization decisions. Traditionally, these models assume that data distribution does not change as more samples are…

Machine Learning · Computer Science 2023-10-27 Ray A. O. Sinurat , Anurag Daram , Haryadi S. Gunawi , Robert B. Ross , Sandeep Madireddy

Conventional deep learning models have limited capacity in learning multiple tasks sequentially. The issue of forgetting the previously learned tasks in continual learning is known as catastrophic forgetting or interference. When the input…

Machine Learning · Computer Science 2020-07-14 Honglin Li , Payam Barnaghi , Shirin Enshaeifar , Frieder Ganz

The intrinsic difficulty in adapting deep learning models to non-stationary environments limits the applicability of neural networks to real-world tasks. This issue is critical in practical supervised learning settings, such as the ones in…

Machine Learning · Computer Science 2023-06-09 Simone Marullo , Matteo Tiezzi , Marco Gori , Stefano Melacci , Tinne Tuytelaars

Deep learning models have gained remarkable performance on a variety of image classification tasks. However, many models suffer from limited performance in clinical or medical settings when data are imbalanced. To address this challenge, we…

Image and Video Processing · Electrical Eng. & Systems 2022-04-15 Long Gao , Chang Liu , Dooman Arefan , Ashok Panigrahy , Margarita L. Zuley , Shandong Wu

Foundational models are trained on extensive datasets to capture the general trends of a domain. However, in medical imaging, the scarcity of data makes pre-training for every domain, modality, or task challenging. Continual learning offers…

Image and Video Processing · Electrical Eng. & Systems 2025-08-20 Mohammad Areeb Qazi , Munachiso S Nwadike , Ibrahim Almakky , Mohammad Yaqub , Numan Saeed

Continual learning is the ability to sequentially learn over time by accommodating knowledge while retaining previously learned experiences. Neural networks can learn multiple tasks when trained on them jointly, but cannot maintain…

Machine Learning · Computer Science 2018-10-26 Frantzeska Lavda , Jason Ramapuram , Magda Gregorova , Alexandros Kalousis

Accurate classification of white blood cells in peripheral blood is essential for diagnosing hematological diseases. Due to constantly evolving clinical settings, data sources, and disease classifications, it is necessary to update machine…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Ario Sadafi , Raheleh Salehi , Armin Gruber , Sayedali Shetab Boushehri , Pascal Giehr , Nassir Navab , Carsten Marr

Continual learning (CL) is a major challenge of machine learning (ML) and describes the ability to learn several tasks sequentially without catastrophic forgetting (CF). Recent works indicate that CL is a complex topic, even more so when…

Machine Learning · Computer Science 2022-06-09 Benedikt Bagus , Alexander Gepperth

Continual Learning (CL) is a field dedicated to devise algorithms able to achieve lifelong learning. Overcoming the knowledge disruption of previously acquired concepts, a drawback affecting deep learning models and that goes by the name of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Francesco Pelosin

Despite the critical importance of the medical domain in Deep Learning, most of the research in this area solely focuses on training models in static environments. It is only in recent years that research has begun to address dynamic…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Marina Ceccon , Davide Dalle Pezze , Alessandro Fabris , Gian Antonio Susto

To cope with real-world dynamics, an intelligent system needs to incrementally acquire, update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as continual learning, provides a foundation for AI systems to…

Machine Learning · Computer Science 2024-02-07 Liyuan Wang , Xingxing Zhang , Hang Su , Jun Zhu

Engineering problems that apply machine learning often involve computationally intensive methods but rely on limited datasets. As engineering data evolves with new designs and constraints, models must incorporate new knowledge over time.…

Machine Learning · Computer Science 2025-04-18 Kaira M. Samuel , Faez Ahmed

Continual learning (CL) is essential for deploying medical image segmentation models in clinical environments where imaging domains, anatomical targets, and diagnostic tasks evolve over time. However, continual segmentation still faces…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Bomin Wang , Hangqi Zhou , Yibo Gao , Xiahai Zhuang

In medical imaging, technical progress or changes in diagnostic procedures lead to a continuous change in image appearance. Scanner manufacturer, reconstruction kernel, dose, other protocol specific settings or administering of contrast…

Machine Learning · Computer Science 2020-07-08 Johannes Hofmanninger , Matthias Perkonigg , James A. Brink , Oleg Pianykh , Christian Herold , Georg Langs

Continual learning (CL) aims to train models sequentially over multiple domains without forgetting previously learned knowledge. However, existing CL methods optimize for in-domain performance and are therefore prone to learning spurious,…

Machine Learning · Computer Science 2026-05-18 Pascal Janetzky , Tobias Schlagenhauf , Stefan Feuerriegel

Deep convolutional neural networks have made significant breakthroughs in medical image classification, under the assumption that training samples from all classes are simultaneously available. However, in real-world medical scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Xuze Hao , Wenqian Ni , Xuhao Jiang , Weimin Tan , Bo Yan

Continual learning consists in incrementally training a model on a sequence of datasets and testing on the union of all datasets. In this paper, we examine continual learning for the problem of sound classification, in which we wish to…

Machine Learning · Computer Science 2019-06-04 Zhepei Wang , Cem Subakan , Efthymios Tzinis , Paris Smaragdis , Laurent Charlin

Continual lifelong learning is essential to many applications. In this paper, we propose a simple but effective approach to continual deep learning. Our approach leverages the principles of deep model compression, critical weights…

Machine Learning · Computer Science 2019-10-31 Steven C. Y. Hung , Cheng-Hao Tu , Cheng-En Wu , Chien-Hung Chen , Yi-Ming Chan , Chu-Song Chen

Motivated by the efficiency and rapid convergence of pre-trained models for solving downstream tasks, this paper extensively studies the impact of Continual Learning (CL) models as pre-trainers. In both supervised and unsupervised CL, we…

Machine Learning · Computer Science 2023-06-22 Jaehong Yoon , Sung Ju Hwang , Yue Cao

This paper aims to evaluate the suitability of current deep learning methods for clinical workflow especially by focusing on dermatology. Although deep learning methods have been attempted to get dermatologist level accuracy in several…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Sourav Mishra , Subhajit Chaudhury , Hideaki Imaizumi , Toshihiko Yamasaki