English
Related papers

Related papers: D-CBRS: Accounting For Intra-Class Diversity in Co…

200 papers

Deep reinforcement learning has emerged as a powerful tool for a variety of learning tasks, however deep nets typically exhibit forgetting when learning multiple tasks in sequence. To mitigate forgetting, we propose an experience replay…

Artificial Intelligence · Computer Science 2018-03-01 David Isele , Akansel Cosgun

The task of Long-tailed Class Incremental Learning (LT-CIL) addresses the sequential learning of new classes from datasets with imbalanced class distributions. This scenario intensifies the fundamental problem of catastrophic forgetting,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Taigo Sakai , Kazuhiro Hotta

A persistent paradox in continual learning (CL) is that neural networks often retain linearly separable representations of past tasks even when their output predictions fail. We formalize this distinction as the gap between deep…

Machine Learning · Computer Science 2026-03-20 Giulia Lanzillotta , Damiano Meier , Thomas Hofmann

Exemplar-based class-incremental learning is to recognize new classes while not forgetting old ones, whose samples can only be saved in limited memory. The ratio fluctuation of new samples to old exemplars, which is caused by the variation…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Zhiheng Liu , Kai Zhu , Yang Cao

We propose a Bayesian neural network-based continual learning algorithm using Variational Inference, aiming to overcome several drawbacks of existing methods. Specifically, in continual learning scenarios, storing network parameters at each…

Machine Learning · Computer Science 2024-11-22 Sanchar Palit , Biplab Banerjee , Subhasis Chaudhuri

Network Intrusion Detection Systems (IDS) have become increasingly important as networks become more vulnerable to new and sophisticated attacks. Machine Learning (ML)-based IDS are increasingly seen as the most effective approach to handle…

Cryptography and Security · Computer Science 2025-02-14 Shrihari Vasudevan , Ishan Chokshi , Raaghul Ranganathan , Nachiappan Sundaram

The design of machines and algorithms capable of learning in a dynamically changing environment has become an increasingly topical problem with the increase of the size and heterogeneity of data available to learning systems. As a…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Francesco Pelosin , Andrea Torsello

Although numerous machine learning models exist to detect issues like rolling bearing strain and deformation, typically caused by improper mounting, overloading, or poor lubrication, these models often struggle to isolate faults from the…

Machine Learning · Computer Science 2025-04-15 Diogo Risca , Afonso Lourenço , Goreti Marreiros

A continual learning agent learns online with a non-stationary and never-ending stream of data. The key to such learning process is to overcome the catastrophic forgetting of previously seen data, which is a well known problem of neural…

Machine Learning · Computer Science 2019-11-01 Rahaf Aljundi , Min Lin , Baptiste Goujaud , Yoshua Bengio

In this work, we investigate the means of using curiosity on replay buffers to improve offline multi-task continual reinforcement learning when tasks, which are defined by the non-stationarity in the environment, are non labeled and not…

Machine Learning · Computer Science 2024-06-19 Pankayaraj Pathmanathan , Natalia Díaz-Rodríguez , Javier Del Ser

Despite significant advances, continual learning models still suffer from catastrophic forgetting when exposed to incrementally available data from non-stationary distributions. Rehearsal approaches alleviate the problem by maintaining and…

Machine Learning · Statistics 2021-03-02 Binh Tang , David S. Matteson

Incremental class learning, a scenario in continual learning context where classes and their training data are sequentially and disjointedly observed, challenges a problem widely known as catastrophic forgetting. In this work, we propose a…

Machine Learning · Computer Science 2019-07-19 Euntae Choi , Kyungmi Lee , Kiyoung Choi

One of the major limitations of deep learning models is that they face catastrophic forgetting in an incremental learning scenario. There have been several approaches proposed to tackle the problem of incremental learning. Most of these…

Machine Learning · Computer Science 2021-02-04 Vinod K Kurmi , Badri N. Patro , Venkatesh K. Subramanian , Vinay P. Namboodiri

Case-based reasoning (CBR) as a methodology for problem-solving can use any appropriate computational technique. This position paper argues that CBR researchers have somewhat overlooked recent developments in deep learning and large…

Artificial Intelligence · Computer Science 2024-05-08 Ian Watson

The recent breakthrough achieved by contrastive learning accelerates the pace for deploying unsupervised training on real-world data applications. However, unlabeled data in reality is commonly imbalanced and shows a long-tail distribution,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Ziyu Jiang , Tianlong Chen , Bobak Mortazavi , Zhangyang Wang

The field of Continual Learning (CL) has inspired numerous researchers over the years, leading to increasingly advanced countermeasures to the issue of catastrophic forgetting. Most studies have focused on the single-class scenario, where…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Martin Menabue , Emanuele Frascaroli , Matteo Boschini , Lorenzo Bonicelli , Angelo Porrello , Simone Calderara

The ability to learn in dynamic, nonstationary environments without forgetting previous knowledge, also known as Continual Learning (CL), is a key enabler for scalable and trustworthy deployments of adaptive solutions. While the importance…

Machine Learning · Computer Science 2021-03-25 Andrea Cossu , Antonio Carta , Davide Bacciu

The staple of human intelligence is the capability of acquiring knowledge in a continuous fashion. In stark contrast, Deep Networks forget catastrophically and, for this reason, the sub-field of Class-Incremental Continual Learning fosters…

Machine Learning · Computer Science 2022-09-20 Matteo Boschini , Lorenzo Bonicelli , Pietro Buzzega , Angelo Porrello , Simone Calderara

Fairness-aware mining of massive data streams is a growing and challenging concern in the contemporary domain of machine learning. Many stream learning algorithms are used to replace humans at critical decision-making points e.g., hiring…

Machine Learning · Computer Science 2022-11-10 Maryam Badar , Marco Fisichella , Vasileios Iosifidis , Wolfgang Nejdl

With the memory-resource-limited constraints, class-incremental learning (CIL) usually suffers from the "catastrophic forgetting" problem when updating the joint classification model on the arrival of newly added classes. To cope with the…

Machine Learning · Computer Science 2021-05-19 Hanbin Zhao , Hui Wang , Yongjian Fu , Fei Wu , Xi Li