English
Related papers

Related papers: A Data-Free Approach to Mitigate Catastrophic Forg…

200 papers

In this paper, we focus on the important yet understudied problem of Continual Federated Learning (CFL), where a server communicates with a set of clients to incrementally learn new concepts over time without sharing or storing any data.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Shaunak Halbe , James Seale Smith , Junjiao Tian , Zsolt Kira

Deep Learning models have achieved remarkable performance in tasks such as image classification or generation, often surpassing human accuracy. However, they can struggle to learn new tasks and update their knowledge without access to…

Machine Learning · Computer Science 2023-12-19 Everton L. Aleixo , Juan G. Colonna , Marco Cristo , Everlandio Fernandes

The rise of cloud-device collaborative computing has enabled intelligent services to be delivered across distributed edge devices while leveraging centralized cloud resources. In this paradigm, federated learning (FL) has become a key…

Machine Learning · Computer Science 2025-12-22 Xiao Zhang , Zengzhe Chen , Yuan Yuan , Yifei Zou , Fuzhen Zhuang , Wenyu Jiao , Yuke Wang , Dongxiao Yu

Given the ability to model more realistic and dynamic problems, Federated Continual Learning (FCL) has been increasingly investigated recently. A well-known problem encountered in this setting is the so-called catastrophic forgetting, for…

Machine Learning · Computer Science 2025-10-07 Giuseppe Serra , Florian Buettner

Many application scenarios call for training a machine learning model among multiple participants. Federated learning (FL) was proposed to enable joint training of a deep learning model using the local data in each party without revealing…

Machine Learning · Computer Science 2021-02-12 Kai-Fung Chu , Lintao Zhang

A catastrophic forgetting problem makes deep neural networks forget the previously learned information, when learning data collected in new environments, such as by different sensors or in different light conditions. This paper presents a…

Machine Learning · Computer Science 2016-07-04 Heechul Jung , Jeongwoo Ju , Minju Jung , Junmo Kim

Federated Learning (FL) has been widely concerned for it enables decentralized learning while ensuring data privacy. However, most existing methods unrealistically assume that the classes encountered by local clients are fixed over time.…

Machine Learning · Computer Science 2023-06-28 Chenghao Liu , Xiaoyang Qu , Jianzong Wang , Jing Xiao

Federated learning (FL) enables distributed optimization of machine learning models while protecting privacy by independently training local models on each client and then aggregating parameters on a central server, thereby producing an…

Machine Learning · Computer Science 2022-03-08 Chencheng Xu , Zhiwei Hong , Minlie Huang , Tao Jiang

Lifelong learning is challenging for deep neural networks due to their susceptibility to catastrophic forgetting. Catastrophic forgetting occurs when a trained network is not able to maintain its ability to accomplish previously learned…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Mengyao Zhai , Lei Chen , Fred Tung , Jiawei He , Megha Nawhal , Greg Mori

Continual learning is a challenging problem in machine learning, especially for image classification tasks with imbalanced datasets. It becomes even more challenging when it involves learning new classes incrementally. One method for…

Machine Learning · Computer Science 2024-06-14 Sohaib Younis , Bernhard Seeger

Federated learning (FL) enables collaborative model training without centralizing raw data, but privacy regulations such as the right to be forgotten require FL systems to remove the influence of previously used training data upon request.…

Machine Learning · Computer Science 2026-02-02 Yue Li , Mingmin Chu , Xilei Yang , Da Xiao , Ziqi Xu , Wei Shao , Qipeng Song , Hui Li

Federated learning (FL) enables collaborative training of a machine learning (ML) model across multiple parties, facilitating the preservation of users' and institutions' privacy by maintaining data stored locally. Instead of centralizing…

Machine Learning · Computer Science 2024-11-06 Nicolò Romandini , Alessio Mora , Carlo Mazzocca , Rebecca Montanari , Paolo Bellavista

We introduce a rehearsal-free federated domain incremental learning framework, RefFiL, based on a global prompt-sharing paradigm to alleviate catastrophic forgetting challenges in federated domain-incremental learning, where unseen domains…

Machine Learning · Computer Science 2025-04-02 Rui Sun , Haoran Duan , Jiahua Dong , Varun Ojha , Tejal Shah , Rajiv Ranjan

Federated Class-Incremental Learning (FCIL) refers to a scenario where a dynamically changing number of clients collaboratively learn an ever-increasing number of incoming tasks. FCIL is known to suffer from local forgetting due to class…

Machine Learning · Computer Science 2025-03-17 Milad Khademi Nori , Il-Min Kim , Guanghui Wang

We investigate the performance of DNNs when trained on class-incremental visual problems consisting of initial training, followed by retraining with added visual classes. Catastrophic forgetting (CF) behavior is measured using a new…

Machine Learning · Computer Science 2019-05-21 B. Pfülb , A. Gepperth , S. Abdullah , A. Kilian

Catastrophic forgetting (CF) happens whenever a neural network overwrites past knowledge while being trained on new tasks. Common techniques to handle CF include regularization of the weights (using, e.g., their importance on past tasks),…

Machine Learning · Statistics 2021-08-06 Jary Pomponi , Simone Scardapane , Aurelio Uncini

Class incremental learning consists in training discriminative models to classify an increasing number of classes over time. However, doing so using only the newly added class data leads to the known problem of catastrophic forgetting of…

Machine Learning · Computer Science 2024-05-15 Quentin Ferdinand , Gilles Le Chenadec , Benoit Clement , Panagiotis Papadakis , Quentin Oliveau

Incremental learning attempts to develop a classifier which learns continuously from a stream of data segregated into different classes. Deep learning approaches suffer from catastrophic forgetting when learning classes incrementally, while…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Ali Ayub , Alan Wagner

Matching animal-like flexibility in recognition and the ability to quickly incorporate new information remains difficult. Limits are yet to be adequately addressed in neural models and recognition algorithms. This work proposes a…

Computer Vision and Pattern Recognition · Computer Science 2012-06-26 Tsvi Achler

Federated Learning is a fast growing area of ML where the training datasets are extremely distributed, all while dynamically changing over time. Models need to be trained on clients' devices without any guarantees for either homogeneity or…

Machine Learning · Computer Science 2021-10-20 Tae Jin Park , Kenichi Kumatani , Dimitrios Dimitriadis