中文
相关论文

相关论文: A Data-Free Approach to Mitigate Catastrophic Forg…

200 篇论文

Federated Learning (FL) is designed to protect the data privacy of each client during the training process by transmitting only models instead of the original data. However, the trained model may memorize certain information about the…

机器学习 · 计算机科学 2022-01-25 Chen Wu , Sencun Zhu , Prasenjit Mitra

Despite huge success, deep networks are unable to learn effectively in sequential multitask learning settings as they forget the past learned tasks after learning new tasks. Inspired from complementary learning systems theory, we address…

机器学习 · 计算机科学 2019-06-04 Mohammad Rostami , Soheil Kolouri , Praveen K. Pilly

Federated Learning (FL) has gained significant attraction due to its ability to enable privacy-preserving training over decentralized data. Current literature in FL mostly focuses on single-task learning. However, over time, new tasks may…

机器学习 · 计算机科学 2023-10-18 Yavuz Faruk Bakman , Duygu Nur Yaldiz , Yahya H. Ezzeldin , Salman Avestimehr

The Web is naturally heterogeneous with user devices, geographic regions, browsing patterns, and contexts all leading to highly diverse, unique datasets. Federated Learning (FL) is an important paradigm for the Web because it enables…

机器学习 · 计算机科学 2026-02-05 Abdulrahman Alotaibi , Irene Tenison , Miriam Kim , Isaac Lee , Lalana Kagal

Standard deep learning-based classification approaches require collecting all samples from all classes in advance and are trained offline. This paradigm may not be practical in real-world clinical applications, where new classes are…

计算机视觉与模式识别 · 计算机科学 2022-07-05 Sana Ayromlou , Purang Abolmaesumi , Teresa Tsang , Xiaoxiao Li

With the increasing importance of data privacy and security, federated unlearning has emerged as a novel research field dedicated to ensuring that federated learning models no longer retain or leak relevant information once specific data…

机器学习 · 计算机科学 2026-04-07 Houzhe Wang , Xiaojie Zhu , Chi Chen

Recent years have witnessed a burgeoning interest in federated learning (FL). However, the contexts in which clients engage in sequential learning remain under-explored. Bridging FL and continual learning (CL) gives rise to a challenging…

Federated Class Continual Learning (FCCL) merges the challenges of distributed client learning with the need for seamless adaptation to new classes without forgetting old ones. The key challenge in FCCL is catastrophic forgetting, an issue…

机器学习 · 计算机科学 2024-09-05 Jinglin Liang , Jin Zhong , Hanlin Gu , Zhongqi Lu , Xingxing Tang , Gang Dai , Shuangping Huang , Lixin Fan , Qiang Yang

Catastrophic forgetting (CF) happens whenever a neural network overwrites past knowledge while being trained on new tasks. Common techniques to handle CF include regularization of the weights (using, e.g., their importance on past tasks),…

机器学习 · 计算机科学 2022-12-29 Jary Pomponi , Simone Scardapane , Aurelio Uncini

We tackle the problem of Federated Learning in the non i.i.d. case, in which local models drift apart, inhibiting learning. Building on an analogy with Lifelong Learning, we adapt a solution for catastrophic forgetting to Federated…

机器学习 · 计算机科学 2019-10-18 Neta Shoham , Tomer Avidor , Aviv Keren , Nadav Israel , Daniel Benditkis , Liron Mor-Yosef , Itai Zeitak

Federated Learning (FL) enables collaborative model training while preserving privacy by allowing clients to share model updates instead of raw data. Pervasive computing environments (e.g., for Human Activity Recognition, HAR), which we…

机器学习 · 计算机科学 2025-05-21 Sara Alosaime , Arshad Jhumka

The ability of artificial agents to increment their capabilities when confronted with new data is an open challenge in artificial intelligence. The main challenge faced in such cases is catastrophic forgetting, i.e., the tendency of neural…

机器学习 · 计算机科学 2020-12-16 Eden Belouadah , Adrian Popescu , Ioannis Kanellos

Federated Continual Learning (FCL) has recently emerged as a crucial research area, as data from distributed clients typically arrives as a stream, requiring sequential learning. This paper explores a more practical and challenging FCL…

机器学习 · 计算机科学 2025-06-17 Minh-Duong Nguyen , Le-Tuan Nguyen , Quoc-Viet Pham

Federated Learning (FL) enables collaborative model training across distributed clients while preserving user privacy. Recently, Federated Unlearning (FU) has emerged to address the "right to be forgotten" and to remove the influence of…

机器学习 · 计算机科学 2026-05-26 Ruinan Jin , Minghui Chen , Qiong Zhang , Xiaoxiao Li

As Web technology continues to develop, it has become increasingly common to use data stored on different clients. At the same time, federated learning has received widespread attention due to its ability to protect data privacy when let…

计算机视觉与模式识别 · 计算机科学 2025-04-14 Xin Luo , Fang-Yi Liang , Jiale Liu , Yu-Wei Zhan , Zhen-Duo Chen , Xin-Shun Xu

Federated learning (FL) is a distributed training paradigm that enables collaborative learning across clients without sharing local data, thereby preserving privacy. However, the increasing scale and complexity of modern deep models often…

机器学习 · 计算机科学 2025-05-20 Honggu Kang , Seohyeon Cha , Joonhyuk Kang

Incremental class learning, a scenario in continual learning context where classes and their training data are sequentially and disjointedly observed, challenges a problem widely known as catastrophic forgetting. In this work, we propose a…

机器学习 · 计算机科学 2019-07-19 Euntae Choi , Kyungmi Lee , Kiyoung Choi

Federated learning (FL) enables collaborative model training across distributed clients while preserving data privacy. However, data and system heterogeneity often cause catastrophic forgetting and unbounded drift in model updates, leading…

机器学习 · 计算机科学 2026-04-28 Taehwan Yoon , Bongjun Choi , Wesley De Neve

The ability to learn more and more concepts over time from incrementally arriving data is essential for the development of a life-long learning system. However, deep neural networks often suffer from forgetting previously learned concepts…

机器学习 · 计算机科学 2019-07-08 Huaiyu Li , Weiming Dong , Bao-Gang Hu

In many real-world scenarios, data to train machine learning models becomes available over time. Unfortunately, these models struggle to continually learn new concepts without forgetting what has been learnt in the past. This phenomenon is…

计算与语言 · 计算机科学 2023-01-16 Beyza Ermis , Giovanni Zappella , Martin Wistuba , Aditya Rawal , Cedric Archambeau