English
Related papers

Related papers: Accurate Forgetting for Heterogeneous Federated Co…

200 papers

Recent advances of generative learning models are accompanied by the growing interest in federated learning (FL) based on generative adversarial network (GAN) models. In the context of FL, GAN can capture the underlying client data…

Machine Learning · Computer Science 2023-08-25 Achintha Wijesinghe , Songyang Zhang , Zhi Ding

Continual Learning (CL) aims to incrementally update a trained model on new tasks without forgetting the acquired knowledge of old ones. Existing CL methods usually reduce forgetting with task priors, \ie using task identity or a subset of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Tao Zhuo , Zhiyong Cheng , Hehe Fan , Mohan Kankanhalli

Traditional Federated Learning (FL) methods encounter significant challenges when dealing with heterogeneous data and providing personalized solutions for non-IID scenarios. Personalized Federated Learning (PFL) approaches aim to address…

Machine Learning · Computer Science 2025-11-11 Yasaman Saadati , Mohammad Rostami , M. Hadi Amini

Federated continual learning (FCL) learns incremental tasks over time from confidential datasets distributed across clients. This paper focuses on rehearsal-free FCL, which has severe forgetting issues when learning new tasks due to the…

Machine Learning · Computer Science 2023-09-07 Gaurav Bagwe , Xiaoyong Yuan , Miao Pan , Lan Zhang

Federated Learning (FL) enables decentralized training of machine learning models on distributed data while preserving privacy. However, in real-world FL settings, client data is often non-identically distributed and imbalanced, resulting…

Machine Learning · Computer Science 2025-09-18 Gergely D. Németh , Eros Fanì , Yeat Jeng Ng , Barbara Caputo , Miguel Ángel Lozano , Nuria Oliver , Novi Quadrianto

Federated Learning (FL) is a distributed machine learning strategy, developed for settings where training data is owned by distributed devices and cannot be shared. FL circumvents this constraint by carrying out model training in…

Machine Learning · Computer Science 2025-01-24 Maria Hartmann , Grégoire Danoy , Pascal Bouvry

Federated learning (FL) is a promising approach that enables distributed clients to collaboratively train a global model while preserving their data privacy. However, FL often suffers from data heterogeneity problems, which can…

Machine Learning · Computer Science 2023-11-29 Ye Lin Tun , Minh N. H. Nguyen , Chu Myaet Thwal , Jinwoo Choi , Choong Seon Hong

Federated learning (FL) provides a privacy-preserving solution for distributed machine learning tasks. One challenging problem that severely damages the performance of FL models is the co-occurrence of data heterogeneity and long-tail…

Machine Learning · Computer Science 2022-04-29 Xinyi Shang , Yang Lu , Gang Huang , Hanzi Wang

The performance of Federated Learning (FL) hinges on the effectiveness of utilizing knowledge from distributed datasets. Traditional FL methods adopt an aggregate-then-adapt framework, where clients update local models based on a global…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Yuan Wang , Huazhu Fu , Renuga Kanagavelu , Qingsong Wei , Yong Liu , Rick Siow Mong Goh

Federated Learning (FL) is a distributed machine learning technique that preserves data privacy by sharing only the trained parameters instead of the client data. This makes FL ideal for highly dynamic, heterogeneous, and time-critical…

Machine Learning · Computer Science 2025-10-30 Kasun Eranda Wijethilake , Adnan Mahmood , Quan Z. Sheng

Federated learning (FL) has recently emerged as a compelling machine learning paradigm, prioritizing the protection of privacy for training data. The increasing demand to address issues such as ``the right to be forgotten'' and combat data…

Federated Learning (FL) is a well-known framework for successfully performing a learning task in an edge computing scenario where the devices involved have limited resources and incomplete data representation. The basic assumption of FL is…

Machine Learning · Computer Science 2023-12-08 Lorenzo Valerio , Chiara Boldrini , Andrea Passarella , János Kertész , Márton Karsai , Gerardo Iñiguez

This work tackles the fundamental challenges in Federated Learning (FL) posed by arbitrary client participation and data heterogeneity, prevalent characteristics in practical FL settings. It is well-established that popular FedAvg-style…

Machine Learning · Computer Science 2025-10-07 Bicheng Ying , Zhe Li , Haibo Yang

Continual Learning (CL) methods aim to enable machine learning models to learn new tasks without catastrophic forgetting of those that have been previously mastered. Existing CL approaches often keep a buffer of previously-seen samples,…

Machine Learning · Computer Science 2022-02-22 Dong Gong , Qingsen Yan , Yuhang Liu , Anton van den Hengel , Javen Qinfeng Shi

Online continual learning (OCL) involves deep neural networks retaining knowledge from old data while adapting to new data, which is accessible only once. A critical challenge in OCL is catastrophic forgetting, reflected in reduced model…

Machine Learning · Computer Science 2024-07-18 Huiwei Lin

The key premise of federated learning (FL) is to train ML models across a diverse set of data-owners (clients), without exchanging local data. An overarching challenge to this date is client heterogeneity, which may arise not only from…

Forgetting is often seen as an unwanted characteristic in both human and machine learning. However, we propose that forgetting can in fact be favorable to learning. We introduce "forget-and-relearn" as a powerful paradigm for shaping the…

Machine Learning · Computer Science 2022-02-02 Hattie Zhou , Ankit Vani , Hugo Larochelle , Aaron Courville

In this paper, we address the dichotomy between heterogeneous models and simultaneous training in Federated Learning (FL) via a clustering framework. We define a new clustering model for FL based on the (optimal) local models of the users:…

Machine Learning · Statistics 2022-10-24 Harshvardhan , Avishek Ghosh , Arya Mazumdar

We consider a federated learning (FL) system consisting of multiple clients and a server, where the clients aim to collaboratively learn a common decision model from their distributed data. Unlike the conventional FL framework that assumes…

Machine Learning · Computer Science 2023-05-10 Kun Jin , Tongxin Yin , Zhongzhu Chen , Zeyu Sun , Xueru Zhang , Yang Liu , Mingyan Liu