English
Related papers

Related papers: FedAvg with Fine Tuning: Local Updates Lead to Rep…

200 papers

Most existing federated learning algorithms are based on the vanilla FedAvg scheme. However, with the increase of data complexity and the number of model parameters, the amount of communication traffic and the number of iteration rounds for…

Machine Learning · Computer Science 2024-01-30 Xiaolin Zheng , Senci Ying , Fei Zheng , Jianwei Yin , Longfei Zheng , Chaochao Chen , Fengqin Dong

Purpose: We apply federated learning to train an OCT image classifier simulating a realistic scenario with multiple clients and statistical heterogeneous data distribution where data in the clients lack samples of some categories entirely.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Sanskar Amgain , Prashant Shrestha , Sophia Bano , Ignacio del Valle Torres , Michael Cunniffe , Victor Hernandez , Phil Beales , Binod Bhattarai

Federated Learning (FL) holds great potential for diverse applications owing to its privacy-preserving nature. However, its convergence is often challenged by non-IID data distributions, limiting its effectiveness in real-world deployments.…

Machine Learning · Computer Science 2025-04-22 Kun Zhai , Yifeng Gao , Difan Zou , Guangnan Ye , Siheng Chen , Xingjun Ma , Yu-Gang Jiang

Federated learning is a distributed machine learning paradigm designed to protect user data privacy, which has been successfully implemented across various scenarios. In traditional federated learning, the entire parameter set of local…

Machine Learning · Computer Science 2024-11-07 Haolin Wang , Xuefeng Liu , Jianwei Niu , Wenkai Guo , Shaojie Tang

Federated learning is an emerging paradigm for decentralized training of machine learning models on distributed clients, without revealing the data to the central server. Most existing works have focused on horizontal or vertical data…

Machine Learning · Computer Science 2024-04-16 Jaeyeon Jang , Diego Klabjan , Veena Mendiratta , Fanfei Meng

Although Federated Learning (FL) enables global model training across clients without compromising their raw data, due to the unevenly distributed data among clients, existing Federated Averaging (FedAvg)-based methods suffer from the…

Machine Learning · Computer Science 2024-07-08 Ming Hu , Zhihao Yue , Xiaofei Xie , Cheng Chen , Yihao Huang , Xian Wei , Xiang Lian , Yang Liu , Mingsong Chen

Federated learning (FL) enables collaborative machine learning across distributed data owners, but data heterogeneity poses a challenge for model calibration. While prior work focused on improving accuracy for non-iid data, calibration…

Machine Learning · Computer Science 2024-06-05 Hongyi Peng , Han Yu , Xiaoli Tang , Xiaoxiao Li

Federated learning (FL) has enabled training machine learning models exploiting the data of multiple agents without compromising privacy. However, FL is known to be vulnerable to data heterogeneity, partial device participation, and…

Machine Learning · Computer Science 2023-06-13 Marina Costantini , Giovanni Neglia , Thrasyvoulos Spyropoulos

Federated Learning using the Federated Averaging algorithm has shown great advantages for large-scale applications that rely on collaborative learning, especially when the training data is either unbalanced or inaccessible due to privacy…

Machine Learning · Computer Science 2021-07-21 Jonatan Reyes , Lisa Di Jorio , Cecile Low-Kam , Marta Kersten-Oertel

Federated learning is a decentralized and privacy-preserving technique that enables multiple clients to collaborate with a server to learn a global model without exposing their private data. However, the presence of statistical…

Machine Learning · Computer Science 2023-07-06 Shiyu Liu , Shaogao Lv , Dun Zeng , Zenglin Xu , Hui Wang , Yue Yu

Federated Learning is a distributed machine learning approach which enables model training without data sharing. In this paper, we propose a new federated learning algorithm, Federated Averaging with Client-level Momentum (FedCM), to tackle…

Machine Learning · Computer Science 2021-06-22 Jing Xu , Sen Wang , Liwei Wang , Andrew Chi-Chih Yao

Federated learning algorithms, such as FedAvg, are negatively affected by data heterogeneity and partial client participation. To mitigate the latter problem, global variance reduction methods, like FedVARP, leverage stale model updates for…

Machine Learning · Computer Science 2024-05-08 Angelo Rodio , Giovanni Neglia

Existing approaches in Federated Learning (FL) mainly focus on sending model parameters or gradients from clients to a server. However, these methods are plagued by significant inefficiency, privacy, and security concerns. Thanks to the…

Machine Learning · Computer Science 2024-06-04 Jie Zhang , Xiaohua Qi , Bo Zhao

Federated learning protects data privacy and security by exchanging models instead of data. However, unbalanced data distributions among participating clients compromise the accuracy and convergence speed of federated learning algorithms.…

Machine Learning · Computer Science 2022-04-11 Qilong Wu , Lin Liu , Shibei Xue

Federated learning (FL) allows multiple clients to collectively train a high-performance global model without sharing their private data. However, the key challenge in federated learning is that the clients have significant statistical…

Machine Learning · Computer Science 2022-03-23 Liang Gao , Huazhu Fu , Li Li , Yingwen Chen , Ming Xu , Cheng-Zhong Xu

Federated Learning (FL) has emerged as a prominent distributed machine learning framework that enables geographically discrete clients to train a global model collaboratively while preserving their privacy-sensitive data. However, due to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-15 Shensheng Zheng , Wenhao Yuan , Xuehe Wang , Lingjie Duan

Federated learning (FL) is a general framework for learning across an axis of group partitioned data (heterogeneous clients) while preserving data privacy, under the orchestration of a central server. FL methods often compute gradients of…

Machine Learning · Computer Science 2024-11-26 Keith Rush , Zachary Charles , Zachary Garrett

Federated Learning (FL) is a distributed learning paradigm that scales on-device learning collaboratively and privately. Standard FL algorithms such as FedAvg are primarily geared towards smooth unconstrained settings. In this paper, we…

Machine Learning · Computer Science 2021-06-08 Honglin Yuan , Manzil Zaheer , Sashank Reddi

Federated Learning (FL) is a distributed machine learning approach where multiple clients work together to solve a machine learning task. One of the key challenges in FL is the issue of partial participation, which occurs when a large…

Machine Learning · Computer Science 2023-03-01 Grigory Malinovsky , Samuel Horváth , Konstantin Burlachenko , Peter Richtárik

Federated Learning (FL) can be coordinated under the orchestration of a central server to collaboratively build a privacy-preserving model without the need for data exchange. However, participant data heterogeneity leads to local optima…

Machine Learning · Computer Science 2024-08-30 Boyuan Li , Zihao Peng , Yafei Li , Mingliang Xu , Shengbo Chen , Baofeng Ji , Cong Shen