English
Related papers

Related papers: Continuous-Time Analysis of Federated Averaging

200 papers

In Federated Learning (FL), the distributed nature and heterogeneity of client data present both opportunities and challenges. While collaboration among clients can significantly enhance the learning process, not all collaborations are…

Machine Learning · Computer Science 2024-07-18 Nazarii Tupitsa , Samuel Horváth , Martin Takáč , Eduard Gorbunov

A widely recognized difficulty in federated learning arises from the statistical heterogeneity among clients: local datasets often originate from distinct yet not entirely unrelated probability distributions, and personalization is,…

Machine Learning · Statistics 2025-03-12 Shuxiao Chen , Qinqing Zheng , Qi Long , Weijie J. Su

Federated learning (FL) enables distributed optimization of machine learning models while protecting privacy by independently training local models on each client and then aggregating parameters on a central server, thereby producing an…

Machine Learning · Computer Science 2022-03-08 Chencheng Xu , Zhiwei Hong , Minlie Huang , Tao Jiang

Federated Learning (FL) emerged as a practical approach to training a model from decentralized data. The proliferation of FL led to the development of numerous FL algorithms and mechanisms. Many prior efforts have given their primary focus…

Machine Learning · Computer Science 2024-03-27 Gustav A. Baumgart , Jaemin Shin , Ali Payani , Myungjin Lee , Ramana Rao Kompella

Federated learning algorithms, such as FedAvg, are negatively affected by data heterogeneity and partial client participation. To mitigate the latter problem, global variance reduction methods, like FedVARP, leverage stale model updates for…

Machine Learning · Computer Science 2024-05-08 Angelo Rodio , Giovanni Neglia

Federated Learning (FL) is a promising framework for performing privacy-preserving, distributed learning with a set of clients. However, the data distribution among clients often exhibits non-IID, i.e., distribution shift, which makes…

Machine Learning · Computer Science 2022-06-07 Zhe Qu , Xingyu Li , Rui Duan , Yao Liu , Bo Tang , Zhuo Lu

Federated learning (FL) has become de facto framework for collaborative learning among edge devices with privacy concern. The core of the FL strategy is the use of stochastic gradient descent (SGD) in a distributed manner. Large scale…

Machine Learning · Computer Science 2022-05-18 Kerem Ozfatura , Emre Ozfatura , Deniz Gunduz

Federated learning (FL) systems enable multiple clients to train a machine learning model iteratively through synchronously exchanging the intermediate model weights with a single server. The scalability of such FL systems can be limited by…

Machine Learning · Computer Science 2024-06-21 Yuncong Zuo , Bart Cox , Lydia Y. Chen , Jérémie Decouchant

Federated learning (FL) enables collaboratively training deep learning models on decentralized data. However, there are three types of heterogeneities in FL setting bringing about distinctive challenges to the canonical federated learning…

Machine Learning · Computer Science 2020-09-18 Tao Shen , Jie Zhang , Xinkang Jia , Fengda Zhang , Gang Huang , Pan Zhou , Kun Kuang , Fei Wu , Chao Wu

Generative models trained on multi-institutional datasets can provide an enriched understanding through diverse data distributions. However, training the models on medical images is often challenging due to hospitals' reluctance to share…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Minjun Kim , Minjee Kim , Jinhoon Jeong

Federated learning is a decentralized and privacy-preserving technique that enables multiple clients to collaborate with a server to learn a global model without exposing their private data. However, the presence of statistical…

Machine Learning · Computer Science 2023-07-06 Shiyu Liu , Shaogao Lv , Dun Zeng , Zenglin Xu , Hui Wang , Yue Yu

Federated Learning (FL) has emerged as a powerful paradigm for decentralized machine learning, enabling collaborative model training across diverse clients without sharing raw data. However, traditional FL approaches often face limitations…

Machine Learning · Computer Science 2025-10-22 Ali Forootani , Raffaele Iervolino

Federated learning (FL) has attracted increasing attention in recent years. As a privacy-preserving collaborative learning paradigm, it enables a broader range of applications, especially for computer vision and natural language processing…

Machine Learning · Computer Science 2020-11-24 Yilun Lin , Chaochao Chen , Cen Chen , Li Wang

Federated learning (FL) has emerged as a promising paradigm for privacy-preserving distributed machine learning, but faces challenges with heterogeneous data distributions across clients. This paper presents FedSat, a novel FL approach…

Machine Learning · Computer Science 2024-12-31 Sujit Chowdhury , Raju Halder

Federated learning (FL) is a promising strategy for performing privacy-preserving, distributed learning with a network of clients (i.e., edge devices). However, the data distribution among clients is often non-IID in nature, making…

Machine Learning · Computer Science 2022-04-15 Matias Mendieta , Taojiannan Yang , Pu Wang , Minwoo Lee , Zhengming Ding , Chen Chen

Federated learning (FL) is an emerging paradigm for decentralized training of machine learning models on distributed clients, without revealing the data to the central server. The learning scheme may be horizontal, vertical or hybrid (both…

Machine Learning · Computer Science 2024-01-11 Fanfei Meng , Lele Zhang , Yu Chen , Yuxin Wang

Decentralized federated learning (DFL) enables devices to collaboratively train models over complex network topologies without relying on a central controller. In this setting, local data remains private, but its quality and quantity can…

Machine Learning · Computer Science 2025-06-05 Samuele Sabella , Chiara Boldrini , Lorenzo Valerio , Andrea Passarella , Marco Conti

We study a hierarchical federated learning (FL) problem, where clients cooperatively seek to select among multiple optimal solutions of a primary distributed learning problem, a solution that minimizes a secondary loss function. This…

Optimization and Control · Mathematics 2026-05-26 Mohammadjavad Ebrahimi , Yuyang Qiu , Shisheng Cui , Farzad Yousefian

Federated Learning (FL) is an emerging framework for distributed processing of large data volumes by edge devices subject to limited communication bandwidths, heterogeneity in data distributions and computational resources, as well as…

Machine Learning · Computer Science 2022-04-11 Yonghai Gong , Yichuan Li , Nikolaos M. Freris

Recently, the ever-growing demand for privacy-oriented machine learning has motivated researchers to develop federated and decentralized learning techniques, allowing individual clients to train models collaboratively without disclosing…

Machine Learning · Computer Science 2021-07-15 David Roschewitz , Mary-Anne Hartley , Luca Corinzia , Martin Jaggi