English
Related papers

Related papers: Second-Order Guarantees in Federated Learning

200 papers

Federated learning is a recent advance in privacy protection. In this context, a trusted curator aggregates parameters optimized in decentralized fashion by multiple clients. The resulting model is then distributed back to all clients,…

Cryptography and Security · Computer Science 2018-03-02 Robin C. Geyer , Tassilo Klein , Moin Nabi

We consider stochastic convex optimization problems, where several machines act asynchronously in parallel while sharing a common memory. We propose a robust training method for the constrained setting and derive non asymptotic convergence…

Machine Learning · Computer Science 2021-06-24 Rotem Zamir Aviv , Ido Hakimi , Assaf Schuster , Kfir Y. Levy

Increasing privacy concerns and unrestricted access to data lead to the development of a novel machine learning paradigm called Federated Learning (FL). FL borrows many of the ideas from distributed machine learning, however, the challenges…

Machine Learning · Computer Science 2025-01-08 Karthik Mohan

Personalized Federated Learning (FL) is an emerging research field in FL that learns an easily adaptable global model in the presence of data heterogeneity among clients. However, one of the main challenges for personalized FL is the heavy…

Machine Learning · Computer Science 2022-06-14 Jaehun Song , Min-hwan Oh , Hyung-Sin Kim

Federated learning is a distributed machine learning paradigm, which aims to train a model using the local data of many distributed clients. A key challenge in federated learning is that the data samples across the clients may not be…

Machine Learning · Computer Science 2022-06-27 Farzan Farnia , Amirhossein Reisizadeh , Ramtin Pedarsani , Ali Jadbabaie

Federated learning allows loads of edge computing devices to collaboratively learn a global model without data sharing. The analysis with partial device participation under non-IID and unbalanced data reflects more reality. In this work, we…

Machine Learning · Computer Science 2020-12-23 Qianqian Tong , Guannan Liang , Jinbo Bi

Federated Learning (FL), while a breakthrough in decentralized machine learning, contends with significant challenges such as limited data availability and the variability of computational resources, which can stifle the performance and…

Machine Learning · Computer Science 2025-10-07 Jiaqi Wang , Xi Li

Federated Learning (FL) facilitates decentralized model training while preserving data privacy. However, achieving both robust generalization and effective personalization simultaneously in heterogeneous (non-IID) environments remains a…

Machine Learning · Computer Science 2026-03-17 Eun Gyung Kong , Je Won Yeom , Yonghoon Jeon , Taesup Kim

Federated learning (FL) is a distributed machine learning technique designed to preserve data privacy and security, and it has gained significant importance due to its broad range of applications. This paper addresses the problem of optimal…

Statistics Theory · Mathematics 2025-01-16 Tony Cai , Abhinav Chakraborty , Lasse Vuursteen

Federated learning is a decentralized and privacy-preserving technique that enables multiple clients to collaborate with a server to learn a global model without exposing their private data. However, the presence of statistical…

Machine Learning · Computer Science 2023-07-06 Shiyu Liu , Shaogao Lv , Dun Zeng , Zenglin Xu , Hui Wang , Yue Yu

Federated learning is renowned for its efficacy in distributed model training, ensuring that users, called clients, retain data privacy by not disclosing their data to the central server that orchestrates collaborations. Most previous work…

Machine Learning · Computer Science 2024-10-30 Pouya M. Ghari , Yanning Shen

Federated Learning (FL) enables collaborative model training across distributed devices while preserving data privacy. Nonetheless, the heterogeneity of edge devices often leads to inconsistent performance of the globally trained models,…

Machine Learning · Computer Science 2025-05-13 Lin Wang , Zhichao Wang , Ye Shi , Sai Praneeth Karimireddy , Xiaoying Tang

We propose a novel framework to study asynchronous federated learning optimization with delays in gradient updates. Our theoretical framework extends the standard FedAvg aggregation scheme by introducing stochastic aggregation weights to…

Machine Learning · Computer Science 2022-06-22 Yann Fraboni , Richard Vidal , Laetitia Kameni , Marco Lorenzi

Data privacy is a major concern in industries such as healthcare or finance. The requirement to safeguard privacy is essential to prevent data breaches and misuse, which can have severe consequences for individuals and organisations.…

Machine Learning · Computer Science 2024-12-18 Jose L Salmeron , Irina Arévalo

Vertical federated learning (VFL) has attracted greater and greater interest since it enables multiple parties possessing non-overlapping features to strengthen their machine learning models without disclosing their private data and model…

Machine Learning · Computer Science 2022-09-07 Changxin Liu , Zhenan Fan , Zirui Zhou , Yang Shi , Jian Pei , Lingyang Chu , Yong Zhang

Federated Learning (FL) is a privacy preserving machine learning scheme, where training happens with data federated across devices and not leaving them to sustain user privacy. This is ensured by making the untrained or partially trained…

Federated Learning (FL) has been becoming a popular interdisciplinary research area in both applied mathematics and information sciences. Mathematically, FL aims to collaboratively optimize aggregate objective functions over distributed…

Machine Learning · Computer Science 2024-12-03 Shusen Yang , Fangyuan Zhao , Zihao Zhou , Liang Shi , Xuebin Ren , Zongben Xu

Federated learning is a privacy-focused approach towards machine learning where models are trained on client devices with locally available data and aggregated at a central server. However, the dependence on a single central server is…

Machine Learning · Computer Science 2026-01-06 Shamik Bhattacharyya , Rachel Kalpana Kalaimani

Federated Learning is a distributed machine learning approach which enables model training without data sharing. In this paper, we propose a new federated learning algorithm, Federated Averaging with Client-level Momentum (FedCM), to tackle…

Machine Learning · Computer Science 2021-06-22 Jing Xu , Sen Wang , Liwei Wang , Andrew Chi-Chih Yao

Federated learning (FL) allows remote clients to train a global model collaboratively while protecting client privacy. Despite its privacy-preserving benefits, FL has significant drawbacks, including slow convergence, high communication…

Machine Learning · Computer Science 2026-02-18 Mohammad Partohaghighi , Roummel Marcia , YangQuan Chen