English
Related papers

Related papers: Statistical Estimation and Inference via Local SGD…

200 papers

Federated learning has emerged as a popular technique for distributing machine learning (ML) model training across the wireless edge. In this paper, we propose two timescale hybrid federated learning (TT-HF), a semi-decentralized learning…

Channel estimation is a critical task in intelligent reflecting surface (IRS)-assisted wireless systems due to the uncertainties imposed by environment dynamics and rapid changes in the IRS configuration. To deal with these uncertainties,…

Signal Processing · Electrical Eng. & Systems 2022-08-10 Ahmet M. Elbir , Sinem Coleri , Kumar Vijay Mishra

Federated learning (FL) is a novel machine learning setting that enables on-device intelligence via decentralized training and federated optimization. Deep neural networks' rapid development facilitates the learning techniques for modeling…

Machine Learning · Computer Science 2021-09-27 Shaoxiong Ji , Wenqi Jiang , Anwar Walid , Xue Li

The paper considers independent reinforcement learning (IRL) for multi-agent decision-making process in the paradigm of federated learning (FL). We show that FL can clearly improve the policy performance of IRL in terms of training…

Machine Learning · Computer Science 2022-02-01 Xing Xu , Rongpeng Li , Zhifeng Zhao , Honggang Zhang

Federated Learning (FL) is a promising framework for performing privacy-preserving, distributed learning with a set of clients. However, the data distribution among clients often exhibits non-IID, i.e., distribution shift, which makes…

Machine Learning · Computer Science 2022-06-07 Zhe Qu , Xingyu Li , Rui Duan , Yao Liu , Bo Tang , Zhuo Lu

Federated Learning is a machine learning setting where the goal is to train a high-quality centralized model while training data remains distributed over a large number of clients each with unreliable and relatively slow network…

Machine Learning · Computer Science 2017-11-01 Jakub Konečný , H. Brendan McMahan , Felix X. Yu , Peter Richtárik , Ananda Theertha Suresh , Dave Bacon

We consider a many-to-one wireless architecture for federated learning at the network edge, where multiple edge devices collaboratively train a model using local data. The unreliable nature of wireless connectivity, together with…

Networking and Internet Architecture · Computer Science 2021-02-17 Junshan Zhang , Na Li , Mehmet Dedeoglu

This paper investigates federated learning in a wireless communication system, where random device selection is employed with non-independent and identically distributed (non-IID) data. The analysis indicates that while training deep…

Signal Processing · Electrical Eng. & Systems 2024-05-28 Kaidi Wang , Zhiguo Ding , Daniel K. C. So , Zhi Ding

Existing approaches in Federated Learning (FL) mainly focus on sending model parameters or gradients from clients to a server. However, these methods are plagued by significant inefficiency, privacy, and security concerns. Thanks to the…

Machine Learning · Computer Science 2024-06-04 Jie Zhang , Xiaohua Qi , Bo Zhao

Speculative decoding accelerates large language model (LLM) inference by using a lightweight draft model to propose tokens that are later verified by a stronger target model. While effective in centralized systems, its behavior in…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-18 Jingwei Song , Wanyi Chen , Xinyuan Song , Max , Chris Tong , Gufeng Chen , Tianyi Zhao , Eric Yang , Bill Shi , Lynn Ai

Federated Learning (FL) refers to the paradigm where multiple worker nodes (WNs) build a joint model by using local data. Despite extensive research, for a generic non-convex FL problem, it is not clear, how to choose the WNs' and the…

Machine Learning · Computer Science 2021-06-22 Prashant Khanduri , Pranay Sharma , Haibo Yang , Mingyi Hong , Jia Liu , Ketan Rajawat , Pramod K. Varshney

Federated learning (FL) enables edge nodes to collaboratively contribute to constructing a global model without sharing their data. This is accomplished by devices computing local, private model updates that are then aggregated by a server.…

Machine Learning · Computer Science 2024-06-13 Sadi Alawadi , Addi Ait-Mlouk , Salman Toor , Andreas Hellander

Federated Learning (FL) enables large-scale distributed training of machine learning models, while still allowing individual nodes to maintain data locally. However, executing FL at scale comes with inherent practical challenges: 1)…

Machine Learning · Computer Science 2025-05-23 Hossein Zakerinia , Shayan Talaei , Giorgi Nadiradze , Dan Alistarh

Federated learning (FL) is a distributed machine learning technique designed to preserve data privacy and security, and it has gained significant importance due to its broad range of applications. This paper addresses the problem of optimal…

Statistics Theory · Mathematics 2025-01-16 Tony Cai , Abhinav Chakraborty , Lasse Vuursteen

Mobile devices, including smartphones and laptops, generate decentralized and heterogeneous data, presenting significant challenges for traditional centralized machine learning models due to substantial communication costs and privacy…

Machine Learning · Computer Science 2024-11-12 Mayank Kumar Kundalwal , Anurag Saraswat , Ishan Mishra , Deepak Mishra

Federated learning (FL) is a distributed machine learning architecture that leverages a large number of workers to jointly learn a model with decentralized data. FL has received increasing attention in recent years thanks to its data…

Machine Learning · Computer Science 2021-05-05 Haibo Yang , Minghong Fang , Jia Liu

Federated Learning (FL) is a promising technique for the collaborative training of deep neural networks across multiple devices while preserving data privacy. Despite its potential benefits, FL is hindered by excessive communication costs…

Machine Learning · Computer Science 2024-02-27 Vasileios Tsouvalas , Aaqib Saeed , Tanir Ozcelebi , Nirvana Meratnia

Federated learning is a distributed machine learning approach where multiple clients collaboratively train a model without sharing their local data, which contributes to preserving privacy. A challenge in federated learning is managing…

Machine Learning · Computer Science 2025-03-04 Rickard Brännvall

Federated learning (FL) provides a communication-efficient approach to solve machine learning problems concerning distributed data, without sending raw data to a central server. However, existing works on FL only utilize first-order…

Machine Learning · Computer Science 2019-10-10 Wei Liu , Li Chen , Yunfei Chen , Wenyi Zhang

Federated averaging (FedAvg) is a popular federated learning (FL) technique that updates the global model by averaging local models and then transmits the updated global model to devices for their local model update. One main limitation of…

Machine Learning · Computer Science 2021-12-15 Luong Trung Nguyen , Junhan Kim , Byonghyo Shim