English
Related papers

Related papers: The Sample-Communication Complexity Trade-off in F…

200 papers

In vertical federated learning (FL), the features of a data sample are distributed across multiple agents. As such, inter-agent collaboration can be beneficial not only during the learning phase, as is the case for standard horizontal FL,…

Information Theory · Computer Science 2022-04-13 Sharu Theresa Jose , Osvaldo Simeone

Federated Learning (FL) enables collaborative training across decentralized data, but faces key challenges of bidirectional communication overhead and client-side data heterogeneity. To address communication costs while embracing data…

Machine Learning · Computer Science 2026-02-03 Jiacheng Cheng , Xu Zhang , Guanghui Qiu , Yifang Zhang , Yinchuan Li , Kaiyuan Feng

We initiate the study of federated reinforcement learning under environmental heterogeneity by considering a policy evaluation problem. Our setup involves $N$ agents interacting with environments that share the same state and action space…

Machine Learning · Computer Science 2024-07-02 Han Wang , Aritra Mitra , Hamed Hassani , George J. Pappas , James Anderson

We study asynchronous federated learning mechanisms with nodes having potentially different computational speeds. In such an environment, each node is allowed to work on models with potential delays and contribute to updates to the central…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-02 Louis Leconte , Matthieu Jonckheere , Sergey Samsonov , Eric Moulines

One main challenge in federated learning is the large communication cost of exchanging weight updates from clients to the server at each round. While prior work has made great progress in compressing the weight updates through gradient…

Machine Learning · Computer Science 2023-02-10 Berivan Isik , Francesco Pase , Deniz Gunduz , Tsachy Weissman , Michele Zorzi

Federated Learning (FL) is a promising technique for the collaborative training of deep neural networks across multiple devices while preserving data privacy. Despite its potential benefits, FL is hindered by excessive communication costs…

Machine Learning · Computer Science 2024-02-27 Vasileios Tsouvalas , Aaqib Saeed , Tanir Ozcelebi , Nirvana Meratnia

Federated learning (FL) often suffers from performance degradation due to key challenges such as data heterogeneity and communication constraints. To address these limitations, we present a novel FL framework called FedWSQ, which integrates…

Machine Learning · Computer Science 2025-07-23 Seung-Wook Kim , Seongyeol Kim , Jiah Kim , Seowon Ji , Se-Ho Lee

Federated Learning (FL) enables participant devices to collaboratively train deep learning models without sharing their data with the server or other devices, effectively addressing data privacy and computational concerns. However, FL faces…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-30 Asadullah Tariq , Tariq Qayyum , Mohamed Adel Serhani , Farag Sallabi , Ikbal Taleb , Ezedin S. Barka

With more regulations tackling users' privacy-sensitive data protection in recent years, access to such data has become increasingly restricted and controversial. To exploit the wealth of data generated and located at distributed entities…

Machine Learning · Computer Science 2020-11-10 Nader Bouacida , Jiahui Hou , Hui Zang , Xin Liu

Federated learning enables many local devices to train a deep learning model jointly without sharing the local data. Currently, most of federated training schemes learns a global model by averaging the parameters of local models. However,…

Machine Learning · Computer Science 2021-10-26 Zhenwei Dai , Chen Dun , Yuxin Tang , Anastasios Kyrillidis , Anshumali Shrivastava

Federated learning (FL) is a distributed learning paradigm that enables a large number of devices to collaboratively learn a model without sharing their raw data. Despite its practical efficiency and effectiveness, the iterative on-device…

Machine Learning · Computer Science 2020-12-16 Bing Luo , Xiang Li , Shiqiang Wang , Jianwei Huang , Leandros Tassiulas

The problem of sample complexity of online reinforcement learning is often studied in the literature without taking into account any partial knowledge about the system dynamics that could potentially accelerate the learning process. In this…

Machine Learning · Computer Science 2024-06-04 Meshal Alharbi , Mardavij Roozbehani , Munther Dahleh

Federated recommendations leverage the federated learning (FL) techniques to make privacy-preserving recommendations. Though recent success in the federated recommender system, several vital challenges remain to be addressed: (i) The…

Information Retrieval · Computer Science 2022-08-25 Sichun Luo , Yuanzhang Xiao , Yang Liu , Congduan Li , Linqi Song

Federated learning uses a set of techniques to efficiently distribute the training of a machine learning algorithm across several devices, who own the training data. These techniques critically rely on reducing the communication cost -- the…

Machine Learning · Computer Science 2022-06-08 Lukang Sun , Adil Salim , Peter Richtárik

The optimal implementation of federated learning (FL) in practical edge computing systems has been an outstanding problem. In this paper, we propose an optimization-based quantized FL algorithm, which can appropriately fit a general edge…

Machine Learning · Computer Science 2023-11-21 Yangchen Li , Ying Cui , Vincent Lau

We present the convergence rates of synchronous and asynchronous Q-learning for average-reward Markov decision processes, where the absence of contraction poses a fundamental challenge. Existing non-asymptotic results overcome this…

Machine Learning · Computer Science 2026-01-30 Zijun Chen , Zaiwei Chen , Nian Si , Shengbo Wang

Federated learning (FL) enables collaborative learning among decentralized clients while safeguarding the privacy of their local data. Existing studies on FL typically assume offline labeled data available at each client when the training…

Machine Learning · Computer Science 2024-12-13 Yuchang Sun , Xinran Li , Tao Lin , Jun Zhang

We consider a distributed empirical risk minimization (ERM) optimization problem with communication efficiency and privacy requirements, motivated by the federated learning (FL) framework. Unique challenges to the traditional ERM problem in…

Machine Learning · Computer Science 2020-09-24 Antonious M. Girgis , Deepesh Data , Suhas Diggavi , Peter Kairouz , Ananda Theertha Suresh

In an episodic Markov Decision Process (MDP) problem, an online algorithm chooses from a set of actions in a sequence of $H$ trials, where $H$ is the episode length, in order to maximize the total payoff of the chosen actions. Q-learning,…

Machine Learning · Computer Science 2019-07-11 Xu Zhu

Communication costs within Federated learning hinder the system scalability for reaching more data from more clients. The proposed FL adopts a hub-and-spoke network topology. All clients communicate through the central server. Hence,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-18 Chun-Chih Kuo , Ted Tsei Kuo , Chia-Yu Lin