中文
相关论文

相关论文: The Sample-Communication Complexity Trade-off in F…

200 篇论文

A significant bottleneck in federated learning (FL) is the network communication cost of sending model updates from client devices to the central server. We present a comprehensive empirical study of the statistics of model updates in FL,…

机器学习 · 计算机科学 2022-05-23 Nicole Mitchell , Johannes Ballé , Zachary Charles , Jakub Konečný

Federated learning (FL) is a decentralized approach, enabling multiple participants to collaboratively train a model while ensuring the protection of data privacy. The transmission of updates from numerous edge clusters to the server…

分布式、并行与集群计算 · 计算机科学 2024-08-20 Haowei Li , Weiying Xie , Hangyu Ye , Jitao Ma , Shuran Ma , Yunsong Li

The high cost of communicating gradients is a major bottleneck for federated learning, as the bandwidth of the participating user devices is limited. Existing gradient compression algorithms are mainly designed for data centers with…

机器学习 · 计算机科学 2019-11-26 Xinyan Dai , Xiao Yan , Kaiwen Zhou , Han Yang , Kelvin K. W. Ng , James Cheng , Yu Fan

Soft Q-learning is a variation of Q-learning designed to solve entropy regularized Markov decision problems where an agent aims to maximize the entropy regularized value function. Despite its empirical success, there have been limited…

机器学习 · 计算机科学 2024-09-06 Narim Jeong , Donghwan Lee

Recent advancements in semantic communication have primarily focused on image transmission, where neural network-based joint source-channel coding modules play a central role. However, such systems often experience semantic communication…

信号处理 · 电气工程与系统科学 2026-02-20 Yoon Huh , Bumjun Kim , Wan Choi

Motivated by real-world settings where data collection and policy deployment -- whether for a single agent or across multiple agents -- are costly, we study the problem of on-policy single-agent reinforcement learning (RL) and federated RL…

机器学习 · 统计学 2026-03-11 Haochen Zhang , Zhong Zheng , Lingzhou Xue

Rapid scaling of deep learning models has enabled performance gains across domains, yet it introduced several challenges. Federated Learning (FL) has emerged as a promising framework to address these concerns by enabling decentralized…

Control of large-scale networked systems often necessitates the availability of complex models for the interactions amongst the agents. However in many applications, building accurate models of agents or interactions amongst them might be…

最优化与控制 · 数学 2019-03-21 Siavash Alemzadeh , Mehran Mesbahi

Federated learning has attracted increasing attention with the emergence of distributed data. While extensive federated learning algorithms have been proposed for the non-convex distributed problem, federated learning in practice still…

机器学习 · 计算机科学 2023-03-10 Xidong Wu , Feihu Huang , Zhengmian Hu , Heng Huang

In the federated learning setting, multiple clients jointly train a model under the coordination of the central server, while the training data is kept on the client to ensure privacy. Normally, inconsistent distribution of data across…

机器学习 · 计算机科学 2020-12-21 Wei Huang , Tianrui Li , Dexian Wang , Shengdong Du , Junbo Zhang

In this letter, we study a wireless federated learning (FL) system where network pruning is applied to local users with limited resources. Although pruning is beneficial to reduce FL latency, it also deteriorates learning performance due to…

机器学习 · 计算机科学 2022-05-31 Jianyang Ren , Wanli Ni , Hui Tian

Federated Learning (FL) enables multiple resource-constrained edge devices with varying levels of heterogeneity to collaboratively train a global model. However, devices with limited capacity can create bottlenecks and slow down model…

机器学习 · 计算机科学 2025-04-08 Afsaneh Mahanipour , Hana Khamfroush

In this paper we address distributed learning problems over peer-to-peer networks. In particular, we focus on the challenges of quantized communications, asynchrony, and stochastic gradients that arise in this set-up. We first discuss how…

最优化与控制 · 数学 2025-09-04 Nicola Bastianello , Apostolos I. Rikos , Karl H. Johansson

Federated learning is a distributed framework according to which a model is trained over a set of devices, while keeping data localized. This framework faces several systems-oriented challenges which include (i) communication bottleneck…

机器学习 · 计算机科学 2020-06-09 Amirhossein Reisizadeh , Aryan Mokhtari , Hamed Hassani , Ali Jadbabaie , Ramtin Pedarsani

We study a model-free federated linear quadratic regulator (LQR) problem where M agents with unknown, distinct yet similar dynamics collaboratively learn an optimal policy to minimize an average quadratic cost while keeping their data…

最优化与控制 · 数学 2023-08-24 Han Wang , Leonardo F. Toso , Aritra Mitra , James Anderson

In this paper, we propose a reinforcement learning algorithm to solve a multi-agent Markov decision process (MMDP). The goal, inspired by Blackwell's Approachability Theorem, is to lower the time average cost of each agent to below a…

系统与控制 · 电气工程与系统科学 2023-11-22 Keshav P. Keval , Vivek S. Borkar

We study the problem of PAC learning $\gamma$-margin halfspaces with Random Classification Noise. We establish an information-computation tradeoff suggesting an inherent gap between the sample complexity of the problem and the sample…

机器学习 · 计算机科学 2023-06-29 Ilias Diakonikolas , Jelena Diakonikolas , Daniel M. Kane , Puqian Wang , Nikos Zarifis

Existing federated learning paradigms usually extensively exchange distributed models at a central solver to achieve a more powerful model. However, this would incur severe communication burden between a server and multiple clients…

机器学习 · 计算机科学 2022-09-30 Ping Liu , Xin Yu , Joey Tianyi Zhou

Federated learning (FL) offers a solution to train a global machine learning model while still maintaining data privacy, without needing access to data stored locally at the clients. However, FL suffers performance degradation when client…

机器学习 · 计算机科学 2021-08-13 Zihan Chen , Kai Fong Ernest Chong , Tony Q. S. Quek

Federated learning (FL) is a novel machine learning setting that enables on-device intelligence via decentralized training and federated optimization. Deep neural networks' rapid development facilitates the learning techniques for modeling…

机器学习 · 计算机科学 2021-09-27 Shaoxiong Ji , Wenqi Jiang , Anwar Walid , Xue Li