中文
相关论文

相关论文: Faster Rates for Compressed Federated Learning wit…

200 篇论文

For distributed learning among collaborative users, this paper develops and analyzes a communication-efficient scheme for federated learning (FL) over the air, which incorporates 1-bit compressive sensing (CS) into analog aggregation…

机器学习 · 计算机科学 2021-03-31 Xin Fan , Yue Wang , Yan Huo , Zhi Tian

Federated learning is an emerging distributed machine learning method, enables a large number of clients to train a model without exchanging their local data. The time cost of communication is an essential bottleneck in federated learning,…

机器学习 · 计算机科学 2023-09-19 Hao Sun , Li Shen , Shixiang Chen , Jingwei Sun , Jing Li , Guangzhong Sun , Dacheng Tao

Gradient compression can effectively alleviate communication bottlenecks in Federated Learning (FL). Contemporary state-of-the-art sparse compressors, such as Top-$k$, exhibit high computational complexity, up to $\mathcal{O}(d\log_2{k})$,…

机器学习 · 计算机科学 2025-05-20 Rongwei Lu , Yutong Jiang , Jinrui Zhang , Chunyang Li , Yifei Zhu , Bin Chen , Zhi Wang

Decentralized optimization methods enable on-device training of machine learning models without a central coordinator. In many scenarios communication between devices is energy demanding and time consuming and forms the bottleneck of the…

最优化与控制 · 数学 2020-11-04 Dmitry Kovalev , Anastasia Koloskova , Martin Jaggi , Peter Richtarik , Sebastian U. Stich

Federated learning (FL) has attracted tremendous attentions in recent years due to its privacy preserving measures and great potentials in some distributed but privacy-sensitive applications like finance and health. However, high…

分布式、并行与集群计算 · 计算机科学 2021-04-14 Yuzhu Mao , Zihao Zhao , Guangfeng Yan , Yang Liu , Tian Lan , Linqi Song , Wenbo Ding

Efficient collaboration between collaborative machine learning and wireless communication technology, forming a Federated Edge Learning (FEEL), has spawned a series of next-generation intelligent applications. However, due to the openness…

机器学习 · 计算机科学 2021-11-05 Yi Liu , Yuanshao Zhu , James J. Q. Yu

Federated learning (FL) faces challenges of intermittent client availability and computation/communication efficiency. As a result, only a small subset of clients can participate in FL at a given time. It is important to understand how…

机器学习 · 计算机科学 2024-12-31 Shiqiang Wang , Mingyue Ji

Federated Learning (FL) is a promising technique for the collaborative training of deep neural networks across multiple devices while preserving data privacy. Despite its potential benefits, FL is hindered by excessive communication costs…

机器学习 · 计算机科学 2024-02-27 Vasileios Tsouvalas , Aaqib Saeed , Tanir Ozcelebi , Nirvana Meratnia

We propose a novel algorithm for solving the composite Federated Learning (FL) problem. This algorithm manages non-smooth regularization by strategically decoupling the proximal operator and communication, and addresses client drift without…

机器学习 · 计算机科学 2023-09-06 Jiaojiao Zhang , Jiang Hu , Mikael Johansson

Federated learning (FL) allows edge devices to collaboratively train models without sharing local data. As FL gains popularity, clients may need to train multiple unrelated FL models, but communication constraints limit their ability to…

机器学习 · 计算机科学 2025-04-23 Haoran Zhang , Zejun Gong , Zekai Li , Marie Siew , Carlee Joe-Wong , Rachid El-Azouzi

This paper focuses on a multi-agent zeroth-order online optimization problem in a federated learning setting for target tracking. The agents only sense their current distances to their targets and aim to maintain a minimum safe distance…

机器学习 · 计算机科学 2023-06-12 Ege C. Kaya , M. Berk Sahin , Abolfazl Hashemi

This paper presents a novel gradient compression method for federated learning (FL) in wireless systems. The proposed method centers on a low-rank matrix factorization strategy for local gradient compression that is based on one iteration…

信息论 · 计算机科学 2024-11-26 Mingzhao Guo , Dongzhu Liu , Osvaldo Simeone , Dingzhu Wen

The core bottleneck of Federated Learning (FL) lies in the communication rounds. That is, how to achieve more effective local updates is crucial for reducing communication rounds. Existing FL methods still primarily use element-wise local…

机器学习 · 计算机科学 2025-11-03 Junkang Liu , Fanhua Shang , Junchao Zhou , Hongying Liu , Yuanyuan Liu , Jin Liu

In many iterative optimization methods, fixed-point theory enables the analysis of the convergence rate via the contraction factor associated with the linear approximation of the fixed-point operator. While this factor characterizes the…

系统与控制 · 电气工程与系统科学 2022-06-22 Trung Vu , Raviv Raich

Federated learning is a framework for distributed optimization that places emphasis on communication efficiency. In particular, it follows a client-server broadcast model and is particularly appealing because of its ability to accommodate…

机器学习 · 计算机科学 2022-03-30 Han Wang , Siddartha Marella , James Anderson

Federated Learning (FL) enables mobile edge devices, functioning as clients, to collaboratively train a decentralized model while ensuring local data privacy. However, the efficiency of FL in wireless networks is limited not only by…

分布式、并行与集群计算 · 计算机科学 2026-01-01 Yanbing Yang , Huiling Zhu , Wenchi Cheng , Jingqing Wang , Changrun Chen , Jiangzhou Wang

Federated learning facilitates collaborative model training across multiple clients while preserving data privacy. However, its performance is often constrained by limited communication resources, particularly in systems supporting a large…

机器学习 · 计算机科学 2025-08-26 Jiaqi Zhu , Bikramjit Das , Yong Xie , Nikolaos Pappas , Howard H. Yang

In this paper, a communication-efficient federated learning (FL) framework is proposed for improving the convergence rate of FL under a limited uplink capacity. The central idea of the proposed framework is to transmit the values and…

信号处理 · 电气工程与系统科学 2023-07-21 Jaewon Yun , Yongjeong Oh , Yo-Seb Jeon , H. Vincent Poor

This paper focuses on reducing the communication cost of federated learning by exploring generalization bounds and representation learning. We first characterize a tighter generalization bound for one-round federated learning based on local…

机器学习 · 计算机科学 2024-05-29 Peyman Gholami , Hulya Seferoglu

Federated Learning is a leading framework for training ML and AI models collaboratively across numerous user devices or databases. We study the trade-offs among estimation accuracy, privacy constraints, and communication cost for…

机器学习 · 统计学 2026-05-19 Arnab Auddy , Xiangni Peng , Subhadeep Paul