中文
相关论文

相关论文: Communication Compression for Distributed Learning…

200 篇论文

Federated Learning enables one to jointly train a machine learning model across distributed clients holding sensitive datasets. In real-world settings, this approach is hindered by expensive communication and privacy concerns. Both of these…

机器学习 · 统计学 2021-10-19 Constance Beguier , Mathieu Andreux , Eric W. Tramel

Federated learning (FL) is a promising paradigm to enable privacy-preserving deep learning from distributed data. Most previous works are based on federated average (FedAvg), which, however, faces several critical issues, including a high…

机器学习 · 计算机科学 2022-03-15 Lumin Liu , Jun Zhang , S. H. Song , Khaled B. Letaief

Federated Learning (FL) is a distributed machine learning paradigm that enables learning models from decentralized local data. While FL offers appealing properties for clients' data privacy, it imposes high communication burdens for…

机器学习 · 计算机科学 2023-11-17 Saeed Khalilian , Vasileios Tsouvalas , Tanir Ozcelebi , Nirvana Meratnia

Federated learning is a powerful distributed learning scheme that allows numerous edge devices to collaboratively train a model without sharing their data. However, training is resource-intensive for edge devices, and limited network…

机器学习 · 计算机科学 2024-10-25 Hui-Po Wang , Sebastian U. Stich , Yang He , Mario Fritz

In federated learning (FL), a global model is trained at a Parameter Server (PS) by aggregating model updates obtained from multiple remote learners. Generally, the communication between the remote users and the PS is rate-limited, while…

机器学习 · 计算机科学 2022-06-06 Sadaf Salehkalaibar , Stefano Rini

Federated learning (FL) is an emerging paradigm that allows a central server to train machine learning models using remote users' data. Despite its growing popularity, FL faces challenges in preserving the privacy of local datasets, its…

密码学与安全 · 计算机科学 2025-05-09 Natalie Lang , Nir Shlezinger , Rafael G. L. D'Oliveira , Salim El Rouayheb

Federated Learning (FL) incurs high communication overhead, which can be greatly alleviated by compression for model updates. Yet the tradeoff between compression and model accuracy in the networked environment remains unclear and, for…

机器学习 · 计算机科学 2021-12-14 Laizhong Cui , Xiaoxin Su , Yipeng Zhou , Jiangchuan Liu

In Federated Learning (FL), a number of clients or devices collaborate to train a model without sharing their data. Models are optimized locally at each client and further communicated to a central hub for aggregation. While FL is an…

机器学习 · 计算机科学 2023-07-25 Farshid Varno , Marzie Saghayi , Laya Rafiee Sevyeri , Sharut Gupta , Stan Matwin , Mohammad Havaei

Federated Learning has become a widely-used framework which allows learning a global model on decentralized local datasets under the condition of protecting local data privacy. However, federated learning faces severe optimization…

机器学习 · 计算机科学 2023-01-26 Wenkai Yang , Yankai Lin , Guangxiang Zhao , Peng Li , Jie Zhou , Xu Sun

Federated Learning (FL) enables large-scale distributed training of machine learning models, while still allowing individual nodes to maintain data locally. However, executing FL at scale comes with inherent practical challenges: 1)…

机器学习 · 计算机科学 2025-05-23 Hossein Zakerinia , Shayan Talaei , Giorgi Nadiradze , Dan Alistarh

Federated Learning (FL) is a distributed approach to collaboratively training machine learning models. FL requires a high level of communication between the devices and a central server, thus imposing several challenges, including…

Federated learning (FL) is a distributed machine learning paradigm in which a large number of clients coordinate with a central server to learn a model without sharing their own training data. One central server is not enough, due to…

Federated learning (FL), as an emerging collaborative learning paradigm, has garnered significant attention due to its capacity to preserve privacy within distributed learning systems. In these systems, clients collaboratively train a…

机器学习 · 计算机科学 2024-05-29 Xi Zhu , Songcan Yu , Junbo Wang , Qinglin Yang

In this paper, the problem of federated learning (FL) through digital communication between clients and a parameter server (PS) over a multiple access channel (MAC), also subject to differential privacy (DP) constraints, is studied. More…

机器学习 · 计算机科学 2020-11-03 Amir Sonee , Stefano Rini

Compression schemes have been extensively used in Federated Learning (FL) to reduce the communication cost of distributed learning. While most approaches rely on a bounded variance assumption of the noise produced by the compressor, this…

机器学习 · 计算机科学 2023-11-01 Mahmoud Hegazy , Rémi Leluc , Cheuk Ting Li , Aymeric Dieuleveut

Federated Learning (FL) is a promising privacy-preserving distributed learning paradigm but suffers from high communication cost when training large-scale machine learning models. Sign-based methods, such as SignSGD…

机器学习 · 计算机科学 2023-02-07 Zhiwei Tang , Yanmeng Wang , Tsung-Hui Chang

Current data compression methods, such as sparsification in Federated Averaging (FedAvg), effectively enhance the communication efficiency of Federated Learning (FL). However, these methods encounter challenges such as the straggler problem…

分布式、并行与集群计算 · 计算机科学 2024-08-28 Zichen Tang , Junlin Huang , Rudan Yan , Yuxin Wang , Zhenheng Tang , Shaohuai Shi , Amelie Chi Zhou , Xiaowen Chu

Federated learning enables collaborative machine learning while preserving data privacy, but high communication and computation costs, exacerbated by statistical and device heterogeneity, limit its practicality in mobile edge computing.…

系统与控制 · 电气工程与系统科学 2025-10-30 Jinghong Tan , Zhichen Zhang , Kun Guo , Tsung-Hui Chang , Tony Q. S. Quek

Bayesian Federated Learning (FL) has been recently introduced to provide well-calibrated Machine Learning (ML) models quantifying the uncertainty of their predictions. Despite their advantages compared to frequentist FL setups, Bayesian FL…

机器学习 · 计算机科学 2024-05-12 Luca Barbieri , Stefano Savazzi , Monica Nicoli

In distributed target-tracking sensor networks, efficient data gathering methods are necessary to save communication resources and assure information accuracy. This paper proposes a Feedback (FB) distributed data-gathering method which lets…

系统与控制 · 电气工程与系统科学 2025-08-07 Hyeongmin Choe , SooJean Han