中文
相关论文

相关论文: Adaptive Gradient Sparsification for Efficient Fed…

200 篇论文

In cross-device Federated Learning (FL), clients with low computational power train a common\linebreak[4] machine model by exchanging parameters via updates instead of potentially private data. Federated Dropout (FD) is a technique that…

机器学习 · 计算机科学 2022-09-16 Giacomo Verardo , Daniel Barreira , Marco Chiesa , Dejan Kostic , Gerald Q. Maguire

Federated learning (FL) enables workers to learn a model collaboratively by using their local data, with the help of a parameter server (PS) for global model aggregation. The high communication cost for periodic model updates and the…

信息论 · 计算机科学 2019-11-04 Yuxuan Sun , Sheng Zhou , Deniz Gündüz

In federated distributed learning, the goal is to optimize a global training objective defined over distributed devices, where the data shard at each device is sampled from a possibly different distribution (a.k.a., heterogeneous or non…

机器学习 · 计算机科学 2019-12-10 Farzin Haddadpour , Mehrdad Mahdavi

In Federated Learning (FL) client devices connected over the internet collaboratively train a machine learning model without sharing their private data with a central server or with other clients. The seminal Federated Averaging (FedAvg)…

机器学习 · 计算机科学 2023-05-17 Jed Mills , Jia Hu , Geyong Min

Federated Learning (FL) is a promising distributed method for edge-level machine learning, particularly for privacysensitive applications such as those in military and medical domains, where client data cannot be shared or transferred to a…

机器学习 · 计算机科学 2024-06-27 Lucas Grativol Ribeiro , Mathieu Leonardon , Guillaume Muller , Virginie Fresse , Matthieu Arzel

Federated learning (FL) has emerged as a widely adopted training paradigm for privacy-preserving machine learning. While the SGD-based FL algorithms have demonstrated considerable success in the past, there is a growing trend towards…

机器学习 · 计算机科学 2024-07-29 Yujia Wang , Shiqiang Wang , Songtao Lu , Jinghui Chen

We propose a novel, efficient approach for distributed sparse learning in high-dimensions, where observations are randomly partitioned across machines. Computationally, at each round our method only requires the master machine to solve a…

机器学习 · 统计学 2016-05-26 Jialei Wang , Mladen Kolar , Nathan Srebro , Tong Zhang

Communication of model updates between client nodes and the central aggregating server is a major bottleneck in federated learning, especially in bandwidth-limited settings and high-dimensional models. Gradient quantization is an effective…

机器学习 · 计算机科学 2021-02-10 Divyansh Jhunjhunwala , Advait Gadhikar , Gauri Joshi , Yonina C. Eldar

Federated learning (FL) is a heavily promoted approach for training ML models on sensitive data, e.g., text typed by users on their smartphones. FL is expressly designed for training on data that are unbalanced and non-iid across the…

机器学习 · 计算机科学 2022-03-07 Tao Yu , Eugene Bagdasaryan , Vitaly Shmatikov

A very large number of communications are typically required to solve distributed learning tasks, and this critically limits scalability and convergence speed in wireless communications applications. In this paper, we devise a Gradient…

机器学习 · 计算机科学 2022-02-08 Yicheng Chen , Rick S. Blum , Martin Takac , Brian M. Sadler

Federated learning (FL), as an emerging collaborative learning paradigm, has garnered significant attention due to its capacity to preserve privacy within distributed learning systems. In these systems, clients collaboratively train a…

机器学习 · 计算机科学 2024-05-29 Xi Zhu , Songcan Yu , Junbo Wang , Qinglin Yang

Federated learning (FL) has emerged as a prominent method for collaboratively training machine learning models using local data from edge devices, all while keeping data decentralized. However, accounting for the quality of data contributed…

机器学习 · 计算机科学 2024-09-05 Haoyuan Li , Mathias Funk , Nezihe Merve Gürel , Aaqib Saeed

Federated Learning (FL) is a distributed learning approach that trains machine learning models across multiple devices while keeping their local data private. However, FL often faces challenges due to data heterogeneity, leading to…

机器学习 · 计算机科学 2025-10-21 Dun Zeng , Zheshun Wu , Shiyu Liu , Yu Pan , Xiaoying Tang , Zenglin Xu

Over the past few years, Federated Learning (FL) has become a popular distributed machine learning paradigm. FL involves a group of clients with decentralized data who collaborate to learn a common model under the coordination of a…

分布式、并行与集群计算 · 计算机科学 2024-05-21 Jieming Bian , Lei Wang , Kun Yang , Cong Shen , Jie Xu

We propose a new optimization formulation for training federated learning models. The standard formulation has the form of an empirical risk minimization problem constructed to find a single global model trained from the private data stored…

机器学习 · 计算机科学 2021-02-15 Filip Hanzely , Peter Richtárik

Federated learning has emerged in the last decade as a distributed optimization paradigm due to the rapidly increasing number of portable devices able to support the heavy computational needs related to the training of machine learning…

机器学习 · 计算机科学 2024-10-10 Emanuel Buttaci , Giuseppe Carlo Calafiore

Federated learning (FL) is a powerful distributed machine learning framework where a server aggregates models trained by different clients without accessing their private data. Hierarchical FL, with a client-edge-cloud aggregation…

机器学习 · 计算机科学 2023-01-10 Lumin Liu , Jun Zhang , Shenghui Song , Khaled B. Letaief

Modern large scale machine learning applications require stochastic optimization algorithms to be implemented on distributed computational architectures. A key bottleneck is the communication overhead for exchanging information such as…

机器学习 · 计算机科学 2017-10-31 Jianqiao Wangni , Jialei Wang , Ji Liu , Tong Zhang

Federated learning (FL) is a popular distributed machine learning (ML) paradigm, but is often limited by significant communication costs and edge device computation capabilities. Federated Split Learning (FSL) preserves the parallel model…

信息论 · 计算机科学 2023-02-14 Yujia Mu , Cong Shen

One of the biggest challenges in Federated Learning (FL) is that client devices often have drastically different computation and communication resources for local updates. To this end, recent research efforts have focused on training…

机器学习 · 计算机科学 2022-02-10 Hanhan Zhou , Tian Lan , Guru Venkataramani , Wenbo Ding