English
Related papers

Related papers: Communication-Efficient and Personalized Federated…

200 papers

Federated learning (FL) is a privacy-preserving machine learning setting that enables many devices to jointly train a shared global model without the need to reveal their data to a central server. However, FL involves a frequent exchange of…

Machine Learning · Computer Science 2021-10-07 Yuzhi Yang , Zhaoyang Zhang , Qianqian Yang

The lottery ticket hypothesis proposes that over-parameterization of deep neural networks (DNNs) aids training by increasing the probability of a "lucky" sub-network initialization being present rather than by helping the optimization…

Machine Learning · Statistics 2020-02-27 Haonan Yu , Sergey Edunov , Yuandong Tian , Ari S. Morcos

We study federated learning (FL), which enables mobile devices to utilize their local datasets to collaboratively train a global model with the help of a central server, while keeping data localized. At each iteration, the server broadcasts…

Information Theory · Computer Science 2020-10-08 Mohammad Mohammadi Amiri , Deniz Gunduz , Sanjeev R. Kulkarni , H. Vincent Poor

Federated learning is a method of training a global model from decentralized data distributed across client devices. Here, model parameters are computed locally by each client device and exchanged with a central server, which aggregates the…

Machine Learning · Computer Science 2020-12-23 Sagar Dhakal , Saurav Prakash , Yair Yona , Shilpa Talwar , Nageen Himayat

Pruning is a standard technique for reducing the computational cost of deep networks. Many advances in pruning leverage concepts from the Lottery Ticket Hypothesis (LTH). LTH reveals that inside a trained dense network exists sparse…

Machine Learning · Computer Science 2024-03-20 Artur Jordao , George Correa de Araujo , Helena de Almeida Maia , Helio Pedrini

Federated learning (FL) has received a surge of interest in recent years thanks to its benefits in data privacy protection, efficient communication, and parallel data processing. Also, with appropriate algorithmic designs, one could achieve…

Machine Learning · Computer Science 2022-08-19 Xin Zhang , Minghong Fang , Zhuqing Liu , Haibo Yang , Jia Liu , Zhengyuan Zhu

Federated learning (FL) is a novel distributed machine learning paradigm that enables participants to collaboratively train a centralized model with privacy preservation by eliminating the requirement of data sharing. In practice, FL often…

Machine Learning · Computer Science 2024-03-05 Wei Guo , Fuzhen Zhuang , Xiao Zhang , Yiqi Tong , Jin Dong

Federated learning (FL) is a distributed machine learning technique in which multiple clients cooperate to train a shared model without exchanging their raw data. However, heterogeneity of data distribution among clients usually leads to…

Machine Learning · Computer Science 2023-03-23 Yu Qiao , Seong-Bae Park , Sun Moo Kang , Choong Seon Hong

Federated learning (FL) is a framework for machine learning across heterogeneous client devices in a privacy-preserving fashion. To date, most FL algorithms learn a "global" server model across multiple rounds. At each round, the same…

Machine Learning · Computer Science 2022-08-22 Zachary Charles , Kallista Bonawitz , Stanislav Chiknavaryan , Brendan McMahan , Blaise Agüera y Arcas

Federated Learning (FL) is known to perform Machine Learning tasks in a distributed manner. Over the years, this has become an emerging technology especially with various data protection and privacy policies being imposed FL allows…

Machine Learning · Computer Science 2021-07-26 Osama Shahid , Seyedamin Pouriyeh , Reza M. Parizi , Quan Z. Sheng , Gautam Srivastava , Liang Zhao

The paper considers independent reinforcement learning (IRL) for multi-agent decision-making process in the paradigm of federated learning (FL). We show that FL can clearly improve the policy performance of IRL in terms of training…

Machine Learning · Computer Science 2022-02-01 Xing Xu , Rongpeng Li , Zhifeng Zhao , Honggang Zhang

The lottery ticket hypothesis (Frankle and Carbin, 2018), states that a randomly-initialized network contains a small subnetwork such that, when trained in isolation, can compete with the performance of the original network. We prove an…

Machine Learning · Computer Science 2020-02-04 Eran Malach , Gilad Yehudai , Shai Shalev-Shwartz , Ohad Shamir

Federated learning (FL) is an effective paradigm for enhancing the learning capability of edge devices while preserving data privacy. In geographically dispersed FL systems, such as sensor networks in remote areas, unmanned aerial vehicles…

Machine Learning · Computer Science 2026-05-26 Shiqian Guo , Jianqing Liu , Beatriz Lorenzo

Federated learning~(FL) facilitates the training and deploying AI models on edge devices. Preserving user data privacy in FL introduces several challenges, including expensive communication costs, limited resources, and data heterogeneity.…

Machine Learning · Computer Science 2022-08-29 Sixing Yu , Phuong Nguyen , Waqwoya Abebe , Wei Qian , Ali Anwar , Ali Jannesari

Federated Learning (FL) is a collaborative machine learning (ML) framework that combines on-device training and server-based aggregation to train a common ML model among distributed agents. In this work, we propose an asynchronous FL design…

Machine Learning · Computer Science 2025-12-04 Chung-Hsuan Hu , Zheng Chen , Erik G. Larsson

According to the Strong Lottery Ticket Hypothesis, every sufficiently large neural network with randomly initialized weights contains a sub-network which - still with its random weights - already performs as well for a given task as the…

Neural and Evolutionary Computing · Computer Science 2024-11-08 Philipp Altmann , Julian Schönberger , Maximilian Zorn , Thomas Gabor

With graphs rapidly growing in size and deeper graph neural networks (GNNs) emerging, the training and inference of GNNs become increasingly expensive. Existing network weight pruning algorithms cannot address the main space and…

Machine Learning · Computer Science 2021-06-08 Tianlong Chen , Yongduo Sui , Xuxi Chen , Aston Zhang , Zhangyang Wang

Federated learning (FL) is a promising technique that enables a large amount of edge computing devices to collaboratively train a global learning model. Due to privacy concerns, the raw data on devices could not be available for centralized…

Machine Learning · Computer Science 2020-11-24 Miao Yang , Akitanoshou Wong , Hongbin Zhu , Haifeng Wang , Hua Qian

Graph learning methods help utilize implicit relationships among data items, thereby reducing training label requirements and improving task performance. However, determining the optimal graph structure for a particular learning task…

Machine Learning · Computer Science 2023-12-11 Anton Tsitsulin , Bryan Perozzi

Quantization is an essential technique for making neural networks more efficient, yet our theoretical understanding of it remains limited. Previous works demonstrated that extremely low-precision networks, such as binary networks, can be…

Machine Learning · Computer Science 2025-08-18 Aakash Kumar , Emanuele Natale