English
Related papers

Related papers: Time-Correlated Sparsification for Communication-E…

200 papers

This paper proposes a federated learning technique for deep algorithm unfolding with applications to sparse signal recovery and compressed sensing. We refer to this architecture as Fed-CS. Specifically, we unfold and learn the iterative…

Signal Processing · Electrical Eng. & Systems 2020-10-27 Komal Krishna Mogilipalepu , Sumanth Kumar Modukuri , Amarlingam Madapu , Sundeep Prabhakar Chepuri

Federated learning (FL) has recently emerged as an attractive decentralized solution for wireless networks to collaboratively train a shared model while keeping data localized. As a general approach, existing FL methods tend to assume…

Machine Learning · Computer Science 2021-04-02 Francesco Pase , Marco Giordani , Michele Zorzi

Federated learning (FL) is a machine learning paradigm that targets model training without gathering the local data dispersed over various data sources. Standard FL, which employs a single server, can only support a limited number of users,…

Machine Learning · Computer Science 2024-02-29 Bin Wang , Jun Fang , Hongbin Li , Yonina C. Eldar

Federated Learning (FL) is a collaborative machine learning technique to train a global model without obtaining clients' private data. The main challenges in FL are statistical diversity among clients, limited computing capability among…

Machine Learning · Computer Science 2023-03-07 Xiaofeng Liu , Yinchuan Li , Qing Wang , Xu Zhang , Yunfeng Shao , Yanhui Geng

Federated learning (FL) is a machine learning approach where nodes collaboratively train a global model. As more nodes participate in a round of FL, the effectiveness of individual model updates by nodes also diminishes. In this study, we…

Machine Learning · Computer Science 2025-03-12 Akash Dhasade , Anne-Marie Kermarrec , Tuan-Anh Nguyen , Rafael Pires , Martijn de Vos

Federated learning (FL) is a collaborative approach where multiple clients, coordinated by a parameter server (PS), train a unified machine-learning model. The approach, however, suffers from two key challenges: data heterogeneity and…

Machine Learning · Computer Science 2024-10-30 Matin Mortaheb , Priyanka Kaswan , Sennur Ulukus

Federated Learning (FL), a privacy-oriented distributed ML paradigm, is being gaining great interest in Internet of Things because of its capability to protect participants data privacy. Studies have been conducted to address challenges…

Cryptography and Security · Computer Science 2023-06-08 Jianhua Wang , Xiaolin Chang , Jelena Mišić , Vojislav B. Mišić , Lin Li , Yingying Yao

In a real federated learning (FL) system, communication overhead for passing model parameters between the clients and the parameter server (PS) is often a bottleneck. Hierarchical federated learning (HFL) that poses multiple edge servers…

Machine Learning · Computer Science 2024-08-20 Xingrun Yan , Shiyuan Zuo , Rongfei Fan , Han Hu , Li Shen , Puning Zhao , Yong Luo

Federated learning (FL) literature typically assumes that each client has a fixed amount of data, which is unrealistic in many practical applications. Some recent works introduced a framework for online FL (Online-Fed) wherein clients…

Machine Learning · Computer Science 2021-10-14 Vinay Chakravarthi Gogineni , Stefan Werner , Yih-Fang Huang , Anthony Kuh

There are situations where data relevant to machine learning problems are distributed across multiple locations that cannot share the data due to regulatory, competitiveness, or privacy reasons. Machine learning approaches that require data…

Machine Learning · Computer Science 2022-06-28 Dimitris Stripelis , Jose Luis Ambite

This work presents a new method for enhancing communication efficiency in stochastic Federated Learning that trains over-parameterized random networks. In this setting, a binary mask is optimized instead of the model weights, which are kept…

Machine Learning · Computer Science 2024-03-01 Mohamad Mestoukirdi , Omid Esrafilian , David Gesbert , Qianrui Li , Nicolas Gresset

Federated learning (FL) is an appealing approach to training machine learning models without sharing raw data. However, standard FL algorithms are iterative and thus induce a significant communication cost. One-shot federated learning (OFL)…

One main challenge in federated learning is the large communication cost of exchanging weight updates from clients to the server at each round. While prior work has made great progress in compressing the weight updates through gradient…

Machine Learning · Computer Science 2023-02-10 Berivan Isik , Francesco Pase , Deniz Gunduz , Tsachy Weissman , Michele Zorzi

In Federated Learning (FL) paradigm, a parameter server (PS) concurrently communicates with distributed participating clients for model collection, update aggregation, and model distribution over multiple rounds, without touching private…

Machine Learning · Computer Science 2024-02-07 Xiaoxin Su , Yipeng Zhou , Laizhong Cui , John C. S. Lui , Jiangchuan Liu

Statistical heterogeneity across clients in a Federated Learning (FL) system increases the algorithm convergence time and reduces the generalization performance, resulting in a large communication overhead in return for a poor model. To…

Machine Learning · Computer Science 2023-04-26 Mohamad Mestoukirdi , Matteo Zecchin , David Gesbert , Qianrui Li

In Federated Learning (FL), both client resource constraints and communication costs pose major problems for training large models. In the centralized setting, sparse training addresses resource constraints, while in the distributed…

Machine Learning · Computer Science 2025-03-03 Georg Meinhardt , Kai Yi , Laurent Condat , Peter Richtárik

In this paper, a new communication-efficient federated learning (FL) framework is proposed, inspired by vector quantized compressed sensing. The basic strategy of the proposed framework is to compress the local model update at each device…

Information Theory · Computer Science 2023-07-04 Yongjeong Oh , Yo-Seb Jeon , Mingzhe Chen , Walid Saad

Federated learning (FL) is a popular distributed machine learning (ML) paradigm, but is often limited by significant communication costs and edge device computation capabilities. Federated Split Learning (FSL) preserves the parallel model…

Information Theory · Computer Science 2023-02-14 Yujia Mu , Cong Shen

Recently, federated learning (FL) has sparked widespread attention as a promising decentralized machine learning approach which provides privacy and low delay. However, communication bottleneck still constitutes an issue, that needs to be…

Signal Processing · Electrical Eng. & Systems 2022-03-14 Pavlos S. Bouzinis , Panagiotis D. Diamantoulakis , George K. Karagiannidis

In this paper, a communication-efficient federated learning (FL) framework is proposed for improving the convergence rate of FL under a limited uplink capacity. The central idea of the proposed framework is to transmit the values and…

Signal Processing · Electrical Eng. & Systems 2023-07-21 Jaewon Yun , Yongjeong Oh , Yo-Seb Jeon , H. Vincent Poor