English
Related papers

Related papers: Bayesian Federated Model Compression for Communica…

200 papers

Federated learning (FL) scenarios inherently generate a large communication overhead by frequently transmitting neural network updates between clients and server. To minimize the communication cost, introducing sparsity in conjunction with…

Machine Learning · Computer Science 2022-04-12 Daniel Becking , Heiner Kirchhoffer , Gerhard Tech , Paul Haase , Karsten Müller , Heiko Schwarz , Wojciech Samek

Optimization-based techniques for federated learning (FL) often come with prohibitive communication cost, as high dimensional model parameters need to be communicated repeatedly between server and clients. In this paper, we follow a…

Machine Learning · Computer Science 2024-06-05 Tim d'Hondt , Mykola Pechenizkiy , Robert Peharz

Federated learning (FL for simplification) is a distributed machine learning technique that utilizes global servers and collaborative clients to achieve privacy-preserving global model training without direct data sharing. However,…

Machine Learning · Computer Science 2022-11-28 Mingjia Shi , Yuhao Zhou , Qing Ye , Jiancheng Lv

In this paper, a novel model-based distributed compressive sensing (DCS) algorithm is proposed. DCS exploits the inter-signal correlations and has the capability to jointly recover multiple sparse signals. Proposed approach is a Bayesian…

Signal Processing · Electrical Eng. & Systems 2020-10-19 Razieh Torkamani , Hadi Zayyani , Ramazan Ali Sadeghzadeh

The objective of Federated Learning (FL) is to perform statistical inference for data which are decentralised and stored locally on networked clients. FL raises many constraints which include privacy and data ownership, communication…

Machine Learning · Computer Science 2022-06-01 Maxime Vono , Vincent Plassier , Alain Durmus , Aymeric Dieuleveut , Eric Moulines

Federated learning (FL) is a promising paradigm to enable privacy-preserving deep learning from distributed data. Most previous works are based on federated average (FedAvg), which, however, faces several critical issues, including a high…

Machine Learning · Computer Science 2022-03-15 Lumin Liu , Jun Zhang , S. H. Song , Khaled B. Letaief

Federated learning (FL) enables a neural network (NN) to be trained using privacy-sensitive data on mobile devices while retaining all the data on their local storages. However, FL asks the mobile devices to perform heavy communication and…

Networking and Internet Architecture · Computer Science 2022-02-11 Sohei Itahara , Takayuki Nishio , Masahiro Morikura , Koji Yamamoto

Distributed learning, particularly Federated Learning (FL), faces a significant bottleneck in the communication cost, particularly the uplink transmission of client-to-server updates, which is often constrained by asymmetric bandwidth…

Machine Learning · Computer Science 2026-02-19 Tomas Ortega , Chun-Yin Huang , Xiaoxiao Li , Hamid Jafarkhani

Federated learning is a privacy-preserving approach to train a global model at a central server by collaborating with wireless devices, each with its own local training data set. In this paper, we present a compressive sensing approach for…

Signal Processing · Electrical Eng. & Systems 2020-08-06 Yo-Seb Jeon , Mohammad Mohammadi Amiri , Jun Li , H. Vincent Poor

Federated Learning (FL) solves many of this decade's concerns regarding data privacy and computation challenges. FL ensures no data leaves its source as the model is trained at where the data resides. However, FL comes with its own set of…

Machine Learning · Computer Science 2021-08-13 Srikanth Chandar , Pravin Chandran , Raghavendra Bhat , Avinash Chakravarthi

Federated learning (FL) is a new distributed machine learning framework that can achieve reliably collaborative training without collecting users' private data. However, due to FL's frequent communication and average aggregation strategy,…

Machine Learning · Computer Science 2022-08-30 Qing Wang , Jing Jin , Xiaofeng Liu , Huixuan Zong , Yunfeng Shao , Yinchuan Li

Federated learning (FL) is a promising and powerful approach for training deep learning models without sharing the raw data of clients. During the training process of FL, the central server and distributed clients need to exchange a vast…

Machine Learning · Computer Science 2021-04-27 Zhefeng Qiao , Xianghao Yu , Jun Zhang , Khaled B. Letaief

Federated Learning (FL) is a privacy-preserving distributed deep learning paradigm that involves substantial communication and computation effort, which is a problem for resource-constrained mobile and IoT devices. Model…

Machine Learning · Computer Science 2023-03-28 Xiaopeng Jiang , Cristian Borcea

Federated Learning (FL) involves training a model over a dataset distributed among clients, with the constraint that each client's dataset is localized and possibly heterogeneous. In FL, small and noisy datasets are common, highlighting the…

Machine Learning · Computer Science 2024-01-11 Mohsin Hasan , Guojun Zhang , Kaiyang Guo , Xi Chen , Pascal Poupart

Federated learning (FL) is a prevailing distributed learning paradigm, where a large number of workers jointly learn a model without sharing their training data. However, high communication costs could arise in FL due to large-scale (deep)…

Machine Learning · Computer Science 2021-06-15 Haibo Yang , Jia Liu , Elizabeth S. Bentley

Federated learning can enable remote workers to collaboratively train a shared machine learning model while allowing training data to be kept locally. In the use case of wireless mobile devices, the communication overhead is a critical…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-11 Kai Yue , Richeng Jin , Chau-Wai Wong , Huaiyu Dai

Federated learning methods enable model training across distributed data sources without data leaving their original locations and have gained increasing interest in various fields. However, existing approaches are limited, excluding many…

Machine Learning · Statistics 2023-07-10 Conor Hassan , Robert Salomone , Kerrie Mengersen

Identifying predictive factors for an outcome of interest via a multivariable analysis is often difficult when the data set is small. Combining data from different medical centers into a single (larger) database would alleviate this…

Applications · Statistics 2024-03-12 Marianne A. Jonker , Hassan Pazira , Anthony CC Coolen

Recent advances in machine learning, wireless communication, and mobile hardware technologies promisingly enable federated learning (FL) over massive mobile edge devices, which opens new horizons for numerous intelligent mobile…

Machine Learning · Computer Science 2020-12-23 Liang Li , Dian Shi , Ronghui Hou , Hui Li , Miao Pan , Zhu Han

For many practical applications in wireless communications, we need to recover a structured sparse signal from a linear observation model with dynamic grid parameters in the sensing matrix. Conventional expectation maximization (EM)-based…

Signal Processing · Electrical Eng. & Systems 2023-11-14 Wenkang Xu , An Liu , Bingpeng Zhou , Minjian Zhao