English
Related papers

Related papers: Bayesian Federated Model Compression for Communica…

200 papers

Federated Learning (FL) enables participant devices to collaboratively train deep learning models without sharing their data with the server or other devices, effectively addressing data privacy and computational concerns. However, FL faces…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-30 Asadullah Tariq , Tariq Qayyum , Mohamed Adel Serhani , Farag Sallabi , Ikbal Taleb , Ezedin S. Barka

Federated learning (FL) is a privacy-preserving collaborative learning framework, and differential privacy can be applied to further enhance its privacy protection. Existing FL systems typically adopt Federated Average (FedAvg) as the…

Machine Learning · Computer Science 2023-08-08 Lumin Liu , Jun Zhang , Shenghui Song , Khaled B. Letaief

This study develops a federated learning (FL) framework overcoming largely incremental communication costs due to model sizes in typical frameworks without compromising model performance. To this end, based on the idea of leveraging an…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-07 Sohei Itahara , Takayuki Nishio , Yusuke Koda , Masahiro Morikura , Koji Yamamoto

Federated learning (FL), which has gained increasing attention recently, enables distributed devices to train a common machine learning (ML) model for intelligent inference cooperatively without data sharing. However, problems in practical…

Machine Learning · Computer Science 2022-11-01 Yujie Zhou , Zhidu Li , Tong Tang , Ruyan Wang

This paper proposes a fusion-based cooperative support identification scheme for distributed compressive sparse signal recovery via resource-constrained wireless sensor networks. The proposed support identification protocol involves: (i)…

Information Theory · Computer Science 2019-07-09 Ming-Hsun Yang , Jwo-Yuh Wu , Tsang-Yi Wang , Robert G. Maunder , Rung-Hung Gau

Model compression is important in federated learning (FL) with large models to reduce communication cost. Prior works have been focusing on sparsification based compression that could desparately affect the global model accuracy. In this…

Machine Learning · Computer Science 2022-04-05 Shengyuan Hu , Jack Goetz , Kshitiz Malik , Hongyuan Zhan , Zhe Liu , Yue Liu

For distributed learning among collaborative users, this paper develops and analyzes a communication-efficient scheme for federated learning (FL) over the air, which incorporates 1-bit compressive sensing (CS) into analog aggregation…

Machine Learning · Computer Science 2021-03-31 Xin Fan , Yue Wang , Yan Huo , Zhi Tian

Learning over massive data stored in different locations is essential in many real-world applications. However, sharing data is full of challenges due to the increasing demands of privacy and security with the growing use of smart mobile…

Machine Learning · Computer Science 2022-10-11 Jinjin Xu , Wenli Du , Ran Cheng , Wangli He , Yaochu Jin

Many common types of data can be represented as functions that map coordinates to signal values, such as pixel locations to RGB values in the case of an image. Based on this view, data can be compressed by overfitting a compact neural…

Machine Learning · Computer Science 2023-10-31 Zongyu Guo , Gergely Flamich , Jiajun He , Zhibo Chen , José Miguel Hernández-Lobato

Decentralized federated learning (DFL) is a promising machine learning paradigm for bringing artificial intelligence (AI) capabilities to the network edge. Running DFL on top of edge networks, however, faces severe performance challenges…

Networking and Internet Architecture · Computer Science 2025-04-22 Tingyang Sun , Tuan Nguyen , Ting He

Federated Learning (FL) is a well-known framework for successfully performing a learning task in an edge computing scenario where the devices involved have limited resources and incomplete data representation. The basic assumption of FL is…

Machine Learning · Computer Science 2023-12-08 Lorenzo Valerio , Chiara Boldrini , Andrea Passarella , János Kertész , Márton Karsai , Gerardo Iñiguez

Federated learning (FL) is an emerging machine learning paradigm for training models across multiple edge devices holding local data sets, without explicitly exchanging the data. Recently, over-the-air (OTA) FL has been suggested to reduce…

Signal Processing · Electrical Eng. & Systems 2023-03-31 Tomer Gafni , Kobi Cohen , Yonina C. Eldar

This study addresses the problem of discrete signal reconstruction from the perspective of sparse Bayesian learning (SBL). Generally, it is intractable to perform the Bayesian inference with the ideal discretization prior under the SBL…

Signal Processing · Electrical Eng. & Systems 2023-04-19 Jisheng Dai , An Liu , Hing Cheung So

Compressing large-scale neural networks is essential for deploying models on resource-constrained devices. Most existing methods adopt weight pruning or low-bit quantization individually, often resulting in suboptimal compression rates to…

Machine Learning · Computer Science 2025-10-13 Ziyi Wang , Nan Jiang , Guang Lin , Qifan Song

In this paper, the problem of delay minimization for federated learning (FL) over wireless communication networks is investigated. In the considered model, each user exploits limited local computational resources to train a local FL model…

Signal Processing · Electrical Eng. & Systems 2020-07-08 Zhaohui Yang , Mingzhe Chen , Walid Saad , Choong Seon Hong , Mohammad Shikh-Bahaei , H. Vincent Poor , Shuguang Cui

Federated Learning (FL) incurs high communication overhead, which can be greatly alleviated by compression for model updates. Yet the tradeoff between compression and model accuracy in the networked environment remains unclear and, for…

Machine Learning · Computer Science 2021-12-14 Laizhong Cui , Xiaoxin Su , Yipeng Zhou , Jiangchuan Liu

Emerging real-time computer vision (CV) applications on wireless edge devices demand energy-efficient and privacy-preserving learning. Federated learning (FL) enables on-device training without raw data sharing, yet remains challenging in…

Machine Learning · Computer Science 2025-08-05 Xiangwang Hou , Jingjing Wang , Fangming Guan , Jun Du , Chunxiao Jiang , Yong Ren

Histopathological tissue classification is a fundamental task in computational pathology. Deep learning-based models have achieved superior performance but centralized training with data centralization suffers from the privacy leakage…

Image and Video Processing · Electrical Eng. & Systems 2023-12-19 Tianpeng Deng , Yanqi Huang , Guoqiang Han , Zhenwei Shi , Jiatai Lin , Qi Dou , Zaiyi Liu , Xiao-jing Guo , C. L. Philip Chen , Chu Han

Federated learning (FL) enables the training of a model leveraging decentralized data in client sites while preserving privacy by not collecting data. However, one of the significant challenges of FL is limited computation and low…

Machine Learning · Computer Science 2023-04-18 Riyasat Ohib , Bishal Thapaliya , Pratyush Gaggenapalli , Jingyu Liu , Vince Calhoun , Sergey Plis

Second-order federated learning (FL) algorithms offer faster convergence than their first-order counterparts by leveraging curvature information. However, they are hindered by high computational and storage costs, particularly for…

Machine Learning · Computer Science 2025-01-15 Abdulmomen Ghalkha , Chaouki Ben Issaid , Mehdi Bennis