English
Related papers

Related papers: A Compressive Sensing Approach for Federated Learn…

200 papers

Compressed sensing (CS) provides an elegant framework for recovering sparse signals from compressed measurements. For example, CS can exploit the structure of natural images and recover an image from only a few random measurements. CS is…

Machine Learning · Computer Science 2019-05-21 Yan Wu , Mihaela Rosca , Timothy Lillicrap

Communicating information, like gradient vectors, between computing nodes in distributed and federated learning is typically an unavoidable burden, resulting in scalability issues. Indeed, communication might be slow and costly. Recent…

Machine Learning · Computer Science 2020-10-08 Alyazeed Albasyoni , Mher Safaryan , Laurent Condat , Peter Richtárik

Compressed sensing can increase resolution, and decrease electron dose and scan time of electron microscope point-scan systems with minimal information loss. Building on a history of successful deep learning applications in compressed…

Image and Video Processing · Electrical Eng. & Systems 2019-10-28 Jeffrey M. Ede

Federated learning (FL) is an emerging machine learning paradigm that allows to accomplish model training without aggregating data at a central server. Most studies on FL consider a centralized framework, in which a single server is endowed…

Machine Learning · Computer Science 2023-03-22 Bin Wang , Jun Fang , Hongbin Li , Xiaojun Yuan , Qing Ling

We discuss a federated learned compression problem, where the goal is to learn a compressor from real-world data which is scattered across clients and may be statistically heterogeneous, yet share a common underlying representation. We…

Machine Learning · Computer Science 2023-05-29 Eric Lei , Hamed Hassani , Shirin Saeedi Bidokhti

With its privacy preservation and communication efficiency, federated learning (FL) has emerged as a learning framework that suits beyond 5G and towards 6G systems. This work looks into a future scenario in which there are multiple groups…

Information Theory · Computer Science 2021-10-19 Tung T. Vu , Hien Quoc Ngo , Duy T. Ngo , Minh N Dao , Erik G. Larsson

In this paper, a communication-efficient federated learning (FL) framework is proposed for improving the convergence rate of FL under a limited uplink capacity. The central idea of the proposed framework is to transmit the values and…

Signal Processing · Electrical Eng. & Systems 2023-07-21 Jaewon Yun , Yongjeong Oh , Yo-Seb Jeon , H. Vincent Poor

The communication bottleneck of over-the-air federated learning (OA-FL) lies in uploading the gradients of local learning models. In this paper, we study the reduction of the communication overhead in the gradients uploading by using the…

Signal Processing · Electrical Eng. & Systems 2023-04-11 Chenxi Zhong , Xiaojun Yuan

Federated learning is a distributed machine learning framework which enables different parties to collaboratively train a model while protecting data privacy and security. Due to model complexity, network unreliability and connection…

Machine Learning · Computer Science 2020-04-08 Anbu Huang , Yuanyuan Chen , Yang Liu , Tianjian Chen , Qiang Yang

Federated learning (FL) is a privacy-preserving distributed machine learning paradigm that operates at the wireless edge. It enables clients to collaborate on model training while keeping their data private from adversaries and the central…

Machine Learning · Computer Science 2023-06-06 Wayne Lemieux , Raphael Pinard , Mitra Hassani

In compressive sensing, a small collection of linear projections of a sparse signal contains enough information to permit signal recovery. Distributed compressive sensing (DCS) extends this framework by defining ensemble sparsity models,…

Information Theory · Computer Science 2013-03-29 Marco F. Duarte , Michael B. Wakin , Dror Baron , Shriram Sarvotham , Richard G. Baraniuk

In federated learning, a server must periodically broadcast a model to the agents. We propose to use multi-resolution coding and modulation (also known as non-uniform modulation) for this purpose. In the simplest instance, broadcast…

Networking and Internet Architecture · Computer Science 2024-05-31 Henrik Rydén , Reza Moosavi , Erik G. Larsson

Reducing communication overhead in federated learning (FL) is challenging but crucial for large-scale distributed privacy-preserving machine learning. While methods utilizing sparsification or others can largely lower the communication…

Machine Learning · Computer Science 2023-03-21 Yuhao Zhou , Mingjia Shi , Yuanxi Li , Qing Ye , Yanan Sun , Jiancheng Lv

We propose a new approach for metric learning by framing it as learning a sparse combination of locally discriminative metrics that are inexpensive to generate from the training data. This flexible framework allows us to naturally derive…

Machine Learning · Computer Science 2019-01-25 Yuan Shi , Aurélien Bellet , Fei Sha

Federated learning is a paradigm that enables local devices to jointly train a server model while keeping the data decentralized and private. In federated learning, since local data are collected by clients, it is hardly guaranteed that the…

Machine Learning · Computer Science 2022-03-01 Seunghan Yang , Hyoungseob Park , Junyoung Byun , Changick Kim

This paper addresses the classical problem of one-bit compressed sensing using a deep learning-based reconstruction algorithm that leverages a trained generative model to enhance the signal reconstruction performance. The generator, a…

Machine Learning · Computer Science 2025-02-19 Swatantra Kafle , Geethu Joseph , Pramod K. Varshney

Compressive sensing has been successfully used for optimized operations in wireless sensor networks. However, raw data collected by sensors may be neither originally sparse nor easily transformed into a sparse data representation. This…

Networking and Internet Architecture · Computer Science 2016-08-16 Mohammad Abu Alsheikh , Shaowei Lin , Hwee-Pink Tan , Dusit Niyato

This extended abstract explores the integration of federated learning with deep transfer hashing for distributed prediction tasks, emphasizing resource-efficient client training from evolving data streams. Federated learning allows multiple…

Machine Learning · Computer Science 2024-09-20 Manuel Röder , Frank-Michael Schleif

Federated learning (FL) is a novel machine learning setting that enables on-device intelligence via decentralized training and federated optimization. Deep neural networks' rapid development facilitates the learning techniques for modeling…

Machine Learning · Computer Science 2021-09-27 Shaoxiong Ji , Wenqi Jiang , Anwar Walid , Xue Li

Statistical and systematic challenges in collaboratively training machine learning models across distributed networks of mobile devices have been the bottlenecks in the real-world application of federated learning. In this work, we show…

Machine Learning · Computer Science 2019-12-17 Fei Chen , Mi Luo , Zhenhua Dong , Zhenguo Li , Xiuqiang He