English
Related papers

Related papers: Federated Learning over Wireless Fading Channels

200 papers

In this paper, we study communication-efficient distributed stochastic gradient descent (SGD) with data sets of users distributed over a certain area and communicating through wireless channels. Since the time for one iteration in the…

Information Theory · Computer Science 2021-05-21 Jinho Choi

We study federated edge learning (FEEL), where wireless edge devices, each with its own dataset, learn a global model collaboratively with the help of a wireless access point acting as the parameter server (PS). At each iteration, wireless…

Information Theory · Computer Science 2020-10-21 Mohammad Mohammadi Amiri , Tolga M. Duman , Deniz Gunduz , Sanjeev R. Kulkarni , H. Vincent Poor

We consider the problem of minimizing the convergence time for decentralized federated learning (DFL) in wireless networks under broadcast communications, with focus on mixing matrix design. The mixing matrix is a critical hyperparameter…

Machine Learning · Computer Science 2026-04-20 Tuan Nguyen , Ting He

Distributed Deep Learning (DDL) is essential for large-scale Deep Learning (DL) training. Synchronous Stochastic Gradient Descent (SSGD) 1 is the de facto DDL optimization method. Using a sufficiently large batch size is critical to…

Machine Learning · Computer Science 2021-12-03 Wei Zhang , Mingrui Liu , Yu Feng , Xiaodong Cui , Brian Kingsbury , Yuhai Tu

Federated learning (FL) is a promising technique that enables many edge devices to train a machine learning model collaboratively in wireless networks. By exploiting the superposition nature of wireless waveforms, over-the-air computation…

Signal Processing · Electrical Eng. & Systems 2020-11-26 Naifu Zhang , Meixia Tao

Training generative adversarial networks (GAN) in a distributed fashion is a promising technology since it is contributed to training GAN on a massive of data efficiently in real-world applications. However, GAN is known to be difficult to…

Machine Learning · Computer Science 2020-10-27 Xiaojun Chen , Shu Yang , Li Shen , Xuanrong Pang

To satisfy the expected plethora of computation-heavy applications, federated edge learning (FEEL) is a new paradigm featuring distributed learning to carry the capacities of low-latency and privacy-preserving. To further improve the…

Systems and Control · Electrical Eng. & Systems 2022-12-02 Jun Du , Bingqing Jiang , Chunxiao Jiang , Yuanming Shi , Zhu Han

We study federated edge learning, where a global model is trained collaboratively using privacy-sensitive data at the edge of a wireless network. A parameter server (PS) keeps track of the global model and shares it with the wireless edge…

Information Theory · Computer Science 2021-07-09 Mohammad Mohammadi Amiri , Sanjeev R. Kulkarni , H. Vincent Poor

To enable wireless federated learning (FL) in communication resource-constrained networks, two communication schemes, i.e., digital and analog ones, are effective solutions. In this paper, we quantitatively compare these two techniques,…

Information Theory · Computer Science 2024-05-29 Jiacheng Yao , Wei Xu , Zhaohui Yang , Xiaohu You , Mehdi Bennis , H. Vincent Poor

The performance of federated learning (FL) over wireless networks critically depends on accurate and timely channel state information (CSI) across distributed devices. This requirement is tightly linked to how rapidly the channel gains…

Information Theory · Computer Science 2025-10-31 Mehdi Karbalayghareh , David J. Love , Christopher G. Brinton

In this paper, we present a communication-efficient federated learning framework inspired by quantized compressed sensing. The presented framework consists of gradient compression for wireless devices and gradient reconstruction for a…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-01 Yongjeong Oh , Namyoon Lee , Yo-Seb Jeon , H. Vincent Poor

This paper presents distributed conjugate gradient algorithms for distributed parameter estimation and spectrum estimation over wireless sensor networks. In particular, distributed conventional conjugate gradient (CCG) and modified…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-01-19 R. C. de Lamare

Wireless traffic prediction plays an indispensable role in cellular networks to achieve proactive adaptation for communication systems. Along this line, Federated Learning (FL)-based wireless traffic prediction at the edge attracts enormous…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-03 Chuanting Zhang , Haixia Zhang , Shuping Dang , Basem Shihada , Mohamed-Slim Alouini

Federated learning (FL) encounters scalability challenges when implemented over fog networks that do not follow FL's conventional star topology architecture. Semi-decentralized FL (SD-FL) has proposed a solution for device-to-device (D2D)…

Networking and Internet Architecture · Computer Science 2026-03-17 Evan Chen , Shiqiang Wang , Christopher G. Brinton

Federated Learning (FL) in mobile environments faces significant communication bottlenecks. Gradient compression has proven as an effective solution to this issue, offering substantial benefits in environments with limited bandwidth and…

Machine Learning · Computer Science 2024-11-26 Rongwei Lu , Yutong Jiang , Yinan Mao , Chen Tang , Bin Chen , Laizhong Cui , Zhi Wang

Stochastic Gradient Descent (SGD) is the key learning algorithm for many machine learning tasks. Because of its computational costs, there is a growing interest in accelerating SGD on HPC resources like GPU clusters. However, the…

Machine Learning · Computer Science 2021-01-20 Peng Jiang , Gagan Agrawal

We propose a novel algorithm for distributed stochastic gradient descent (SGD) with compressed gradient communication in the parameter-server framework. Our gradient compression technique, named flattened one-bit stochastic gradient descent…

Machine Learning · Computer Science 2024-05-21 Alexander Stollenwerk , Laurent Jacques

Federated Learning (FL) has evolved as a promising technique to handle distributed machine learning across edge devices. A single neural network (NN) that optimises a global objective is generally learned in most work in FL, which could be…

Information Theory · Computer Science 2022-03-10 Sawan Singh Mahara , Shruti M. , B. N. Bharath , Akash Murthy

As artificial intelligence (AI)-enabled wireless communication systems continue their evolution, distributed learning has gained widespread attention for its ability to offer enhanced data privacy protection, improved resource utilization,…

Networking and Internet Architecture · Computer Science 2024-04-03 Junjie Wu , Xuming Fang

The state-of-the-art deep learning algorithms rely on distributed training systems to tackle the increasing sizes of models and training data sets. Minibatch stochastic gradient descent (SGD) algorithm requires workers to halt forward/back…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-02 Qinggang Zhou , Yawen Zhang , Pengcheng Li , Xiaoyong Liu , Jun Yang , Runsheng Wang , Ru Huang