English
Related papers

Related papers: Random Orthogonalization for Federated Learning in…

200 papers

The communication bottleneck of over-the-air federated learning (OA-FL) lies in uploading the gradients of local learning models. In this paper, we study the reduction of the communication overhead in the gradients uploading by using the…

Signal Processing · Electrical Eng. & Systems 2023-04-11 Chenxi Zhong , Xiaojun Yuan

Federated Learning (FL) has recently received a lot of attention for large-scale privacy-preserving machine learning. However, high communication overheads due to frequent gradient transmissions decelerate FL. To mitigate the communication…

Machine Learning · Computer Science 2021-05-27 Milad Khademi Nori , Sangseok Yun , Il-Min Kim

Model-free techniques, such as machine learning (ML), have recently attracted much interest towards the physical layer design, e.g., symbol detection, channel estimation, and beamforming. Most of these ML techniques employ centralized…

Signal Processing · Electrical Eng. & Systems 2021-08-09 Ahmet M. Elbir , Anastasios K. Papazafeiropoulos , Symeon Chatzinotas

Channel prediction compensates for outdated channel state information in multiple-input multiple-output (MIMO) systems. Machine learning (ML) techniques have recently been implemented to design channel predictors by leveraging the temporal…

Information Theory · Computer Science 2024-08-23 Beomsoo Ko , Hwanjin Kim , Minje Kim , Junil Choi

Over-the-air federated learning (OTA-FL) exploits the inherent superposition property of wireless channels to integrate the communication and model aggregation. Though a naturally promising framework for wireless federated learning, it…

Information Theory · Computer Science 2023-09-20 Jiayu Mao , Aylin Yener

We propose an uplink over-the-air aggregation (OAA) method for wireless federated learning (FL) that simultaneously trains multiple models. To maximize the multi-model training convergence rate, we derive an upper bound on the optimality…

Information Theory · Computer Science 2024-09-04 Chong Zhang , Min Dong , Ben Liang , Ali Afana , Yahia Ahmed

Federated learning (FL) enables collaborative model training without direct data sharing, but its performance can degrade significantly in the presence of data distribution perturbations. Distributionally robust optimization (DRO) provides…

Machine Learning · Computer Science 2025-09-30 Zifan Wang , Xinlei Yi , Xenia Konti , Michael M. Zavlanos , Karl H. Johansson

A new machine learning (ML) technique termed as federated learning (FL) aims to preserve data at the edge devices and to only exchange ML model parameters in the learning process. FL not only reduces the communication needs but also helps…

Machine Learning · Computer Science 2021-08-09 Xiang Ma , Haijian Sun , Qun Wang , Rose Qingyang Hu

Communication has been known to be one of the primary bottlenecks of federated learning (FL), and yet existing studies have not addressed the efficient communication design, particularly in wireless FL where both uplink and downlink…

Information Theory · Computer Science 2020-12-09 Sihui Zheng , Cong Shen , Xiang Chen

Federated Learning (FL) incurs high communication overhead, which can be greatly alleviated by compression for model updates. Yet the tradeoff between compression and model accuracy in the networked environment remains unclear and, for…

Machine Learning · Computer Science 2021-12-14 Laizhong Cui , Xiaoxin Su , Yipeng Zhou , Jiangchuan Liu

Second-order federated learning (FL) algorithms offer faster convergence than their first-order counterparts by leveraging curvature information. However, they are hindered by high computational and storage costs, particularly for…

Machine Learning · Computer Science 2025-01-15 Abdulmomen Ghalkha , Chaouki Ben Issaid , Mehdi Bennis

Over-the-Air Federated Learning (AirFL) is an emerging paradigm that tightly integrates wireless signal processing and distributed machine learning to enable scalable AI at the network edge. By leveraging the superposition property of…

Information Theory · Computer Science 2025-12-04 Seyed Mohammad Azimi-Abarghouyi , Carlo Fischione , Kaibin Huang

Federated Learning (FL) is a privacy-protected machine learning paradigm that allows model to be trained directly at the edge without uploading data. One of the biggest challenges faced by FL in practical applications is the heterogeneity…

Machine Learning · Computer Science 2021-08-20 Zirui Zhu , Ziyi Ye

Cooperative training methods for distributed machine learning are typically based on the exchange of local gradients or local model parameters. The latter approach is known as Federated Learning (FL). An alternative solution with reduced…

Signal Processing · Electrical Eng. & Systems 2020-02-05 Jin-Hyun Ahn , Osvaldo Simeone , Joonhyuk Kang

Federated Learning (FL) enables large-scale distributed training of machine learning models, while still allowing individual nodes to maintain data locally. However, executing FL at scale comes with inherent practical challenges: 1)…

Machine Learning · Computer Science 2025-05-23 Hossein Zakerinia , Shayan Talaei , Giorgi Nadiradze , Dan Alistarh

Motivated by the increasing computational capacity of wireless user equipments (UEs), e.g., smart phones, tablets, or vehicles, as well as the increasing concerns about sharing private data, a new machine learning model has emerged, namely…

Information Theory · Computer Science 2019-10-10 Howard H. Yang , Zuozhu Liu , Tony Q. S. Quek , H. Vincent Poor

We introduce a new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are unevenly distributed over an extremely large number of nodes. The goal is to train a…

Machine Learning · Computer Science 2016-10-11 Jakub Konečný , H. Brendan McMahan , Daniel Ramage , Peter Richtárik

Robust machine learning (ML) models can be developed by leveraging large volumes of data and distributing the computational tasks across numerous devices or servers. Federated learning (FL) is a technique in the realm of ML that facilitates…

Machine learning (ML) is a widely accepted means for supporting customized services for mobile devices and applications. Federated Learning (FL), which is a promising approach to implement machine learning while addressing data privacy…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-29 Tinghao Zhang , Kwok-Yan Lam , Jun Zhao , Feng Li , Huimei Han , Norziana Jamil

While network coverage maps continue to expand, many devices located in remote areas remain unconnected to terrestrial communication infrastructures, preventing them from getting access to the associated data-driven services. In this paper,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-27 Dong-Jun Han , Seyyedali Hosseinalipour , David J. Love , Mung Chiang , Christopher G. Brinton