English
Related papers

Related papers: Scalable and Resource-Efficient Second-Order Feder…

200 papers

As 6G and beyond networks grow increasingly complex and interconnected, federated learning (FL) emerges as an indispensable paradigm for securely and efficiently leveraging decentralized edge data for AI. By virtue of the superposition…

Machine Learning · Computer Science 2024-12-24 Jonggyu Jang , Hyeonsu Lyu , David J. Love , Hyun Jong Yang

Federated learning (FL) has emerged as a promising learning paradigm in which only local model parameters (gradients) are shared. Private user data never leaves the local devices thus preserving data privacy. However, recent research has…

Cryptography and Security · Computer Science 2022-12-23 Xiaochan Xue , Moh Khalid Hasan , Shucheng Yu , Laxima Niure Kandel , Min Song

Federated learning (FL) is usually performed on resource-constrained edge devices, e.g., with limited memory for the computation. If the required memory to train a model exceeds this limit, the device will be excluded from the training.…

Machine Learning · Computer Science 2023-11-28 Kilian Pfeiffer , Ramin Khalili , Jörg Henkel

Federated learning (FL) enables workers to learn a model collaboratively by using their local data, with the help of a parameter server (PS) for global model aggregation. The high communication cost for periodic model updates and the…

Information Theory · Computer Science 2019-11-04 Yuxuan Sun , Sheng Zhou , Deniz Gündüz

Over-the-air federated learning (OTA-FL) unifies communication and model aggregation by leveraging the inherent superposition property of the wireless medium. This strategy can enable scalable and bandwidth-efficient learning via…

Information Theory · Computer Science 2024-12-05 Jiayu Mao , Aylin Yener

Recently, federated learning (FL), which replaces data sharing with model sharing, has emerged as an efficient and privacy-friendly machine learning (ML) paradigm. One of the main challenges in FL is the huge communication cost for model…

Signal Processing · Electrical Eng. & Systems 2023-02-14 Huiyuan Yang , Tian Ding , Xiaojun Yuan

Federated learning (FL) has recently emerged as a promising technology to enable artificial intelligence (AI) at the network edge, where distributed mobile devices collaboratively train a shared AI model under the coordination of an edge…

Information Theory · Computer Science 2022-03-07 Zehong Lin , Hang Liu , Ying-Jun Angela Zhang

Federated learning (FL) is a new paradigm to train AI models over distributed edge devices (i.e., workers) using their local data, while confronting various challenges including communication resource constraints, edge heterogeneity and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-09 Qianpiao Ma , Junlong Zhou , Xiangpeng Hou , Jianchun Liu , Hongli Xu , Jianeng Miao , Qingmin Jia

Federated Learning (FL) has recently received a lot of attention for large-scale privacy-preserving machine learning. However, high communication overheads due to frequent gradient transmissions decelerate FL. To mitigate the communication…

Machine Learning · Computer Science 2021-05-27 Milad Khademi Nori , Sangseok Yun , Il-Min Kim

Federated learning (FL) can suffer from a communication bottleneck when deployed in mobile networks, limiting participating clients and deterring FL convergence. The impact of practical air interfaces with discrete modulations on FL has not…

Signal Processing · Electrical Eng. & Systems 2023-11-28 Shuyan Hu , Xin Yuan , Wei Ni , Xin Wang , Ekram Hossain , H. Vincent Poor

In this work, we propose FedSSO, a server-side second-order optimization method for federated learning (FL). In contrast to previous works in this direction, we employ a server-side approximation for the Quasi-Newton method without…

Machine Learning · Computer Science 2022-08-24 Xin Ma , Renyi Bao , Jinpeng Jiang , Yang Liu , Arthur Jiang , Jun Yan , Xin Liu , Zhisong Pan

Vertical federated learning (FL) is a collaborative machine learning framework that enables devices to learn a global model from the feature-partition datasets without sharing local raw data. However, as the number of the local intermediate…

Information Theory · Computer Science 2023-05-11 Yuanming Shi , Shuhao Xia , Yong Zhou , Yijie Mao , Chunxiao Jiang , Meixia Tao

Federated Learning (FL) typically aggregates client model parameters using a weighting approach determined by sample proportions. However, this naive weighting method may lead to unfairness and degradation in model performance due to…

Machine Learning · Computer Science 2023-11-13 Mingwei Xu , Xiaofeng Cao , Ivor W. Tsang , James T. Kwok

Federated learning (FL) is a recently developed area of machine learning, in which the private data of a large number of distributed clients is used to develop a global model under the coordination of a central server without explicitly…

Machine Learning · Computer Science 2022-07-21 Amit Kumar Kundu , Joseph Jaja

In federated learning (FL), a machine learning model is trained on multiple nodes in a decentralized manner, while keeping the data local and not shared with other nodes. However, FL requires the nodes to also send information on the model…

Machine Learning · Computer Science 2021-10-08 Mohammad Aghapour , Aidin Ferdowsi , Walid Saad

Second-order optimization uses curvature information about the objective function, which can help in faster convergence. However, such methods typically require expensive computation of the Hessian matrix, preventing their usage in a…

Machine Learning · Computer Science 2022-11-03 Mohamed Elsayed , A. Rupam Mahmood

In this paper, we consider federated learning (FL) over a noisy fading multiple access channel (MAC), where an edge server aggregates the local models transmitted by multiple end devices through over-the-air computation (AirComp). To…

Information Theory · Computer Science 2020-11-16 Shuhao Xia , Jingyang Zhu , Yuhan Yang , Yong Zhou , Yuanming Shi , Wei Chen

Federated learning (FL) aims to minimize the communication complexity of training a model over heterogeneous data distributed across many clients. A common approach is local methods, where clients take multiple optimization steps over local…

Machine Learning · Computer Science 2023-04-18 Charlie Hou , Kiran K. Thekumparampil , Giulia Fanti , Sewoong Oh

In the era of advanced technologies, mobile devices are equipped with computing and sensing capabilities that gather excessive amounts of data. These amounts of data are suitable for training different learning models. Cooperated with…

Machine Learning · Computer Science 2020-04-07 Muhammad Asad , Ahmed Moustafa , Takayuki Ito , Muhammad Aslam

To enable communication-efficient federated learning (FL), this paper studies an unmanned aerial vehicle (UAV)-enabled FL system, where the UAV coordinates distributed ground devices for a shared model training. Specifically, by exploiting…

Signal Processing · Electrical Eng. & Systems 2022-10-21 Min Fu , Yuanming Shi , Yong Zhou