English
Related papers

Related papers: Hierarchical Federated Learning with SignSGD: A Hi…

200 papers

Decentralized federated learning, inherited from decentralized learning, enables the edge devices to collaborate on model training in a peer-to-peer manner without the assistance of a server. However, existing decentralized learning…

Information Theory · Computer Science 2021-08-06 Hao Ye , Le Liang , Geoffrey Li

Reducing communication overhead in federated learning (FL) is challenging but crucial for large-scale distributed privacy-preserving machine learning. While methods utilizing sparsification or others can largely lower the communication…

Machine Learning · Computer Science 2023-03-21 Yuhao Zhou , Mingjia Shi , Yuanxi Li , Qing Ye , Yanan Sun , Jiancheng Lv

In this paper, we consider communication-efficient over-the-air federated learning (FL), where multiple edge devices with non-independent and identically distributed datasets perform multiple local iterations in each communication round and…

Signal Processing · Electrical Eng. & Systems 2022-03-29 Yinan Zou , Zixin Wang , Xu Chen , Haibo Zhou , Yong Zhou

Federated learning (FL) was designed to enable mobile phones to collaboratively learn a global model without uploading their private data to a cloud server. However, exiting FL protocols has a critical communication bottleneck in a…

Machine Learning · Computer Science 2020-10-24 Jinliang Yuan , Mengwei Xu , Xiao Ma , Ao Zhou , Xuanzhe Liu , Shangguang Wang

Deep learning is a key approach for the environment perception function of Cooperative Intelligent Transportation Systems (C-ITS) with autonomous vehicles and smart traffic infrastructure. In today's C-ITS, smart traffic participants are…

Machine Learning · Computer Science 2022-07-29 Rui Song , Liguo Zhou , Venkatnarayanan Lakshminarasimhan , Andreas Festag , Alois Knoll

Wireless traffic prediction plays an indispensable role in cellular networks to achieve proactive adaptation for communication systems. Along this line, Federated Learning (FL)-based wireless traffic prediction at the edge attracts enormous…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-03 Chuanting Zhang , Haixia Zhang , Shuping Dang , Basem Shihada , Mohamed-Slim Alouini

Federated learning (FL) has become de facto framework for collaborative learning among edge devices with privacy concern. The core of the FL strategy is the use of stochastic gradient descent (SGD) in a distributed manner. Large scale…

Machine Learning · Computer Science 2022-05-18 Kerem Ozfatura , Emre Ozfatura , Deniz Gunduz

In contrast to training traditional machine learning (ML) models in data centers, federated learning (FL) trains ML models over local datasets contained on resource-constrained heterogeneous edge devices. Existing FL algorithms aim to learn…

Machine Learning · Computer Science 2022-09-13 El Houcine Bergou , Konstantin Burlachenko , Aritra Dutta , Peter Richtárik

Low Earth Orbit (LEO) satellites are emerging as key components of 6G networks, with many already deployed to support large-scale Earth observation and sensing related tasks. Federated Learning (FL) presents a promising paradigm for…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-31 Zhuocheng Liu , Zhishu Shen , Qiushi Zheng , Tiehua Zhang , Zheng Lei , Jiong Jin

Federated Learning (FL) enables training a global model without sharing the decentralized raw data stored on multiple devices to protect data privacy. Due to the diverse capacity of the devices, FL frameworks struggle to tackle the problems…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-22 Guanghao Li , Yue Hu , Miao Zhang , Ji Liu , Quanjun Yin , Yong Peng , Dejing Dou

Federated learning (FL) has attracted much attention as a privacy-preserving distributed machine learning framework, where many clients collaboratively train a machine learning model by exchanging model updates with a parameter server…

Machine Learning · Computer Science 2022-09-09 Yuchang Sun , Jiawei Shao , Songze Li , Yuyi Mao , Jun Zhang

Federated learning (FL), as an emerging collaborative learning paradigm, has garnered significant attention due to its capacity to preserve privacy within distributed learning systems. In these systems, clients collaboratively train a…

Machine Learning · Computer Science 2024-05-29 Xi Zhu , Songcan Yu , Junbo Wang , Qinglin Yang

Federated learning, where algorithms are trained across multiple decentralized devices without sharing local data, is increasingly popular in distributed machine learning practice. Typically, a graph structure $G$ exists behind local…

Machine Learning · Statistics 2022-09-20 Huiyuan Wang , Xuyang Zhao , Wei Lin

Federated Learning (FL) has recently received a lot of attention for large-scale privacy-preserving machine learning. However, high communication overheads due to frequent gradient transmissions decelerate FL. To mitigate the communication…

Machine Learning · Computer Science 2021-05-27 Milad Khademi Nori , Sangseok Yun , Il-Min Kim

Federated learning (FL) is a useful tool in distributed machine learning that utilizes users' local datasets in a privacy-preserving manner. When deploying FL in a constrained wireless environment; however, training models in a…

Machine Learning · Computer Science 2022-05-06 Jake Perazzone , Shiqiang Wang , Mingyue Ji , Kevin Chan

Federated Graph Learning (FGL) enables privacy-preserving, distributed training of graph neural networks without sharing raw data. Among its approaches, subgraph-FL has become the dominant paradigm, with most work focused on improving…

Machine Learning · Computer Science 2025-04-15 Zhengyu Wu , Boyang Pang , Xunkai Li , Yinlin Zhu , Daohan Su , Bowen Fan , Rong-Hua Li , Guoren Wang , Chenghu Zhou

Sign-based algorithms (e.g. signSGD) have been proposed as a biased gradient compression technique to alleviate the communication bottleneck in training large neural networks across multiple workers. We show simple convex counter-examples…

Machine Learning · Computer Science 2019-05-30 Sai Praneeth Karimireddy , Quentin Rebjock , Sebastian U. Stich , Martin Jaggi

Federated learning (FL) is a machine learning paradigm that targets model training without gathering the local data dispersed over various data sources. Standard FL, which employs a single server, can only support a limited number of users,…

Machine Learning · Computer Science 2024-02-29 Bin Wang , Jun Fang , Hongbin Li , Yonina C. Eldar

Federated Averaging (FedAvg) has emerged as the algorithm of choice for federated learning due to its simplicity and low communication cost. However, in spite of recent research efforts, its performance is not fully understood. We obtain…

Data generated at the network edge can be processed locally by leveraging the paradigm of edge computing (EC). Aided by EC, decentralized federated learning (DFL), which overcomes the single-point-of-failure problem in the parameter server…

Networking and Internet Architecture · Computer Science 2022-12-06 Yunming Liao , Yang Xu , Hongli Xu , Lun Wang , Chen Qian