English
Related papers

Related papers: Sporadic Gradient Tracking over Directed Graphs: A…

200 papers

In federated learning (FL), model training performance is strongly impacted by data heterogeneity across clients. Client-drift compensation methods have recently emerged as a solution to this issue, introducing correction terms into local…

Machine Learning · Computer Science 2025-05-20 Evan Chen , Shiqiang Wang , Jianing Zhang , Dong-Jun Han , Chaoyue Liu , Christopher Brinton

Federated graph learning (FGL) has become an important research topic in response to the increasing scale and the distributed nature of graph-structured data in the real world. In FGL, a global graph is distributed across different clients,…

Machine Learning · Computer Science 2024-08-27 Binchi Zhang , Minnan Luo , Shangbin Feng , Ziqi Liu , Jun Zhou , Qinghua Zheng

Much of federated learning (FL) focuses on settings where local dataset statistics remain the same between training and testing. However, this assumption often does not hold in practice due to distribution shifts, motivating the development…

Machine Learning · Computer Science 2026-02-02 Shahryar Zehtabi , Dong-Jun Han , Seyyedali Hosseinalipour , Christopher G. Brinton

Data privacy and long-tailed distribution are the norms rather than the exception in many real-world tasks. This paper investigates a federated long-tailed learning (Fed-LT) task in which each client holds a locally heterogeneous dataset;…

Machine Learning · Computer Science 2023-11-28 Zikai Xiao , Zihan Chen , Songshang Liu , Hualiang Wang , Yang Feng , Jin Hao , Joey Tianyi Zhou , Jian Wu , Howard Hao Yang , Zuozhu Liu

Vertical Federated Learning (VFL) is an emergent distributed machine learning paradigm for collaborative learning between clients who have disjoint features of common entities. However, standard VFL lacks fault tolerance, with each…

Machine Learning · Computer Science 2024-12-03 Avi Amalanshu , Yash Sirvi , David I. Inouye

In the era of big data applications, Federated Graph Learning (FGL) has emerged as a prominent solution that reconcile the tradeoff between optimizing the collective intelligence between decentralized datasets holders and preserving…

Machine Learning · Computer Science 2025-07-23 Zhengyu Wu , Xunkai Li , Yinlin Zhu , Zekai Chen , Guochen Yan , Yanyu Yan , Hao Zhang , Yuming Ai , Xinmo Jin , Rong-Hua Li , Guoren Wang

Federated Learning is an algorithm suited for training models on decentralized data, but the requirement of a central "server" node is a bottleneck. In this document, we first introduce the notion of Decentralized Federated Learning (DFL).…

Machine Learning · Computer Science 2021-08-10 Zhuofan Zhang , Mi Zhou , Kaicheng Niu , Chaouki Abdallah

Graphs are widely used to model relational data. As graphs are getting larger and larger in real-world scenarios, there is a trend to store and compute subgraphs in multiple local systems. For example, recently proposed \emph{subgraph…

Machine Learning · Computer Science 2024-01-30 Zaixi Zhang , Qingyong Hu , Yang Yu , Weibo Gao , Qi Liu

Attributes skew hinders the current federated learning (FL) frameworks from consistent optimization directions among the clients, which inevitably leads to performance reduction and unstable convergence. The core problems lie in that: 1)…

Machine Learning · Computer Science 2022-06-15 Zhengquan Luo , Yunlong Wang , Zilei Wang , Zhenan Sun , Tieniu Tan

Federated learning (FL) enables collaborative model training across distributed clients (e.g., edge devices) without sharing raw data. Yet, FL can be computationally expensive as the clients need to train the entire model multiple times.…

Machine Learning · Computer Science 2023-08-24 Chao Huang , Geng Tian , Ming Tang

Federated learning (FL) aims to train machine learning models in the decentralized system consisting of an enormous amount of smart edge devices. Federated averaging (FedAvg), the fundamental algorithm in FL settings, proposes on-device…

Machine Learning · Computer Science 2020-12-17 Xin Yao , Tianchi Huang , Rui-Xiao Zhang , Ruiyu Li , Lifeng Sun

Decentralized federated learning (DFL) realizes cooperative model training among connected clients without relying on a central server, thereby mitigating communication bottlenecks and eliminating the single-point failure issue present in…

Machine Learning · Computer Science 2024-12-19 Xinyang Liu , Pengchao Han , Xuan Li , Bo Liu

In this paper, we investigate the problem of decentralized federated learning (DFL) in Internet of things (IoT) systems, where a number of IoT clients train models collectively for a common task without sharing their private training data…

Machine Learning · Computer Science 2021-05-13 Chengxi Li , Gang Li , Pramod K. Varshney

Learning on Graphs (LoG) is widely used in multi-client systems when each client has insufficient local data, and multiple clients have to share their raw data to learn a model of good quality. One scenario is to recommend items to clients…

Machine Learning · Computer Science 2022-12-26 Shuang Wu , Mingxuan Zhang , Yuantong Li , Carl Yang , Pan Li

Wireless traffic prediction plays an indispensable role in cellular networks to achieve proactive adaptation for communication systems. Along this line, Federated Learning (FL)-based wireless traffic prediction at the edge attracts enormous…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-03 Chuanting Zhang , Haixia Zhang , Shuping Dang , Basem Shihada , Mohamed-Slim Alouini

Federated learning (FL) is a popular technique for distributing machine learning (ML) across a set of edge devices. In this paper, we study fully decentralized FL, where in addition to devices conducting training locally, they carry out…

Machine Learning · Computer Science 2025-11-20 Shahryar Zehtabi , Seyyedali Hosseinalipour , Christopher G. Brinton

Integrating native AI support into the network architecture is an essential objective of 6G. Federated Learning (FL) emerges as a potential paradigm, facilitating decentralized AI model training across a diverse range of devices under the…

Networking and Internet Architecture · Computer Science 2023-09-29 Wenxuan Ye , Chendi Qian , Xueli An , Xueqiang Yan , Georg Carle

Decentralized federated learning, inherited from decentralized learning, enables the edge devices to collaborate on model training in a peer-to-peer manner without the assistance of a server. However, existing decentralized learning…

Information Theory · Computer Science 2021-08-06 Hao Ye , Le Liang , Geoffrey Li

In personalized Federated Learning (pFL), high data heterogeneity can cause significant gradient divergence across devices, adversely affecting the learning process. This divergence, especially when gradients from different users form an…

Machine Learning · Computer Science 2024-10-07 Minh Duong Nguyen , Khanh Le , Khoi Do , Nguyen H. Tran , Duc Nguyen , Chien Trinh , Zhaohui Yang

The ongoing deployment of the Internet of Things (IoT)-based smart applications is spurring the adoption of machine learning as a key technology enabler. To overcome the privacy and overhead challenges of centralized machine learning, there…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-21 Latif U. Khan , Walid Saad , Zhu Han , Choong Seon Hong