English
Related papers

Related papers: Sporadic Gradient Tracking over Directed Graphs: A…

200 papers

Gradient-tracking (GT) based decentralized methods have emerged as an effective and viable alternative method to decentralized (stochastic) gradient descent (DSGD) when solving distributed online stochastic optimization problems. Initial…

Optimization and Control · Mathematics 2023-01-10 Sulaiman A. Alghunaim , Kun Yuan

Split federated learning (SFL) is a recent distributed approach for collaborative model training among multiple clients. In SFL, a global model is typically split into two parts, where clients train one part in a parallel federated manner,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-10 Pengchao Han , Chao Huang , Geng Tian , Ming Tang , Xin Liu

Horizontal Federated learning (FL) handles multi-client data that share the same set of features, and vertical FL trains a better predictor that combine all the features from different clients. This paper targets solving vertical FL in an…

Machine Learning · Computer Science 2021-02-02 Tianyi Chen , Xiao Jin , Yuejiao Sun , Wotao Yin

Federated Learning (FL) enables edge devices to collaboratively learn a global model, but it may not perform well when clients have high data heterogeneity. In this paper, we propose a dynamic clustering algorithm for personalized federated…

Machine Learning · Computer Science 2025-08-05 Heting Liu , Junzhe Huang , Fang He , Guohong Cao

Federated Learning (FL) enables collaborative learning without directly sharing individual's raw data. FL can be implemented in either a centralized (server-based) or decentralized (peer-to-peer) manner. In this survey, we present a novel…

Machine Learning · Computer Science 2025-03-11 Qiongxiu Li , Wenrui Yu , Yufei Xia , Jun Pang

Federated learning is a semi-distributed algorithm, where a server communicates with multiple dispersed clients to learn a global model. The federated architecture is not robust and is sensitive to communication and computational overloads…

Machine Learning · Computer Science 2023-01-18 Elsa Rizk , Stefan Vlaski , Ali H. Sayed

The Federated Learning (FL) paradigm is known to face challenges under heterogeneous client data. Local training on non-iid distributed data results in deflected local optimum, which causes the client models drift further away from each…

Machine Learning · Computer Science 2022-11-22 Renjie Pi , Weizhong Zhang , Yueqi Xie , Jiahui Gao , Xiaoyu Wang , Sunghun Kim , Qifeng Chen

Personalized federated learning (PFL) has garnered significant attention for its ability to address heterogeneous client data distributions while preserving data privacy. However, when local client data is limited, deep learning models…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-24 Ying Chang , Xiaohu Shi , Xiaohui Zhao , Zhaohuang Chen , Deyin Ma

Traditional federated learning (FL) algorithms operate under the assumption that the data distributions at training (source domains) and testing (target domain) are the same. The fact that domain shifts often occur in practice necessitates…

Machine Learning · Computer Science 2023-11-02 Jungwuk Park , Dong-Jun Han , Jinho Kim , Shiqiang Wang , Christopher G. Brinton , Jaekyun Moon

Federated learning (FL) is an emerging technique for training machine learning models using geographically dispersed data collected by local entities. It includes local computation and synchronization steps. To reduce the communication…

Machine Learning · Computer Science 2020-03-23 Pengchao Han , Shiqiang Wang , Kin K. Leung

To address the communication burden and privacy concerns associated with the centralized server in Federated Learning (FL), Decentralized Federated Learning (DFL) has emerged, which discards the server with a peer-to-peer (P2P)…

Machine Learning · Computer Science 2023-10-10 Qinglun Li , Miao Zhang , Nan Yin , Quanjun Yin , Li Shen

Federated learning (FL) can lead to significant communication overhead and reliance on a central server. To address these challenges, decentralized federated learning (DFL) has been proposed as a more resilient framework. DFL involves…

Machine Learning · Computer Science 2023-08-15 Zhigang Yan , Dong Li

Federated Learning (FL) confronts a significant challenge known as data heterogeneity, which impairs model performance and convergence. Existing methods have made notable progress in addressing this issue. However, improving performance in…

Machine Learning · Computer Science 2025-10-24 Zhiqin Yang , Yonggang Zhang , Chenxin Li , Yiu-ming Cheung , Bo Han , Yixuan Yuan

Federated Graph Learning (FGL) has garnered widespread attention by enabling collaborative training on multiple clients for semi-supervised classification tasks. However, most existing FGL studies do not well consider the missing…

Machine Learning · Computer Science 2024-07-17 Luying Zhong , Yueyang Pi , Zheyi Chen , Zhengxin Yu , Wang Miao , Xing Chen , Geyong Min

We consider the problem of minimizing the convergence time for decentralized federated learning (DFL) in wireless networks under broadcast communications, with focus on mixing matrix design. The mixing matrix is a critical hyperparameter…

Machine Learning · Computer Science 2026-04-20 Tuan Nguyen , Ting He

The performance of Federated Learning (FL) hinges on the effectiveness of utilizing knowledge from distributed datasets. Traditional FL methods adopt an aggregate-then-adapt framework, where clients update local models based on a global…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Yuan Wang , Huazhu Fu , Renuga Kanagavelu , Qingsong Wei , Yong Liu , Rick Siow Mong Goh

Personalized Federated Learning (PFL) has witnessed remarkable advancements, enabling the development of innovative machine learning applications that preserve the privacy of training data. However, existing theoretical research in this…

Federated Learning (FL) emerged as a learning method to enable the server to train models over data distributed among various clients. These clients are protective about their data being leaked to the server, any other client, or an…

Machine Learning · Computer Science 2025-01-27 Uday Bhaskar , Varul Srivastava , Avyukta Manjunatha Vummintala , Naresh Manwani , Sujit Gujar

Graph neural networks (GNN) have been successful in many fields, and derived various researches and applications in real industries. However, in some privacy sensitive scenarios (like finance, healthcare), training a GNN model centrally…

Machine Learning · Computer Science 2021-05-25 Huanding Zhang , Tao Shen , Fei Wu , Mingyang Yin , Hongxia Yang , Chao Wu

Federated Learning (FL) marks a transformative approach to distributed model training by combining locally optimized models from various clients into a unified global model. While FL preserves data privacy by eliminating centralized…

Machine Learning · Computer Science 2026-01-08 Pranab Sahoo , Ashutosh Tripathi , Sriparna Saha , Samrat Mondal