English
Related papers

Related papers: SMoFi: Step-wise Momentum Fusion for Split Federat…

200 papers

Federated Split Learning has been identified as an efficient approach to address the computational resource constraints of clients in classical federated learning, while guaranteeing data privacy for distributed model training across data…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-30 Yimeng Shan , Zhaorui Zhang , Sheng Di , Yu Liu , Xiaoyi Lu , Benben Liu

High complexity in precoding design for frequency division duplex systems necessitates streamlined solutions. Guided by Synesthesia of Machines (SoM), this paper introduces a heterogeneous multi-vehicle, multi-modal sensing aided precoding…

Signal Processing · Electrical Eng. & Systems 2025-03-14 Haotian Zhang , Shijian Gao , Weibo Wen , Xiang Cheng

Asynchronous federated learning mitigates the inefficiency of conventional synchronous aggregation by integrating updates as they arrive and adjusting their influence based on staleness. Due to asynchrony and data heterogeneity, learning…

Machine Learning · Computer Science 2025-02-27 Jiayun Zhang , Shuheng Li , Haiyu Huang , Xiaofan Yu , Rajesh K. Gupta , Jingbo Shang

Statistical heterogeneity in federated learning poses two major challenges: slow global training due to conflicting gradient signals, and the need of personalization for local distributions. In this work, we tackle both challenges by…

Machine Learning · Computer Science 2025-02-13 Dennis Grinwald , Philipp Wiesner , Shinichi Nakajima

Federated Learning (FL) is a promising distributed machine learning framework that allows collaborative learning of a global model across decentralized devices without uploading their local data. However, in real-world FL scenarios, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-11 Md Sirajul Islam , Sanjeev Panta , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

Communication costs within Federated learning hinder the system scalability for reaching more data from more clients. The proposed FL adopts a hub-and-spoke network topology. All clients communicate through the central server. Hence,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-18 Chun-Chih Kuo , Ted Tsei Kuo , Chia-Yu Lin

Although federated learning has achieved many breakthroughs recently, the heterogeneous nature of the learning environment greatly limits its performance and hinders its real-world applications. The heterogeneous data, time-varying wireless…

Machine Learning · Computer Science 2023-02-22 Jingxin Li , Toktam Mahmoodi , Hak-Keung Lam

Split-Federated (SplitFed) learning is an extension of federated learning that places minimal requirements on the clients computing infrastructure, since only a small portion of the overall model is deployed on the clients hardware. In…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Zahra Hafezi Kafshgari , Ivan V. Bajic , Parvaneh Saeedi

Federated learning (FL) is a challenging setting for optimization due to the heterogeneity of the data across different clients which gives rise to the client drift phenomenon. In fact, obtaining an algorithm for FL which is uniformly…

Federated Learning is a novel paradigm that involves learning from data samples distributed across a large network of clients while the data remains local. It is, however, known that federated learning is prone to multiple system challenges…

Machine Learning · Computer Science 2021-01-01 Amirhossein Reisizadeh , Isidoros Tziotis , Hamed Hassani , Aryan Mokhtari , Ramtin Pedarsani

Split federated learning (SFL) is a recent distributed approach for collaborative model training among multiple clients. In SFL, a global model is typically split into two parts, where clients train one part in a parallel federated manner,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-10 Pengchao Han , Chao Huang , Geng Tian , Ming Tang , Xin Liu

Federated learning is a powerful paradigm for large-scale machine learning, but it faces significant challenges due to unreliable network connections, slow communication, and substantial data heterogeneity across clients. FedAvg and…

Machine Learning · Computer Science 2024-03-06 Ziheng Cheng , Xinmeng Huang , Pengfei Wu , Kun Yuan

While fairness-aware machine learning algorithms have been receiving increasing attention, the focus has been on centralized machine learning, leaving decentralized methods underexplored. Federated Learning is a decentralized form of…

Machine Learning · Computer Science 2023-07-04 Teresa Salazar , Miguel Fernandes , Helder Araujo , Pedro Henriques Abreu

Federated Learning (FL) enables multiple clients to collaboratively train a shared model while preserving data privacy. However, the high memory demand during model training severely limits the deployment of FL on resource-constrained…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-14 Yebo Wu , Jingguang Li , Chunlin Tian , Kahou Tam , Li Li , Chengzhong Xu

In this paper, we propose a novel distributed learning scheme, named group-based split federated learning (GSFL), to speed up artificial intelligence (AI) model training. Specifically, the GSFL operates in a split-then-federated manner,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-31 Songge Zhang , Wen Wu , Penghui Hu , Shaofeng Li , Ning Zhang

This paper proposes a novel federated algorithm that leverages momentum-based variance reduction with adaptive learning to address non-convex settings across heterogeneous data. We intend to minimize communication and computation overhead,…

Machine Learning · Computer Science 2024-12-17 Dipanwita Thakur , Antonella Guzzo , Giancarlo Fortino , Sajal K. Das

Federated learning (FL) is a promising paradigm that enables collaboratively learning a shared model across massive clients while keeping the training data locally. However, for many existing FL systems, clients need to frequently exchange…

Networking and Internet Architecture · Computer Science 2023-01-18 Qiong Wu , Xu Chen , Tao Ouyang , Zhi Zhou , Xiaoxi Zhang , Shusen Yang , Junshan Zhang

In cross-device Federated Learning (FL) environments, scaling synchronous FL methods is challenging as stragglers hinder the training process. Moreover, the availability of each client to join the training is highly variable over time due…

Machine Learning · Computer Science 2023-04-17 Tuo Zhang , Lei Gao , Sunwoo Lee , Mi Zhang , Salman Avestimehr

Federated learning allows a large number of devices to jointly learn a model without sharing data. In this work, we enable clients with limited computing power to perform action recognition, a computationally heavy task. We first perform…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-27 Pranjal Jain , Shreyas Goenka , Saurabh Bagchi , Biplab Banerjee , Somali Chaterji

Federated learning (FL) and split learning (SL) are two effective distributed learning paradigms in wireless networks, enabling collaborative model training across mobile devices without sharing raw data. While FL supports low-latency…

Machine Learning · Computer Science 2025-11-26 Kun Guo , Xuefei Li , Xijun Wang , Howard H. Yang , Wei Feng , Tony Q. S. Quek