English
Related papers

Related papers: Lean Clients, Full Accuracy: Hybrid Zeroth- and Fi…

200 papers

Federated Learning (FL) trains machine learning models on edge devices with distributed data. However, the computational and memory limitations of these devices restrict the training of large models using FL. Split Federated Learning (SFL)…

Machine Learning · Computer Science 2025-04-02 Di Wu , Weibo He , Wanglei Feng , Zhenyu Wen , Bin Qian , Blesson Varghese

Federated learning (FL) is an important paradigm for training global models from decentralized data in a privacy-preserving way. Existing FL methods usually assume the global model can be trained on any participating client. However, in…

Machine Learning · Computer Science 2022-07-19 Ruixuan Liu , Fangzhao Wu , Chuhan Wu , Yanlin Wang , Lingjuan Lyu , Hong Chen , Xing Xie

Federated learning (FL) is a privacy-preserving machine learning setting that enables many devices to jointly train a shared global model without the need to reveal their data to a central server. However, FL involves a frequent exchange of…

Machine Learning · Computer Science 2021-10-07 Yuzhi Yang , Zhaoyang Zhang , Qianqian Yang

The performance of Federated Learning (FL) hinges on the effectiveness of utilizing knowledge from distributed datasets. Traditional FL methods adopt an aggregate-then-adapt framework, where clients update local models based on a global…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Yuan Wang , Huazhu Fu , Renuga Kanagavelu , Qingsong Wei , Yong Liu , Rick Siow Mong Goh

Vertical Federated Learning (VFL) attracts increasing attention because it empowers multiple parties to jointly train a privacy-preserving model over vertically partitioned data. Recent research has shown that applying zeroth-order…

Machine Learning · Computer Science 2023-06-30 Ganyu Wang , Qingsong Zhang , Li Xiang , Boyu Wang , Bin Gu , Charles Ling

Federated Learning (FL) is a well-known framework for successfully performing a learning task in an edge computing scenario where the devices involved have limited resources and incomplete data representation. The basic assumption of FL is…

Machine Learning · Computer Science 2023-12-08 Lorenzo Valerio , Chiara Boldrini , Andrea Passarella , János Kertész , Márton Karsai , Gerardo Iñiguez

Federated learning (FL) is a distributed learning paradigm that enables multiple clients to learn a powerful global model by aggregating local training. However, the performance of the global model is often hampered by non-i.i.d.…

Machine Learning · Computer Science 2023-08-21 Chun-Mei Feng , Kai Yu , Nian Liu , Xinxing Xu , Salman Khan , Wangmeng Zuo

Federated Learning is widely employed to tackle distributed sensitive data. Existing methods primarily focus on addressing in-federation data heterogeneity. However, we observed that they suffer from significant performance degradation when…

Machine Learning · Computer Science 2024-07-09 Mengmeng Ma , Tang Li , Xi Peng

In this paper, we propose a hybrid learning framework that combines federated and split learning, termed semi-federated learning (SemiFL), in which over-the-air computation is utilized for gradient aggregation. A key idea is to…

Signal Processing · Electrical Eng. & Systems 2026-02-26 Jingheng Zheng , Hui Tian , Wanli Ni , Yang Tian , Ping Zhang

Federated learning is a method of training a global model from decentralized data distributed across client devices. Here, model parameters are computed locally by each client device and exchanged with a central server, which aggregates the…

Machine Learning · Computer Science 2020-12-23 Sagar Dhakal , Saurav Prakash , Yair Yona , Shilpa Talwar , Nageen Himayat

Federated learning (FL) is an emerging distributed machine learning paradigm that enables collaborative training of machine learning models over decentralized devices without exposing their local data. One of the major challenges in FL is…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-11 Md Sirajul Islam , Simin Javaherian , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

Federated Learning (FL) is a promising distributed machine learning framework that allows collaborative learning of a global model across decentralized devices without uploading their local data. However, in real-world FL scenarios, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-11 Md Sirajul Islam , Sanjeev Panta , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

Due to its advantages in resource constraint scenarios, Split Federated Learning (SFL) is promising in AIoT systems. However, due to data heterogeneity and stragglers, SFL suffers from the challenges of low inference accuracy and low…

Machine Learning · Computer Science 2024-04-09 Dengke Yan , Ming Hu , Zeke Xia , Yanxin Yang , Jun Xia , Xiaofei Xie , Mingsong Chen

Federated learning (FL) enables learning from decentralized privacy-sensitive data, with computations on raw data confined to take place at edge clients. This paper introduces mixed FL, which incorporates an additional loss term calculated…

Machine Learning · Computer Science 2022-06-28 Sean Augenstein , Andrew Hard , Lin Ning , Karan Singhal , Satyen Kale , Kurt Partridge , Rajiv Mathews

Wireless federated learning (FL) facilitates collaborative training of artificial intelligence (AI) models to support ubiquitous intelligent applications at the wireless edge. However, the inherent constraints of limited wireless resources…

Machine Learning · Computer Science 2026-03-12 Yiyang Yue , Jiacheng Yao , Wei Xu , Zhaohui Yang , George K. Karagiannidis , Dusit Niyato

Federated learning (FL) is an effective technique to directly involve edge devices in machine learning training while preserving client privacy. However, the substantial communication overhead of FL makes training challenging when edge…

Machine Learning · Computer Science 2022-12-06 Shiqi He , Qifan Yan , Feijie Wu , Lanjun Wang , Mathias Lécuyer , Ivan Beschastnikh

Online federated learning (FL) enables geographically distributed devices to learn a global shared model from locally available streaming data. Most online FL literature considers a best-case scenario regarding the participating clients and…

Machine Learning · Computer Science 2023-10-31 Francois Gauthier , Vinay Chakravarthi Gogineni , Stefan Werner , Yih-Fang Huang , Anthony Kuh

Communication on heterogeneous edge networks is a fundamental bottleneck in Federated Learning (FL), restricting both model capacity and user participation. To address this issue, we introduce two novel strategies to reduce communication…

Machine Learning · Computer Science 2019-01-09 Sebastian Caldas , Jakub Konečny , H. Brendan McMahan , Ameet Talwalkar

As the number of sensors becomes massive in Internet of Things (IoT) networks, the amount of data is humongous. To process data in real-time while protecting user privacy, federated learning (FL) has been regarded as an enabling technique…

Information Theory · Computer Science 2023-10-05 Jianyang Ren , Wanli Ni , Hui Tian , Gaofeng Nie

Federated Learning (FL) has been proposed as an appealing approach to handle data privacy issue of mobile devices compared to conventional machine learning at the remote cloud with raw user data uploading. By leveraging edge servers as…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-09 Siqi Luo , Xu Chen , Qiong Wu , Zhi Zhou , Shuai Yu