English
Related papers

Related papers: Breaking the Memory Wall for Heterogeneous Federat…

200 papers

Federated learning is a distributed learning paradigm in which multiple mobile clients train a global model while keeping data local. These mobile clients can have various available memory and network bandwidth. However, to achieve the best…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-16 Dixi Yao

Federated learning (FL) coordinates multiple devices to collaboratively train a shared model while preserving data privacy. However, large memory footprint and high energy consumption during the training process excludes the low-end devices…

Machine Learning · Computer Science 2024-09-12 Shichen Zhan , Yebo Wu , Chunlin Tian , Yan Zhao , Li Li

Split learning (SL) is a collaborative learning framework, which can train an artificial intelligence (AI) model between a device and an edge server by splitting the AI model into a device-side model and a server-side model at a cut layer.…

Networking and Internet Architecture · Computer Science 2023-01-03 Wen Wu , Mushu Li , Kaige Qu , Conghao Zhou , Xuemin , Shen , Weihua Zhuang , Xu Li , Weisen Shi

Nowadays, AI companies improve service quality by aggressively collecting users' data generated by edge devices, which jeopardizes data privacy. To prevent this, Federated Learning is proposed as a private learning scheme, using which users…

Machine Learning · Computer Science 2022-10-06 Jingtao Li , Runcong Kuang

Fine-tuning large language models (LLMs) on private, on-device data can empower tailored personalized AI agents. However, fine-tuning LLMs on resource-constrained edge devices faces significant challenges, including excessive computation…

Machine Learning · Computer Science 2025-03-26 Jian Ma , Xinchen Lyu , Jun Jiang , Qimei Cui , Haipeng Yao , Xiaofeng Tao

Edge AI has been recently proposed to facilitate the training and deployment of Deep Neural Network (DNN) models in proximity to the sources of data. To enable the training of large models on resource-constraint edge devices and protect…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-26 Mingjin Zhang , Jiannong Cao , Yuvraj Sahni , Xiangchun Chen , Shan Jiang

Federated learning (FL) is one of the popular distributed machine learning (ML) solutions but incurs significant communication and computation costs at edge devices. Federated split learning (FSL) can train sub-models in parallel and reduce…

Machine Learning · Computer Science 2025-07-22 Yujia Mu , Cong Shen

Federated learning (FL) promotes decentralized training while prioritizing data confidentiality. However, its application on resource-constrained devices is challenging due to the high demand for computation and memory resources to train…

Machine Learning · Computer Science 2024-03-25 Hong Huang , Weiming Zhuang , Chen Chen , Lingjuan Lyu

Originated from distributed learning, federated learning enables privacy-preserved collaboration on a new abstracted level by sharing the model parameters only. While the current research mainly focuses on optimizing learning algorithms and…

Machine Learning · Computer Science 2020-09-17 Cong Wang , Yuanyuan Yang , Pengzhan Zhou

Large Artificial Intelligence Models (LAMs) powered by massive datasets, extensive parameter scales, and extensive computational resources, leading to significant transformations across various industries. Yet, their practical deployment on…

Machine Learning · Computer Science 2026-04-22 Xianke Qiang , Hongda Liu , Xinran Zhang , Zheng Chang , Ying-Chang Liang

As AI models expand in size, it has become increasingly challenging to deploy federated learning (FL) on resource-constrained edge devices. To tackle this issue, split federated learning (SFL) has emerged as an FL framework with reduced…

Machine Learning · Computer Science 2025-04-22 Zheng Lin , Wei Wei , Zhe Chen , Chan-Tong Lam , Xianhao Chen , Yue Gao , Jun Luo

Federated Split Learning (FSL) is a promising distributed learning paradigm in practice, which gathers the strengths of both Federated Learning (FL) and Split Learning (SL) paradigms, to ensure model privacy while diminishing the resource…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Yifan Shi , Yuhui Zhang , Ziyue Huang , Xiaofeng Yang , Li Shen , Wei Chen , Xueqian Wang

Federated Learning (FL) enables distributed training of machine learning models while keeping personal data on user devices private. While we witness increasing applications of FL in the area of mobile sensing, such as human activity…

Machine Learning · Computer Science 2022-09-22 Hyunsung Cho , Akhil Mathur , Fahim Kawsar

Federated learning enables a cluster of decentralized mobile devices at the edge to collaboratively train a shared machine learning model, while keeping all the raw training samples on device. This decentralized training approach is…

Machine Learning · Computer Science 2021-07-20 Young Geun Kim , Carole-Jean Wu

Federated learning (FL) enables edge nodes to collaboratively contribute to constructing a global model without sharing their data. This is accomplished by devices computing local, private model updates that are then aggregated by a server.…

Machine Learning · Computer Science 2024-06-13 Sadi Alawadi , Addi Ait-Mlouk , Salman Toor , Andreas Hellander

Split federated learning (SFL) has emerged as a promising paradigm to democratize machine learning (ML) on edge devices by enabling layer-wise model partitioning. However, existing SFL approaches suffer significantly from the straggler…

Machine Learning · Computer Science 2025-06-11 Zheng Lin , Zhe Chen , Xianhao Chen , Wei Ni , Yue Gao

Federated learning (FL) enables distributed learning across edge devices while protecting data privacy. However, the learning accuracy decreases due to the heterogeneity of devices' data, and the computation and communication latency…

Machine Learning · Computer Science 2024-01-17 Xiaonan Liu , Tharmalingam Ratnarajah , Mathini Sellathurai , Yonina C. Eldar

Federated learning (FL) is usually performed on resource-constrained edge devices, e.g., with limited memory for the computation. If the required memory to train a model exceeds this limit, the device will be excluded from the training.…

Machine Learning · Computer Science 2023-11-28 Kilian Pfeiffer , Ramin Khalili , Jörg Henkel

Federated Learning(FL) is a privacy-preserving machine learning paradigm where a global model is trained in-situ across a large number of distributed edge devices. These systems are often comprised of millions of user devices and only a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-05 Yuanli Wang , Lei Huang

Federated Learning (FL) enables collaborative learning of large-scale distributed clients without data sharing. However, due to the disparity of computing resources among massive mobile computing devices, the performance of traditional…

Machine Learning · Computer Science 2023-11-27 Ruixuan Liu , Ming Hu , Zeke Xia , Jun Xia , Pengyu Zhang , Yihao Huang , Yang Liu , Mingsong Chen