中文
相关论文

相关论文: Heterogeneity-Aware Memory Efficient Federated Lea…

200 篇论文

Federated learning is an emerging research paradigm enabling collaborative training of machine learning models among different organizations while keeping data private at each institution. Despite recent progress, there remain fundamental…

机器学习 · 计算机科学 2022-04-15 Liangqiong Qu , Yuyin Zhou , Paul Pu Liang , Yingda Xia , Feifei Wang , Ehsan Adeli , Li Fei-Fei , Daniel Rubin

While federated learning leverages distributed client resources, it faces challenges due to heterogeneous client capabilities. This necessitates allocating models suited to clients' resources and careful parameter aggregation to accommodate…

机器学习 · 计算机科学 2024-10-04 Yujin Shin , Kichang Lee , Sungmin Lee , You Rim Choi , Hyung-Sin Kim , JeongGil Ko

Split Learning (SL) is a promising collaborative machine learning approach, enabling resource-constrained devices to train models without sharing raw data, while reducing computational load and preserving privacy simultaneously. However,…

机器学习 · 计算机科学 2024-11-22 Yunrui Sun , Gang Hu , Yinglei Teng , Dunbo Cai

Federated Learning is a training framework that enables multiple participants to collaboratively train a shared model while preserving data privacy and minimizing communication overhead. The heterogeneity of devices and networking resources…

分布式、并行与集群计算 · 计算机科学 2023-06-08 Rahul Mishra , Hari Prabhat Gupta , Garvit Banga

Federated learning (FL) is usually performed on resource-constrained edge devices, e.g., with limited memory for the computation. If the required memory to train a model exceeds this limit, the device will be excluded from the training.…

机器学习 · 计算机科学 2023-11-28 Kilian Pfeiffer , Ramin Khalili , Jörg Henkel

Edge machine learning involves the deployment of learning algorithms at the network edge to leverage massive distributed data and computation resources to train artificial intelligence (AI) models. Among others, the framework of federated…

信息论 · 计算机科学 2020-07-16 Qunsong Zeng , Yuqing Du , Kaibin Huang , Kin K. Leung

One underlying assumption of recent federated learning (FL) paradigms is that all local models usually share the same network architecture and size, which becomes impractical for devices with different hardware resources. A scalable…

机器学习 · 计算机科学 2022-05-27 Dezhong Yao , Wanning Pan , Michael J O'Neill , Yutong Dai , Yao Wan , Hai Jin , Lichao Sun

Federated Learning (FL) is a novel distributed machine learning which allows thousands of edge devices to train model locally without uploading data concentrically to the server. But since real federated settings are resource-constrained,…

机器学习 · 计算机科学 2024-04-16 Li Li , Moming Duan , Duo Liu , Yu Zhang , Ao Ren , Xianzhang Chen , Yujuan Tan , Chengliang Wang

Mobile devices contribute more than half of the world's web traffic, providing massive and diverse data for powering various federated learning (FL) applications. In order to avoid the communication bottleneck on the parameter server (PS)…

分布式、并行与集群计算 · 计算机科学 2024-10-03 Yunming Liao , Yang Xu , Hongli Xu , Zhiwei Yao , Liusheng Huang , Chunming Qiao

Existing work only effective on a given number of GPUs, often neglecting the complexities involved in manually determining the specific types and quantities of GPUs needed, which can be a significant burden for developers. To address this…

分布式、并行与集群计算 · 计算机科学 2024-12-20 Zihan Chang , Sheng Xiao , Shuibing He , Siling Yang , Zhe Pan , Dong Li

In cross-device Federated Learning (FL) environments, scaling synchronous FL methods is challenging as stragglers hinder the training process. Moreover, the availability of each client to join the training is highly variable over time due…

机器学习 · 计算机科学 2023-04-17 Tuo Zhang , Lei Gao , Sunwoo Lee , Mi Zhang , Salman Avestimehr

As privacy protection gains increasing importance, more models are being trained on edge devices and subsequently merged into the central server through Federated Learning (FL). However, current research overlooks the impact of network…

机器学习 · 计算机科学 2025-08-04 Hangyu Li , Hongyue Wu , Guodong Fan , Zhen Zhang , Shizhan Chen , Zhiyong Feng

Federated learning (FL) has emerged as a solution to deal with the risk of privacy leaks in machine learning training. This approach allows a variety of mobile devices to collaboratively train a machine learning model without sharing the…

机器学习 · 计算机科学 2022-12-01 Young Geun Kim , Carole-Jean Wu

The promotion of large-scale applications of reinforcement learning (RL) requires efficient training computation. While existing parallel RL frameworks encompass a variety of RL algorithms and parallelization techniques, the excessively…

机器学习 · 计算机科学 2023-12-12 Jing Hou , Guang Chen , Ruiqi Zhang , Zhijun Li , Shangding Gu , Changjun Jiang

Federated learning involves training machine learning models over devices or data silos, such as edge processors or data warehouses, while keeping the data local. Training in heterogeneous and potentially massive networks introduces bias…

机器学习 · 计算机科学 2021-06-18 Zichen Ma , Yu Lu , Zihan Lu , Wenye Li , Jinfeng Yi , Shuguang Cui

Federated learning (FL) is able to manage edge devices to cooperatively train a model while maintaining the training data local and private. One common assumption in FL is that all edge devices share the same machine learning model in…

机器学习 · 计算机科学 2022-07-07 Chan Yun Hin , Ngai Edith

A novel federated learning training framework for heterogeneous environments is presented, taking into account the diverse network speeds of clients in realistic settings. This framework integrates asynchronous learning algorithms and…

机器学习 · 计算机科学 2024-03-26 Chengjie Ma

The key premise of federated learning (FL) is to train ML models across a diverse set of data-owners (clients), without exchanging local data. An overarching challenge to this date is client heterogeneity, which may arise not only from…

Federated learning encounters a critical challenge of data heterogeneity, adversely affecting the performance and convergence of the federated model. Various approaches have been proposed to address this issue, yet their effectiveness is…

机器学习 · 计算机科学 2023-12-06 Jinqian Chen , Jihua Zhu , Qinghai Zheng

Edge AI has been recently proposed to facilitate the training and deployment of Deep Neural Network (DNN) models in proximity to the sources of data. To enable the training of large models on resource-constraint edge devices and protect…

分布式、并行与集群计算 · 计算机科学 2024-03-26 Mingjin Zhang , Jiannong Cao , Yuvraj Sahni , Xiangchun Chen , Shan Jiang