中文
相关论文

相关论文: Kuramoto-FedAvg: Using Synchronization Dynamics to…

200 篇论文

Federated learning has emerged as a new paradigm of collaborative machine learning; however, it has also faced several challenges such as non-independent and identically distributed(IID) data and high communication cost. To this end, we…

机器学习 · 计算机科学 2020-12-10 Jin-woo Lee , Jaehoon Oh , Yooju Shin , Jae-Gil Lee , Se-Young Yoon

Federated learning (FL) is a machine learning paradigm where a shared central model is learned across distributed edge devices while the training data remains on these devices. Federated Averaging (FedAvg) is the leading optimization method…

分布式、并行与集群计算 · 计算机科学 2020-10-22 Yujing Chen , Yue Ning , Martin Slawski , Huzefa Rangwala

Federated learning often suffers from slow and unstable convergence due to the heterogeneous characteristics of participating client datasets. Such a tendency is aggravated when the client participation ratio is low since the information…

机器学习 · 计算机科学 2024-04-02 Geeho Kim , Jinkyu Kim , Bohyung Han

In Federated Learning (FL), the distributed nature and heterogeneity of client data present both opportunities and challenges. While collaboration among clients can significantly enhance the learning process, not all collaborations are…

机器学习 · 计算机科学 2024-07-18 Nazarii Tupitsa , Samuel Horváth , Martin Takáč , Eduard Gorbunov

Federated Learning (FL) has emerged as a prominent distributed machine learning framework that enables geographically discrete clients to train a global model collaboratively while preserving their privacy-sensitive data. However, due to…

分布式、并行与集群计算 · 计算机科学 2024-04-15 Shensheng Zheng , Wenhao Yuan , Xuehe Wang , Lingjie Duan

Federated learning (FL) is an emerging distributed machine learning paradigm that enables collaborative training of machine learning models over decentralized devices without exposing their local data. One of the major challenges in FL is…

分布式、并行与集群计算 · 计算机科学 2024-07-11 Md Sirajul Islam , Simin Javaherian , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

Recent attacks have shown that user data can be recovered from FedSGD updates, thus breaking privacy. However, these attacks are of limited practical relevance as federated learning typically uses the FedAvg algorithm. Compared to FedSGD,…

机器学习 · 计算机科学 2022-11-02 Dimitar I. Dimitrov , Mislav Balunović , Nikola Konstantinov , Martin Vechev

A novel federated learning training framework for heterogeneous environments is presented, taking into account the diverse network speeds of clients in realistic settings. This framework integrates asynchronous learning algorithms and…

机器学习 · 计算机科学 2024-03-26 Chengjie Ma

Traditional Federated Learning (FL) faces significant challenges in terms of efficiency and accuracy, particularly in heterogeneous environments where clients employ diverse model architectures and have varying computational resources. Such…

机器学习 · 计算机科学 2025-05-13 Jiacheng Wang , Hongtao Lv , Lei Liu

Federated Learning (FL) is a promising decentralized learning framework and has great potentials in privacy preservation and in lowering the computation load at the cloud. Recent work showed that FedAvg and FedProx - the two widely-adopted…

机器学习 · 统计学 2022-02-16 Lili Su , Jiaming Xu , Pengkun Yang

This work addresses the key challenges of applying federated learning to large-scale deep neural networks, particularly the issue of client drift due to data heterogeneity across clients and the high costs of communication, computation, and…

机器学习 · 计算机科学 2025-09-08 Jiaojiao Zhang , Yuqi Xu , Kun Yuan

Federated Learning (FL) has become a popular paradigm for learning from distributed data. To effectively utilize data at different devices without moving them to the cloud, algorithms such as the Federated Averaging (FedAvg) have adopted a…

机器学习 · 计算机科学 2021-11-24 Xinwei Zhang , Mingyi Hong , Sairaj Dhople , Wotao Yin , Yang Liu

In federated optimization, heterogeneity in the clients' local datasets and computation speeds results in large variations in the number of local updates performed by each client in each communication round. Naive weighted aggregation of…

机器学习 · 计算机科学 2020-07-16 Jianyu Wang , Qinghua Liu , Hao Liang , Gauri Joshi , H. Vincent Poor

Federated learning (FL) has emerged as a promising paradigm for privacy-preserving distributed machine learning, but faces challenges with heterogeneous data distributions across clients. This paper presents FedSat, a novel FL approach…

机器学习 · 计算机科学 2024-12-31 Sujit Chowdhury , Raju Halder

The heterogeneity of hardware and data is a well-known and studied problem in the community of Federated Learning (FL) as running under heterogeneous settings. Recently, custom-size client models trained with Knowledge Distillation (KD) has…

机器学习 · 计算机科学 2022-11-15 Hongrui Shi , Valentin Radu , Po Yang

To improve the efficiency of reinforcement learning (RL), we propose a novel asynchronous federated reinforcement learning (FedRL) framework termed AFedPG, which constructs a global model through collaboration among $N$ agents using policy…

机器学习 · 计算机科学 2025-01-27 Guangchen Lan , Dong-Jun Han , Abolfazl Hashemi , Vaneet Aggarwal , Christopher G. Brinton

Federated learning is a decentralized machine learning framework that enables collaborative model training without revealing raw data. Due to the diverse hardware and software limitations, a client may not always be available for the…

机器学习 · 计算机科学 2024-02-21 Lili Su , Ming Xiang , Jiaming Xu , Pengkun Yang

Asynchronous federated learning aims to solve the straggler problem in heterogeneous environments, i.e., clients have small computational capacities that could cause aggregation delay. The principle of asynchronous federated learning is to…

分布式、并行与集群计算 · 计算机科学 2023-06-05 Xiang Ma , Qun Wang , Haijian Sun , Rose Qingyang Hu , Yi Qian

Federated averaging (FedAvg) is a communication efficient algorithm for the distributed training with an enormous number of clients. In FedAvg, clients keep their data locally for privacy protection; a central parameter server is used to…

分布式、并行与集群计算 · 计算机科学 2021-04-26 Tao Sun , Dongsheng Li , Bao Wang

Federated Learning is a novel paradigm that involves learning from data samples distributed across a large network of clients while the data remains local. It is, however, known that federated learning is prone to multiple system challenges…

机器学习 · 计算机科学 2021-01-01 Amirhossein Reisizadeh , Isidoros Tziotis , Hamed Hassani , Aryan Mokhtari , Ramtin Pedarsani