English
Related papers

Related papers: Federated Learning with Hypergradient-based Online…

200 papers

Federated Learning (FL) endeavors to harness decentralized data while preserving privacy, facing challenges of performance, scalability, and collaboration. Asynchronous Federated Learning (AFL) methods have emerged as promising alternatives…

Machine Learning · Computer Science 2024-06-06 Jeffrey Ma , Alan Tu , Yiling Chen , Vijay Janapa Reddi

We propose a novel framework to study asynchronous federated learning optimization with delays in gradient updates. Our theoretical framework extends the standard FedAvg aggregation scheme by introducing stochastic aggregation weights to…

Machine Learning · Computer Science 2022-06-22 Yann Fraboni , Richard Vidal , Laetitia Kameni , Marco Lorenzi

In an asynchronous federated learning framework, the server updates the global model once it receives an update from a client instead of waiting for all the updates to arrive as in the synchronous setting. This allows heterogeneous devices…

Machine Learning · Computer Science 2022-06-08 Qiyuan Wang , Qianqian Yang , Shibo He , Zhiguo Shi , Jiming Chen

Although federated learning has achieved many breakthroughs recently, the heterogeneous nature of the learning environment greatly limits its performance and hinders its real-world applications. The heterogeneous data, time-varying wireless…

Machine Learning · Computer Science 2023-02-22 Jingxin Li , Toktam Mahmoodi , Hak-Keung Lam

This paper investigates federated learning in a wireless communication system, where random device selection is employed with non-independent and identically distributed (non-IID) data. The analysis indicates that while training deep…

Signal Processing · Electrical Eng. & Systems 2024-05-28 Kaidi Wang , Zhiguo Ding , Daniel K. C. So , Zhi Ding

Asynchronous Federated Learning (AFL) confronts inherent challenges arising from the heterogeneity of devices (e.g., their computation capacities) and low-bandwidth environments, both potentially causing stale model updates (e.g., local…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-09 Jiajun Song , Jiajun Luo , Rongwei Lu , Shuzhao Xie , Bin Chen , Zhi Wang

Federated learning (FL) has emerged as a promising paradigm for privacy-preserving distributed machine learning, but faces challenges with heterogeneous data distributions across clients. This paper presents FedSat, a novel FL approach…

Machine Learning · Computer Science 2024-12-31 Sujit Chowdhury , Raju Halder

Decentralized federated learning (DFL) is an emerging paradigm to enable edge devices collaboratively training a learning model using a device-to-device (D2D) communication manner without the coordination of a parameter server (PS).…

Signal Processing · Electrical Eng. & Systems 2025-11-06 Zhiyuan Zhai , Xiaojun Yuan , Xin Wang , Geoffrey Ye Li

There has been a surge of interest in continual learning and federated learning, both of which are important in deep neural networks in real-world scenarios. Yet little research has been done regarding the scenario where each client learns…

Machine Learning · Computer Science 2021-06-15 Jaehong Yoon , Wonyong Jeong , Giwoong Lee , Eunho Yang , Sung Ju Hwang

In this paper, a new learning algorithm for Federated Learning (FL) is introduced. The proposed scheme is based on a weighted gradient aggregation using two-step optimization to offer a flexible training pipeline. Herein, two different…

Machine Learning · Computer Science 2021-06-15 Dimitrios Dimitriadis , Kenichi Kumatani , Robert Gmyr , Yashesh Gaur , Sefik Emre Eskimez

Federated learning often suffers from slow and unstable convergence due to the heterogeneous characteristics of participating client datasets. Such a tendency is aggravated when the client participation ratio is low since the information…

Machine Learning · Computer Science 2024-04-02 Geeho Kim , Jinkyu Kim , Bohyung Han

Heterogeneity is a fundamental and challenging issue in federated learning, especially for the graph data due to the complex relationships among the graph nodes. To deal with the heterogeneity, lots of existing methods perform the weighted…

Machine Learning · Computer Science 2024-12-17 Wentao Yu , Shuo Chen , Yongxin Tong , Tianlong Gu , Chen Gong

Federated learning (FL) is capable of performing large distributed machine learning tasks across multiple edge users by periodically aggregating trained local parameters. To address key challenges of enabling FL over a wireless fog-cloud…

Machine Learning · Computer Science 2024-10-28 Van-Dinh Nguyen , Symeon Chatzinotas , Bjorn Ottersten , Trung Q. Duong

Federated learning (FL) has emerged as a promising paradigm in machine learning, enabling collaborative model training across decentralized devices without the need for raw data sharing. In FL, a global model is trained iteratively on local…

Machine Learning · Computer Science 2025-04-01 Kanishka Ranaweera , Azadeh Ghari Neiat , Xiao Liu , Bipasha Kashyap , Pubudu N. Pathirana

Over-the-air computation is a communication-efficient solution for federated learning (FL). In such a system, iterative procedure is performed: Local gradient of private loss function is updated, amplified and then transmitted by every…

Machine Learning · Computer Science 2023-09-06 Rongfei Fan , Xuming An , Shiyuan Zuo , Han Hu

Motivated by the drawbacks of cloud-based federated learning (FL), cooperative federated edge learning (CFEL) has been proposed to improve efficiency for FL over mobile edge networks, where multiple edge servers collaboratively coordinate…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-22 Zhenxiao Zhang , Zhidong Gao , Yuanxiong Guo , Yanmin Gong

Federated Learning (FL) has emerged as a promising approach for privacy-preserving model training across decentralized devices. However, it faces challenges such as statistical heterogeneity and susceptibility to adversarial attacks, which…

Machine Learning · Computer Science 2024-12-13 Jialuo He , Wei Chen , Xiaojin Zhang

We propose a simple new aggregation strategy for federated learning that won the MICCAI Federated Tumor Segmentation Challenge 2021 (FETS), the first ever challenge on Federated Learning in the Machine Learning community. Our method…

Federated learning is a machine learning training paradigm that enables clients to jointly train models without sharing their own localized data. However, the implementation of federated learning in practice still faces numerous challenges,…

Machine Learning · Computer Science 2023-04-21 Yujia Wang , Lu Lin , Jinghui Chen

The performance of Federated learning (FL) is negatively affected by device differences and statistical characteristics between participating clients. To address this issue, we introduce a deep unfolding network (DUN)-based technique that…

Machine Learning · Computer Science 2023-07-03 Shanika I Nanayakkara , Shiva Raj Pokhrel , Gang Li