English
Related papers

Related papers: Mime: Mimicking Centralized Stochastic Algorithms …

200 papers

With the advent of interconnected and sensor-equipped edge devices, Federated Learning (FL) has gained significant attention, enabling decentralized learning while maintaining data privacy. However, FL faces two challenges in real-world…

Machine Learning · Computer Science 2023-12-13 Manuel Röder , Leon Heller , Maximilian Münch , Frank-Michael Schleif

Traditional machine learning relies on a centralized data pipeline, i.e., data are provided to a central server for model training. In many applications, however, data are inherently fragmented. Such a decentralized nature of these…

Machine Learning · Computer Science 2021-11-02 Ye Yuan , Jun Liu , Dou Jin , Zuogong Yue , Ruijuan Chen , Maolin Wang , Chuan Sun , Lei Xu , Feng Hua , Xin He , Xinlei Yi , Tao Yang , Hai-Tao Zhang , Shaochun Sui , Han Ding

Federated Learning is an emerging learning paradigm that allows training models from samples distributed across a large network of clients while respecting privacy and communication restrictions. Despite its success, federated learning…

Machine Learning · Computer Science 2022-06-07 Isidoros Tziotis , Zebang Shen , Ramtin Pedarsani , Hamed Hassani , Aryan Mokhtari

Federated learning (FL) enables collaborative model training across distributed edge devices while preserving data privacy, and typically operates in a round-based synchronous manner. However, synchronous FL suffers from latency bottlenecks…

Machine Learning · Computer Science 2026-03-17 Asaf Goren , Natalie Lang , Nir Shlezinger , Alejandro Cohen

Federated learning enables training on a massive number of edge devices. To improve flexibility and scalability, we propose a new asynchronous federated optimization algorithm. We prove that the proposed approach has near-linear convergence…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-08 Cong Xie , Sanmi Koyejo , Indranil Gupta

Federated learning (FL) is typically performed in a synchronous parallel manner, where the involvement of a slow client delays a training iteration. Current FL systems employ a participant selection strategy to select fast clients with…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-22 Zhifeng Jiang , Wei Wang , Baochun Li , Bo Li

Federated Learning (FL) is a learning paradigm that protects privacy by keeping client data on edge devices. However, optimizing FL in practice can be difficult due to the diversity and heterogeneity of the learning system. Despite recent…

Machine Learning · Computer Science 2023-02-21 Yongxin Guo , Tao Lin , Xiaoying Tang

One of the key challenges in federated learning (FL) is local data distribution heterogeneity across clients, which may cause inconsistent feature spaces across clients. To address this issue, we propose a novel method FedFM, which guides…

Machine Learning · Computer Science 2022-10-17 Rui Ye , Zhenyang Ni , Chenxin Xu , Jianyu Wang , Siheng Chen , Yonina C. Eldar

Federated Learning (FL) is a distributed training paradigm that enables clients scattered across the world to cooperatively learn a global model without divulging confidential data. However, FL faces a significant challenge in the form of…

Machine Learning · Computer Science 2023-11-16 Xidong Wu , Wan-Yi Lin , Devin Willmott , Filipe Condessa , Yufei Huang , Zhenzhen Li , Madan Ravi Ganesh

Federated learning has emerged as an umbrella term for centralized coordination strategies in multi-agent environments. While many federated learning architectures process data in an online manner, and are hence adaptive by nature, most…

Machine Learning · Computer Science 2020-05-06 Elsa Rizk , Stefan Vlaski , Ali H. Sayed

In Federated Learning, we aim to train models across multiple computing units (users), while users can only communicate with a common central server, without exchanging their data samples. This mechanism exploits the computational power of…

Machine Learning · Computer Science 2020-10-26 Alireza Fallah , Aryan Mokhtari , Asuman Ozdaglar

Federated learning has emerged as an innovative paradigm of collaborative machine learning. Unlike conventional machine learning, a global model is collaboratively learned while data remains distributed over a tremendous number of client…

Machine Learning · Computer Science 2020-12-08 Taehyeon Kim , Sangmin Bae , Jin-woo Lee , Seyoung Yun

Federated learning is a distributed optimization paradigm that allows training machine learning models across decentralized devices while keeping the data localized. The standard method, FedAvg, suffers from client drift which can hamper…

Machine Learning · Computer Science 2024-04-15 Xiaowen Jiang , Anton Rodomanov , Sebastian U. Stich

Federated Learning (FL) can be coordinated under the orchestration of a central server to collaboratively build a privacy-preserving model without the need for data exchange. However, participant data heterogeneity leads to local optima…

Machine Learning · Computer Science 2024-08-30 Boyuan Li , Zihao Peng , Yafei Li , Mingliang Xu , Shengbo Chen , Baofeng Ji , Cong Shen

Federated Learning (FL) aims to learn a single global model that enables the central server to help the model training in local clients without accessing their local data. The key challenge of FL is the heterogeneity of local data in…

Machine Learning · Computer Science 2023-04-17 Sicong Liang , Junchao Tian , Shujun Yang , Yu Zhang

Federated learning (FL) enables distributed model training from local data collected by users. In distributed systems with constrained resources and potentially high dynamics, e.g., mobile edge networks, the efficiency of FL is an important…

Machine Learning · Computer Science 2022-12-19 Shiqiang Wang , Jake Perazzone , Mingyue Ji , Kevin S. Chan

Federated learning has emerged as a promising approach for training machine learning models on decentralized data sources while preserving data privacy. However, challenges such as communication bottlenecks, heterogeneity of client devices,…

Machine Learning · Computer Science 2023-12-27 Anna Vettoruzzo , Mohamed-Rafik Bouguelia , Thorsteinn Rögnvaldsson

Federated learning (FL) systems face performance challenges in dealing with heterogeneous devices and non-identically distributed data across clients. We propose a dynamic global model aggregation method within Asynchronous Federated…

Machine Learning · Computer Science 2024-02-02 Jikun Gao , Ioannis Mavromatis , Peizheng Li , Pietro Carnelli , Aftab Khan

With the development of federated learning (FL), mobile devices (MDs) are able to train their local models with private data and sends them to a central server for aggregation, thereby preventing sensitive raw data leakage. In this paper,…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-15 Shunfeng Chu , Jun Li , Jianxin Wang , Zhe Wang , Ming Ding , Yijin Zang , Yuwen Qian , Wen Chen

Clustered Federated Multitask Learning (CFL) was introduced as an efficient scheme to obtain reliable specialized models when data is imbalanced and distributed in a non-i.i.d. (non-independent and identically distributed) fashion amongst…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-20 Abdullatif Albaseer , Mohamed Abdallah , Ala Al-Fuqaha , Aiman Erbad