English
Related papers

Related papers: Decentralized Federated Averaging via Random Walk

200 papers

The Federated Averaging (FedAvg) algorithm, which consists of alternating between a few local stochastic gradient updates at client nodes, followed by a model averaging update at the server, is perhaps the most commonly used method in…

Machine Learning · Computer Science 2022-05-30 Liam Collins , Hamed Hassani , Aryan Mokhtari , Sanjay Shakkottai

Federated learning (FL) enables collaborative machine learning across distributed data owners, but data heterogeneity poses a challenge for model calibration. While prior work focused on improving accuracy for non-iid data, calibration…

Machine Learning · Computer Science 2024-06-05 Hongyi Peng , Han Yu , Xiaoli Tang , Xiaoxiao Li

As two mainstream frameworks in federated learning (FL), both centralized and decentralized approaches have shown great application value in practical scenarios. However, existing studies do not provide sufficient evidence and clear…

Machine Learning · Computer Science 2024-10-15 Yan Sun , Li Shen , Dacheng Tao

Federated Learning (FL) is a decentralized learning method used to train machine learning algorithms. In FL, a global model iteratively collects the parameters of local models without accessing their local data. However, a significant…

Machine Learning · Computer Science 2023-08-29 Mingjie Wang , Jianxiong Guo , Weijia Jia

Classic Machine Learning techniques require training on data available in a single data lake. However, aggregating data from different owners is not always convenient for different reasons, including security, privacy and secrecy. Data…

Machine Learning · Computer Science 2023-04-03 Bruno Casella , Roberto Esposito , Carlo Cavazzoni , Marco Aldinucci

Federated Learning (FL) is a variant of distributed learning where edge devices collaborate to learn a model without sharing their data with the central server or each other. We refer to the process of training multiple independent models…

Machine Learning · Computer Science 2022-09-22 Neelkamal Bhuyan , Sharayu Moharir , Gauri Joshi

Federated Learning (FL), as a privacy-preserving machine learning paradigm, trains a global model across devices without exposing local data. However, resource heterogeneity and inevitable stragglers in wireless networks severely impact the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-20 Youquan Xian , Xiaoyun Gan , Chuanjian Yao , Dongcheng Li , Peng Wang , Peng Liu , Ying Zhao

The emerging machine learning paradigm of decentralized federated learning (DFL) has the promise of greatly boosting the deployment of artificial intelligence (AI) by directly learning across distributed agents without centralized…

Machine Learning · Computer Science 2024-08-12 Yudi Huang , Tingyang Sun , Ting He

Federated learning is a distributed machine learning paradigm in which a large number of clients coordinate with a central server to learn a model without sharing their own training data. Standard federated optimization methods such as…

Federated learning (FL) aims at optimizing a shared global model over multiple edge devices without transmitting (private) data to the central server. While it is theoretically well-known that FL yields an optimal model -- centrally trained…

Machine Learning · Computer Science 2022-11-01 Youngjoon Lee , Sangwoo Park , Joonhyuk Kang

The ever-growing volume and decentralized nature of data, coupled with the need to harness it and extract knowledge, have led to the extensive use of distributed deep learning (DDL) techniques for training. These techniques rely on local…

Machine Learning · Computer Science 2024-11-22 Michail Theologitis , Georgios Frangias , Georgios Anestis , Vasilis Samoladas , Antonios Deligiannakis

Federated Learning (FL) has emerged as a key approach for distributed machine learning, enhancing online personalization while ensuring user data privacy. Instead of sending private data to a central server as in traditional approaches, FL…

Information Retrieval · Computer Science 2023-09-19 Francesco Fabbri , Xianghang Liu , Jack R. McKenzie , Bartlomiej Twardowski , Tri Kurniawan Wijaya

Federated learning (FL) is a distributed learning methodology that allows multiple nodes to cooperatively train a deep learning model, without the need to share their local data. It is a promising solution for telemonitoring systems that…

Machine Learning · Computer Science 2021-07-15 Alaa Awad Abdellatif , Naram Mhaisen , Amr Mohamed , Aiman Erbad , Mohsen Guizani , Zaher Dawy , Wassim Nasreddine

In traffic prediction, the goal is to estimate traffic speed or flow in specific regions or road segments using historical data collected by devices deployed in each area. Each region or road segment can be viewed as an individual client…

Machine Learning · Computer Science 2025-07-15 Audri Banik , Glaucio Haroldo Silva de Carvalho , Renata Dividino

Federated Learning (FL) trains a shared model using data and computation power on distributed agents coordinated by a central server. Decentralized FL (DFL) utilizes local model exchange and aggregation between agents to reduce the…

Machine Learning · Computer Science 2025-02-05 Xiaoyu Wang , Guojun Xiong , Houwei Cao , Jian Li , Yong Liu

In cross-device federated learning (FL) with millions of mobile clients, only a small subset of clients participate in training in every communication round, and Federated Averaging (FedAvg) is the most popular algorithm in practice.…

Machine Learning · Computer Science 2024-10-03 Zhenyu Sun , Ziyang Zhang , Zheng Xu , Gauri Joshi , Pranay Sharma , Ermin Wei

Federated Learning (FL) is a decentralized model training approach that preserves data privacy but struggles with low efficiency. Quantization, a powerful training optimization technique, has been widely explored for integration into FL.…

Machine Learning · Computer Science 2025-05-20 Zihao Zheng , Ziyao Wang , Xiuping Cui , Maoliang Li , Jiayu Chen , Yun , Liang , Ang Li , Xiang Chen

Federated learning has been identified as an efficient decentralized training paradigm for scaling the machine learning model training on a large number of devices while guaranteeing the data privacy of the trainers. FedAvg has become a…

Machine Learning · Computer Science 2024-04-23 Haotian Xu , Zhaorui Zhang , Sheng Di , Benben Liu , Khalid Ayed Alharthi , Jiannong Cao

With privacy as a motivation, Federated Learning (FL) is an increasingly used paradigm where learning takes place collectively on edge devices, each with a cache of user-generated training examples that remain resident on the local device.…

Machine Learning · Computer Science 2021-11-25 Sean Augenstein , Andrew Hard , Kurt Partridge , Rajiv Mathews

Federated Learning (FL) is a distributed learning paradigm that can learn a global or personalized model from decentralized datasets on edge devices. However, in the computer vision domain, model performance in FL is far behind centralized…