English
Related papers

Related papers: Communication-Efficient Agnostic Federated Averagi…

200 papers

Federated learning offers a promising approach under the constraints of networking and data privacy constraints in aerial and space networks (ASNs), utilizing large-scale private edge data from drones, balloons, and satellites. Existing…

Machine Learning · Computer Science 2024-04-18 Fan Dong , Ali Abbasi , Henry Leung , Xin Wang , Jiayu Zhou , Steve Drew

Learning over massive data stored in different locations is essential in many real-world applications. However, sharing data is full of challenges due to the increasing demands of privacy and security with the growing use of smart mobile…

Machine Learning · Computer Science 2022-10-11 Jinjin Xu , Wenli Du , Ran Cheng , Wangli He , Yaochu Jin

Smart devices, such as smartphones, wearables, robots, and others, can collect vast amounts of data from their environment. This data is suitable for training machine learning models, which can significantly improve their behavior, and…

Machine Learning · Computer Science 2021-07-16 Fernando E. Casado , Dylan Lema , Marcos F. Criado , Roberto Iglesias , Carlos V. Regueiro , Senén Barro

In Federated Learning (FL) client devices connected over the internet collaboratively train a machine learning model without sharing their private data with a central server or with other clients. The seminal Federated Averaging (FedAvg)…

Machine Learning · Computer Science 2023-05-17 Jed Mills , Jia Hu , Geyong Min

Federated learning often suffers from slow and unstable convergence due to the heterogeneous characteristics of participating client datasets. Such a tendency is aggravated when the client participation ratio is low since the information…

Machine Learning · Computer Science 2024-04-02 Geeho Kim , Jinkyu Kim , Bohyung Han

Federated Learning (FL), a distributed learning paradigm that scales on-device learning collaboratively, has emerged as a promising approach for decentralized AI applications. Local optimization methods such as Federated Averaging (FedAvg)…

Machine Learning · Computer Science 2024-01-25 Honglin Yuan

Federated learning has received significant attention as a potential solution for distributing machine learning (ML) model training through edge networks. This work addresses an important consideration of federated learning at the network…

Machine Learning · Computer Science 2020-08-24 Frank Po-Chen Lin , Christopher G. Brinton , Nicolò Michelusi

We consider federated learning (FL), where the training data is distributed across a large number of clients. The standard optimization method in this setting is Federated Averaging (FedAvg), which performs multiple local first-order…

Machine Learning · Computer Science 2021-09-07 Sebastian Bischoff , Stephan Günnemann , Martin Jaggi , Sebastian U. Stich

Federated averaging (FedAvg) is the most fundamental algorithm in Federated learning (FL). Previous theoretical results assert that FedAvg convergence and generalization degenerate under heterogeneous clients. However, recent empirical…

Machine Learning · Computer Science 2024-12-16 Dun Zeng , Zenglin Xu , Shiyu Liu , Yu Pan , Qifan Wang , Xiaoying Tang

Federated Averaging (FedAvg) and its variants are the most popular optimization algorithms in federated learning (FL). Previous convergence analyses of FedAvg either assume full client participation or partial client participation where the…

Machine Learning · Computer Science 2023-02-08 Yae Jee Cho , Pranay Sharma , Gauri Joshi , Zheng Xu , Satyen Kale , Tong Zhang

Federated learning is a framework for distributed optimization that places emphasis on communication efficiency. In particular, it follows a client-server broadcast model and is particularly appealing because of its ability to accommodate…

Machine Learning · Computer Science 2022-03-30 Han Wang , Siddartha Marella , James Anderson

Federated learning has become a promising solution for collaboration among medical institutions. However, data owned by each institution would be highly heterogeneous and the distribution is always non-independent and identical distribution…

Machine Learning · Computer Science 2024-12-25 Guochen Yan , Luyuan Xie , Xinyi Gao , Wentao Zhang , Qingni Shen , Yuejian Fang , Zhonghai Wu

Federated learning is a distributed and privacy-preserving approach to train a statistical model collaboratively from decentralized data of different parties. However, when datasets of participants are not independent and identically…

Machine Learning · Computer Science 2023-01-24 Li Ju , Tianru Zhang , Salman Toor , Andreas Hellander

With the wealth of information produced by social networks, smartphones, medical or financial applications, speculations have been raised about the sensitivity of such data in terms of users' personal privacy and data security. To address…

Machine Learning · Computer Science 2019-08-21 Vito Walter Anelli , Yashar Deldjoo , Tommaso Di Noia , Antonio Ferrara

Federated learning (FL) is a widely employed distributed paradigm for collaboratively training machine learning models from multiple clients without sharing local data. In practice, FL encounters challenges in dealing with partial client…

Machine Learning · Computer Science 2024-10-30 Xin Liu , Wei li , Dazhi Zhan , Yu Pan , Xin Ma , Yu Ding , Zhisong Pan

Federated learning has emerged as an innovative paradigm of collaborative machine learning. Unlike conventional machine learning, a global model is collaboratively learned while data remains distributed over a tremendous number of client…

Machine Learning · Computer Science 2020-12-08 Taehyeon Kim , Sangmin Bae , Jin-woo Lee , Seyoung Yun

Federated learning (FL), as an emerging distributed machine learning paradigm, allows a mass of edge devices to collaboratively train a global model while preserving privacy. In this tutorial, we focus on FL via over-the-air computation…

Machine Learning · Computer Science 2023-10-17 Jingyang Zhu , Yuanming Shi , Yong Zhou , Chunxiao Jiang , Wei Chen , Khaled B. Letaief

Statistical and systematic challenges in collaboratively training machine learning models across distributed networks of mobile devices have been the bottlenecks in the real-world application of federated learning. In this work, we show…

Machine Learning · Computer Science 2019-12-17 Fei Chen , Mi Luo , Zhenhua Dong , Zhenguo Li , Xiuqiang He

In recent years, distributed optimization is proven to be an effective approach to accelerate training of large scale machine learning models such as deep neural networks. With the increasing computation power of GPUs, the bottleneck of…

Machine Learning · Computer Science 2021-09-14 Xiangyi Chen , Xiaoyun Li , Ping Li

Federated learning systems facilitate training of global models in settings where potentially heterogeneous data is distributed across a large number of clients. Such systems operate in settings with intermittent client availability and/or…

Machine Learning · Computer Science 2023-03-22 Monica Ribero , Haris Vikalo , Gustavo De Veciana