English
Related papers

Related papers: Federated Optimization: Distributed Machine Learni…

200 papers

Federated learning is a distributed, privacy-aware learning scenario which trains a single model on data belonging to several clients. Each client trains a local model on its data and the local models are then aggregated by a central party.…

Machine Learning · Computer Science 2020-01-01 Hesham Mostafa

Federated learning (FL) enables edge nodes to collaboratively contribute to constructing a global model without sharing their data. This is accomplished by devices computing local, private model updates that are then aggregated by a server.…

Machine Learning · Computer Science 2024-06-13 Sadi Alawadi , Addi Ait-Mlouk , Salman Toor , Andreas Hellander

Federated Learning is a distributed machine learning approach which enables model training on a large corpus of decentralized data. We have built a scalable production system for Federated Learning in the domain of mobile devices, based on…

Federated Edge Learning (FEL), an emerging distributed Machine Learning (ML) paradigm, enables model training in a distributed environment while ensuring user privacy by using physical separation for each user data. However, with the…

Machine Learning · Computer Science 2024-10-11 Jingbo Zhang , Qiong Wu , Pingyi Fan , Qiang Fan

Federated learning is a paradigm of distributed machine learning in which multiple clients coordinate with a central server to learn a model, without sharing their own training data. Standard federated optimization methods such as Federated…

Machine Learning · Computer Science 2024-05-15 Sohom Mukherjee , Nicolas Loizou , Sebastian U. Stich

Decentralized optimization methods enable on-device training of machine learning models without a central coordinator. In many scenarios communication between devices is energy demanding and time consuming and forms the bottleneck of the…

Optimization and Control · Mathematics 2020-11-04 Dmitry Kovalev , Anastasia Koloskova , Martin Jaggi , Peter Richtarik , Sebastian U. Stich

Federated learning is a distributed paradigm that aims at training models using samples distributed across multiple users in a network while keeping the samples on users' devices with the aim of efficiency and protecting users privacy. In…

Machine Learning · Computer Science 2020-06-17 Amirhossein Reisizadeh , Farzan Farnia , Ramtin Pedarsani , Ali Jadbabaie

Distributed optimization is fundamental to modern machine learning applications like federated learning, but existing methods often struggle with ill-conditioned problems and face stability-versus-speed tradeoffs. We introduce fractional…

Machine Learning · Computer Science 2024-12-04 Andrei Lixandru , Marcel van Gerven , Sergio Pequito

Federated learning is widely used to perform decentralized training of a global model on multiple devices while preserving the data privacy of each device. However, it suffers from heterogeneous local data on each training device which…

Machine Learning · Computer Science 2023-01-18 Sirui Hu , Ling Feng , Xiaohan Yang , Yongchao Chen

Federated learning (FL) is a useful tool that enables the training of machine learning models over distributed data without having to collect data centrally. When deploying FL in constrained wireless environments, however, intermittent…

Machine Learning · Computer Science 2025-03-04 Jake B. Perazzone , Shiqiang Wang , Mingyue Ji , Kevin Chan

In Federated Learning (FL), with parameter aggregated by a central node, the communication overhead is a substantial concern. To circumvent this limitation and alleviate the single point of failure within the FL framework, recent studies…

Machine Learning · Computer Science 2024-04-01 Zhigang Yan , Dong Li

Federated Learning is a new machine learning paradigm dealing with distributed model learning on independent devices. One of the many advantages of federated learning is that training data stay on devices (such as smartphones), and only…

Machine Learning · Computer Science 2022-07-19 Sannara Ek , Romain Rombourg , François Portet , Philippe Lalanda

Federated learning (FL) enables wireless terminals to collaboratively learn a shared parameter model while keeping all the training data on devices per se. Parameter sharing consists of synchronous and asynchronous ways: the former…

Information Theory · Computer Science 2024-01-17 Haihui Xie , Minghua Xia , Peiran Wu , Shuai Wang , Kaibin Huang

Federated learning has emerged recently as a promising solution for distributing machine learning tasks through modern networks of mobile devices. Recent studies have obtained lower bounds on the expected decrease in model loss that is…

Federated learning (FL) leverages data distributed at the edge of the network to enable intelligent applications. The efficiency of FL can be improved by using over-the-air computation (AirComp) technology in the process of gradient…

Machine Learning · Computer Science 2023-12-20 Fan Zhang , Jining Chen , Kunlun Wang , Wen Chen

In recent advancements in machine learning, federated learning allows a network of distributed clients to collaboratively develop a global model without needing to share their local data. This technique aims to safeguard privacy, countering…

Machine Learning · Computer Science 2024-07-18 Davide Domini , Gianluca Aguzzi , Nicolas Farabegoli , Mirko Viroli , Lukas Esterle

Distributed Learning (DL) enables the training of machine learning models across multiple devices, yet it faces challenges like non-IID data distributions and device capability disparities, which can impede training efficiency.…

Machine Learning · Computer Science 2025-02-20 Mengchen Fan , Keren Li , Tianyun Zhang , Qing Tian , Baocheng Geng

This paper studies a federated edge learning system, in which an edge server coordinates a set of edge devices to train a shared machine learning model based on their locally distributed data samples. During the distributed training, we…

Information Theory · Computer Science 2020-03-03 Xiaopeng Mo , Jie Xu

The popular federated edge learning (FEEL) framework allows privacy-preserving collaborative model training via frequent learning-updates exchange between edge devices and server. Due to the constrained bandwidth, only a subset of devices…

Networking and Internet Architecture · Computer Science 2021-07-27 Maojun Zhang , Guangxu Zhu , Shuai Wang , Jiamo Jiang , Caijun Zhong , Shuguang Cui

The conventional federated learning (FedL) architecture distributes machine learning (ML) across worker devices by having them train local models that are periodically aggregated by a server. FedL ignores two important characteristics of…

Networking and Internet Architecture · Computer Science 2024-08-21 Su Wang , Roberto Morabito , Seyyedali Hosseinalipour , Mung Chiang , Christopher G. Brinton