English
Related papers

Related papers: Faster Adaptive Federated Learning

200 papers

Federated Learning (FL) is an increasingly popular machine learning paradigm in which multiple nodes try to collaboratively learn under privacy, communication and multiple heterogeneity constraints. A persistent problem in federated…

Machine Learning · Computer Science 2022-02-24 Elnur Gasanov , Ahmed Khaled , Samuel Horváth , Peter Richtárik

We propose \texttt{FedGLOMO}, a novel federated learning (FL) algorithm with an iteration complexity of $\mathcal{O}(\epsilon^{-1.5})$ to converge to an $\epsilon$-stationary point (i.e., $\mathbb{E}[\|\nabla f(\bm{x})\|^2] \leq \epsilon$)…

Machine Learning · Statistics 2021-10-26 Rudrajit Das , Anish Acharya , Abolfazl Hashemi , Sujay Sanghavi , Inderjit S. Dhillon , Ufuk Topcu

Federated learning (FL) algorithms usually sample a fraction of clients in each round (partial participation) when the number of participants is large and the server's communication bandwidth is limited. Recent works on the convergence…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-23 Bing Luo , Wenli Xiao , Shiqiang Wang , Jianwei Huang , Leandros Tassiulas

The future of machine learning lies in moving data collection along with training to the edge. Federated Learning, for short FL, has been recently proposed to achieve this goal. The principle of this approach is to aggregate models learned…

Machine Learning · Computer Science 2023-07-13 Adnan Ben Mansour , Gaia Carenini , Alexandre Duplessis

With the rapid growth in mobile computing, massive amounts of data and computing resources are now located at the edge. To this end, Federated learning (FL) is becoming a widely adopted distributed machine learning (ML) paradigm, which aims…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-15 Li Chou , Zichang Liu , Zhuang Wang , Anshumali Shrivastava

Federated learning (FL) is emerging as a new paradigm to train machine learning models in distributed systems. Rather than sharing, and disclosing, the training dataset with the server, the model parameters (e.g. neural networks weights and…

Signal Processing · Electrical Eng. & Systems 2020-05-27 Stefano Savazzi , Monica Nicoli , Vittorio Rampa

Federated learning (FL), as an emerging distributed machine learning paradigm, allows a mass of edge devices to collaboratively train a global model while preserving privacy. In this tutorial, we focus on FL via over-the-air computation…

Machine Learning · Computer Science 2023-10-17 Jingyang Zhu , Yuanming Shi , Yong Zhou , Chunxiao Jiang , Wei Chen , Khaled B. Letaief

Federated learning (FL) aims at optimizing a shared global model over multiple edge devices without transmitting (private) data to the central server. While it is theoretically well-known that FL yields an optimal model -- centrally trained…

Machine Learning · Computer Science 2022-11-01 Youngjoon Lee , Sangwoo Park , Joonhyuk Kang

Federated learning (FL) enables resource-constrained edge nodes to collaboratively learn a global model under the orchestration of a central server while keeping privacy-sensitive data locally. The…

Machine Learning · Computer Science 2021-04-07 Hongda Wu , Ping Wang

Federated Learning (FL) enables collaborative learning across distributed clients while preserving data privacy. However, FL faces significant challenges when dealing with heterogeneous data distributions, which can lead to suboptimal…

Machine Learning · Computer Science 2025-03-11 Duy Phuong Nguyen , J. Pablo Munoz , Tanya Roosta , Ali Jannesari

Federated learning (FL) is a recently proposed distributed machine learning paradigm dealing with distributed and private data sets. Based on the data partition pattern, FL is often categorized into horizontal, vertical, and hybrid…

Machine Learning · Computer Science 2021-02-19 Xinwei Zhang , Wotao Yin , Mingyi Hong , Tianyi Chen

Bilevel Optimization has witnessed notable progress recently with new emerging efficient algorithms and has been applied to many machine learning tasks such as data cleaning, few-shot learning, and neural architecture search. However,…

Machine Learning · Computer Science 2022-05-04 Junyi Li , Feihu Huang , Heng Huang

Federated learning is a paradigm of distributed machine learning in which multiple clients coordinate with a central server to learn a model, without sharing their own training data. Standard federated optimization methods such as Federated…

Machine Learning · Computer Science 2024-05-15 Sohom Mukherjee , Nicolas Loizou , Sebastian U. Stich

The federated learning (FL) framework trains a machine learning model using decentralized data stored at edge client devices by periodically aggregating locally trained models. Popular optimization algorithms of FL use vanilla (stochastic)…

Machine Learning · Computer Science 2021-06-07 Jianyu Wang , Zheng Xu , Zachary Garrett , Zachary Charles , Luyang Liu , Gauri Joshi

Federated learning (FL) is a distributed machine learning technology for next-generation AI systems that allows a number of workers, i.e., edge devices, collaboratively learn a shared global model while keeping their data locally to prevent…

Networking and Internet Architecture · Computer Science 2022-06-01 Pinyarash Pinyoanuntapong , Prabhu Janakaraj , Ravikumar Balakrishnan , Minwoo Lee , Chen Chen , Pu Wang

Federated Learning (FL) can be used in mobile edge networks to train machine learning models in a distributed manner. Recently, FL has been interpreted within a Model-Agnostic Meta-Learning (MAML) framework, which brings FL significant…

Machine Learning · Computer Science 2023-03-29 Chaoqun You , Kun Guo , Gang Feng , Peng Yang , Tony Q. S. Quek

Federated learning uses a set of techniques to efficiently distribute the training of a machine learning algorithm across several devices, who own the training data. These techniques critically rely on reducing the communication cost -- the…

Machine Learning · Computer Science 2022-06-08 Lukang Sun , Adil Salim , Peter Richtárik

Federated Learning (FL) has emerged as a new paradigm for training machine learning models distributively without sacrificing data security and privacy. Learning models on edge devices such as mobile phones is one of the most common use…

Machine Learning · Computer Science 2023-02-10 Sixing Yu , Phuong Nguyen , Ali Anwar , Ali Jannesari

There are situations where data relevant to machine learning problems are distributed across multiple locations that cannot share the data due to regulatory, competitiveness, or privacy reasons. Machine learning approaches that require data…

Machine Learning · Computer Science 2022-06-28 Dimitris Stripelis , Jose Luis Ambite

Advances in federated learning (FL) algorithms,along with technologies like differential privacy and homomorphic encryption, have led to FL being increasingly adopted and used in many application domains. This increasing adoption has led to…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-08 K. R. Jayaram , Vinod Muthusamy , Gegi Thomas , Ashish Verma , Mark Purcell