English
Related papers

Related papers: Effective Federated Adaptive Gradient Methods with…

200 papers

Federated Learning (FL) allows edge devices (or clients) to keep data locally while simultaneously training a shared high-quality global model. However, current research is generally based on an assumption that the training data of local…

Machine Learning · Computer Science 2021-10-27 Zhe Zhang , Shiyao Ma , Jiangtian Nie , Yi Wu , Qiang Yan , Xiaoke Xu , Dusit Niyato

Federated learning protects data privacy and security by exchanging models instead of data. However, unbalanced data distributions among participating clients compromise the accuracy and convergence speed of federated learning algorithms.…

Machine Learning · Computer Science 2022-04-11 Qilong Wu , Lin Liu , Shibei Xue

In federated learning (FL), models must \emph{converge quickly} under tight communication budgets while \emph{generalizing} across non-IID client distributions. These twin requirements have naturally led to two widely used techniques:…

Machine Learning · Computer Science 2025-12-01 Tianle Li , Yongzhi Huang , Linshan Jiang , Chang Liu , Qipeng Xie , Wenfeng Du , Lu Wang , Kaishun Wu

Accelerated gradient-based methods are being extensively used for solving non-convex machine learning problems, especially when the data points are abundant or the available data is distributed across several agents. Two of the prominent…

Machine Learning · Computer Science 2021-10-04 Kushal Chakrabarti , Nikhil Chopra

The Web is naturally heterogeneous with user devices, geographic regions, browsing patterns, and contexts all leading to highly diverse, unique datasets. Federated Learning (FL) is an important paradigm for the Web because it enables…

Machine Learning · Computer Science 2026-02-05 Abdulrahman Alotaibi , Irene Tenison , Miriam Kim , Isaac Lee , Lalana Kagal

Federated Learning (FL) is a machine-learning approach enabling collaborative model training across multiple decentralized edge devices that hold local data samples, all without exchanging these samples. This collaborative process occurs…

Machine Learning · Computer Science 2024-01-02 Venkataraman Natarajan Iyer

Availability of large, diverse, and multi-national datasets is crucial for the development of effective and clinically applicable AI systems in the medical imaging domain. However, forming a global model by bringing these datasets together…

Machine Learning · Computer Science 2022-09-07 Ece Isik-Polat , Gorkem Polat , Altan Kocyigit , Alptekin Temizel

Federated learning offers a paradigm to the challenge of preserving privacy in distributed machine learning. However, datasets distributed across each client in the real world are inevitably heterogeneous, and if the datasets can be…

Machine Learning · Computer Science 2024-09-19 Xiuhua Lu , Peng Li , Xuefeng Jiang

Federated Learning (FL) enables collaborative model training across distributed devices while preserving data privacy. Nonetheless, the heterogeneity of edge devices often leads to inconsistent performance of the globally trained models,…

Machine Learning · Computer Science 2025-05-13 Lin Wang , Zhichao Wang , Ye Shi , Sai Praneeth Karimireddy , Xiaoying Tang

Federated learning involves a mixture of centralized and decentralized processing tasks, where a server regularly selects a sample of the agents and these in turn sample their local data to compute stochastic gradients for their learning…

Machine Learning · Computer Science 2020-10-27 Elsa Rizk , Stefan Vlaski , Ali H. Sayed

Federated Learning (FL) has become an active and promising distributed machine learning paradigm. As a result of statistical heterogeneity, recent studies clearly show that the performance of popular FL methods (e.g., FedAvg) deteriorates…

Machine Learning · Computer Science 2021-06-24 Hua Huang , Fanhua Shang , Yuanyuan Liu , Hongying Liu

Federated learning is a promising paradigm that allows multiple clients to collaboratively train a model without sharing the local data. However, the presence of heterogeneous devices in federated learning, such as mobile phones and IoT…

Machine Learning · Computer Science 2025-09-03 Kai Zhang , Yutong Dai , Hongyi Wang , Eric Xing , Xun Chen , Lichao Sun

Federated learning is a decentralized training approach that keeps data under stakeholder control while achieving superior performance over isolated training. While inter-institutional feature discrepancies pose a challenge in all federated…

Image and Video Processing · Electrical Eng. & Systems 2025-07-01 Vasilis Siomos , Jonathan Passerat-Palmbach , Giacomo Tarroni

Federated Learning (FL) is a variant of distributed learning where edge devices collaborate to learn a model without sharing their data with the central server or each other. We refer to the process of training multiple independent models…

Machine Learning · Computer Science 2022-09-22 Neelkamal Bhuyan , Sharayu Moharir , Gauri Joshi

Adaptive optimization methods, which perform local optimization with a metric constructed from the history of iterates, are becoming increasingly popular for training deep neural networks. Examples include AdaGrad, RMSProp, and Adam. We…

Machine Learning · Statistics 2018-05-23 Ashia C. Wilson , Rebecca Roelofs , Mitchell Stern , Nathan Srebro , Benjamin Recht

Federated Learning (FL) is a distributed machine learning framework in communication network systems. However, the systems' Non-Independent and Identically Distributed (Non-IID) data negatively affect the convergence efficiency of the…

Machine Learning · Computer Science 2025-07-04 Ping Luo , Xiaoge Deng , Ziqing Wen , Tao Sun , Dongsheng Li

Federated learning (FL) is usually performed on resource-constrained edge devices, e.g., with limited memory for the computation. If the required memory to train a model exceeds this limit, the device will be excluded from the training.…

Machine Learning · Computer Science 2023-11-28 Kilian Pfeiffer , Ramin Khalili , Jörg Henkel

In the context of stochastic gradient descent(SGD) and adaptive moment estimation (Adam),researchers have recently proposed optimization techniques that transition from Adam to SGD with the goal of improving both convergence and…

Machine Learning · Computer Science 2020-07-01 Jiaxuan Wang , Jenna Wiens

Federated learning (FL) has emerged as an instance of distributed machine learning paradigm that avoids the transmission of data generated on the users' side. Although data are not transmitted, edge devices have to deal with limited…

Machine Learning · Computer Science 2024-03-27 Shashi Kant , José Mairton B. da Silva , Gabor Fodor , Bo Göransson , Mats Bengtsson , Carlo Fischione

Federated learning is gaining popularity as a distributed machine learning method that can be used to deploy AI-dependent IoT applications while protecting client data privacy and security. Due to the differences of clients, a single global…

Machine Learning · Computer Science 2022-02-21 Xingjian Cao , Gang Sun , Hongfang Yu , Mohsen Guizani