English
Related papers

Related papers: Momentum Approximation in Asynchronous Private Fed…

200 papers

Communication costs within Federated learning hinder the system scalability for reaching more data from more clients. The proposed FL adopts a hub-and-spoke network topology. All clients communicate through the central server. Hence,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-18 Chun-Chih Kuo , Ted Tsei Kuo , Chia-Yu Lin

Federated Learning (FL) has emerged as the state-of-the-art approach for learning from decentralized data in privacy-constrained scenarios.However, system and statistical challenges hinder its real-world applicability, requiring efficient…

Machine Learning · Computer Science 2025-06-30 Riccardo Zaccone , Sai Praneeth Karimireddy , Carlo Masone , Marco Ciccone

In this paper, we propose a novel centralized Asynchronous Federated Learning (FL) framework, FAVANO, for training Deep Neural Networks (DNNs) in resource-constrained environments. Despite its popularity, ``classical'' federated learning…

Machine Learning · Computer Science 2023-11-27 Louis Leconte , Van Minh Nguyen , Eric Moulines

Federated learning (FL) enables a set of distributed clients to jointly train machine learning models while preserving their local data privacy, making it attractive for applications in healthcare, finance, mobility, and smart-city systems.…

Machine Learning · Computer Science 2026-03-26 Eman M. AbouNassar , Amr Elshall , Sameh Abdulah

Investigation of the degree of personalization in federated learning algorithms has shown that only maximizing the performance of the global model will confine the capacity of the local models to personalize. In this paper, we advocate an…

Machine Learning · Computer Science 2020-11-09 Yuyang Deng , Mohammad Mahdi Kamani , Mehrdad Mahdavi

The rise of mobile devices with abundant sensory data and local computing capabilities has driven the trend of federated learning (FL) on these devices. And personalized FL (PFL) emerges to train specific deep models for each mobile device…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-30 Xiaochen Li , Sicong Liu , Zimu Zhou , Bin Guo , Yuan Xu , Zhiwen Yu

Federated learning (FL) is a distributed machine learning architecture that leverages a large number of workers to jointly learn a model with decentralized data. FL has received increasing attention in recent years thanks to its data…

Machine Learning · Computer Science 2021-05-05 Haibo Yang , Minghong Fang , Jia Liu

Federated learning enables a cluster of decentralized mobile devices at the edge to collaboratively train a shared machine learning model, while keeping all the raw training samples on device. This decentralized training approach is…

Machine Learning · Computer Science 2021-07-20 Young Geun Kim , Carole-Jean Wu

Statistical heterogeneity is a root cause of tension among accuracy, fairness, and robustness of federated learning (FL), and is key in paving a path forward. Personalized FL (PFL) is an approach that aims to reduce the impact of…

Machine Learning · Computer Science 2024-07-24 Shengkun Zhu , Jinshan Zeng , Sheng Wang , Yuan Sun , Xiaodong Li , Yuan Yao , Zhiyong Peng

This paper presents a comprehensive analysis of an enhanced asynchronous AdaBoost framework for federated learning (FL), focusing on its application across five distinct domains: computer vision on edge devices, blockchain-based model…

Machine Learning · Computer Science 2025-06-12 Arthur Oghlukyan , Nuria Gomez Blas

Federated learning is a communication-efficient training process that alternates between local training at the edge devices and averaging the updated local model at the central server. Nevertheless, it is impractical to achieve a perfect…

Machine Learning · Computer Science 2019-11-04 Fan Ang , Li Chen , Nan Zhao , Yunfei Chen , Weidong Wang , F. Richard Yu

Federated learning (FL) has emerged as a new paradigm for privacy-preserving collaborative training. Under domain skew, the current FL approaches are biased and face two fairness problems. 1) Parameter Update Conflict: data disparity among…

Machine Learning · Computer Science 2024-05-28 Yuhang Chen , Wenke Huang , Mang Ye

Asynchronous distributed algorithms are a popular way to reduce synchronization costs in large-scale optimization, and in particular for neural network training. However, for nonsmooth and nonconvex objectives, few convergence guarantees…

Optimization and Control · Mathematics 2020-07-14 Vyacheslav Kungurtsev , Malcolm Egan , Bapi Chatterjee , Dan Alistarh

Federated Learning (FL) refers to learning a high quality global model based on decentralized data storage, without ever copying the raw data. A natural scenario arises with data created on mobile phones by the activity of their users.…

Machine Learning · Computer Science 2023-01-19 Yihan Jiang , Jakub Konečný , Keith Rush , Sreeram Kannan

The proliferation of Internet of Things devices and advances in communication technology have unleashed an explosion of personal data, amplifying privacy concerns amid stringent regulations like GDPR and CCPA. Federated Learning offers a…

Machine Learning · Computer Science 2025-03-04 Fan Wan , Yuchen Li , Xueqi Qiu , Rui Sun , Leyuan Zhang , Xingyu Miao , Tianyu Zhang , Haoran Duan , Yang Long

In federated learning (FL), the significant communication overhead due to the slow convergence speed of training the global model poses a great challenge. Specifically, a large number of communication rounds are required to achieve the…

Machine Learning · Computer Science 2024-03-19 Mrinmay Sen , A. K. Qin , Krishna Mohan C

The proliferation of the Internet of Things (IoT) and widespread use of devices with sensing, computing, and communication capabilities have motivated intelligent applications empowered by artificial intelligence. The classical artificial…

Machine Learning · Computer Science 2022-06-24 Zunming Chen , Hongyan Cui , Ensen Wu , Yu Xi

We propose new techniques for reducing communication in private federated learning without the need for setting or tuning compression rates. Our on-the-fly methods automatically adjust the compression rate based on the error induced during…

Machine Learning · Computer Science 2023-07-21 Enayat Ullah , Christopher A. Choquette-Choo , Peter Kairouz , Sewoong Oh

Federated learning (FL) allows edge devices to collaboratively train models without sharing local data. As FL gains popularity, clients may need to train multiple unrelated FL models, but communication constraints limit their ability to…

Machine Learning · Computer Science 2025-04-23 Haoran Zhang , Zejun Gong , Zekai Li , Marie Siew , Carlee Joe-Wong , Rachid El-Azouzi

In recent years, model-agnostic meta-learning (MAML) has become a popular research area. However, the stochastic optimization of MAML is still underdeveloped. Existing MAML algorithms rely on the ``episode'' idea by sampling a few tasks and…

Machine Learning · Computer Science 2023-04-26 Bokun Wang , Zhuoning Yuan , Yiming Ying , Tianbao Yang