English
Related papers

Related papers: On Principled Local Optimization Methods for Feder…

200 papers

We study optimization algorithms for the finite sum problems frequently arising in machine learning applications. First, we propose novel variants of stochastic gradient descent with a variance reduction property that enables linear…

Machine Learning · Computer Science 2017-07-06 Jakub Konečný

Federated learning (FL) is a general framework for learning across an axis of group partitioned data (heterogeneous clients) while preserving data privacy, under the orchestration of a central server. FL methods often compute gradients of…

Machine Learning · Computer Science 2024-11-26 Keith Rush , Zachary Charles , Zachary Garrett

Federated Learning (FL) is an emerging approach for collaboratively training Deep Neural Networks (DNNs) on mobile devices, without private user data leaving the devices. Previous works have shown that non-Independent and Identically…

Machine Learning · Computer Science 2021-07-23 Jed Mills , Jia Hu , Geyong Min

Recent demands on data privacy have called for federated learning (FL) as a new distributed learning paradigm in massive and heterogeneous networks. Although many FL algorithms have been proposed, few of them have considered the matrix…

Machine Learning · Computer Science 2020-11-02 Shuai Wang , Tsung-Hui Chang

Federated learning (FL) is emerging as a new paradigm to train machine learning models in distributed systems. Rather than sharing, and disclosing, the training dataset with the server, the model parameters (e.g. neural networks weights and…

Signal Processing · Electrical Eng. & Systems 2020-05-27 Stefano Savazzi , Monica Nicoli , Vittorio Rampa

In Federated Learning (FL), a framework to train machine learning models across distributed data, well-known algorithms like FedAvg tend to have slow convergence rates, resulting in high communication costs during training. To address this…

Machine Learning · Computer Science 2024-02-16 Zhiwei Tang , Tsung-Hui Chang

Federated Learning (FL) emerged as a practical approach to training a model from decentralized data. The proliferation of FL led to the development of numerous FL algorithms and mechanisms. Many prior efforts have given their primary focus…

Machine Learning · Computer Science 2024-03-27 Gustav A. Baumgart , Jaemin Shin , Ali Payani , Myungjin Lee , Ramana Rao Kompella

In this work, we explore combining automatic hyperparameter tuning and optimization for federated learning (FL) in an online, one-shot procedure. We apply a principled approach on a method for adaptive client learning rate, number of local…

Machine Learning · Computer Science 2022-11-07 Andrew K Kan

Federated learning has allowed the training of statistical models over remote devices without the transfer of raw client data. In practice, training in heterogeneous and large networks introduce novel challenges in various aspects like…

Machine Learning · Computer Science 2020-11-17 Dipankar Sarkar , Sumit Rai , Ankur Narang

Federated learning (FL) enables collaborative learning of a deep learning model without sharing the data of participating sites. FL in medical image analysis tasks is relatively new and open for enhancements. In this study, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Gozde N. Gunesli , Mohsin Bilal , Shan E Ahmed Raza , Nasir M. Rajpoot

Federated Learning (FL) has emerged as a prominent distributed machine learning framework that enables geographically discrete clients to train a global model collaboratively while preserving their privacy-sensitive data. However, due to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-15 Shensheng Zheng , Wenhao Yuan , Xuehe Wang , Lingjie Duan

Over-the-air computation is a communication-efficient solution for federated learning (FL). In such a system, iterative procedure is performed: Local gradient of private loss function is updated, amplified and then transmitted by every…

Machine Learning · Computer Science 2023-09-06 Rongfei Fan , Xuming An , Shiyuan Zuo , Han Hu

Federated Learning (FL) is a distributed machine learning paradigm that allows clients to train models on their data while preserving their privacy. FL algorithms, such as Federated Averaging (FedAvg) and its variants, have been shown to…

Machine Learning · Computer Science 2024-03-05 Changxin Xu , Yuxin Qiao , Zhanxin Zhou , Fanghao Ni , Jize Xiong

Federated learning (FL) is a distributed learning technique that trains a shared model over distributed data in a privacy-preserving manner. Unfortunately, FL's performance degrades when there is (i) variability in client characteristics in…

Machine Learning · Computer Science 2021-10-28 Muhammad Tahir Munir , Muhammad Mustansar Saeed , Mahad Ali , Zafar Ayyub Qazi , Ihsan Ayyub Qazi

Federated learning has attracted increasing attention with the emergence of distributed data. While extensive federated learning algorithms have been proposed for the non-convex distributed problem, federated learning in practice still…

Machine Learning · Computer Science 2023-03-10 Xidong Wu , Feihu Huang , Zhengmian Hu , Heng Huang

In this paper, we consider federated learning (FL) over a noisy fading multiple access channel (MAC), where an edge server aggregates the local models transmitted by multiple end devices through over-the-air computation (AirComp). To…

Information Theory · Computer Science 2020-11-16 Shuhao Xia , Jingyang Zhu , Yuhan Yang , Yong Zhou , Yuanming Shi , Wei Chen

Federated Learning (FL) is a decentralized machine learning framework that enables collaborative model training while respecting data privacy. In various applications, non-uniform availability or participation of users is unavoidable due to…

Machine Learning · Computer Science 2023-09-26 Periklis Theodoropoulos , Konstantinos E. Nikolakakis , Dionysis Kalogerias

With the increasingly strengthened data privacy act and the difficult data centralization, Federated Learning (FL) has become an effective solution to collaboratively train the model while preserving each client's privacy. FedAvg is a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Zhifang Deng , Xiaohong Huang , Dandan Li , Xueguang Yuan

Federated learning (FL) is a widely adopted paradigm for privacy-preserving model training, but FedAvg optimise for the majority while under-serving minority clients. Existing methods such as federated multi-objective learning (FMOL)…

Machine Learning · Computer Science 2025-08-26 Jiansheng Rao , Jiayi Li , Zhizhi Gong , Soummya Kar , Haoxuan Li

Federated Learning (FL) offers a promising approach for collaborative machine learning across distributed devices. However, its adoption is hindered by the complexity of building reliable communication architectures and the need for…

Machine Learning · Computer Science 2024-08-26 Chamith Mawela , Chaouki Ben Issaid , Mehdi Bennis