English
Related papers

Related papers: Federated Multi-Mini-Batch: An Efficient Training …

200 papers

Large machine learning models trained on diverse data have recently seen unprecedented success. Federated learning enables training on private data that may otherwise be inaccessible, such as domain-specific datasets decentralized across…

One-shot FL enables collaborative training in a single round, eliminating the need for iterative communication, making it particularly suitable for use in resource-constrained and privacy-sensitive applications. This survey offers a…

Machine Learning · Computer Science 2025-05-06 Flora Amato , Lingyu Qiu , Mohammad Tanveer , Salvatore Cuomo , Fabio Giampaolo , Francesco Piccialli

Federated Learning (FL) is an increasingly popular machine learning paradigm in which multiple nodes try to collaboratively learn under privacy, communication and multiple heterogeneity constraints. A persistent problem in federated…

Machine Learning · Computer Science 2022-02-24 Elnur Gasanov , Ahmed Khaled , Samuel Horváth , Peter Richtárik

Federated learning harnesses the power of distributed optimization to train a unified machine learning model across separate clients. However, heterogeneous data distributions and computational workloads can lead to inconsistent updates and…

Machine Learning · Computer Science 2024-10-15 Aayushya Agarwal , Gauri Joshi , Larry Pileggi

Federated learning methods enable us to train machine learning models on distributed user data while preserving its privacy. However, it is not always feasible to obtain high-quality supervisory signals from users, especially for vision…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Chun-Han Yao , Boqing Gong , Yin Cui , Hang Qi , Yukun Zhu , Ming-Hsuan Yang

We present a class of methods for robust, personalized federated learning, called Fed+, that unifies many federated learning algorithms. The principal advantage of this class of methods is to better accommodate the real-world…

Machine Learning · Computer Science 2022-07-13 Achintya Kundu , Pengqian Yu , Laura Wynter , Shiau Hong Lim

Federated learning is a distributed machine learning paradigm where multiple data owners (clients) collaboratively train one machine learning model while keeping data on their own devices. The heterogeneity of client datasets is one of the…

Machine Learning · Computer Science 2021-08-18 Ye Xue , Diego Klabjan , Yuan Luo

This paper studies a federated edge learning system, in which an edge server coordinates a set of edge devices to train a shared machine learning model based on their locally distributed data samples. During the distributed training, we…

Information Theory · Computer Science 2020-03-03 Xiaopeng Mo , Jie Xu

As large language models continue to develop and expand, the extensive public data they rely on faces the risk of depletion. Consequently, leveraging private data within organizations to enhance the performance of large models has emerged…

Machine Learning · Computer Science 2025-11-11 Dongcheng Li , Junhan Chen , Aoxiang Zhou , Chunpei Li , Youquan Xian , Peng Liu , Xianxian Li

Training task in classical machine learning models, such as deep neural networks, is generally implemented at a remote cloud center for centralized learning, which is typically time-consuming and resource-hungry. It also incurs serious…

Machine Learning · Computer Science 2020-10-27 Jinke Ren , Guanding Yu , Guangyao Ding

In federated learning (FL), a number of devices train their local models and upload the corresponding parameters or gradients to the base station (BS) to update the global model while protecting their data privacy. However, due to the…

Machine Learning · Computer Science 2022-05-04 Zhigang Yan , Dong Li , Zhichao Zhang , Jiguang He

Federated Learning (FL) allows edge devices (or clients) to keep data locally while simultaneously training a shared high-quality global model. However, current research is generally based on an assumption that the training data of local…

Machine Learning · Computer Science 2021-10-27 Zhe Zhang , Shiyao Ma , Jiangtian Nie , Yi Wu , Qiang Yan , Xiaoke Xu , Dusit Niyato

In the traditional distributed machine learning scenario, the user's private data is transmitted between clients and a central server, which results in significant potential privacy risks. In order to balance the issues of data privacy and…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-20 Zihao Zhao , Yuzhu Mao , Yang Liu , Linqi Song , Ye Ouyang , Xinlei Chen , Wenbo Ding

Federated Learning (FL) enables distributed training by learners using local data, thereby enhancing privacy and reducing communication. However, it presents numerous challenges relating to the heterogeneity of the data distribution, device…

Machine Learning · Computer Science 2022-11-07 Ahmed M. Abdelmoniem , Atal Narayan Sahu , Marco Canini , Suhaib A. Fahmy

Federated learning~(FL) has recently attracted increasing attention from academia and industry, with the ultimate goal of achieving collaborative training under privacy and communication constraints. Existing iterative model averaging based…

Machine Learning · Computer Science 2022-07-21 Yuanhao Xiong , Ruochen Wang , Minhao Cheng , Felix Yu , Cho-Jui Hsieh

Federated Learning (FL) enables multiple clients to collaboratively learn a machine learning model without exchanging their own local data. In this way, the server can exploit the computational power of all clients and train the model on a…

Machine Learning · Computer Science 2023-07-04 Song Wang , Xingbo Fu , Kaize Ding , Chen Chen , Huiyuan Chen , Jundong Li

Federated learning (FL) has become a hot research area in enabling the collaborative training of machine learning models among multiple clients that hold sensitive local data. Nevertheless, unconstrained federated optimization has been…

Machine Learning · Computer Science 2022-08-31 Ying Cui , Yangchen Li , Chencheng Ye

Federated learning is an approach to collaboratively training machine learning models for multiple parties that prohibit data sharing. One of the challenges in federated learning is non-IID data between clients, as a single model can not…

Machine Learning · Computer Science 2023-08-08 Peng Lan , Donglai Chen , Chong Xie , Keshu Chen , Jinyuan He , Juntao Zhang , Yonghong Chen , Yan Xu

Federated learning (FL) coordinates multiple devices to collaboratively train a shared model while preserving data privacy. However, large memory footprint and high energy consumption during the training process excludes the low-end devices…

Machine Learning · Computer Science 2024-09-12 Shichen Zhan , Yebo Wu , Chunlin Tian , Yan Zhao , Li Li

Federated Learning as a decentralized artificial intelligence (AI) solution solves a variety of problems in industrial applications. It enables a continuously self-improving AI, which can be deployed everywhere at the edge. However,…

Machine Learning · Computer Science 2022-05-24 Nico Weber , Patrick Holzer , Tania Jacob , Enislay Ramentol