English
Related papers

Related papers: Federated Learning Optimization: A Comparative Stu…

200 papers

With the rapid growth in the volume of data sets, models, and devices in the domain of deep learning, there is increasing attention on large-scale distributed deep learning. In contrast to traditional distributed deep learning, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-10 Feng Liang , Zhen Zhang , Haifeng Lu , Victor C. M. Leung , Yanyi Guo , Xiping Hu

Federated learning (FL) has received significant attention in recent years for its advantages in efficient training of machine learning models across distributed clients without disclosing user-sensitive data. Specifically, in federated…

Machine Learning · Computer Science 2024-10-10 Chung-Hsuan Hu , Zheng Chen , Erik G. Larsson

We consider a distributed estimation method in a setting with heterogeneous streams of correlated data distributed across nodes in a network. In the considered approach, linear models are estimated locally (i.e., with only local data)…

Machine Learning · Computer Science 2021-02-11 Lingzhou Hong , Alfredo Garcia , Ceyhun Eksin

Recent advances in distributed learning raise environmental concerns due to the large energy needed to train and move data to/from data centers. Novel paradigms, such as federated learning (FL), are suitable for decentralized model training…

Machine Learning · Computer Science 2021-11-15 Stefano Savazzi , Sanaz Kianoush , Vittorio Rampa , Mehdi Bennis

Federated learning opens a number of research opportunities due to its high communication efficiency in distributed training problems within a star network. In this paper, we focus on improving the communication efficiency for fully…

Machine Learning · Computer Science 2019-12-11 Songtao Lu , Yawen Zhang , Yunlong Wang , Christina Mack

Federated Learning is a machine learning setting where the goal is to train a high-quality centralized model while training data remains distributed over a large number of clients each with unreliable and relatively slow network…

Machine Learning · Computer Science 2017-11-01 Jakub Konečný , H. Brendan McMahan , Felix X. Yu , Peter Richtárik , Ananda Theertha Suresh , Dave Bacon

Large machine learning models trained on diverse data have recently seen unprecedented success. Federated learning enables training on private data that may otherwise be inaccessible, such as domain-specific datasets decentralized across…

Large-scale Internet of Things (IoT) networks enable intelligent services such as smart cities and autonomous driving, but often face resource constraints. Collecting heterogeneous sensory data, especially in small-scale datasets, is…

Machine Learning · Computer Science 2026-04-14 Haihui Xie , Wenkun Wen , Shuwu Chen , Zhaogang Shu , Minghua Xia

Federated learning (FL) enables distributed model training from local data collected by users. In distributed systems with constrained resources and potentially high dynamics, e.g., mobile edge networks, the efficiency of FL is an important…

Machine Learning · Computer Science 2022-12-19 Shiqiang Wang , Jake Perazzone , Mingyue Ji , Kevin S. Chan

An approach to distributed machine learning is to train models on local datasets and aggregate these models into a single, stronger model. A popular instance of this form of parallelization is federated learning, where the nodes…

Machine Learning · Computer Science 2019-11-19 Linara Adilova , Julia Rosenzweig , Michael Kamp

Federated learning involves training statistical models over remote devices such as mobile phones while keeping data localized. Training in heterogeneous and potentially massive networks introduces opportunities for privacy-preserving data…

Machine Learning · Computer Science 2022-01-21 Afra Mashhadi , Alex Kyllo , Reza M. Parizi

Federated learning (FL) is a novel machine learning setting that enables on-device intelligence via decentralized training and federated optimization. Deep neural networks' rapid development facilitates the learning techniques for modeling…

Machine Learning · Computer Science 2021-09-27 Shaoxiong Ji , Wenqi Jiang , Anwar Walid , Xue Li

Federated learning (FL) enables edge devices to collaboratively train a machine learning model without sharing their raw data. Due to its privacy-protecting benefits, FL has been deployed in many real-world applications. However, deploying…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-16 Zhidong Gao , Zhenxiao Zhang , Yu Zhang , Tongnian Wang , Yanmin Gong , Yuanxiong Guo

In this paper, we propose feature-based federated transfer learning as a novel approach to improve communication efficiency by reducing the uplink payload by multiple orders of magnitude compared to that of existing approaches in federated…

Machine Learning · Computer Science 2024-05-16 Feng Wang , M. Cenk Gursoy , Senem Velipasalar

In federated learning (FL), a number of devices train their local models and upload the corresponding parameters or gradients to the base station (BS) to update the global model while protecting their data privacy. However, due to the…

Machine Learning · Computer Science 2022-05-04 Zhigang Yan , Dong Li , Zhichao Zhang , Jiguang He

At the intersection of the cutting-edge technologies and privacy concerns, Federated Learning (FL) with its distributed architecture, stands at the forefront in a bid to facilitate collaborative model training across multiple clients while…

Machine Learning · Computer Science 2025-09-03 Noorain Mukhtiar , Adnan Mahmood , Quan Z. Sheng

With privacy as a motivation, Federated Learning (FL) is an increasingly used paradigm where learning takes place collectively on edge devices, each with a cache of user-generated training examples that remain resident on the local device.…

Machine Learning · Computer Science 2021-11-25 Sean Augenstein , Andrew Hard , Kurt Partridge , Rajiv Mathews

Federated learning (FL) has emerged as a secure paradigm for collaborative training among clients. Without data centralization, FL allows clients to share local information in a privacy-preserving manner. This approach has gained…

Machine Learning · Computer Science 2024-02-20 Jiawei Shao , Zijian Li , Wenqiang Sun , Tailin Zhou , Yuchang Sun , Lumin Liu , Zehong Lin , Yuyi Mao , Jun Zhang

Federated learning (FL) refers to a distributed machine learning framework involving learning from several decentralized edge clients without sharing local dataset. This distributed strategy prevents data leakage and enables on-device…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-28 Taki Hasan Rafi , Faiza Anan Noor , Tahmid Hussain , Dong-Kyu Chae , Zhaohui Yang

Federated learning learns from scattered data by fusing collaborative models from local nodes. However, due to chaotic information distribution, the model fusion may suffer from structural misalignment with regard to unmatched parameters.…

Machine Learning · Computer Science 2022-03-22 Fuxun Yu , Weishan Zhang , Zhuwei Qin , Zirui Xu , Di Wang , Chenchen Liu , Zhi Tian , Xiang Chen