English
Related papers

Related papers: Sparse Training for Federated Learning with Regula…

200 papers

Decentralized Federated Learning (DFL) enables collaborative model training without a central server but faces challenges in efficiency, stability, and trustworthiness due to communication and computational limitations among distributed…

Machine Learning · Computer Science 2025-03-18 Shan Sha , Shenglong Zhou , Lingchen Kong , Geoffrey Ye Li

Federated learning (FL) enables the training of a model leveraging decentralized data in client sites while preserving privacy by not collecting data. However, one of the significant challenges of FL is limited computation and low…

Machine Learning · Computer Science 2023-04-18 Riyasat Ohib , Bishal Thapaliya , Pratyush Gaggenapalli , Jingyu Liu , Vince Calhoun , Sergey Plis

Federated Learning (FL) is a privacy-preserving distributed deep learning paradigm that involves substantial communication and computation effort, which is a problem for resource-constrained mobile and IoT devices. Model…

Machine Learning · Computer Science 2023-03-28 Xiaopeng Jiang , Cristian Borcea

Federated learning (FL) is an emerging technique for training machine learning models using geographically dispersed data collected by local entities. It includes local computation and synchronization steps. To reduce the communication…

Machine Learning · Computer Science 2020-03-23 Pengchao Han , Shiqiang Wang , Kin K. Leung

Federated learning (FL), as an emerging artificial intelligence (AI) approach, enables decentralized model training across multiple devices without exposing their local training data. FL has been increasingly gaining popularity in both…

Machine Learning · Computer Science 2023-10-23 Victoria Huang , Shaleeza Sohail , Michael Mayo , Tania Lorido Botran , Mark Rodrigues , Chris Anderson , Melanie Ooi

Federated Learning (FL) is a distributed machine learning approach where multiple clients work together to solve a machine learning task. One of the key challenges in FL is the issue of partial participation, which occurs when a large…

Machine Learning · Computer Science 2023-03-01 Grigory Malinovsky , Samuel Horváth , Konstantin Burlachenko , Peter Richtárik

Federated learning (FL) is a trending training paradigm to utilize decentralized training data. FL allows clients to update model parameters locally for several epochs, then share them to a global model for aggregation. This training…

Machine Learning · Computer Science 2022-08-09 Xiaoxiao Li , Zhao Song , Jiaming Yang

In Federated Learning (FL), both client resource constraints and communication costs pose major problems for training large models. In the centralized setting, sparse training addresses resource constraints, while in the distributed…

Machine Learning · Computer Science 2025-03-03 Georg Meinhardt , Kai Yi , Laurent Condat , Peter Richtárik

Federated Learning (FL) facilitates collaborative model training across distributed clients while ensuring data privacy. Traditionally, FL relies on a centralized server to coordinate learning, which creates bottlenecks and a single point…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-03 Phani Sahasra Akkinepally , Manaswini Piduguralla , Sushant Joshi , Sathya Peri , Sandeep Kulkarni

Sparse training is often adopted in cross-device federated learning (FL) environments where constrained devices collaboratively train a machine learning model on private data by exchanging pseudo-gradients across heterogeneous networks.…

Machine Learning · Computer Science 2025-04-08 Adriano Guastella , Lorenzo Sani , Alex Iacob , Alessio Mora , Paolo Bellavista , Nicholas D. Lane

Federated Learning (FL) is a novel, multidisciplinary Machine Learning paradigm where multiple clients, such as mobile devices, collaborate to solve machine learning problems. Initially introduced in Kone{\v{c}}n{\'y} et al. (2016a,b);…

Machine Learning · Computer Science 2025-09-11 Konstantin Burlachenko

Federated learning (FL) enables collaborative model training across distributed devices while preserving data privacy, but deployment on resource-constrained edge nodes remains challenging due to limited memory, energy, and communication…

Machine Learning · Computer Science 2026-03-25 Irene Tenison , Anna Murphy , Charles Beauville , Lalana Kagal

Federated learning (FL), which has gained increasing attention recently, enables distributed devices to train a common machine learning (ML) model for intelligent inference cooperatively without data sharing. However, problems in practical…

Machine Learning · Computer Science 2022-11-01 Yujie Zhou , Zhidu Li , Tong Tang , Ruyan Wang

Federated learning (FL) enables multiple clients to collaboratively train a shared model without disclosing their local datasets. This is achieved by exchanging local model updates with the help of a parameter server (PS). However, due to…

Machine Learning · Computer Science 2021-01-25 Emre Ozfatura , Kerem Ozfatura , Deniz Gunduz

Federated Learning (FL) is a novel distributed machine learning which allows thousands of edge devices to train model locally without uploading data concentrically to the server. But since real federated settings are resource-constrained,…

Machine Learning · Computer Science 2024-04-16 Li Li , Moming Duan , Duo Liu , Yu Zhang , Ao Ren , Xianzhang Chen , Yujuan Tan , Chengliang Wang

Transfer learning via fine-tuning pre-trained transformer models has gained significant success in delivering state-of-the-art results across various NLP tasks. In the absence of centralized data, Federated Learning (FL) can benefit from…

To effectively manage and utilize massive distributed data at the network edge, Federated Learning (FL) has emerged as a promising edge computing paradigm across data silos. However, FL still faces two challenges: system heterogeneity…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-08 Jingjing Xue , Sheng Sun , Min Liu , Yuwei Wang , Zhuotao Liu , Jingyuan Wang

Federated Learning (FL) is a promising technique for the collaborative training of deep neural networks across multiple devices while preserving data privacy. Despite its potential benefits, FL is hindered by excessive communication costs…

Machine Learning · Computer Science 2024-02-27 Vasileios Tsouvalas , Aaqib Saeed , Tanir Ozcelebi , Nirvana Meratnia

Federated learning (FL) is a popular distributed machine learning (ML) paradigm, but is often limited by significant communication costs and edge device computation capabilities. Federated Split Learning (FSL) preserves the parallel model…

Information Theory · Computer Science 2023-02-14 Yujia Mu , Cong Shen

Federated Learning (FL) aims to train machine learning models for multiple clients without sharing their own private data. Due to the heterogeneity of clients' local data distribution, recent studies explore the personalized FL that learns…

Machine Learning · Computer Science 2023-06-12 Daoyuan Chen , Liuyi Yao , Dawei Gao , Bolin Ding , Yaliang Li