English
Related papers

Related papers: Sparse Training for Federated Learning with Regula…

200 papers

Federated learning (FL) is a distributed machine learning paradigm where multiple clients conduct local training based on their private data, then the updated models are sent to a central server for global aggregation. The practical…

Machine Learning · Computer Science 2025-04-03 Harsh Vardhan , Xiaofan Yu , Tajana Rosing , Arya Mazumdar

Federated learning (FL) has emerged as a privacy solution for collaborative distributed learning where clients train AI models directly on their devices instead of sharing their data with a centralized (potentially adversarial) server.…

Machine Learning · Computer Science 2022-09-08 Haleh Hayati , Carlos Murguia , Nathan van de Wouw

In cross-device Federated Learning (FL), clients with low computational power train a common\linebreak[4] machine model by exchanging parameters via updates instead of potentially private data. Federated Dropout (FD) is a technique that…

Machine Learning · Computer Science 2022-09-16 Giacomo Verardo , Daniel Barreira , Marco Chiesa , Dejan Kostic , Gerald Q. Maguire

Federated learning (FL) enables distributed training while preserving data privacy, but stragglers-slow or incapable clients-can significantly slow down the total training time and degrade performance. To mitigate the impact of stragglers,…

Machine Learning · Computer Science 2024-09-11 Honggu Kang , Seohyeon Cha , Jinwoo Shin , Jongmyeong Lee , Joonhyuk Kang

Federated Learning (FL) is a distributed machine learning paradigm facilitating participants to collaboratively train a model without revealing their local data. However, when FL is deployed into the wild, some intelligent clients can…

Machine Learning · Computer Science 2025-10-03 Andrea Augello , Ashish Gupta , Giuseppe Lo Re , Sajal K. Das

Federated learning (FL) has emerged as a widely adopted training paradigm for privacy-preserving machine learning. While the SGD-based FL algorithms have demonstrated considerable success in the past, there is a growing trend towards…

Machine Learning · Computer Science 2024-07-29 Yujia Wang , Shiqiang Wang , Songtao Lu , Jinghui Chen

The increasing demand for privacy-preserving collaborative learning has given rise to a new computing paradigm called federated learning (FL), in which clients collaboratively train a machine learning (ML) model without revealing their…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-31 Zhifeng Jiang , Wei Wang , Bo Li , Qiang Yang

Federated Learning allows multiple parties to jointly train a deep learning model on their combined data, without any of the participants having to reveal their local data to a centralized server. This form of privacy-preserving…

Machine Learning · Computer Science 2019-03-08 Felix Sattler , Simon Wiedemann , Klaus-Robert Müller , Wojciech Samek

Federated Learning (FL) has emerged as a compelling methodology for the management of distributed data, marked by significant advancements in recent years. In this paper, we propose an efficient FL approach that capitalizes on additional…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-09 Juncheng Jia , Ji Liu , Chao Huo , Yihui Shen , Yang Zhou , Huaiyu Dai , Dejing Dou

Increasing concerns on intelligent spectrum sensing call for efficient training and inference technologies. In this paper, we propose a novel federated learning (FL) framework, dubbed federated spectrum learning (FSL), which exploits the…

Networking and Internet Architecture · Computer Science 2022-05-24 Bo Yang , Xuelin Cao , Chongwen Huang , Chau Yuen , Marco Di Renzo , Yong Liang Guan , Dusit Niyato , Lijun Qian , Merouane Debbah

To improve federated training of neural networks, we develop FedSparsify, a sparsification strategy based on progressive weight magnitude pruning. Our method has several benefits. First, since the size of the network becomes increasingly…

Machine Learning · Computer Science 2023-05-17 Dimitris Stripelis , Umang Gupta , Greg Ver Steeg , Jose Luis Ambite

In the evolving landscape of federated learning (FL), addressing label noise presents unique challenges due to the decentralized and diverse nature of data collection across clients. Traditional centralized learning approaches to mitigate…

Machine Learning · Computer Science 2024-02-09 Taehyeon Kim , Donggyu Kim , Se-Young Yun

Existing resource-adaptive LoRA federated fine-tuning methods enable clients to fine-tune models using compressed versions of global LoRA matrices, in order to accommodate various compute resources across clients. This compression…

Machine Learning · Computer Science 2025-07-16 Khiem Le , Tuan Tran , Ting Hua , Nitesh V. Chawla

Federated learning (FL) is able to manage edge devices to cooperatively train a model while maintaining the training data local and private. One common assumption in FL is that all edge devices share the same machine learning model in…

Machine Learning · Computer Science 2022-07-07 Chan Yun Hin , Ngai Edith

We consider a standard federated learning (FL) architecture where a group of clients periodically coordinate with a central server to train a statistical model. We develop a general algorithmic framework called FedLin to tackle some of the…

Machine Learning · Computer Science 2021-09-01 Aritra Mitra , Rayana Jaafar , George J. Pappas , Hamed Hassani

Federated learning (FL) is a decentralized machine learning paradigm in which multiple clients collaboratively train a global model by exchanging only model updates with the central server without sharing the local data of the clients. Due…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Jonas Klotz , Barış Büyüktaş , Begüm Demir

Federated learning (FL) enables collaborative training across clients while preserving privacy. While most existing FL methods assume homogeneous model architectures, client heterogeneity in both data and resources makes this assumption…

Machine Learning · Computer Science 2026-03-30 Yuan Yao , Lixu Wang , Jiaqi Wu , Jin Song , Simin Chen , Zehua Wang , Zijian Tian , Wei Chen , Huixia Li , Xiaoxiao Li

Federated Learning (FL) enables distributed training on edge devices but faces significant challenges due to resource constraints in edge environments, impacting both communication and computational efficiency. Existing iterative pruning…

Machine Learning · Computer Science 2025-04-02 Haonan Wang , Zeli Liu , Kajimusugura Hoshino , Tuo Zhang , John Paul Walters , Stephen Crago

Federated Learning (FL) is a promising paradigm that offers significant advancements in privacy-preserving, decentralized machine learning by enabling collaborative training of models across distributed devices without centralizing data.…

Machine Learning · Computer Science 2024-06-03 Khiem Le , Nhan Luong-Ha , Manh Nguyen-Duc , Danh Le-Phuoc , Cuong Do , Kok-Seng Wong

We propose a reconfigurable hardware architecture for deep neural networks (DNNs) capable of online training and inference, which uses algorithmically pre-determined, structured sparsity to significantly lower memory and computational…

Neural and Evolutionary Computing · Computer Science 2017-11-07 Sourya Dey , Yinan Shao , Keith M. Chugg , Peter A. Beerel