English
Related papers

Related papers: Semi-Decentralized Federated Learning with Collabo…

200 papers

Decentralized federated learning (DFL) realizes cooperative model training among connected clients without relying on a central server, thereby mitigating communication bottlenecks and eliminating the single-point failure issue present in…

Machine Learning · Computer Science 2024-12-19 Xinyang Liu , Pengchao Han , Xuan Li , Bo Liu

One main challenge in federated learning is the large communication cost of exchanging weight updates from clients to the server at each round. While prior work has made great progress in compressing the weight updates through gradient…

Machine Learning · Computer Science 2023-02-10 Berivan Isik , Francesco Pase , Deniz Gunduz , Tsachy Weissman , Michele Zorzi

Under the organization of the base station (BS), wireless federated learning (FL) enables collaborative model training among multiple devices. However, the BS is merely responsible for aggregating local updates during the training process,…

Information Theory · Computer Science 2023-10-05 Jingheng Zheng , Wanli Ni , Hui Tian , Deniz Gunduz , Tony Q. S. Quek , Zhu Han

To enhance straggler resilience in federated learning (FL) systems, a semi-decentralized approach has been recently proposed, enabling collaboration between clients. Unlike the existing semi-decentralized schemes, which adaptively adjust…

Information Theory · Computer Science 2025-02-20 Shudi Weng , Ming Xiao , Chao Ren , Mikael Skoglund

Federated Learning (FL) is a well-known framework for successfully performing a learning task in an edge computing scenario where the devices involved have limited resources and incomplete data representation. The basic assumption of FL is…

Machine Learning · Computer Science 2023-12-08 Lorenzo Valerio , Chiara Boldrini , Andrea Passarella , János Kertész , Márton Karsai , Gerardo Iñiguez

Federated learning is a method of training models on private data distributed over multiple devices. To keep device data private, the global model is trained by only communicating parameters and updates which poses scalability challenges…

With the wealth of information produced by social networks, smartphones, medical or financial applications, speculations have been raised about the sensitivity of such data in terms of users' personal privacy and data security. To address…

Machine Learning · Computer Science 2019-08-21 Vito Walter Anelli , Yashar Deldjoo , Tommaso Di Noia , Antonio Ferrara

In this paper, a new communication-efficient federated learning (FL) framework is proposed, inspired by vector quantized compressed sensing. The basic strategy of the proposed framework is to compress the local model update at each device…

Information Theory · Computer Science 2023-07-04 Yongjeong Oh , Yo-Seb Jeon , Mingzhe Chen , Walid Saad

Federated Learning (FL) facilitates collaborative model training across distributed clients while ensuring data privacy. Traditionally, FL relies on a centralized server to coordinate learning, which creates bottlenecks and a single point…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-03 Phani Sahasra Akkinepally , Manaswini Piduguralla , Sushant Joshi , Sathya Peri , Sandeep Kulkarni

The federated learning (FL) framework trains a machine learning model using decentralized data stored at edge client devices by periodically aggregating locally trained models. Popular optimization algorithms of FL use vanilla (stochastic)…

Machine Learning · Computer Science 2021-06-07 Jianyu Wang , Zheng Xu , Zachary Garrett , Zachary Charles , Luyang Liu , Gauri Joshi

In federated learning (FL), clients may have diverse objectives, and merging all clients' knowledge into one global model will cause negative transfer to local performance. Thus, clustered FL is proposed to group similar clients into…

Artificial Intelligence · Computer Science 2022-11-22 Zexi Li , Jiaxun Lu , Shuang Luo , Didi Zhu , Yunfeng Shao , Yinchuan Li , Zhimeng Zhang , Yongheng Wang , Chao Wu

Learning an effective global model on private and decentralized datasets has become an increasingly important challenge of machine learning when applied in practice. Existing distributed learning paradigms, such as Federated Learning,…

Machine Learning · Computer Science 2023-06-05 Tengfei Ma , Trong Nghia Hoang , Jie Chen

Federated Learning (FL) is a promising framework for performing privacy-preserving, distributed learning with a set of clients. However, the data distribution among clients often exhibits non-IID, i.e., distribution shift, which makes…

Machine Learning · Computer Science 2022-06-07 Zhe Qu , Xingyu Li , Rui Duan , Yao Liu , Bo Tang , Zhuo Lu

Federated learning (FL) is a promising framework for privacy-preserving collaborative learning, where model training tasks are distributed to clients and only the model updates need to be collected at a server. However, when being deployed…

Machine Learning · Computer Science 2024-04-09 Yuchang Sun , Yuyi Mao , Jun Zhang

This work tackles the challenges of data heterogeneity and communication limitations in decentralized federated learning. We focus on creating a collaboration graph that guides each client in selecting suitable collaborators for training…

Machine Learning · Computer Science 2024-06-11 Salma Kharrat , Marco Canini , Samuel Horvath

It is well understood that client-master communication can be a primary bottleneck in Federated Learning. In this work, we address this issue with a novel client subsampling scheme, where we restrict the number of clients allowed to…

Machine Learning · Computer Science 2022-08-23 Wenlin Chen , Samuel Horvath , Peter Richtarik

In this paper, we investigate the problem of decentralized federated learning (DFL) in Internet of things (IoT) systems, where a number of IoT clients train models collectively for a common task without sharing their private training data…

Machine Learning · Computer Science 2021-05-13 Chengxi Li , Gang Li , Pramod K. Varshney

With the rapid growth in mobile computing, massive amounts of data and computing resources are now located at the edge. To this end, Federated learning (FL) is becoming a widely adopted distributed machine learning (ML) paradigm, which aims…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-15 Li Chou , Zichang Liu , Zhuang Wang , Anshumali Shrivastava

Federated Learning (FL) enables a group of clients to jointly train a machine learning model with the help of a centralized server. Clients do not need to submit their local data to the server during training, and hence the local training…

Machine Learning · Computer Science 2023-01-10 Liling Zhang , Xinyu Lei , Yichun Shi , Hongyu Huang , Chao Chen

Federated Learning (FL) enables privacy-preserving collaborative model training, but its effectiveness is often limited by client data heterogeneity. We introduce a client-selection algorithm that (i) dynamically forms nonoverlapping…

Machine Learning · Computer Science 2025-10-16 Alessandro Licciardi , Roberta Raineri , Anton Proskurnikov , Lamberto Rondoni , Lorenzo Zino