English
Related papers

Related papers: Vanishing Variance Problem in Fully Decentralized …

200 papers

Federated Learning (FL) is a decentralized training framework widely used in IoT ecosystems that preserves privacy by keeping raw data local, making it ideal for IoT-enabled cyber-physical systems with sensing and communication like Smart…

Machine Learning · Computer Science 2025-09-24 Bishal K C , Amr Hilal , Pawan Thapa

Federated Learning is an emerging privacy-preserving distributed machine learning approach to building a shared model by performing distributed training locally on participating devices (clients) and aggregating the local models into a…

Machine Learning · Computer Science 2021-04-15 Sreya Francis , Irene Tenison , Irina Rish

Federated learning (FL) is an emerging paradigm to train model with distributed data from numerous Internet of Things (IoT) devices. It inherently assumes a uniform capacity among participants. However, due to different conditions such as…

Machine Learning · Computer Science 2023-07-04 Hao Zhang , Tingting Wu , Siyao Cheng , Jie Liu

Federated learning is a communication-efficient training process that alternates between local training at the edge devices and averaging the updated local model at the central server. Nevertheless, it is impractical to achieve a perfect…

Machine Learning · Computer Science 2019-11-04 Fan Ang , Li Chen , Nan Zhao , Yunfei Chen , Weidong Wang , F. Richard Yu

Federated Learning with client-level differential privacy (DP) provides a promising framework for collaboratively training models while rigorously protecting clients' privacy. However, classic approaches like DP-FedAvg struggle when clients…

Cryptography and Security · Computer Science 2026-02-10 Jiahao Xu , Rui Hu , Olivera Kotevska

Privacy has raised considerable concerns recently, especially with the advent of information explosion and numerous data mining techniques to explore the information inside large volumes of data. In this context, a new distributed learning…

Machine Learning · Computer Science 2019-10-15 Mengwei Yang , Linqi Song , Jie Xu , Congduan Li , Guozhen Tan

Federated learning aims at training models collaboratively across participants while protecting privacy. However, one major challenge for this paradigm is the data heterogeneity issue, where biased data preferences across multiple clients,…

Machine Learning · Computer Science 2025-07-21 Huan Wang , Haoran Li , Huaming Chen , Jun Yan , Jiahua Shi , Jun Shen

Deep learning has achieved great success in many applications. However, its deployment in practice has been hurdled by two issues: the privacy of data that has to be aggregated centrally for model training and high communication overhead…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-04 Tien-Dung Cao , Tram Truong-Huu , Hien Tran , Khanh Tran

In cross-device federated learning (FL) with millions of mobile clients, only a small subset of clients participate in training in every communication round, and Federated Averaging (FedAvg) is the most popular algorithm in practice.…

Machine Learning · Computer Science 2024-10-03 Zhenyu Sun , Ziyang Zhang , Zheng Xu , Gauri Joshi , Pranay Sharma , Ermin Wei

Federated learning (FL) is a distributed learning process where the model (weights and checkpoints) is transferred to the devices that posses data rather than the classical way of transferring and aggregating the data centrally. In this…

Machine Learning · Computer Science 2020-09-15 Sudipta Paul , Poushali Sengupta , Subhankar Mishra

Establishing how a set of learners can provide privacy-preserving federated learning in a fully decentralized (peer-to-peer, no coordinator) manner is an open problem. We propose the first privacy-preserving consensus-based algorithm for…

Cryptography and Security · Computer Science 2022-10-04 Yang Lu , Zhengxin Yu , Neeraj Suri

We propose a prototype-based federated learning method designed for embedding networks in classification or verification tasks. Our focus is on scenarios where each client has data from a single class. The main challenge is to develop an…

Machine Learning · Computer Science 2024-09-13 Hyunsin Park , Sungrack Yun

With the wealth of information produced by social networks, smartphones, medical or financial applications, speculations have been raised about the sensitivity of such data in terms of users' personal privacy and data security. To address…

Machine Learning · Computer Science 2019-08-21 Vito Walter Anelli , Yashar Deldjoo , Tommaso Di Noia , Antonio Ferrara

Federated learning (FL) allows remote clients to train a global model collaboratively while protecting client privacy. Despite its privacy-preserving benefits, FL has significant drawbacks, including slow convergence, high communication…

Machine Learning · Computer Science 2026-02-18 Mohammad Partohaghighi , Roummel Marcia , YangQuan Chen

Federated Learning (FL) facilitates collaborative training of a global model whose performance is boosted by private data owned by distributed clients, without compromising data privacy. Yet the wide applicability of FL is hindered by…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-31 Xinyuan Zhao , Hanlin Gu , Lixin Fan , Yuxing Han , Qiang Yang

Distributed machine learning has been widely studied in order to handle exploding amount of data. In this paper, we study an important yet less visited distributed learning problem where features are inherently distributed or vertically…

Machine Learning · Computer Science 2019-07-19 Yaochen Hu , Peng Liu , Linglong Kong , Di Niu

Federated Learning (FL) has become a key choice for distributed machine learning. Initially focused on centralized aggregation, recent works in FL have emphasized greater decentralization to adapt to the highly heterogeneous network edge.…

Machine Learning · Computer Science 2022-12-15 Ahnaf Hannan Lodhi , Barış Akgün , Öznur Özkasap

Fully decentralized learning algorithms are still in an early stage of development. Creating modular Gossip Learning strategies is not trivial due to convergence challenges and Byzantine faults intrinsic in systems of decentralized nature.…

Machine Learning · Computer Science 2025-01-22 Aitor Belenguer , Jose A. Pascual , Javier Navaridas

In 6G mobile communication systems, various AI-based network functions and applications have been standardized. Federated learning (FL) is adopted as the core learning architecture for 6G systems to avoid privacy leakage from mobile user…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-01 Seyoung Ahn , Soohyeong Kim , Yongseok Kwon , Joohan Park , Jiseung Youn , Sunghyun Cho

Vertical Federated Learning (VFL) is an emergent distributed machine learning paradigm for collaborative learning between clients who have disjoint features of common entities. However, standard VFL lacks fault tolerance, with each…

Machine Learning · Computer Science 2024-12-03 Avi Amalanshu , Yash Sirvi , David I. Inouye