English
Related papers

Related papers: Secure Aggregation Meets Sparsification in Decentr…

200 papers

Secure aggregation protocols ensure the privacy of users' data in federated learning by preventing the disclosure of local gradients. Many existing protocols impose significant communication and computational burdens on participants and may…

Cryptography and Security · Computer Science 2024-11-12 Rouzbeh Behnia , Arman Riasi , Reza Ebrahimi , Sherman S. M. Chow , Balaji Padmanabhan , Thang Hoang

Recent advances in differentially private federated learning (DPFL) algorithms have found that using correlated noise across the rounds of federated learning (DP-FTRL) yields provably and empirically better accuracy than using independent…

Cryptography and Security · Computer Science 2024-10-16 Marshall Ball , James Bell-Clark , Adria Gascon , Peter Kairouz , Sewoong Oh , Zhiye Xie

Decentralized learning (DL) is an emerging technique that allows nodes on the web to collaboratively train machine learning models without sharing raw data. Dealing with stragglers, i.e., nodes with slower compute or communication than…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-04 Sayan Biswas , Anne-Marie Kermarrec , Alexis Marouani , Rafael Pires , Rishi Sharma , Martijn de Vos

Deep learning (DL) approaches are achieving extraordinary results in a wide range of domains, but often require a massive collection of private data. Hence, methods for training neural networks on the joint data of different data owners,…

Cryptography and Security · Computer Science 2021-10-27 Derian Boer , Stefan Kramer

Decentralized learning (DL) leverages edge devices for collaborative model training while avoiding coordination by a central server. Due to privacy concerns, DL has become an attractive alternative to centralized learning schemes since…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-08 Martijn de Vos , Akash Dhasade , Anne-Marie Kermarrec , Erick Lavoie , Johan Pouwelse , Rishi Sharma

Decentralized learning (DL) is an emerging machine learning paradigm where nodes collaboratively train models without a central server. However, the collaborative nature of DL makes it vulnerable to backdoor attacks, where a model is taught…

Distributed learning techniques such as federated learning have enabled multiple workers to train machine learning models together to reduce the overall training time. However, current distributed training algorithms (centralized or…

Machine Learning · Computer Science 2020-02-25 Zhenheng Tang , Shaohuai Shi , Xiaowen Chu

Privacy-preserving machine learning (PPML) enables clients to collaboratively train deep learning models without sharing private datasets, but faces privacy leakage risks due to gradient leakage attacks. Prevailing methods leverage secure…

Cryptography and Security · Computer Science 2025-03-05 Qingqing Ren , Wen Wang , Shuyong Zhu , Zhiyuan Wu , Yujun Zhang

Cross-device Federated Learning is an increasingly popular machine learning setting to train a model by leveraging a large population of client devices with high privacy and security guarantees. However, communication efficiency remains a…

Machine Learning · Computer Science 2022-07-27 Karthik Prasad , Sayan Ghosh , Graham Cormode , Ilya Mironov , Ashkan Yousefpour , Pierre Stock

Motivated by the increasing demand for data security in decentralized federated learning (FL) and stochastic optimization, we formulate and investigate the problem of information-theoretic \emph{decentralized secure aggregation} (DSA).…

Information Theory · Computer Science 2026-03-24 Xiang Zhang , Zhou Li , Shuangyang Li , Kai Wan , Derrick Wing Kwan Ng , Giuseppe Caire

Wider coverage and a better solution to a latency reduction in 5G necessitate its combination with multi-access edge computing (MEC) technology. Decentralized deep learning (DDL) such as federated learning and swarm learning as a promising…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-23 Yuwei Sun , Hideya Ochiai , Hiroshi Esaki

Logistic Regression (LR) is the most widely used machine learning model in industry for its efficiency, robustness, and interpretability. Due to the problem of data isolation and the requirement of high model performance, many applications…

Cryptography and Security · Computer Science 2021-06-01 Chaochao Chen , Jun Zhou , Li Wang , Xibin Wu , Wenjing Fang , Jin Tan , Lei Wang , Alex X. Liu , Hao Wang , Cheng Hong

Differential privacy (DP) is widely employed to provide privacy protection for individuals by limiting information leakage from the aggregated data. Two well-known models of DP are the central model and the local model. The former requires…

Cryptography and Security · Computer Science 2024-11-05 Yucheng Fu , Tianhao Wang

Large-scale decentralized learning frameworks such as federated learning (FL), require both communication efficiency and strong data security, motivating the study of secure aggregation (SA). While information-theoretic SA is well…

Information Theory · Computer Science 2026-01-28 Xiang Zhang , Zhou Li , Han Yu , Kai Wan , Hua Sun , Mingyue Ji , Giuseppe Caire

Federated learning has become a widely used paradigm for collaboratively training a common model among different participants with the help of a central server that coordinates the training. Although only the model parameters or other model…

Cryptography and Security · Computer Science 2023-10-31 Raouf Kerkouche , Gergely Ács , Mario Fritz

Secure aggregation promises a heightened level of privacy in federated learning, maintaining that a server only has access to a decrypted aggregate update. Within this setting, linear layer leakage methods are the only data reconstruction…

Machine Learning · Computer Science 2023-03-28 Joshua C. Zhao , Ahmed Roushdy Elkordy , Atul Sharma , Yahya H. Ezzeldin , Salman Avestimehr , Saurabh Bagchi

Federated learning (FL) enables collaborative model training by aggregating local updates without requiring raw data sharing. However, prior studies have shown that servers can exploit gradient inversion to compromise user privacy or…

Cryptography and Security · Computer Science 2026-05-26 Yufei Zhou

Federated learning (FL) is an emerging paradigm that allows a central server to train machine learning models using remote users' data. Despite its growing popularity, FL faces challenges in preserving the privacy of local datasets, its…

Cryptography and Security · Computer Science 2025-05-09 Natalie Lang , Nir Shlezinger , Rafael G. L. D'Oliveira , Salim El Rouayheb

Decentralized learning is appealing as it enables the scalable usage of large amounts of distributed data and resources (without resorting to any central entity), while promoting privacy since every user minimizes the direct exposure of…

Machine Learning · Computer Science 2024-05-06 Youssef Allouah , Anastasia Koloskova , Aymane El Firdoussi , Martin Jaggi , Rachid Guerraoui

Federated learning is a computing paradigm that enhances privacy by enabling multiple parties to collaboratively train a machine learning model without revealing personal data. However, current research indicates that traditional federated…

Cryptography and Security · Computer Science 2025-01-10 Runhua Xu , Bo Li , Chao Li , James B. D. Joshi , Shuai Ma , Jianxin Li