English
Related papers

Related papers: Low-Cost Privacy-Preserving Decentralized Learning

200 papers

Train machine learning models on sensitive user data has raised increasing privacy concerns in many areas. Federated learning is a popular approach for privacy protection that collects the local gradient information instead of real data.…

Cryptography and Security · Computer Science 2021-05-24 Lichao Sun , Jianwei Qian , Xun Chen

Federated Learning (FL) is an emerging distributed machine learning paradigm enabling multiple clients to train a global model collaboratively without sharing their raw data. While FL enhances data privacy by design, it remains vulnerable…

Federated learning has been rapidly evolving and gaining popularity in recent years due to its privacy-preserving features, among other advantages. Nevertheless, the exchange of model updates and gradients in this architecture provides new…

Cryptography and Security · Computer Science 2024-03-20 Ehsan Hallaji , Roozbeh Razavi-Far , Mehrdad Saif , Boyu Wang , Qiang Yang

Federated Learning (FL) is a machine learning paradigm where local nodes collaboratively train a central model while the training data remains decentralized. Existing FL methods typically share model parameters or employ co-distillation to…

Cryptography and Security · Computer Science 2022-09-13 Xuan Gong , Abhishek Sharma , Srikrishna Karanam , Ziyan Wu , Terrence Chen , David Doermann , Arun Innanje

We consider a collaborative learning scenario in which multiple data-owners wish to jointly train a logistic regression model, while keeping their individual datasets private from the other parties. We propose COPML, a fully-decentralized…

Machine Learning · Computer Science 2020-11-05 Jinhyun So , Basak Guler , A. Salman Avestimehr

This paper presents LDP-Fed, a novel federated learning system with a formal privacy guarantee using local differential privacy (LDP). Existing LDP protocols are developed primarily to ensure data privacy in the collection of single…

Machine Learning · Computer Science 2020-06-09 Stacey Truex , Ling Liu , Ka-Ho Chow , Mehmet Emre Gursoy , Wenqi Wei

Distributed deep learning (DL) has become prevalent in recent years to reduce training time by leveraging multiple computing devices (e.g., GPUs/TPUs) due to larger models and datasets. However, system scalability is limited by…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-04 Zhenheng Tang , Shaohuai Shi , Wei Wang , Bo Li , Xiaowen Chu

Privacy-preserving federated learning enables a population of distributed clients to jointly learn a shared model while keeping client training data private, even from an untrusted server. Prior works do not provide efficient solutions that…

Cryptography and Security · Computer Science 2022-02-22 David Byrd , Vaikkunth Mugunthan , Antigoni Polychroniadou , Tucker Hybinette Balch

In the paradigm of decentralized learning, a group of agents collaborates to learn a global model using distributed datasets without a central server. However, due to the heterogeneity of the local data across the different agents, learning…

Machine Learning · Computer Science 2025-04-15 Lina Wang , Yunsheng Yuan , Chunxiao Wang , Feng Li

Decentralized learning (DL) faces increased vulnerability to privacy breaches due to sophisticated attacks on machine learning (ML) models. Secure aggregation is a computationally efficient cryptographic technique that enables multiple…

Machine Learning · Computer Science 2024-05-15 Sayan Biswas , Anne-Marie Kermarrec , Rafael Pires , Rishi Sharma , Milos Vujasinovic

Decentralized learning (DL) is an emerging machine learning paradigm where nodes collaboratively train models without a central server. However, the collaborative nature of DL makes it vulnerable to backdoor attacks, where a model is taught…

Federated learning (FL) enables collaborative model training while preserving data privacy, yet both centralized and decentralized approaches face challenges in scalability, security, and update validation. We propose ZK-HybridFL, a secure…

Machine Learning · Computer Science 2026-03-09 Amirhossein Taherpour , Xiaodong Wang

Federated Learning (FL) has emerged as a transformative paradigm in the field of distributed machine learning, enabling multiple clients such as mobile devices, edge nodes, or organizations to collaboratively train a shared global model…

Machine Learning · Computer Science 2026-03-09 Ratun Rahman

In this paper, we focus on preserving differential privacy (DP) in continual learning (CL), in which we train ML models to learn a sequence of new tasks while memorizing previous tasks. We first introduce a notion of continual adjacent…

Machine Learning · Computer Science 2021-10-12 Pradnya Desai , Phung Lai , NhatHai Phan , My T. Thai

With powerful parallel computing GPUs and massive user data, neural-network-based deep learning can well exert its strong power in problem modeling and solving, and has archived great success in many applications such as image…

Cryptography and Security · Computer Science 2019-10-28 Lingchen Zhao , Qian Wang , Qin Zou , Yan Zhang , Yanjiao Chen

Machine learning (ML) models have been shown to leak private information from their training datasets. Differential Privacy (DP), typically implemented through the differential private stochastic gradient descent algorithm (DP-SGD), has…

Machine Learning · Computer Science 2025-02-17 Dariush Wahdany , Matthew Jagielski , Adam Dziedzic , Franziska Boenisch

Differentially private (DP) decentralized Federated Learning (FL) allows local users to collaborate without sharing their data with a central server. However, accurately quantifying the privacy budget of private FL algorithms is challenging…

Machine Learning · Computer Science 2025-10-24 Xiang Li , Buxin Su , Chendi Wang , Qi Long , Weijie J. Su

The growing reliance on artificial intelligence (AI) in customer support has significantly improved operational efficiency and user experience. However, traditional machine learning (ML) approaches, which require extensive local training on…

Machine Learning · Computer Science 2025-01-03 Anant Prakash Awasthi , Girdhar Gopal Agarwal , Chandraketu Singh , Rakshit Varma , Sanchit Sharma

Federated learning (FL) with differential privacy (DP) provides a framework for collaborative machine learning, enabling clients to train a shared model while adhering to strict privacy constraints. The framework allows each client to have…

Machine Learning · Computer Science 2025-02-27 Shahrzad Kiani , Nupur Kulkarni , Adam Dziedzic , Stark Draper , Franziska Boenisch

Large language models (LLMs) are increasingly integrated into real-time machine learning applications, where safeguarding user privacy is paramount. Traditional differential privacy mechanisms often struggle to balance privacy and accuracy,…

Cryptography and Security · Computer Science 2024-10-04 Jessica Smith , David Williams , Emily Brown