English
Related papers

Related papers: Distributed Differentially-Private Algorithms for …

200 papers

Modern machine learning algorithms aim to extract fine-grained information from data to provide accurate predictions, which often conflicts with the goal of privacy protection. This paper addresses the practical and theoretical importance…

Machine Learning · Statistics 2023-07-17 Puyu Wang , Yunwen Lei , Yiming Ying , Ding-Xuan Zhou

In collaborative learning (CL), multiple parties jointly train a machine learning model on their private datasets. However, data can not be shared directly due to privacy concerns. To ensure input confidentiality, cryptographic techniques,…

Cryptography and Security · Computer Science 2026-01-15 Francesco Capano , Jonas Böhler , Benjamin Weggenmann

We study continual mean estimation, where data vectors arrive sequentially and the goal is to maintain accurate estimates of the running mean. We address this problem under user-level differential privacy, which protects each user's entire…

Machine Learning · Computer Science 2026-05-12 Nikita P. Kalinin , Ali Najar , Valentin Roth , Christoph H. Lampert

Decentralized algorithms for stochastic optimization and learning rely on the diffusion of information as a result of repeated local exchanges of intermediate estimates. Such structures are particularly appealing in situations where agents…

Machine Learning · Computer Science 2020-10-26 Stefan Vlaski , Ali H. Sayed

We consider the problem of designing a coding scheme that allows both sparsity and privacy for distributed matrix-vector multiplication. Perfect information-theoretic privacy requires encoding the input sparse matrices into matrices…

Information Theory · Computer Science 2022-03-04 Marvin Xhemrishi , Rawad Bitar , Antonia Wachter-Zeh

The integration of Differential Privacy (DP) with diffusion models (DMs) presents a promising yet challenging frontier, particularly due to the substantial memorization capabilities of DMs that pose significant privacy risks. Differential…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Yu-Lin Tsai , Yizhe Li , Zekai Chen , Po-Yu Chen , Chia-Mu Yu , Xuebin Ren , Francois Buet-Golfouse

How can agents exchange information to learn while protecting privacy? Healthcare centers collaborating on clinical trials must balance knowledge sharing with safeguarding sensitive patient data. We address this challenge by using…

Machine Learning · Computer Science 2025-03-19 Marios Papachristou , M. Amin Rahimian

In distributed networks, calculating the maximum element is a fundamental task in data analysis, known as the distributed maximum consensus problem. However, the sensitive nature of the data involved makes privacy protection essential.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-17 Wenrui Yu , Richard Heusdens , Jun Pang , Qiongxiu Li

As a staple of data analysis and unsupervised learning, the problem of private clustering has been widely studied under various privacy models. Centralized differential privacy is the first of them, and the problem has also been studied for…

Data Structures and Algorithms · Computer Science 2024-06-18 Max Dupré la Tour , Monika Henzinger , David Saulpic

If learning methods are to scale to the massive sizes of modern datasets, it is essential for the field of machine learning to embrace parallel and distributed computing. Inspired by the recent development of matrix factorization methods…

Machine Learning · Computer Science 2013-10-29 Lester Mackey , Ameet Talwalkar , Michael I. Jordan

The software-based implementation of differential privacy mechanisms has been shown to be neither friendly for lightweight devices nor secure against side-channel attacks. In this work, we aim to develop a hardware-based technique to…

Cryptography and Security · Computer Science 2024-03-27 Jianqing Liu , Na Gong , Hritom Das

We study the problem of computing the privacy parameters for DP machine learning when using privacy amplification via random batching and noise correlated across rounds via a correlation matrix $\textbf{C}$ (i.e., the matrix mechanism).…

Cryptography and Security · Computer Science 2025-03-24 Christopher A. Choquette-Choo , Arun Ganesh , Saminul Haque , Thomas Steinke , Abhradeep Thakurta

Networked system often relies on distributed algorithms to achieve a global computation goal with iterative local information exchanges between neighbor nodes. To preserve data privacy, a node may add a random noise to its original data for…

Information Theory · Computer Science 2017-03-21 Jianping He , Lin Cai , Xinping Guan

This paper investigates privacy issues in distributed resource allocation over directed networks, where each agent holds a private cost function and optimizes its decision subject to a global coupling constraint through local interaction…

Systems and Control · Electrical Eng. & Systems 2025-07-08 Wei Huo , Xiaomeng Chen , Lingying Huang , Karl Henrik Johansson , Ling Shi

Federated learning with differential privacy, or private federated learning, provides a strategy to train machine learning models while respecting users' privacy. However, differential privacy can disproportionately degrade the performance…

Machine Learning · Computer Science 2022-04-18 Borja Rodríguez-Gálvez , Filip Granqvist , Rogier van Dalen , Matt Seigel

In this paper, we design Top-DP, a novel solution to optimize the differential privacy protection of decentralized image classification systems. The key insight of our solution is to leverage the unique features of decentralized…

Cryptography and Security · Computer Science 2021-09-03 Shangwei Guo , Tianwei Zhang , Guowen Xu , Han Yu , Tao Xiang , Yang Liu

This paper investigates privacy-preserving distributed cooperative control for multi-agent systems within the framework of differential privacy. In cooperative control, communication noise is inevitable and is usually regarded as a…

Systems and Control · Electrical Eng. & Systems 2026-01-14 Yuwen Ma , Sarah K. Spurgeon , Tao Li , Boli Chen

We study a pitfall in the typical workflow for differentially private machine learning. The use of differentially private learning algorithms in a "drop-in" fashion -- without accounting for the impact of differential privacy (DP) noise…

Cryptography and Security · Computer Science 2022-05-16 Wenxuan Bao , Luke A. Bauer , Vincent Bindschaedler

A common goal of privacy research is to release synthetic data that satisfies a formal privacy guarantee and can be used by an analyst in place of the original data. To achieve reasonable accuracy, a synthetic data set must be tuned to…

Databases · Computer Science 2015-03-20 Chao Li , Gerome Miklau

Differential Privacy (DP) is a probabilistic framework that protects privacy while preserving data utility. To protect the privacy of the individuals in the dataset, DP requires adding a precise amount of noise to a statistic of interest;…

Computation · Statistics 2025-05-05 Yu-Wei Chen , Pranav Sanghi , Jordan Awan