English
Related papers

Related papers: Optimizing Noise Distributions for Differential Pr…

200 papers

Network routing problems are common across many engineering applications. Computing optimal routing policies requires knowledge about network demand, i.e., the origin and destination (OD) of all requests in the network. However, privacy…

Systems and Control · Electrical Eng. & Systems 2022-10-27 Matthew Tsao , Karthik Gopalakrishnan , Kaidi Yang , Marco Pavone

We derive the optimal $\epsilon$-differentially private mechanism for a general two-dimensional real-valued (histogram-like) query function under a utility-maximization (or cost-minimization) framework for the $\ell^1$ cost function. We…

Cryptography and Security · Computer Science 2013-12-04 Quan Geng , Pramod Viswanath

We propose an adaptive (stochastic) gradient perturbation method for differentially private empirical risk minimization. At each iteration, the random noise added to the gradient is optimally adapted to the stepsize; we name this process…

Machine Learning · Computer Science 2021-10-26 Xiaoxia Wu , Lingxiao Wang , Irina Cristali , Quanquan Gu , Rebecca Willett

Integer data is typically made differentially private by adding noise from a Discrete Laplace (or Discrete Gaussian) distribution. We study the setting where differential privacy of a counting query is achieved using bit-wise randomized…

Information Theory · Computer Science 2023-11-17 David Rasmussen Lolck , Rasmus Pagh

In the highly interconnected realm of Internet of Things, exchange of sensitive information raises severe privacy concerns. The Laplace mechanism -- adding Laplace-distributed artificial noise to sensitive data -- is one of the widely used…

Cryptography and Security · Computer Science 2015-04-09 Fragkiskos Koufogiannis , Shuo Han , George J. Pappas

While Local Differential Privacy (LDP) serves as a foundational primitive for distributed data collection, its stringent noise injection requirement often leads to severe degradation in data utility. This degradation stems from the…

Machine Learning · Computer Science 2026-05-21 Youngmok Ha , Viktor Schlegel , Yidan Sun , Anil Anthony Bharath

Differentially Private Stochastic Gradient Descent (DP-SGD) is a standard method for enforcing privacy in deep learning, typically using the Gaussian mechanism to perturb gradient updates. However, conventional mechanisms such as Gaussian…

Cryptography and Security · Computer Science 2025-09-09 Qin Yang , Nicholas Stout , Meisam Mohammady , Han Wang , Ayesha Samreen , Christopher J Quinn , Yan Yan , Ashish Kundu , Yuan Hong

Privacy protection and nonconvexity are two challenging problems in decentralized optimization and learning involving sensitive data. Despite some recent advances addressing each of the two problems separately, no results have been reported…

Optimization and Control · Mathematics 2022-12-16 Yongqiang Wang , Tamer Basar

A canonical noise distribution (CND) is an additive mechanism designed to satisfy $f$-differential privacy ($f$-DP), without any wasted privacy budget. $f$-DP is a hypothesis testing-based formulation of privacy phrased in terms of tradeoff…

Cryptography and Security · Computer Science 2022-10-07 Jordan Awan , Jinshuo Dong

Fine-tuning large language models on downstream tasks is crucial for realizing their cross-domain potential but often relies on sensitive data, raising privacy concerns. Differential privacy (DP) offers rigorous privacy guarantees and has…

Machine Learning · Computer Science 2026-01-19 Lele Zheng , Xiang Wang , Tao Zhang , Yang Cao , Ke Cheng , Yulong Shen

The calibration of noise for a privacy-preserving mechanism depends on the sensitivity of the query and the prescribed privacy level. A data steward must make the non-trivial choice of a privacy level that balances the requirements of users…

Cryptography and Security · Computer Science 2020-04-15 Ashish Dandekar , Debabrota Basu , Stephane Bressan

The Podium mechanism guarantees ($\epsilon, 0$)-differential privacy by sampling noise from a \emph{finite} mixture of three uniform distributions. By carefully constructing such a mixture distribution, we trivially guarantee privacy…

Cryptography and Security · Computer Science 2019-08-05 Vasyl Pihur

Datasets are often used multiple times and each successive analysis may depend on the outcome of previous analyses. Standard techniques for ensuring generalization and statistical validity do not account for this adaptive dependence. A…

Machine Learning · Computer Science 2018-06-13 Vitaly Feldman , Thomas Steinke

The Gaussian Mechanism (GM), which consists in adding Gaussian noise to a vector-valued query before releasing it, is a standard privacy protection mechanism. In particular, given that the query respects some L2 sensitivity property (the L2…

Machine Learning · Computer Science 2024-03-20 Hadrien Hendrikx , Paul Mangold , Aurélien Bellet

Metric Differential Privacy (mDP) generalizes Local Differential Privacy (LDP) by adapting privacy guarantees based on pairwise distances, enabling context-aware protection and improved utility. While existing optimization-based methods…

Machine Learning · Computer Science 2026-01-16 Chenxi Qiu

We introduce a differentially private manifold denoising framework that allows users to exploit sensitive reference datasets to correct noisy, non-private query points without compromising privacy. The method follows an iterative procedure…

Machine Learning · Computer Science 2026-04-02 Jiaqi Wu , Yiqing Sun , Zhigang Yao

Deep learning models leak significant amounts of information about their training datasets. Previous work has investigated training models with differential privacy (DP) guarantees through adding DP noise to the gradients. However, such…

Machine Learning · Computer Science 2020-07-23 Milad Nasr , Reza Shokri , Amir houmansadr

Noisy gradient descent and its variants are the predominant algorithms for differentially private machine learning. It is a fundamental question to quantify their privacy leakage, yet tight characterizations remain open even in the…

Machine Learning · Computer Science 2024-06-13 Jinho Bok , Weijie Su , Jason M. Altschuler

In this paper, we develop a distributionally robust optimal control approach for differentially private dynamical systems, enabling a plant to securely outsource control computation to an untrusted remote server. We consider a plant that…

Systems and Control · Electrical Eng. & Systems 2026-03-20 Yeongjun Jang , Kaoru Teranishi , Junsoo Kim

Differential Privacy (DP) provides tight upper bounds on the capabilities of optimal adversaries, but such adversaries are rarely encountered in practice. Under the hypothesis testing/membership inference interpretation of DP, we examine…

Cryptography and Security · Computer Science 2022-10-25 Georgios Kaissis , Alexander Ziller , Stefan Kolek Martinez de Azagra , Daniel Rueckert