English
Related papers

Related papers: Private Optimization Without Constraint Violations

200 papers

The widespread acceptance of differential privacy has led to the publication of many sophisticated algorithms for protecting privacy. However, due to the subtle nature of this privacy definition, many such algorithms have bugs that make…

Cryptography and Security · Computer Science 2019-09-09 Zeyu Ding , Yuxin Wang , Guanhong Wang , Danfeng Zhang , Daniel Kifer

In this paper we present an extremely general method for approximately solving a large family of convex programs where the solution can be divided between different agents, subject to joint differential privacy. This class includes…

Data Structures and Algorithms · Computer Science 2018-03-16 Justin Hsu , Zhiyi Huang , Aaron Roth , Zhiwei Steven Wu

Given a dataset of $n$ user-contributed strings, each of length at most $\ell$, a key problem is how to identify all frequent substrings while preserving each user's privacy. Recent work by Bernardini et al. (PODS'25) introduced a…

Data Structures and Algorithms · Computer Science 2026-03-11 Peaker Guo , Rayne Holland , Hao Wu

In this work, we study trade-offs between accuracy and privacy in the context of linear queries over histograms. This is a rich class of queries that includes contingency tables and range queries, and has been a focus of a long line of…

Data Structures and Algorithms · Computer Science 2013-08-05 Aleksandar Nikolov , Kunal Talwar , Li Zhang

In this paper, we analyze the problem of optimally allocating resources in a distributed and privacy-preserving manner. We propose a novel distributed optimal resource allocation algorithm with privacy-preserving guarantees, which operates…

Systems and Control · Electrical Eng. & Systems 2022-07-19 Jakob Nylöf , Apostolos I. Rikos , Sebin Gracy , Karl H. Johansson

Data privacy is a central concern in many applications involving ranking from incomplete and noisy pairwise comparisons, such as recommendation systems, educational assessments, and opinion surveys on sensitive topics. In this work, we…

Statistics Theory · Mathematics 2025-07-15 T. Tony Cai , Abhinav Chakraborty , Yichen Wang

The objective of differential privacy (DP) is to protect privacy by producing an output distribution that is indistinguishable between any two neighboring databases. However, traditional differentially private mechanisms tend to produce…

Cryptography and Security · Computer Science 2023-11-07 Kai Zhang , Yanjun Zhang , Ruoxi Sun , Pei-Wei Tsai , Muneeb Ul Hassan , Xin Yuan , Minhui Xue , Jinjun Chen

We study computing the convolution of a private input $x$ with a public input $h$, while satisfying the guarantees of $(\epsilon, \delta)$-differential privacy. Convolution is a fundamental operation, intimately related to Fourier…

Data Structures and Algorithms · Computer Science 2013-01-29 Nadia Fawaz , S. Muthukrishnan , Aleksandar Nikolov

We prove new upper and lower bounds on the sample complexity of $(\epsilon, \delta)$ differentially private algorithms for releasing approximate answers to threshold functions. A threshold function $c_x$ over a totally ordered domain $X$…

Cryptography and Security · Computer Science 2024-12-23 Mark Bun , Kobbi Nissim , Uri Stemmer , Salil Vadhan

This paper proposes a differentially private gradient-tracking-based distributed stochastic optimization algorithm over directed graphs. In particular, privacy noises are incorporated into each agent's state and tracking variable to…

Systems and Control · Electrical Eng. & Systems 2026-04-15 Jialong Chen , Jimin Wang , Ji-Feng Zhang

The design of a statistical signal processing privacy problem is studied where the private data is assumed to be observable. In this work, an agent observes useful data $Y$, which is correlated with private data $X$, and wants to disclose…

Information Theory · Computer Science 2023-09-19 Amirreza Zamani , Tobias J. Oechtering , Mikael Skoglund

Training differentially private machine learning models requires constraining an individual's contribution to the optimization process. This is achieved by clipping the $2$-norm of their gradient at a predetermined threshold prior to…

Machine Learning · Computer Science 2024-01-09 Filippo Galli , Catuscia Palamidessi , Tommaso Cucinotta

The problem of learning threshold functions is a fundamental one in machine learning. Classical learning theory implies sample complexity of $O(\xi^{-1} \log(1/\beta))$ (for generalization error $\xi$ with confidence $1-\beta$). The private…

Machine Learning · Computer Science 2022-11-14 Edith Cohen , Xin Lyu , Jelani Nelson , Tamás Sarlós , Uri Stemmer

We study differentially private approximation algorithms for positive linear programs (LPs with nonnegative coefficients and variables), focusing on the fundamental families of packing, covering, and mixed packing-covering formulations. We…

Data Structures and Algorithms · Computer Science 2026-05-28 Alina Ene , Huy Le Nguyen , Ta Duy Nguyen , Adrian Vladu

Working under a model of privacy in which data remains private even from the statistician, we study the tradeoff between privacy guarantees and the risk of the resulting statistical estimators. We develop private versions of classical…

Statistics Theory · Mathematics 2017-11-16 John Duchi , Martin Wainwright , Michael Jordan

Differential privacy (DP) is a formal notion that restricts the privacy leakage of an algorithm when running on sensitive data, in which privacy-utility trade-off is one of the central problems in private data analysis. In this work, we…

Machine Learning · Computer Science 2025-03-18 Bo Li , Wei Wang , Peng Ye

We present an improved $(\epsilon, \delta)$-jointly differentially private algorithm for packing problems. Our algorithm gives a feasible output that is approximately optimal up to an $\alpha n$ additive factor as long as the supply of each…

Data Structures and Algorithms · Computer Science 2019-05-03 Zhiyi Huang , Xue Zhu

As large-scale theft of data from corporate servers is becoming increasingly common, it becomes interesting to examine alternatives to the paradigm of centralizing sensitive data into large databases. Instead, one could use cryptography and…

Artificial Intelligence · Computer Science 2014-07-15 Thomas Leaute , Boi Faltings

The challenge of producing accurate statistics while respecting the privacy of the individuals in a sample is an important area of research. We study minimax lower bounds for classes of differentially private estimators. In particular, we…

Machine Learning · Computer Science 2024-09-19 Clément Lalanne , Aurélien Garivier , Rémi Gribonval

We design differentially private algorithms for the problem of online linear optimization in the full information and bandit settings with optimal $\tilde{O}(\sqrt{T})$ regret bounds. In the full-information setting, our results demonstrate…

Machine Learning · Computer Science 2017-06-15 Naman Agarwal , Karan Singh