English
Related papers

Related papers: Private Selection from Private Candidates

200 papers

We consider the problem of property testing for differential privacy: with black-box access to a purportedly private algorithm, can we verify its privacy guarantees? In particular, we show that any privacy guarantee that can be efficiently…

Cryptography and Security · Computer Science 2019-02-14 Anna Gilbert , Audra McMillan

Differential privacy, a notion of algorithmic stability, is a gold standard for measuring the additional risk an algorithm's output poses to the privacy of a single record in the dataset. Differential privacy is defined as the distance…

Machine Learning · Computer Science 2019-07-05 Kamalika Chaudhuri , Jacob Imola , Ashwin Machanavajjhala

In recent years, differential privacy has emerged as the de facto standard for sharing statistics of datasets while limiting the disclosure of private information about the involved individuals. This is achieved by randomly perturbing the…

Cryptography and Security · Computer Science 2024-12-18 Aras Selvi , Huikang Liu , Wolfram Wiesemann

Modern machine learning algorithms aim to extract fine-grained information from data to provide accurate predictions, which often conflicts with the goal of privacy protection. This paper addresses the practical and theoretical importance…

Machine Learning · Statistics 2023-07-17 Puyu Wang , Yunwen Lei , Yiming Ying , Ding-Xuan Zhou

We study the computational cost of differential privacy in terms of memory efficiency. While the trade-off between accuracy and differential privacy is well-understood, the inherent cost of privacy regarding memory use remains largely…

Cryptography and Security · Computer Science 2026-02-13 Alessandro Epasto , Xin Lyu , Pasin Manurangsi

In this paper, we initiate a systematic investigation of differentially private algorithms for convex empirical risk minimization. Various instantiations of this problem have been studied before. We provide new algorithms and matching lower…

Machine Learning · Computer Science 2014-10-21 Raef Bassily , Adam Smith , Abhradeep Thakurta

We introduce an $(\epsilon, \delta)$-jointly differentially private algorithm for packing problems. Our algorithm not only achieves the optimal trade-off between the privacy parameter $\epsilon$ and the minimum supply requirement (up to…

Data Structures and Algorithms · Computer Science 2019-05-03 Zhiyi Huang , Xue Zhu

We present new differentially private algorithms for learning a large-margin halfspace. In contrast to previous algorithms, which are based on either differentially private simulations of the statistical query model or on private convex…

Machine Learning · Computer Science 2020-02-25 Huy L. Nguyen , Jonathan Ullman , Lydia Zakynthinou

In this paper, an adjustment to the original differentially private stochastic gradient descent (DPSGD) algorithm for deep learning models is proposed. As a matter of motivation, to date, almost no state-of-the-art machine learning…

Machine Learning · Computer Science 2021-07-13 Mehdi Amian

While machine learning has proven to be a powerful data-driven solution to many real-life problems, its use in sensitive domains has been limited due to privacy concerns. A popular approach known as **differential privacy** offers provable…

Machine Learning · Statistics 2016-04-28 Yu-Xiang Wang , Jing Lei , Stephen E. Fienberg

Iterative algorithms, like gradient descent, are common tools for solving a variety of problems, such as model fitting. For this reason, there is interest in creating differentially private versions of them. However, their conversion to…

Machine Learning · Computer Science 2018-08-30 Jaewoo Lee , Daniel Kifer

Differential privacy is a recent notion of privacy for statistical databases that provides rigorous, meaningful confidentiality guarantees, even in the presence of an attacker with access to arbitrary side information. We show that for a…

Cryptography and Security · Computer Science 2008-09-30 Adam Smith

In this paper, we develop a general framework to design differentially private expectation-maximization (EM) algorithms in high-dimensional latent variable models, based on the noisy iterative hard-thresholding. We derive the statistical…

Machine Learning · Statistics 2021-09-10 Zhe Zhang , Linjun Zhang

We show a new lower bound on the sample complexity of $(\varepsilon, \delta)$-differentially private algorithms that accurately answer statistical queries on high-dimensional databases. The novelty of our bound is that it depends optimally…

Data Structures and Algorithms · Computer Science 2015-01-27 Thomas Steinke , Jonathan Ullman

Training machine learning models with differential privacy (DP) has received increasing interest in recent years. One of the most popular algorithms for training differentially private models is differentially private stochastic gradient…

Machine Learning · Computer Science 2024-02-21 Ziteng Sun , Ananda Theertha Suresh , Aditya Krishna Menon

Feature selection is a technique that extracts a meaningful subset from a set of features in training data. When the training data is large-scale, appropriate feature selection enables the removal of redundant features, which can improve…

Cryptography and Security · Computer Science 2025-05-20 Koki Wakiyama , Tomohiro I , Hiroshi Sakamoto

We study the design of differentially private algorithms for adaptive analysis of dynamically growing databases, where a database accumulates new data entries while the analysis is ongoing. We provide a collection of tools for machine…

Data Structures and Algorithms · Computer Science 2018-03-20 Rachel Cummings , Sara Krehbiel , Kevin A. Lai , Uthaipon Tantipongpipat

Given a dataset of $n$ user-contributed strings, each of length at most $\ell$, a key problem is how to identify all frequent substrings while preserving each user's privacy. Recent work by Bernardini et al. (PODS'25) introduced a…

Data Structures and Algorithms · Computer Science 2026-03-11 Peaker Guo , Rayne Holland , Hao Wu

We initiate the study of differentially private learning in the proportional dimensionality regime, in which the number of data samples $n$ and problem dimension $d$ approach infinity at rates proportional to one another, meaning that…

Machine Learning · Computer Science 2025-02-20 Cynthia Dwork , Pranay Tankala , Linjun Zhang

Differential privacy is a recently proposed notion of privacy that provides strong privacy guarantees without any assumptions on the adversary. The paper studies the problem of computing a differentially private solution to convex…

Optimization and Control · Mathematics 2014-03-26 Shuo Han , Ufuk Topcu , George J. Pappas