English
Related papers

Related papers: Minimax optimal differentially private synthetic d…

200 papers

The need to analyze sensitive data, such as medical records or financial data, has created a critical research challenge in recent years. In this paper, we adopt the framework of differential privacy, and explore mechanisms for generating…

Cryptography and Security · Computer Science 2024-05-09 Nikolija Bojkovic , Po-Ling Loh

Differential privacy is a rigorous privacy condition achieved by randomizing query answers. This paper develops efficient algorithms for answering multiple queries under differential privacy with low error. We pursue this goal by advancing…

Databases · Computer Science 2011-03-08 Chao Li , Gerome Miklau

Differential Privacy (DP) has become a gold standard in privacy-preserving data analysis. While it provides one of the most rigorous notions of privacy, there are many settings where its applicability is limited. Our main contribution is in…

Cryptography and Security · Computer Science 2021-10-20 Aman Bansal , Rahul Chunduru , Deepesh Data , Manoj Prabhakaran

Consider a database of $n$ people, each represented by a bit-string of length $d$ corresponding to the setting of $d$ binary attributes. A $k$-way marginal query is specified by a subset $S$ of $k$ attributes, and a $|S|$-dimensional binary…

Data Structures and Algorithms · Computer Science 2013-08-07 Cynthia Dwork , Aleksandar Nikolov , Kunal Talwar

We show that convex-concave Lipschitz stochastic saddle point problems (also known as stochastic minimax optimization) can be solved under the constraint of $(\epsilon,\delta)$-differential privacy with \emph{strong (primal-dual) gap} rate…

Machine Learning · Computer Science 2023-06-30 Raef Bassily , Cristóbal Guzmán , Michael Menart

We show new lower bounds on the sample complexity of $(\varepsilon, \delta)$-differentially private algorithms that accurately answer large sets of counting queries. A counting query on a database $D \in (\{0,1\}^d)^n$ has the form "What…

Cryptography and Security · Computer Science 2018-10-25 Mark Bun , Jonathan Ullman , Salil Vadhan

We develop a theory of asymptotic efficiency in regular parametric models when data confidentiality is ensured by local differential privacy (LDP). Even though efficient parameter estimation is a classical and well-studied problem in…

Statistics Theory · Mathematics 2024-03-08 Lukas Steinberger

Most prior results on differentially private stochastic gradient descent (DP-SGD) are derived under the simplistic assumption of uniform Lipschitzness, i.e., the per-sample gradients are uniformly bounded. We generalize uniform…

Machine Learning · Computer Science 2023-06-07 Rudrajit Das , Satyen Kale , Zheng Xu , Tong Zhang , Sujay Sanghavi

Differentially-private stochastic gradient descent (DP-SGD) is a family of iterative machine learning training algorithms that privatize gradients to generate a sequence of differentially-private (DP) model parameters. It is also the…

Machine Learning · Computer Science 2025-02-11 Weiwei Kong , Mónica Ribero

We study differentially private (DP) algorithms for smooth stochastic minimax optimization, with stochastic minimization as a byproduct. The holy grail of these settings is to guarantee the optimal trade-off between the privacy and the…

Machine Learning · Computer Science 2022-10-20 Liang Zhang , Kiran Koshy Thekumparampil , Sewoong Oh , Niao He

Differential privacy enables organizations to collect accurate aggregates over sensitive data with strong, rigorous guarantees on individuals' privacy. Previous work has found that under differential privacy, computing multiple correlated…

Databases · Computer Science 2016-05-18 Ganzhao Yuan , Yin Yang , Zhenjie Zhang , Zhifeng Hao

Differential privacy (DP) is a class of mathematical standards for assessing the privacy provided by a data-release mechanism. This work concerns two important flavors of DP that are related yet conceptually distinct: pure…

Statistics Theory · Mathematics 2024-08-22 James Bailie , Ruobin Gong

Recently, due to the popularity of deep neural networks and other methods whose training typically relies on the optimization of an objective function, and due to concerns for data privacy, there is a lot of interest in differentially…

Machine Learning · Computer Science 2025-02-12 Antoine Barczewski , Jan Ramon

Preserving privacy of continuous and/or high-dimensional data such as images, videos and audios, can be challenging with syntactic anonymization methods which are designed for discrete attributes. Differential privacy, which provides a more…

Machine Learning · Computer Science 2017-12-04 Jihun Hamm

Private synthetic data sharing is preferred as it keeps the distribution and nuances of original data compared to summary statistics. The state-of-the-art methods adopt a select-measure-generate paradigm, but measuring large domain…

Cryptography and Security · Computer Science 2023-10-11 Meifan Zhang , Dihang Deng , Lihua Yin

We provide a differentially private algorithm for producing synthetic data simultaneously useful for multiple tasks: marginal queries and multitask machine learning (ML). A key innovation in our algorithm is the ability to directly handle…

Privacy preservation has become a critical concern in high-dimensional data analysis due to the growing prevalence of data-driven applications. Since its proposal, sliced inverse regression has emerged as a widely utilized statistical…

Machine Learning · Statistics 2025-04-08 Xintao Xia , Linjun Zhang , Zhanrui Cai

In this paper, we address the challenge of differential privacy in the context of graph cuts, specifically focusing on the multiway cut and the minimum $k$-cut. We introduce edge-differentially private algorithms that achieve nearly optimal…

Cryptography and Security · Computer Science 2024-12-04 Rishi Chandra , Michael Dinitz , Chenglin Fan , Zongrui Zou

Protecting user data privacy can be achieved via many methods, from statistical transformations to generative models. However, all of them have critical drawbacks. For example, creating a transformed data set using traditional techniques is…

Machine Learning · Computer Science 2024-04-24 Tânia Carvalho , Nuno Moniz , Luís Antunes , Nitesh Chawla

We propose a Bayesian pseudo posterior mechanism to generate record-level synthetic databases equipped with an $(\epsilon,\delta)-$ probabilistic differential privacy (pDP) guarantee, where $\delta$ denotes the probability that any observed…

Methodology · Statistics 2021-08-17 Terrance D. Savitsky , Matthew R. Williams , Jingchen Hu