English
Related papers

Related papers: Private Evolution Converges

200 papers

Differential privacy guarantees allow the results of a statistical analysis involving sensitive data to be released without compromising the privacy of any individual taking part. Achieving such guarantees generally requires the injection…

Machine Learning · Statistics 2023-10-31 Jack Jewson , Sahra Ghalebikesabi , Chris Holmes

Differential privacy has emerged as an significant cornerstone in the realm of scientific hypothesis testing utilizing confidential data. In reporting scientific discoveries, Bayesian tests are widely adopted since they effectively…

Machine Learning · Statistics 2025-12-22 Abhisek Chakraborty , Saptati Datta

In many applications, the labeled data at the learner's disposal is subject to privacy constraints and is relatively limited. To derive a more accurate predictor for the target domain, it is often beneficial to leverage publicly available…

Machine Learning · Computer Science 2024-02-06 Raef Bassily , Corinna Cortes , Anqi Mao , Mehryar Mohri

Privacy in AI remains a topic that draws attention from researchers and the general public in recent years. As one way to implement privacy-preserving AI, differentially private learning is a framework that enables AI models to use…

Machine Learning · Computer Science 2023-05-03 Tianyu Xia , Shuheng Shen , Su Yao , Xinyi Fu , Ke Xu , Xiaolong Xu , Xing Fu

Developing machine learning methods that are privacy preserving is today a central topic of research, with huge practical impacts. Among the numerous ways to address privacy-preserving learning, we here take the perspective of computing the…

Machine Learning · Computer Science 2021-07-06 Alain Rakotomamonjy , Liva Ralaivola

Differentially private (DP) linear regression has received significant attention in the recent theoretical literature, with several approaches proposed to improve error rates. Our work considers the popular high-dimensional regime with…

Machine Learning · Statistics 2026-04-28 Simone Bombari , Jialei Luo , Inbar Seroussi , Marco Mondelli

Techniques to deliver privacy-preserving synthetic datasets take a sensitive dataset as input and produce a similar dataset as output while maintaining differential privacy. These approaches have the potential to improve data sharing and…

Databases · Computer Science 2018-08-24 Luke Rodriguez , Bill Howe

We initiate the study of differentially private learning in the proportional dimensionality regime, in which the number of data samples $n$ and problem dimension $d$ approach infinity at rates proportional to one another, meaning that…

Machine Learning · Computer Science 2025-02-20 Cynthia Dwork , Pranay Tankala , Linjun Zhang

Existing differentially private (DP) synthetic data generation mechanisms typically assume a single-source table. In practice, data is often distributed across multiple tables with relationships across tables. In this paper, we introduce…

Machine Learning · Computer Science 2025-01-22 Kaveh Alimohammadi , Hao Wang , Ojas Gulati , Akash Srivastava , Navid Azizan

We construct a universally Bayes consistent learning rule that satisfies differential privacy (DP). We first handle the setting of binary classification and then extend our rule to the more general setting of density estimation (with…

Machine Learning · Computer Science 2022-12-09 Olivier Bousquet , Haim Kaplan , Aryeh Kontorovich , Yishay Mansour , Shay Moran , Menachem Sadigurschi , Uri Stemmer

Privacy concerns have attracted increasing attention in data-driven products due to the tendency of machine learning models to memorize sensitive training data. Generating synthetic versions of such data with a formal privacy guarantee,…

Computation and Language · Computer Science 2023-07-19 Xiang Yue , Huseyin A. Inan , Xuechen Li , Girish Kumar , Julia McAnallen , Hoda Shajari , Huan Sun , David Levitan , Robert Sim

Gaussian processes (GPs) are non-parametric Bayesian models that are widely used for diverse prediction tasks. Previous work in adding strong privacy protection to GPs via differential privacy (DP) has been limited to protecting only the…

Machine Learning · Computer Science 2021-11-12 Antti Honkela , Laila Melkas

Differentially Private (DP) generative marginal models are often used in the wild to release synthetic tabular datasets in lieu of sensitive data while providing formal privacy guarantees. These models approximate low-dimensional marginals…

Cryptography and Security · Computer Science 2025-10-29 Georgi Ganev , Meenatchi Sundaram Muthu Selva Annamalai , Sofiane Mahiou , Emiliano De Cristofaro

This paper is the first to attempt differentially private (DP) topological data analysis (TDA), producing near-optimal private persistence diagrams. We analyze the sensitivity of persistence diagrams in terms of the bottleneck distance, and…

Machine Learning · Statistics 2023-11-06 Taegyu Kang , Sehwan Kim , Jinwon Sohn , Jordan Awan

Differential privacy (DP) is a compelling privacy definition that explains the privacy-utility tradeoff via formal, provable guarantees. Inspired by recent progress toward general-purpose data release algorithms, we propose a private…

Data Structures and Algorithms · Computer Science 2020-06-17 Benjamin Coleman , Anshumali Shrivastava

The recent developments of Diffusion Models (DMs) enable generation of astonishingly high-quality synthetic samples. Recent work showed that the synthetic samples generated by the diffusion model, which is pre-trained on public data and…

Machine Learning · Computer Science 2024-06-11 Jing Liu , Andrew Lowy , Toshiaki Koike-Akino , Kieran Parsons , Ye Wang

We study the problem of efficiently generating differentially private synthetic data that approximate the statistical properties of an underlying sensitive dataset. In recent years, there has been a growing line of work that approaches this…

Neural and Evolutionary Computing · Computer Science 2023-06-07 Terrance Liu , Jingwu Tang , Giuseppe Vietri , Zhiwei Steven Wu

We present differentially private (DP) algorithms for bilevel optimization, a problem class that received significant attention lately in various machine learning applications. These are the first algorithms for such problems under standard…

Machine Learning · Computer Science 2026-01-15 Guy Kornowski

Bayesian optimization is a powerful tool for fine-tuning the hyper-parameters of a wide variety of machine learning models. The success of machine learning has led practitioners in diverse real-world settings to learn classifiers for…

Machine Learning · Statistics 2015-02-24 Matt J. Kusner , Jacob R. Gardner , Roman Garnett , Kilian Q. Weinberger

Differentially private stochastic gradient descent (DP-SGD) has become the standard algorithm for training machine learning models with rigorous privacy guarantees. Despite its widespread use, the theoretical understanding of its long-run…

Machine Learning · Computer Science 2025-11-21 Amartya Mukherjee , Jun Liu