English
Related papers

Related papers: A Bias-Accuracy-Privacy Trilemma for Statistical E…

200 papers

We revisit the problem of linear regression under a differential privacy constraint. By consolidating existing pieces in the literature, we clarify the correct dependence of the feature, label and coefficient domains in the optimization…

Machine Learning · Statistics 2018-07-10 Yu-Xiang Wang

We study the fundamental problem of the construction of optimal randomization in Differential Privacy. Depending on the clipping strategy or additional properties of the processing function, the corresponding sensitivity set theoretically…

Cryptography and Security · Computer Science 2023-09-29 Hanshen Xiao , Jun Wan , Srinivas Devadas

Differentially private (DP) synthetic data generation is a practical method for improving access to data as a means to encourage productive partnerships. One issue inherent to DP is that the "privacy budget" is generally "spent" evenly…

Machine Learning · Computer Science 2022-08-11 Lucas Rosenblatt , Joshua Allen , Julia Stoyanovich

Perhaps the single most important use case for differential privacy is to privately answer numerical queries, which is usually achieved by adding noise to the answer vector. The central question, therefore, is to understand which noise…

Machine Learning · Statistics 2021-03-17 Jinshuo Dong , Weijie J. Su , Linjun Zhang

Bayesian optimization is a powerful tool for fine-tuning the hyper-parameters of a wide variety of machine learning models. The success of machine learning has led practitioners in diverse real-world settings to learn classifiers for…

Machine Learning · Statistics 2015-02-24 Matt J. Kusner , Jacob R. Gardner , Roman Garnett , Kilian Q. Weinberger

Differential privacy is a mathematical concept that provides an information-theoretic security guarantee. While differential privacy has emerged as a de facto standard for guaranteeing privacy in data sharing, the known mechanisms to…

Cryptography and Security · Computer Science 2024-03-26 March Boedihardjo , Thomas Strohmer , Roman Vershynin

The verification of differential privacy algorithms that employ Gaussian distributions is little understood. This paper tackles the challenge of verifying such programs by introducing a novel approach to approximating probability…

Cryptography and Security · Computer Science 2025-09-11 Bishnu Bhusal , Rohit Chadha , A. Prasad Sistla , Mahesh Viswanathan

Differential Privacy (DP) is a formal definition of privacy that provides rigorous guarantees against risks of privacy breaches during data processing. It makes no assumptions about the knowledge or computational power of adversaries, and…

Cryptography and Security · Computer Science 2022-05-20 Roxana Danger

Statistical model checking is a class of sequential algorithms that can verify specifications of interest on an ensemble of cyber-physical systems (e.g., whether 99% of cars from a batch meet a requirement on their energy efficiency). These…

Machine Learning · Computer Science 2022-06-29 Yu Wang , Hussein Sibai , Mark Yen , Sayan Mitra , Geir E. Dullerud

Differential privacy (DP) is an essential technique for privacy-preserving. It was found that a large model trained for privacy preserving performs worse than a smaller model (e.g. ResNet50 performs worse than ResNet18). To better…

Machine Learning · Computer Science 2021-11-30 Yinchen Shen , Zhiguo Wang , Ruoyu Sun , Xiaojing Shen

Large organizations that collect data about populations (like the US Census Bureau) release summary statistics that are used by multiple stakeholders for resource allocation and policy making problems. These organizations are also legally…

Databases · Computer Science 2021-11-08 David Pujol , Yikai Wu , Brandon Fain , Ashwin Machanavajjhala

In this paper we study the problem of estimating the unknown mean $\theta$ of a unit variance Gaussian distribution in a locally differentially private (LDP) way. In the high-privacy regime ($\epsilon\le 1$), we identify an optimal privacy…

Statistics Theory · Mathematics 2025-03-06 Nikita P. Kalinin , Lukas Steinberger

Most existing decentralized learning methods with differential privacy (DP) guarantee rely on constant gradient clipping bounds and fixed-level DP Gaussian noises for each node throughout the training process, leading to a significant…

Machine Learning · Computer Science 2025-05-13 Zehan Zhu , Yan Huang , Xin Wang , Shouling Ji , Jinming Xu

The ratio of two Gaussians is useful in many contexts of statistical inference. We discuss statistically valid inference of the ratio under Differential Privacy (DP). We use the delta method to derive the asymptotic distribution of the…

Methodology · Statistics 2022-06-30 Jingang Miao , Yiming Paul Li

Differential privacy (DP), provides a framework for provable privacy protection against arbitrary adversaries, while allowing the release of summary statistics and synthetic data. We address the problem of releasing a noisy real-valued…

Methodology · Statistics 2024-11-04 Jordan Awan , Aleksandra Slavkovic

Differential privacy (DP) is a privacy-preserving paradigm that protects the training data when training deep learning models. Critically, the performance of models is determined by the training hyperparameters, especially those of the…

Machine Learning · Computer Science 2025-03-04 Zhiqi Bu , Ruixuan Liu

Differential privacy (DP) is a widely used approach for mitigating privacy risks when training machine learning models on sensitive data. DP mechanisms add noise during training to limit the risk of information leakage. The scale of the…

Machine Learning · Computer Science 2024-11-11 Bogdan Kulynych , Juan Felipe Gomez , Georgios Kaissis , Flavio du Pin Calmon , Carmela Troncoso

Differential privacy (DP) enables private data analysis. In a typical DP deployment, controllers manage individuals' sensitive data and are responsible for answering analysts' queries while protecting individuals' privacy. They do so by…

Databases · Computer Science 2026-05-05 Zhiru Zhu , Raul Castro Fernandez

Privacy protection of users' entire contribution of samples is important in distributed systems. The most effective approach is the two-stage scheme, which finds a small interval first and then gets a refined estimate by clipping samples…

Machine Learning · Computer Science 2024-10-25 Puning Zhao , Lifeng Lai , Li Shen , Qingming Li , Jiafei Wu , Zhe Liu

Differential privacy (DP) is widely employed to provide privacy protection for individuals by limiting information leakage from the aggregated data. Two well-known models of DP are the central model and the local model. The former requires…

Cryptography and Security · Computer Science 2024-11-05 Yucheng Fu , Tianhao Wang