English
Related papers

Related papers: Privacy Mechanism Design based on Empirical Distri…

200 papers

This work identifies the first privacy-aware stratified sampling scheme that minimizes the variance for general private mean estimation under the Laplace, Discrete Laplace (DLap) and Truncated-Uniform-Laplace (TuLap) mechanisms within the…

Machine Learning · Statistics 2025-01-31 Yu-Wei Chen , Raghu Pasupathy , Jordan A. Awan

We study the privacy risks that are associated with training a neural network's weights with self-supervised learning algorithms. Through empirical evidence, we show that the fine-tuning stage, in which the network weights are updated with…

Machine Learning · Computer Science 2022-05-26 Yunhao Yang , Parham Gohari , Ufuk Topcu

Security concerns in large-scale networked environments are becoming increasingly critical. To further improve the algorithm security from the design perspective of decentralized optimization algorithms, we introduce a new measure: Privacy…

Optimization and Control · Mathematics 2024-12-16 Luqing Wang , Luyao Guo , Shaofu Yang , Xinli Shi

Human mobility is highly predictable. Individuals tend to only visit a few locations with high frequency, and to move among them in a certain sequence reflecting their habits and daily routine. This predictability has to be taken into…

Cryptography and Security · Computer Science 2014-09-08 George Theodorakopoulos , Reza Shokri , Carmela Troncoso , Jean-Pierre Hubaux , Jean-Yves Le Boudec

We investigate how to optimally design local differential privacy (LDP) mechanisms that reduce data unfairness and thereby improve fairness in downstream classification. We first derive a closed-form optimal mechanism for binary sensitive…

Machine Learning · Computer Science 2026-02-02 Hrad Ghoukasian , Shahab Asoodeh

We consider the problem of mean estimation under user-level local differential privacy, where $n$ users are contributing through their local pool of data samples. Previous work assume that the number of data samples is the same across…

Methodology · Statistics 2024-10-15 Corentin Pla , Hugo Richard , Maxime Vono

Differential privacy (DP) is a mathematical privacy notion increasingly deployed across government and industry. With DP, privacy protections are probabilistic: they are bounded by the privacy budget parameter, $\epsilon$. Prior work in…

Cryptography and Security · Computer Science 2023-03-02 Priyanka Nanayakkara , Mary Anne Smart , Rachel Cummings , Gabriel Kaptchuk , Elissa Redmiles

The privacy-utility tradeoff problem is formulated as determining the privacy mechanism (random mapping) that minimizes the mutual information (a metric for privacy leakage) between the private features of the original dataset and a…

Information Theory · Computer Science 2026-05-12 Kousha Kalantari , Oliver Kosut , Lalitha Sankar

Privacy-preserving distributed machine learning becomes increasingly important due to the recent rapid growth of data. This paper focuses on a class of regularized empirical risk minimization (ERM) machine learning problems, and develops…

Machine Learning · Computer Science 2016-03-11 Tao Zhang , Quanyan Zhu

Differential privacy is a promising privacy-preserving paradigm for statistical query processing over sensitive data. It works by injecting random noise into each query result, such that it is provably hard for the adversary to infer the…

Databases · Computer Science 2012-08-02 Ganzhao Yuan , Zhenjie Zhang , Marianne Winslett , Xiaokui Xiao , Yin Yang , Zhifeng Hao

Hypothesis testing is a statistical inference framework for determining the true distribution among a set of possible distributions for a given dataset. Privacy restrictions may require the curator of the data or the respondents themselves…

Information Theory · Computer Science 2017-04-28 Jiachun Liao , Lalitha Sankar , Vincent Y. F. Tan , Flavio P. Calmon

Local differential privacy (LDP) enables private data sharing and analytics without the need for a trusted data collector. Error-optimal primitives (for, e.g., estimating means and item frequencies) under LDP have been well studied. For…

Cryptography and Security · Computer Science 2020-05-19 Zhuolun Xiang , Bolin Ding , Xi He , Jingren Zhou

When building machine learning models using sensitive data, organizations should ensure that the data processed in such systems is adequately protected. For projects involving machine learning on personal data, Article 35 of the GDPR…

Cryptography and Security · Computer Science 2020-07-21 Sasi Kumar Murakonda , Reza Shokri

The differential privacy is a widely accepted conception of privacy preservation and the Laplace mechanism is a famous instance of differential privacy mechanisms to deal with numerical data. In this paper, we find that the differential…

Cryptography and Security · Computer Science 2020-10-20 Wen Huang , Shijie Zhou , Yongjian Liao

The objective of differential privacy (DP) is to protect privacy by producing an output distribution that is indistinguishable between any two neighboring databases. However, traditional differentially private mechanisms tend to produce…

Cryptography and Security · Computer Science 2023-11-07 Kai Zhang , Yanjun Zhang , Ruoxi Sun , Pei-Wei Tsai , Muneeb Ul Hassan , Xin Yuan , Minhui Xue , Jinjun Chen

Assessment of disclosure risk is of paramount importance in the research and applications of data privacy techniques. The concept of differential privacy (DP) formalizes privacy in probabilistic terms and provides a robust concept for…

Statistics Theory · Mathematics 2020-07-01 Fang Liu

We propose differentially private algorithms for parameter estimation in both low-dimensional and high-dimensional sparse generalized linear models (GLMs) by constructing private versions of projected gradient descent. We show that the…

Machine Learning · Statistics 2020-12-08 T. Tony Cai , Yichen Wang , Linjun Zhang

We analytically investigate how over-parameterization of models in randomized machine learning algorithms impacts the information leakage about their training data. Specifically, we prove a privacy bound for the KL divergence between model…

Machine Learning · Statistics 2023-11-01 Jiayuan Ye , Zhenyu Zhu , Fanghui Liu , Reza Shokri , Volkan Cevher

We present a differentially private mechanism to display statistics (e.g., the moving average) of a stream of real valued observations where the bound on each observation is either too conservative or unknown in advance. This is…

Cryptography and Security · Computer Science 2018-11-09 Victor Perrier , Hassan Jameel Asghar , Dali Kaafar

The Horvitz-Thompson estimate of a total can be seen as as differentially private mechanism applied to this population total. We provide forumlae to compute the $\epsilon$ and $\delta$ parameter for this specific mecanism, coupled or not…

Statistics Theory · Mathematics 2025-06-18 Daniel Bernard Bonnéry , Julien Jamme