English
Related papers

Related papers: Mutual Information Optimally Local Private Discret…

200 papers

One goal of statistical privacy research is to construct a data release mechanism that protects individual privacy while preserving information content. An example is a {\em random mechanism} that takes an input database $X$ and outputs a…

Statistics Theory · Mathematics 2012-01-11 Larry Wasserman , Shuheng Zhou

We study a basic private estimation problem: each of $n$ users draws a single i.i.d. sample from an unknown Gaussian distribution, and the goal is to estimate the mean of this Gaussian distribution while satisfying local differential…

Machine Learning · Computer Science 2019-10-29 Matthew Joseph , Janardhan Kulkarni , Jieming Mao , Zhiwei Steven Wu

Data privacy is an important concern in learning, when datasets contain sensitive information about individuals. This paper considers consensus-based distributed optimization under data privacy constraints. Consensus-based optimization…

Machine Learning · Computer Science 2019-03-20 Mehrdad Showkatbakhsh , Can Karakus , Suhas Diggavi

Local Differential Privacy (LDP) addresses significant privacy concerns in sensitive data collection. In this work, we focus on numerical data collection under LDP, targeting a significant gap in the literature: existing LDP mechanisms are…

Cryptography and Security · Computer Science 2025-10-14 Incheol Baek , Yon Dohn Chung

We study mechanisms for differential privacy on finite datasets. By deriving \emph{sufficient sets} for differential privacy we obtain necessary and sufficient conditions for differential privacy, a tight lower bound on the maximal expected…

Discrete Mathematics · Computer Science 2015-05-28 Naoise Holohan , Doug Leith , Oliver Mason

Differential privacy (DP), provides a framework for provable privacy protection against arbitrary adversaries, while allowing the release of summary statistics and synthetic data. We address the problem of releasing a noisy real-valued…

Methodology · Statistics 2024-11-04 Jordan Awan , Aleksandra Slavkovic

Consider a data publishing setting for a data set with public and private features. The objective of the publisher is to maximize the amount of information about the public features in a revealed data set, while keeping the information…

Information Theory · Computer Science 2018-05-11 Hao Wang , Mario Diaz , Flavio P. Calmon , Lalitha Sankar

Distributed online learning is gaining increased traction due to its unique ability to process large-scale datasets and streaming data. To address the growing public awareness and concern on privacy protection, plenty of algorithms have…

Machine Learning · Computer Science 2024-08-27 Ziqin Chen , Yongqiang Wang

Many resource allocation problems can be formulated as an optimization problem whose constraints contain sensitive information about participating users. This paper concerns solving this kind of optimization problem in a distributed manner…

Optimization and Control · Mathematics 2016-11-17 Shuo Han , Ufuk Topcu , George J. Pappas

In this paper we study the problem of estimating the unknown mean $\theta$ of a unit variance Gaussian distribution in a locally differentially private (LDP) way. In the high-privacy regime ($\epsilon\le 1$), we identify an optimal privacy…

Statistics Theory · Mathematics 2025-03-06 Nikita P. Kalinin , Lukas Steinberger

Local differential privacy (LDP) can provide each user with strong privacy guarantees under untrusted data curators while ensuring accurate statistics derived from privatized data. Due to its powerfulness, LDP has been widely adopted to…

Cryptography and Security · Computer Science 2019-06-06 Teng Wang , Jun Zhao , Xinyu Yang , Xuebin Ren

Recent years, local differential privacy (LDP) has been adopted by many web service providers like Google \cite{erlingsson2014rappor}, Apple \cite{apple2017privacy} and Microsoft \cite{bolin2017telemetry} to collect and analyse users' data…

Information Theory · Computer Science 2022-03-15 Zhongzheng Xiong , Jialin Sun , Xiaojun Mao , Jian Wang , Shan Ying , Zengfeng Huang

Differential privacy is a standard framework to quantify the privacy loss in the data anonymization process. To preserve differential privacy, a random noise adding mechanism is widely adopted, where the trade-off between data privacy level…

Cryptography and Security · Computer Science 2022-03-22 Shuying Qin , Jianping He , Chongrong Fang , James Lam

We introduce the multi-dimensional Skellam mechanism, a discrete differential privacy mechanism based on the difference of two independent Poisson random variables. To quantify its privacy guarantees, we analyze the privacy loss…

Machine Learning · Computer Science 2021-11-01 Naman Agarwal , Peter Kairouz , Ziyu Liu

We consider the problem of mean estimation under user-level local differential privacy, where $n$ users are contributing through their local pool of data samples. Previous work assume that the number of data samples is the same across…

Methodology · Statistics 2024-10-15 Corentin Pla , Hugo Richard , Maxime Vono

We consider a private discrete distribution estimation problem with one-bit communication constraint. The privacy constraints are imposed with respect to the local differential privacy and the maximal leakage. The estimation error is…

Information Theory · Computer Science 2023-10-18 Seung-Hyun Nam , Vincent Y. F. Tan , Si-Hyeon Lee

We find separation rates for testing multinomial or more general discrete distributions under the constraint of local differential privacy. We construct efficient randomized algorithms and test procedures, in both the case where only…

Statistics Theory · Mathematics 2020-05-27 Thomas B. Berrett , Cristina Butucea

We introduce a privacy measure called statistic maximal leakage that quantifies how much a privacy mechanism leaks about a specific secret, relative to the adversary's prior information about that secret. Statistic maximal leakage is an…

Information Theory · Computer Science 2024-11-28 Shuaiqi Wang , Zinan Lin , Giulia Fanti

We consider the privacy amplification properties of a sampling scheme in which a user's data is used in $k$ steps chosen randomly and uniformly from a sequence (or set) of $t$ steps. This sampling scheme has been recently applied in the…

Machine Learning · Computer Science 2026-02-20 Vitaly Feldman , Moshe Shenfeld

Mutual information is widely used in artificial intelligence, in a descriptive way, to measure the stochastic dependence of discrete random variables. In order to address questions such as the reliability of the empirical value, one must…

Artificial Intelligence · Computer Science 2008-06-26 Marco Zaffalon , Marcus Hutter