English
Related papers

Related papers: Mutual Information Bounds in the Shuffle Model

200 papers

Most works in learning with differential privacy (DP) have focused on the setting where each user has a single sample. In this work, we consider the setting where each user holds $m$ samples and the privacy protection is enforced at the…

Machine Learning · Computer Science 2021-12-28 Badih Ghazi , Ravi Kumar , Pasin Manurangsi

We study an information-theoretic privacy mechanism design problem, where an agent observes useful data $Y$ that is arbitrarily correlated with sensitive data $X$, and design disclosed data $U$ generated from $Y$ (the agent has no direct…

Information Theory · Computer Science 2026-01-13 Amirreza Zamani , Sajad Daei , Parastoo Sadeghi , Mikael Skoglund

In the setting where information cannot be verified, we propose a simple yet powerful information theoretical framework---the Mutual Information Paradigm---for information elicitation mechanisms. Our framework pays every agent a measure of…

Computer Science and Game Theory · Computer Science 2018-01-19 Yuqing Kong , Grant Schoenebeck

Aggregate time-series data like traffic flow and site occupancy repeatedly sample statistics from a population across time. Such data can be profoundly useful for understanding trends within a given population, but also pose a significant…

Cryptography and Security · Computer Science 2022-01-14 Tatsuki Koga , Casey Meehan , Kamalika Chaudhuri

Data publishing under privacy constraints can be achieved with mechanisms that add randomness to data points when released to an untrusted party, thereby decreasing the data's utility. In this paper, we analyze this privacy-utility tradeoff…

Information Theory · Computer Science 2024-08-28 Leonhard Grosse , Sara Saeidian , Tobias Oechtering

Multiparty computation is raising importance because it's primary objective is to replace any trusted third party in the distributed computation. This work presents two multiparty shuffling protocols where each party, possesses a private…

Cryptography and Security · Computer Science 2021-03-10 Dhaneshwar Mardi , Surbhi Tanwar , Jaydeep Howlader

Machine learning (ML) models have been shown to leak private information from their training datasets. Differential Privacy (DP), typically implemented through the differential private stochastic gradient descent algorithm (DP-SGD), has…

Machine Learning · Computer Science 2025-02-17 Dariush Wahdany , Matthew Jagielski , Adam Dziedzic , Franziska Boenisch

We consider the problem of continually releasing an estimate of the population mean of a stream of samples that is user-level differentially private (DP). At each time instant, a user contributes a sample, and the users can arrive in…

Machine Learning · Computer Science 2022-12-21 Anand Jerry George , Lekshmi Ramesh , Aditya Vikram Singh , Himanshu Tyagi

A privacy mechanism design problem is studied through the lens of information theory. In this work, an agent observes useful data $Y=(Y_1,...,Y_N)$ that is correlated with private data $X=(X_1,...,X_N)$ which is assumed to be also…

Information Theory · Computer Science 2022-11-29 Amirreza Zamani , Tobias J. Oechtering , Mikael Skoglund

We study information-theoretic security for discrete memoryless interference and broadcast channels with independent confidential messages sent to two receivers. Confidential messages are transmitted to their respective receivers with…

Information Theory · Computer Science 2016-11-15 Ruoheng Liu , Ivana Maric , Predrag Spasojevic , Roy D. Yates

Differential privacy is often studied under two different models of neighboring datasets: the add-remove model and the swap model. While the swap model is frequently used in the academic literature to simplify analysis, many practical…

Data Structures and Algorithms · Computer Science 2024-02-21 Alex Kulesza , Ananda Theertha Suresh , Yuyan Wang

We consider a setup in which confidential i.i.d. samples $X_1,\dotsc,X_n$ from an unknown finite-support distribution $\boldsymbol{p}$ are passed through $n$ copies of a discrete privatization channel (a.k.a. mechanism) producing outputs…

Machine Learning · Computer Science 2018-11-30 Adriano Pastore , Michael Gastpar

In this paper, we consider the framework of privacy amplification via iteration, which is originally proposed by Feldman et al. and subsequently simplified by Asoodeh et al. in their analysis via the contraction coefficient. This line of…

Cryptography and Security · Computer Science 2021-06-23 Matteo Sordello , Zhiqi Bu , Jinshuo Dong

Differential privacy is typically studied in the central model where a trusted "aggregator" holds the sensitive data of all the individuals and is responsible for protecting their privacy. A popular alternative is the local model in which…

Cryptography and Security · Computer Science 2020-09-14 Thomas Steinke

We consider a distributed empirical risk minimization (ERM) optimization problem with communication efficiency and privacy requirements, motivated by the federated learning (FL) framework. Unique challenges to the traditional ERM problem in…

Machine Learning · Computer Science 2020-09-24 Antonious M. Girgis , Deepesh Data , Suhas Diggavi , Peter Kairouz , Ananda Theertha Suresh

We consider the estimation of a signal from the knowledge of its noisy linear random Gaussian projections. A few examples where this problem is relevant are compressed sensing, sparse superposition codes, and code division multiple access.…

Information Theory · Computer Science 2020-08-31 Jean Barbier , Nicolas Macris , Mohamad Dia , Florent Krzakala

Organizations started to adopt differential privacy (DP) techniques hoping to persuade more users to share personal data with them. However, many users do not understand DP techniques, thus may not be willing to share. Previous research…

Human-Computer Interaction · Computer Science 2022-08-05 Jingyu Jia , Zikai Alex Wen , Zheli Liu , Changyu Dong

Differential privacy is becoming a gold standard for privacy research; it offers a guaranteed bound on loss of privacy due to release of query results, even under worst-case assumptions. The theory of differential privacy is an active…

In settings like vaccination registries, individuals act after observing others, and the resulting public records can expose private information. We study privacy-preserving sequential learning, where agents add endogenous noise to their…

Theoretical Economics · Economics 2025-10-03 Yuxin Liu , M. Amin Rahimian

This paper introduces a new method that embeds any Bayesian model used to generate synthetic data and converts it into a differentially private (DP) mechanism. We propose an alteration of the model synthesizer to utilize a censored…

Methodology · Statistics 2023-08-07 Jingchen Hu , Matthew R. Williams , Terrance D. Savitsky