English
Related papers

Related papers: Optimal Private Discrete Distribution Estimation w…

200 papers

We establish a simple connection between robust and differentially-private algorithms: private mechanisms which perform well with very high probability are automatically robust in the sense that they retain accuracy even if a constant…

Machine Learning · Statistics 2022-12-02 Kristian Georgiev , Samuel B. Hopkins

Working under a model of privacy in which data remains private even from the statistician, we study the tradeoff between privacy guarantees and the utility of the resulting statistical estimators. We prove bounds on information-theoretic…

Statistics Theory · Mathematics 2014-08-28 John C. Duchi , Michael I. Jordan , Martin J. Wainwright

Recent years, local differential privacy (LDP) has been adopted by many web service providers like Google \cite{erlingsson2014rappor}, Apple \cite{apple2017privacy} and Microsoft \cite{bolin2017telemetry} to collect and analyse users' data…

Information Theory · Computer Science 2022-03-15 Zhongzheng Xiong , Jialin Sun , Xiaojun Mao , Jian Wang , Shan Ying , Zengfeng Huang

We consider the problem of estimating the arithmetic average of a finite collection of real vectors stored in a distributed fashion across several compute nodes subject to a communication budget constraint. Our analysis does not rely on any…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-24 Jakub Konečný , Peter Richtárik

A key task in managing distributed, sensitive data is to measure the extent to which a distribution changes. Understanding this drift can effectively support a variety of federated learning and analytics tasks. However, in many practical…

Machine Learning · Computer Science 2024-12-02 Mary Scott , Sayan Biswas , Graham Cormode , Carsten Maple

In this paper, we propose a new class of local differential privacy (LDP) schemes based on combinatorial block designs for discrete distribution estimation. This class not only recovers many known LDP schemes in a unified framework of…

Cryptography and Security · Computer Science 2023-10-18 Hyun-Young Park , Seung-Hyun Nam , Si-Hyeon Lee

Working under a model of privacy in which data remains private even from the statistician, we study the tradeoff between privacy guarantees and the risk of the resulting statistical estimators. We develop private versions of classical…

Statistics Theory · Mathematics 2017-11-16 John Duchi , Martin Wainwright , Michael Jordan

Consider a pair of random variables $(X,Y)$ distributed according to a given joint distribution $p_{XY}$. A curator wishes to maximally disclose information about $Y$, while limiting the information leakage incurred on $X$. Adopting mutual…

Information Theory · Computer Science 2023-01-30 Borzoo Rassouli , Deniz Gündüz

The ubiquity of distributed machine learning (ML) in sensitive public domain applications calls for algorithms that protect data privacy, while being robust to faults and adversarial behaviors. Although privacy and robustness have been…

Machine Learning · Computer Science 2023-05-30 Youssef Allouah , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot , John Stephan

The privacy loss distribution (PLD) provides a tight characterization of the privacy loss of a mechanism in the context of differential privacy (DP). Recent work has shown that PLD-based accounting allows for tighter $(\varepsilon,…

Data Structures and Algorithms · Computer Science 2022-07-12 Vadym Doroshenko , Badih Ghazi , Pritish Kamath , Ravi Kumar , Pasin Manurangsi

When sensitive information is encoded in data, it is important to ensure the privacy of information when attempting to learn useful information from the data. There is a natural tradeoff whereby increasing privacy requirements may decrease…

Quantum Physics · Physics 2026-02-12 Theshani Nuradha , Sujeet Bhalerao , Felix Leditzky

Privacy-preserving data release mechanisms aim to simultaneously minimize information-leakage with respect to sensitive data and distortion with respect to useful data. Dependencies between sensitive and useful data results in a…

Information Theory · Computer Science 2017-10-26 Ye Wang , Yuksel Ozan Basciftci , Prakash Ishwar

We investigate the problem of estimating a random variable $Y\in \mathcal{Y}$ under a privacy constraint dictated by another random variable $X\in \mathcal{X}$, where estimation efficiency and privacy are assessed in terms of two different…

Information Theory · Computer Science 2018-08-14 Shahab Asoodeh , Mario Diaz , Fady Alajaji , Tamas Linder

In distributed networks, calculating the maximum element is a fundamental task in data analysis, known as the distributed maximum consensus problem. However, the sensitive nature of the data involved makes privacy protection essential.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-17 Wenrui Yu , Richard Heusdens , Jun Pang , Qiongxiu Li

Consider a data publishing setting for a dataset composed by both private and non-private features. The publisher uses an empirical distribution, estimated from $n$ i.i.d. samples, to design a privacy mechanism which is applied to new fresh…

Information Theory · Computer Science 2020-03-23 Mario Diaz , Hao Wang , Flavio P. Calmon , Lalitha Sankar

This paper studies the privacy-preserving distributed optimization problem under limited communication, where each agent aims to keep its cost function private while minimizing the sum of all agents' cost functions. To this end, we propose…

Optimization and Control · Mathematics 2024-05-02 Antai Xie , Xinlei Yi , Xiaofan Wang , Ming Cao , Xiaoqiang Ren

Privacy-constrained source coding problems have become increasingly important recently, and the utility-privacy trade-off has been investigated for various systems. As pioneering work, Yamamoto (1983) found theoretical limits of the coding…

Information Theory · Computer Science 2022-05-10 Naruki Shinohara , Hideki Yagi

Real-time data-driven optimization and control problems over networks may require sensitive information of participating users to calculate solutions and decision variables, such as in traffic or energy systems. Adversaries with access to…

Optimization and Control · Mathematics 2020-05-25 Roel Dobbe , Ye Pu , Jingge Zhu , Kannan Ramchandran , Claire Tomlin

Two parties observing correlated data seek to exchange their data using interactive communication. How many bits must they communicate? We propose a new interactive protocol for data exchange which increases the communication size in steps…

Information Theory · Computer Science 2017-11-15 Himanshu Tyagi , Pramod Viswanath , Shun Watanabe

We consider the federated frequency estimation problem, where each user holds a private item $X_i$ from a size-$d$ domain and a server aims to estimate the empirical frequency (i.e., histogram) of $n$ items with $n \ll d$. Without any…

Information Theory · Computer Science 2022-11-21 Wei-Ning Chen , Ayfer Özgür , Graham Cormode , Akash Bharadwaj