English
Related papers

Related papers: Privately Evaluating Untrusted Black-Box Functions

200 papers

We consider a dataset $S$ held by an agency, and a vector query of interest, $f(S) \in \mathbb{R}^k$, to be posed by an analyst, which contains the information required for certain planned statistical inference. The agency releases the…

Cryptography and Security · Computer Science 2021-10-13 Tomer Shoham , Yosef Rinott

Differential privacy is a widely adopted framework designed to safeguard the sensitive information of data providers within a data set. It is based on the application of controlled noise at the interface between the server that stores and…

Cryptography and Security · Computer Science 2024-05-06 Rūta Binkytė , Carlos Pinzón , Szilvia Lestyán , Kangsoo Jung , Héber H. Arcolezi , Catuscia Palamidessi

Privacy preservation is a crucial component of any real-world application. But, in applications relying on machine learning backends, privacy is challenging because models often capture more than what the model was initially trained for,…

Computation and Language · Computer Science 2021-10-05 Mimansa Jaiswal , Emily Mower Provost

We study differentially private mean estimation in a high-dimensional setting. Existing differential privacy techniques applied to large dimensions lead to computationally intractable problems or estimators with excessive privacy loss.…

Machine Learning · Computer Science 2020-07-23 Aditya Dhar , Jason Huang

Deep neural networks are susceptible to various inference attacks as they remember information about their training data. We design white-box inference attacks to perform a comprehensive privacy analysis of deep learning models. We measure…

Machine Learning · Statistics 2020-06-09 Milad Nasr , Reza Shokri , Amir Houmansadr

We study private prediction where differential privacy is achieved by adding noise to the outputs of a non-private model. Existing methods rely on noise proportional to the global sensitivity of the model, often resulting in sub-optimal…

This paper studies the tradeoff in privacy and utility in a single-trial multi-terminal guessing (estimation) framework using a system model that is inspired by index coding. There are $n$ independent discrete sources at a data curator.…

Information Theory · Computer Science 2020-06-19 Yucheng Liu , Ni Ding , Parastoo Sadeghi , Thierry Rakotoarivelo

Many machine learning applications are based on data collected from people, such as their tastes and behaviour as well as biological traits and genetic data. Regardless of how important the application might be, one has to make sure…

Machine Learning · Statistics 2017-04-11 Joonas Jälkö , Onur Dikmen , Antti Honkela

We introduce a differentially private manifold denoising framework that allows users to exploit sensitive reference datasets to correct noisy, non-private query points without compromising privacy. The method follows an iterative procedure…

Machine Learning · Computer Science 2026-04-02 Jiaqi Wu , Yiqing Sun , Zhigang Yao

Differential privacy provides strong privacy guarantees simultaneously enabling useful insights from sensitive datasets. However, it provides the same level of protection for all elements (individuals and attributes) in the data. There are…

Machine Learning · Statistics 2019-08-30 Parameswaran Kamalaruban , Victor Perrier , Hassan Jameel Asghar , Mohamed Ali Kaafar

With changes in privacy laws, there is often a hard requirement for client data to remain on the device rather than being sent to the server. Therefore, most processing happens on the device, and only an altered element is sent to the…

Cryptography and Security · Computer Science 2022-12-27 Ajinkya K Mulay

The recently proposed Fast Fourier Transform (FFT)-based accountant for evaluating $(\varepsilon,\delta)$-differential privacy guarantees using the privacy loss distribution formalism has been shown to give tighter bounds than commonly used…

Cryptography and Security · Computer Science 2021-06-22 Antti Koskela , Antti Honkela

We prove new upper and lower bounds on the sample complexity of $(\epsilon, \delta)$ differentially private algorithms for releasing approximate answers to threshold functions. A threshold function $c_x$ over a totally ordered domain $X$…

Cryptography and Security · Computer Science 2024-12-23 Mark Bun , Kobbi Nissim , Uri Stemmer , Salil Vadhan

What should regulators of complex algorithms regulate? We propose a model of oversight over 'black-box' algorithms used in high-stakes applications such as lending, medical testing, or hiring. In our model, a regulator is limited in how…

General Economics · Economics 2024-06-04 Laura Blattner , Scott Nelson , Jann Spiess

Cloud computing enables users to process and store data remotely on high-performance computers and servers by sharing data over the Internet. However, transferring data to clouds causes unavoidable privacy concerns. Here, we present a…

Cryptography and Security · Computer Science 2024-08-12 Haleh Hayati , Nathan van de Wouw , Carlos Murguia

In this paper, we investigate the differentially private estimation of data depth functions and their associated medians. We introduce several methods for privatizing depth values at a fixed point, and show that for some depth functions,…

Statistics Theory · Mathematics 2021-04-09 Kelly Ramsay , Shoja'eddin Chenouri

We study mechanisms for differential privacy on finite datasets. By deriving \emph{sufficient sets} for differential privacy we obtain necessary and sufficient conditions for differential privacy, a tight lower bound on the maximal expected…

Discrete Mathematics · Computer Science 2015-05-28 Naoise Holohan , Doug Leith , Oliver Mason

In this paper, we propose two new definitions of local differential privacy for belief functions. One is based on Shafer's semantics of randomly coded messages and the other from the perspective of imprecise probabilities. We show that such…

Cryptography and Security · Computer Science 2022-02-18 Qiyu Li , Chunlai Zhou , Biao Qin , Zhiqiang Xu

The widespread acceptance of differential privacy has led to the publication of many sophisticated algorithms for protecting privacy. However, due to the subtle nature of this privacy definition, many such algorithms have bugs that make…

Cryptography and Security · Computer Science 2019-09-09 Zeyu Ding , Yuxin Wang , Guanhong Wang , Danfeng Zhang , Daniel Kifer

The huge computation demand of deep learning models and limited computation resources on the edge devices calls for the cooperation between edge device and cloud service by splitting the deep models into two halves. However, transferring…

Cryptography and Security · Computer Science 2020-01-03 Ruiyuan Gao , Ming Dun , Hailong Yang , Zhongzhi Luan , Depei Qian