English
Related papers

Related papers: A Model Randomization Approach to Statistical Para…

200 papers

Poisson subsampling is the default sampling scheme in differentially private machine learning, largely because its unstructured randomness yields tractable privacy amplification analyses. Yet this same randomness introduces substantial…

Machine Learning · Computer Science 2026-05-11 Andy Dong , Ayfer Özgür

In this work, fundamental limits and optimal mechanisms of privacy-preserving data release that aims to minimize the privacy leakage under utility constraints of a set of multiple tasks are investigated. While the private feature to be…

Information Theory · Computer Science 2024-09-04 Ta-Yuan Liu , I-Hsiang Wang

Decentralized algorithms for stochastic optimization and learning rely on the diffusion of information as a result of repeated local exchanges of intermediate estimates. Such structures are particularly appealing in situations where agents…

Machine Learning · Computer Science 2020-10-26 Stefan Vlaski , Ali H. Sayed

This paper studies the H2 (Kalman) filtering problem in the situation where a signal estimate must be constructed based on inputs from individual participants, whose data must remain private. This problem arises in emerging applications…

Optimization and Control · Mathematics 2012-07-20 Jerome Le Ny , George J. Pappas

Many machine learning applications are based on data collected from people, such as their tastes and behaviour as well as biological traits and genetic data. Regardless of how important the application might be, one has to make sure…

Machine Learning · Statistics 2017-04-11 Joonas Jälkö , Onur Dikmen , Antti Honkela

Differentially private machine learning trains models while protecting privacy of the sensitive training data. The key to obtain differentially private models is to introduce noise/randomness to the training process. In particular, existing…

Cryptography and Security · Computer Science 2020-08-25 Hongbin Liu , Jinyuan Jia , Neil Zhenqiang Gong

A sum-product network (SPN) is a graphical model that allows several types of probabilistic inference to be performed efficiently. In this paper, we propose a privacy-preserving protocol which tackles structure generation and parameter…

Cryptography and Security · Computer Science 2025-10-08 Xenia Heilmann , Ernst Althaus , Mattia Cerrato , Nick Johannes Peter Rassau , Mohammad Sadeq Dousti , Stefan Kramer

Data publishing under privacy constraints can be achieved with mechanisms that add randomness to data points when released to an untrusted party, thereby decreasing the data's utility. In this paper, we analyze this privacy-utility tradeoff…

Information Theory · Computer Science 2024-08-28 Leonhard Grosse , Sara Saeidian , Tobias Oechtering

A privacy-preserving adversarial network (PPAN) was recently proposed as an information-theoretical framework to address the issue of privacy in data sharing. The main idea of this model was using mutual information as the privacy measure…

Signal Processing · Electrical Eng. & Systems 2020-04-02 Mohammadhadi Shateri , Fabrice Labeau

We investigate the privacy of {\em any} algorithm whose outputs have Gaussian distribution. This work is motivated by the prevalence of such algorithms in several useful (ML) applications, and the comparatively little research that focuses…

Cryptography and Security · Computer Science 2026-05-19 Yu Wei , Yun Lu , Malik Magdon-Ismail , Vassilis Zikas

This study examines a resource-sharing problem involving multiple parties that agree to use a set of capacities together. We start with modeling the whole problem as a mathematical program, where all parties are required to exchange…

Optimization and Control · Mathematics 2024-01-08 Utku Karaca , Nursen Aydin , Sinan Yildirim , S. Ilker Birbil

We investigate the problem of estimating a random variable $Y\in \mathcal{Y}$ under a privacy constraint dictated by another random variable $X\in \mathcal{X}$, where estimation efficiency and privacy are assessed in terms of two different…

Information Theory · Computer Science 2018-08-14 Shahab Asoodeh , Mario Diaz , Fady Alajaji , Tamas Linder

There has been increasing demand for establishing privacy-preserving methodologies for modern statistics and machine learning. Differential privacy, a mathematical notion from computer science, is a rising tool offering robust privacy…

Methodology · Statistics 2024-05-09 Shurong Lin , Elliot Paquette , Eric D. Kolaczyk

In the literature of data privacy, differential privacy is the most popular model. An algorithm is differentially private if its outputs with and without any individual's data are indistinguishable. In this paper, we focus on data generated…

Cryptography and Security · Computer Science 2022-06-24 Darshan Chakrabarti , Jie Gao , Aditya Saraf , Grant Schoenebeck , Fang-Yi Yu

Semiparametric forecasting and filtering are introduced as a method of addressing model errors arising from unresolved physical phenomena. While traditional parametric models are able to learn high-dimensional systems from small data sets,…

Methodology · Statistics 2016-02-17 Tyrus Berry , John Harlim

Privacy issues of recommender systems have become a hot topic for the society as such systems are appearing in every corner of our life. In contrast to the fact that many secure multi-party computation protocols have been proposed to…

Cryptography and Security · Computer Science 2017-03-13 Jun Wang , Qiang Tang

Data-dependent privacy accounting frameworks such as per-instance differential privacy (pDP) and Fisher information loss (FIL) confer fine-grained privacy guarantees for individuals in a fixed training dataset. These guarantees can be…

Cryptography and Security · Computer Science 2024-03-12 Shengyuan Hu , Saeed Mahloujifar , Virginia Smith , Kamalika Chaudhuri , Chuan Guo

A major challenge for machine learning is increasing the availability of data while respecting the privacy of individuals. Here we combine the provable privacy guarantees of the differential privacy framework with the flexibility of…

Machine Learning · Statistics 2019-01-18 Michael Thomas Smith , Max Zwiessele , Neil D. Lawrence

Differentially-private mechanisms for text generation typically add carefully calibrated noise to input words and use the nearest neighbor to the noised input as the output word. When the noise is small in magnitude, these mechanisms are…

Computation and Language · Computer Science 2021-04-27 Zekun Xu , Abhinav Aggarwal , Oluwaseyi Feyisetan , Nathanael Teissier

We study the classical problem of community recovery in stochastic block models with a fixed number of communities, with a twist: We seek algorithms that are stable with respect to node-wise changes in the graph structure, formally defined…

Statistics Theory · Mathematics 2026-05-18 Laurentiu Marchis , Ethan D'souza , Tomáš Flídr , Po-Ling Loh