English
Related papers

Related papers: Efficient Proposal-Test-Release for Minimax Optima…

200 papers

Differential privacy is a mathematical framework for privacy-preserving data analysis. Changing the hyperparameters of a differentially private algorithm allows one to trade off privacy and utility in a principled way. Quantifying this…

Machine Learning · Statistics 2020-07-23 Brendan Avent , Javier Gonzalez , Tom Diethe , Andrei Paleyes , Borja Balle

Differential privacy is a widely accepted measure of privacy in the context of deep learning algorithms, and achieving it relies on a noisy training approach known as differentially private stochastic gradient descent (DP-SGD). DP-SGD…

Machine Learning · Computer Science 2023-07-26 Ce Feng , Nuo Xu , Wujie Wen , Parv Venkitasubramaniam , Caiwen Ding

We are interested in privatizing an approximate posterior inference algorithm called Expectation Propagation (EP). EP approximates the posterior by iteratively refining approximations to the local likelihoods, and is known to provide better…

Machine Learning · Computer Science 2022-11-02 Margarita Vinaroz , Mijung Park

Data holders are increasingly seeking to protect their user's privacy, whilst still maximizing their ability to produce machine models with high quality predictions. In this work, we empirically evaluate various implementations of…

Cryptography and Security · Computer Science 2020-09-16 Benjamin Zi Hao Zhao , Mohamed Ali Kaafar , Nicolas Kourtellis

We consider a problem where mutually untrusting curators possess portions of a vertically partitioned database containing information about a set of individuals. The goal is to enable an authorized party to obtain aggregate (statistical)…

Cryptography and Security · Computer Science 2013-04-18 Bing-Rong Lin , Ye Wang , Shantanu Rane

In this paper, we present a notion of differential privacy (DP) for data that comes from different classes. Here, the class-membership is private information that needs to be protected. The proposed method is an output perturbation…

Signal Processing · Electrical Eng. & Systems 2023-06-12 Raksha Ramakrishna , Anna Scaglione , Tong Wu , Nikhil Ravi , Sean Peisert

Cross-attention has emerged as a cornerstone module in modern artificial intelligence, underpinning critical applications such as retrieval-augmented generation (RAG), system prompting, and guided stable diffusion. However, this is a rising…

Machine Learning · Computer Science 2026-01-26 Yekun Ke , Yingyu Liang , Zhenmei Shi , Zhao Song , Jiahao Zhang

New regulations and increased awareness of data privacy have led to the deployment of new and more efficient differentially private mechanisms across public institutions and industries. Ensuring the correctness of these mechanisms is…

Cryptography and Security · Computer Science 2023-12-20 William Kong , Andrés Muñoz Medina , Mónica Ribero , Umar Syed

Differential Privacy (DP) considers a scenario in which an adversary has almost complete information about the entries of a database. This worst-case assumption is likely to overestimate the privacy threat faced by an individual in…

Cryptography and Security · Computer Science 2026-02-11 Dennis Breutigam , Rüdiger Reischuk

(Gradient) Expectation Maximization (EM) is a widely used algorithm for estimating the maximum likelihood of mixture models or incomplete data problems. A major challenge facing this popular technique is how to effectively preserve the…

Machine Learning · Computer Science 2022-01-19 Di Wang , Jiahao Ding , Lijie Hu , Zejun Xie , Miao Pan , Jinhui Xu

For the modeling, design and planning of future energy transmission networks, it is vital for stakeholders to access faithful and useful power flow data, while provably maintaining the privacy of business confidentiality of service…

Cryptography and Security · Computer Science 2021-03-29 David Smith , Frederik Geth , Elliott Vercoe , Andrew Feutrill , Ming Ding , Jonathan Chan , James Foster , Thierry Rakotoarivelo

We study distributed estimation and learning problems in a networked environment where agents exchange information to estimate unknown statistical properties of random variables from their privately observed samples. The agents can…

Machine Learning · Computer Science 2024-04-02 Marios Papachristou , M. Amin Rahimian

Users of a personalised recommendation system face a dilemma: recommendations can be improved by learning from data, but only if the other users are willing to share their private information. Good personalised predictions are vitally…

Machine Learning · Statistics 2018-02-12 Antti Honkela , Mrinal Das , Arttu Nieminen , Onur Dikmen , Samuel Kaski

Differential privacy has seen remarkable success as a rigorous and practical formalization of data privacy in the past decade. This privacy definition and its divergence based relaxations, however, have several acknowledged weaknesses,…

Machine Learning · Computer Science 2019-06-03 Jinshuo Dong , Aaron Roth , Weijie J. Su

Differential privacy (DP) is a gold-standard concept of measuring and guaranteeing privacy in data analysis. It is well-known that the cost of adding DP to deep learning model is its accuracy. However, it remains unclear how it affects…

Machine Learning · Computer Science 2021-08-26 Nurislam Tursynbek , Aleksandr Petiushko , Ivan Oseledets

A common problem in private data analysis is the partition selection problem, where each user holds a set of partitions (e.g. keys in a GROUP BY operation) from a possibly unbounded set. The challenge here is in maximizing the set of…

Cryptography and Security · Computer Science 2026-03-12 Charlie Harrison , Pasin Manurangsi

Privacy concerns have attracted increasing attention in data-driven products due to the tendency of machine learning models to memorize sensitive training data. Generating synthetic versions of such data with a formal privacy guarantee,…

Computation and Language · Computer Science 2023-07-19 Xiang Yue , Huseyin A. Inan , Xuechen Li , Girish Kumar , Julia McAnallen , Hoda Shajari , Huan Sun , David Levitan , Robert Sim

We propose, implement, and evaluate a new algorithm for releasing answers to very large numbers of statistical queries like $k$-way marginals, subject to differential privacy. Our algorithm makes adaptive use of a continuous relaxation of…

Machine Learning · Computer Science 2021-06-24 Sergul Aydore , William Brown , Michael Kearns , Krishnaram Kenthapadi , Luca Melis , Aaron Roth , Ankit Siva

This work considers computationally efficient privacy-preserving data release. We study the task of analyzing a database containing sensitive information about individual participants. Given a set of statistical queries on the data, we want…

Computational Complexity · Computer Science 2011-07-14 Moritz Hardt , Guy N. Rothblum , Rocco A. Servedio

This paper aims to construct a valid and efficient confidence interval for the extrema of parameters under privacy protection. The usual statistical inference on the extrema of parameters often suffers from the selection bias issue, and the…

Methodology · Statistics 2023-03-07 Xiaowen Fu , Yang Xiang , Xinzhou Guo