English
Related papers

Related papers: Nearly-Optimal Private Selection via Gaussian Mech…

200 papers

In this paper we study the implementation challenge in an abstract interdependent values model and an arbitrary objective function. We design a mechanism that allows for approximate optimal implementation of insensitive objective functions…

Computer Science and Game Theory · Computer Science 2015-03-14 Kobbi Nissim , Rann Smorodinsky , Moshe Tennenholtz

The Gaussian Mechanism (GM), which consists in adding Gaussian noise to a vector-valued query before releasing it, is a standard privacy protection mechanism. In particular, given that the query respects some L2 sensitivity property (the L2…

Machine Learning · Computer Science 2024-03-20 Hadrien Hendrikx , Paul Mangold , Aurélien Bellet

In differential privacy (DP), the generalized private testing problem was introduced by Liu and Talwar (STOC 2019). Given a dataset $X \in \mathcal{X}$ and a sequence of black-box $\varepsilon_t$-DP mechanisms $M_t:\mathcal{X}\to\{+1,-1\}$,…

Data Structures and Algorithms · Computer Science 2026-05-22 Anamay Chaturvedi , Monika Henzinger , Jalaj Upadhyay

A new line of work, started with Dwork et al., studies the task of answering statistical queries using a sample and relates the problem to the concept of differential privacy. By the Hoeffding bound, a sample of size $O(\log k/\alpha^2)$…

Machine Learning · Computer Science 2015-11-11 Kobbi Nissim , Uri Stemmer

We provide the first $\widetilde{\mathcal{O}}\left(d\right)$-sample algorithm for sampling from unbounded Gaussian distributions under the constraint of $\left(\varepsilon, \delta\right)$-differential privacy. This is a quadratic…

Data Structures and Algorithms · Computer Science 2025-03-04 Valentio Iverson , Gautam Kamath , Argyris Mouzakis

In a Bayesian learning setting, the posterior distribution of a predictive model arises from a trade-off between its prior distribution and the conditional likelihood of observed data. Such distribution functions usually rely on additional…

Machine Learning · Statistics 2011-11-01 Andrea Schirru , Simone Pampuri , Giuseppe De Nicolao , Sean McLoone

We design a new algorithm for the Euclidean $k$-means problem that operates in the local model of differential privacy. Unlike in the non-private literature, differentially private algorithms for the $k$-means objective incur both additive…

Machine Learning · Computer Science 2021-06-29 Uri Stemmer

A pervasive task in the differential privacy literature is to select the $k$ items of "highest quality" out of a set of $d$ items, where the quality of each item depends on a sensitive dataset that must be protected. Variants of this task…

Data Structures and Algorithms · Computer Science 2017-04-12 Thomas Steinke , Jonathan Ullman

Releasing the result size of conjunctive queries and graph pattern queries under differential privacy (DP) has received considerable attention in the literature, but existing solutions do not offer any optimality guarantees. We provide the…

Databases · Computer Science 2021-12-28 Wei Dong , Ke Yi

We study the differentially private top-$k$ selection problem, aiming to identify a sequence of $k$ items with approximately the highest scores from $d$ items. Recent work by Gillenwater et al. (ICML '22) employs a direct sampling approach…

Cryptography and Security · Computer Science 2026-01-09 Hao WU , Hanwen Zhang

We provide optimal lower bounds for two well-known parameter estimation (also known as statistical estimation) tasks in high dimensions with approximate differential privacy. First, we prove that for any $\alpha \le O(1)$, estimating the…

Statistics Theory · Mathematics 2024-01-05 Shyam Narayanan

In this paper, we study private optimization problems for non-smooth convex functions $F(x)=\mathbb{E}_i f_i(x)$ on $\mathbb{R}^d$. We show that modifying the exponential mechanism by adding an $\ell_2^2$ regularizer to $F(x)$ and sampling…

Data Structures and Algorithms · Computer Science 2022-07-29 Sivakanth Gopi , Yin Tat Lee , Daogao Liu

With the rapid development of quantum computers, quantum algorithms have been studied extensively. However, quantum algorithms tackling statistical problems are still lacking. In this paper, we propose a novel non-oracular quantum adaptive…

Methodology · Statistics 2021-07-20 Wenxuan Zhong , Yuan Ke , Ye Wang , Yongkai Chen , Jinyang Chen , Ping Ma

We propose an algorithm with improved query-complexity for the problem of hypothesis selection under local differential privacy constraints. Given a set of $k$ probability distributions $Q$, we describe an algorithm that satisfies local…

Data Structures and Algorithms · Computer Science 2026-01-16 Gautam Kamath , Alireza F. Pour , Matthew Regehr , David P. Woodruff

We provide new high-accuracy randomized algorithms for solving linear systems and regression problems that are well-conditioned except for $k$ large singular values. For solving such $d \times d$ positive definite system our algorithms…

Data Structures and Algorithms · Computer Science 2025-07-17 Michał Dereziński , Aaron Sidford

In this paper, we propose differentially private algorithms for the problem of stochastic linear bandits in the central, local and shuffled models. In the central model, we achieve almost the same regret as the optimal non-private…

Machine Learning · Computer Science 2022-07-08 Osama A. Hanna , Antonious M. Girgis , Christina Fragouli , Suhas Diggavi

Achieving the full promise of the Thermodynamic Variational Objective (TVO), a recently proposed variational lower bound on the log evidence involving a one-dimensional Riemann integral approximation, requires choosing a "schedule" of…

Machine Learning · Computer Science 2020-11-24 Vu Nguyen , Vaden Masrani , Rob Brekelmans , Michael A. Osborne , Frank Wood

A longstanding open problem in Algorithmic Mechanism Design is to design computationally-efficient truthful mechanisms for (approximately) maximizing welfare in combinatorial auctions with submodular bidders. The first such mechanism was…

Computer Science and Game Theory · Computer Science 2019-11-11 Sepehr Assadi , Sahil Singla

Variable selection for Gaussian process models is often done using automatic relevance determination, which uses the inverse length-scale parameter of each input variable as a proxy for variable relevance. This implicitly determined…

Methodology · Statistics 2019-04-24 Topi Paananen , Juho Piironen , Michael Riis Andersen , Aki Vehtari

We present a method to approximate Gaussian process regression models for large datasets by considering only a subset of the data. Our approach is novel in that the size of the subset is selected on the fly during exact inference with…

Machine Learning · Computer Science 2023-05-01 Simon Bartels , Kristoffer Stensbo-Smidt , Pablo Moreno-Muñoz , Wouter Boomsma , Jes Frellsen , Søren Hauberg