English
Related papers

Related papers: Nearly-Optimal Private Selection via Gaussian Mech…

200 papers

Likelihood-free (a.k.a. simulation-based) inference problems are inverse problems with expensive, or intractable, forward models. ODE inverse problems are commonly treated as likelihood-free, as their forward map has to be numerically…

Machine Learning · Statistics 2020-07-01 Hans Kersting , Nicholas Krämer , Martin Schiegg , Christian Daniel , Michael Tiemann , Philipp Hennig

We study efficient mechanisms for the query release problem in differential privacy: given a workload of $m$ statistical queries, output approximate answers to the queries while satisfying the constraints of differential privacy. In…

Data Structures and Algorithms · Computer Science 2018-11-12 Jaroslaw Blasiok , Mark Bun , Aleksandar Nikolov , Thomas Steinke

We study the problem of list-decodable Gaussian mean estimation and the related problem of learning mixtures of separated spherical Gaussians. We develop a set of techniques that yield new efficient algorithms with significantly improved…

Data Structures and Algorithms · Computer Science 2017-11-21 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

At CRYPTO 2015, Kirchner and Fouque claimed that a carefully tuned variant of the Blum-Kalai-Wasserman (BKW) algorithm (JACM 2003) should solve the Learning with Errors problem (LWE) in slightly subexponential time for modulus…

Cryptography and Security · Computer Science 2025-04-01 Léo Ducas , Lynn Engelberts , Johanna Loyer

Bayesian optimization is a powerful tool for fine-tuning the hyper-parameters of a wide variety of machine learning models. The success of machine learning has led practitioners in diverse real-world settings to learn classifiers for…

Machine Learning · Statistics 2015-02-24 Matt J. Kusner , Jacob R. Gardner , Roman Garnett , Kilian Q. Weinberger

State estimation is critical to control systems, especially when the states cannot be directly measured. This paper presents an approximate optimal filter, which enables to use policy iteration technique to obtain the steady-state gain in…

Systems and Control · Electrical Eng. & Systems 2021-03-10 Kaiming Tang , Shengbo Eben Li , Yuming Yin , Yang Guan , Jingliang Duan , Wenhan Cao , Jie Li

We consider the problem of learning mixtures of Gaussians under the constraint of approximate differential privacy. We prove that $\widetilde{O}(k^2 d \log^{3/2}(1/\delta) / \alpha^2 \varepsilon)$ samples are sufficient to learn a mixture…

Machine Learning · Computer Science 2021-06-07 Ishaq Aden-Ali , Hassan Ashtiani , Christopher Liaw

We present a framework for designing distorting mechanisms that allow remotely operating anomaly detectors while preserving privacy. We consider the problem setting in which a remote station seeks to identify anomalies using system…

Systems and Control · Electrical Eng. & Systems 2023-09-08 Haleh Hayati , Carlos Murguia , Nathan van de Wouw

We present new algorithms for estimating and testing \emph{collision probability}, a fundamental measure of the spread of a discrete distribution that is widely used in many scientific fields. We describe an algorithm that satisfies…

Machine Learning · Statistics 2025-04-21 Robert Busa-Fekete , Umar Syed

We design new differentially private algorithms for the Euclidean k-means problem, both in the centralized model and in the local model of differential privacy. In both models, our algorithms achieve significantly improved error guarantees…

Data Structures and Algorithms · Computer Science 2018-07-17 Haim Kaplan , Uri Stemmer

We consider a platform's problem of collecting data from privacy sensitive users to estimate an underlying parameter of interest. We formulate this question as a Bayesian-optimal mechanism design problem, in which an individual can share…

Computer Science and Game Theory · Computer Science 2023-09-07 Alireza Fallah , Ali Makhdoumi , Azarakhsh Malekian , Asuman Ozdaglar

A key tool for building differentially private systems is adding Gaussian noise to the output of a function evaluated on a sensitive dataset. Unfortunately, using a continuous distribution presents several practical challenges. First and…

Data Structures and Algorithms · Computer Science 2024-11-19 Clément L. Canonne , Gautam Kamath , Thomas Steinke

We consider the task of privately obtaining prediction error guarantees in ordinary least-squares regression problems with Gaussian covariates (with unknown covariance structure). We provide the first sample-optimal polynomial time…

Data Structures and Algorithms · Computer Science 2025-04-01 Prashanti Anderson , Ainesh Bakshi , Mahbod Majid , Stefan Tiegel

During recent years there has been an increased interest in stochastic adaptations of limited memory quasi-Newton methods, which compared to pure gradient-based routines can improve the convergence by incorporating second order information.…

Optimization and Control · Mathematics 2018-10-03 Adrian Wills , Carl Jidling , Thomas Schon

We study differentially private stochastic optimization in convex and non-convex settings. For the convex case, we focus on the family of non-smooth generalized linear losses (GLLs). Our algorithm for the $\ell_2$ setting achieves optimal…

Machine Learning · Computer Science 2021-11-11 Raef Bassily , Cristóbal Guzmán , Michael Menart

Detection of a signal under noise is a classical signal processing problem. When monitoring spatial phenomena under a fixed budget, i.e., either physical, economical or computational constraints, the selection of a subset of available…

Signal Processing · Electrical Eng. & Systems 2018-08-01 Mario Coutino , Sundeep Prabhakar Chepuri , Geert Leus

It is well known that quantum computers can efficiently find a hidden subgroup $H$ of a finite Abelian group $G$. This implies that after only a polynomial (in $\log |G|$) number of calls to the oracle function, the states corresponding to…

Quantum Physics · Physics 2007-05-23 Mark Ettinger , Peter Hoyer , Emanuel Knill

Differentially private computation often begins with a bound on some $d$-dimensional statistic's $\ell_p$ sensitivity. For pure differential privacy, the $K$-norm mechanism can improve on this approach using a norm tailored to the…

Cryptography and Security · Computer Science 2024-05-22 Matthew Joseph , Alexander Yu

We present novel, computationally efficient, and differentially private algorithms for two fundamental high-dimensional learning problems: learning a multivariate Gaussian and learning a product distribution over the Boolean hypercube in…

Data Structures and Algorithms · Computer Science 2019-05-31 Gautam Kamath , Jerry Li , Vikrant Singhal , Jonathan Ullman

In this paper, we consider the $k$-approximate pattern matching problem under differential privacy, where the goal is to report or count all substrings of a given string $S$ which have a Hamming distance at most $k$ to a pattern $P$, or…

Data Structures and Algorithms · Computer Science 2023-11-14 Teresa Anna Steiner