English
Related papers

Related papers: Query Complexity of Bayesian Private Learning

200 papers

A membership-inference attack gets the output of a learning algorithm, and a target individual, and tries to determine whether this individual is a member of the training data or an independent sample from the same distribution. A…

Machine Learning · Computer Science 2025-08-28 Mahdi Haghifam , Adam Smith , Jonathan Ullman

Differential privacy is a modern approach in privacy-preserving data analysis to control the amount of information that can be inferred about an individual by querying a database. The most common techniques are based on the introduction of…

Cryptography and Security · Computer Science 2012-07-05 Catuscia Palamidessi , Marco Stronati

Bayesian optimization is a powerful tool for fine-tuning the hyper-parameters of a wide variety of machine learning models. The success of machine learning has led practitioners in diverse real-world settings to learn classifiers for…

Machine Learning · Statistics 2015-02-24 Matt J. Kusner , Jacob R. Gardner , Roman Garnett , Kilian Q. Weinberger

We present new differentially private algorithms for learning a large-margin halfspace. In contrast to previous algorithms, which are based on either differentially private simulations of the statistical query model or on private convex…

Machine Learning · Computer Science 2020-02-25 Huy L. Nguyen , Jonathan Ullman , Lydia Zakynthinou

Recent increase in online privacy concerns prompts the following question: can a recommender system be accurate if users do not entrust it with their private data? To answer this, we study the problem of learning item-clusters under local…

Machine Learning · Computer Science 2014-10-29 Siddhartha Banerjee , Nidhi Hegde , Laurent Massoulié

We describe a new algorithm for answering a given set of range queries under $\epsilon$-differential privacy which often achieves substantially lower error than competing methods. Our algorithm satisfies differential privacy by adding noise…

Databases · Computer Science 2014-10-02 Chao Li , Michael Hay , Gerome Miklau , Yue Wang

We propose and analyze algorithms to solve a range of learning tasks under user-level differential privacy constraints. Rather than guaranteeing only the privacy of individual samples, user-level DP protects a user's entire contribution ($m…

Machine Learning · Computer Science 2021-12-06 Daniel Levy , Ziteng Sun , Kareem Amin , Satyen Kale , Alex Kulesza , Mehryar Mohri , Ananda Theertha Suresh

We provide sample complexity upper bounds for agnostically learning multivariate Gaussians under the constraint of approximate differential privacy. These are the first finite sample upper bounds for general Gaussians which do not impose…

Machine Learning · Statistics 2020-10-21 Ishaq Aden-Ali , Hassan Ashtiani , Gautam Kamath

Differential privacy is a notion of privacy that has become very popular in the database community. Roughly, the idea is that a randomized query mechanism provides sufficient privacy protection if the ratio between the probabilities of two…

Information Theory · Computer Science 2010-12-22 Mário S. Alvim , Konstantinos Chatzikokolakis , Pierpaolo Degano , Catuscia Palamidessi

In the thesis, we use a recently developed tight characterisation of quantum query complexity, the adversary bound, to develop new quantum algorithms and lower bounds. Our results are as follows: * We develop a new technique for the…

Quantum Physics · Physics 2014-02-18 Aleksandrs Belovs

The use of personal data for training machine learning systems comes with a privacy threat and measuring the level of privacy of a model is one of the major challenges in machine learning today. Identifying training data based on a trained…

Machine Learning · Computer Science 2022-03-24 Ganesh Del Grosso , Hamid Jalalzai , Georg Pichler , Catuscia Palamidessi , Pablo Piantanida

Ensuring differential privacy of models learned from sensitive user data is an important goal that has been studied extensively in recent years. It is now known that for some basic learning problems, especially those involving…

Machine Learning · Computer Science 2018-05-10 Cynthia Dwork , Vitaly Feldman

Federated learning (FL) offers a promising paradigm for collaborative model training while preserving data privacy. However, its susceptibility to gradient inversion attacks poses a significant challenge, necessitating robust privacy…

Cryptography and Security · Computer Science 2025-08-19 Xiaojin Zhang , Mingcong Xu , Yiming Li , Wei Chen , Qiang Yang

Learning Bayesian networks is often cast as an optimization problem, where the computational task is to find a structure that maximizes a statistically motivated score. By and large, existing learning tools address this optimization problem…

Machine Learning · Computer Science 2013-01-30 Nir Friedman , Iftach Nachman , Dana Pe'er

We describe a method to upper bound the quantum query complexity of Boolean formula evaluation problems, using fundamental theorems about the general adversary bound. This nonconstructive method can give an upper bound on query complexity…

Quantum Physics · Physics 2013-05-20 Shelby Kimmel

A private learner is an algorithm that given a sample of labeled individual examples outputs a generalizing hypothesis while preserving the privacy of each individual. In 2008, Kasiviswanathan et al. (FOCS 2008) gave a generic construction…

Machine Learning · Computer Science 2015-07-03 Amos Beimel , Kobbi Nissim , Uri Stemmer

We study the problem of learning general (i.e., not necessarily homogeneous) halfspaces with Random Classification Noise under the Gaussian distribution. We establish nearly-matching algorithmic and Statistical Query (SQ) lower bound…

Machine Learning · Computer Science 2023-07-18 Ilias Diakonikolas , Jelena Diakonikolas , Daniel M. Kane , Puqian Wang , Nikos Zarifis

Bayesian methods lie at the heart of modern data science and provide a powerful scaffolding for estimation in data-constrained settings and principled quantification and propagation of uncertainty. Yet in many real-world use cases where…

Data Structures and Algorithms · Computer Science 2026-03-20 Sitan Chen , Jingqiu Ding , Mahbod Majid , Walter McKelvie

Linear regression is an important tool across many fields that work with sensitive human-sourced data. Significant prior work has focused on producing differentially private point estimates, which provide a privacy guarantee to individuals…

Machine Learning · Computer Science 2019-10-30 Garrett Bernstein , Daniel Sheldon

Balancing exploration and exploitation is a fundamental part of reinforcement learning, yet most state-of-the-art algorithms use a naive exploration protocol like $\epsilon$-greedy. This contributes to the problem of high sample complexity,…

Machine Learning · Computer Science 2019-11-21 Tom Blau , Lionel Ott , Fabio Ramos