English
Related papers

Related papers: Private Mean Estimation with Person-Level Differen…

200 papers

In this paper, we investigate one of the most fundamental nonconvex learning problems, ReLU regression, in the Differential Privacy (DP) model. Previous studies on private ReLU regression heavily rely on stringent assumptions, such as…

Machine Learning · Computer Science 2025-06-11 Meng Ding , Mingxi Lei , Shaowei Wang , Tianhang Zheng , Di Wang , Jinhui Xu

Differentially Private (DP) data release is a promising technique to disseminate data without compromising the privacy of data subjects. However the majority of prior work has focused on scenarios where a single party owns all the data. In…

Cryptography and Security · Computer Science 2022-06-22 Ruihan Wu , Xin Yang , Yuanshun Yao , Jiankai Sun , Tianyi Liu , Kilian Q. Weinberger , Chong Wang

The private collection of multiple statistics from a population is a fundamental statistical problem. One possible approach to realize this is to rely on the local model of differential privacy (LDP). Numerous LDP protocols have been…

Cryptography and Security · Computer Science 2023-08-02 Héber H. Arcolezi , Sébastien Gambs , Jean-François Couchot , Catuscia Palamidessi

We investigate a problem of finding the minimum, in which each user has a real value and we want to estimate the minimum of these values under the local differential privacy constraint. We reveal that this problem is fundamentally…

Statistics Theory · Mathematics 2019-05-28 Kazuto Fukuchi , Chia-Mu Yu , Arashi Haishima , Jun Sakuma

A new line of work, started with Dwork et al., studies the task of answering statistical queries using a sample and relates the problem to the concept of differential privacy. By the Hoeffding bound, a sample of size $O(\log k/\alpha^2)$…

Machine Learning · Computer Science 2015-11-11 Kobbi Nissim , Uri Stemmer

Differentially private (DP) mechanisms protect individual-level information by introducing randomness into the statistical analysis procedure. Despite the availability of numerous DP tools, there remains a lack of general techniques for…

Machine Learning · Statistics 2025-09-25 Zhanyu Wang , Guang Cheng , Jordan Awan

There are numerous methods of achieving $\epsilon$-differential privacy (DP). The question is what is the appropriate value of $\epsilon$, since there is no common agreement on a "sufficiently small" $\epsilon$, and its goodness depends on…

Cryptography and Security · Computer Science 2019-12-02 Peeter Laud , Alisa Pankova

Algorithms such as Differentially Private SGD enable training machine learning models with formal privacy guarantees. However, there is a discrepancy between the protection that such algorithms guarantee in theory and the protection they…

Many applications of machine learning, for example in health care, would benefit from methods that can guarantee privacy of data subjects. Differential privacy (DP) has become established as a standard for protecting learning results. The…

Machine Learning · Statistics 2017-05-30 Mikko Heikkilä , Eemil Lagerspetz , Samuel Kaski , Kana Shimizu , Sasu Tarkoma , Antti Honkela

We explore the trade-off between privacy and statistical utility in private two-sample testing under local differential privacy (LDP) for both multinomial and continuous data. We begin by addressing the multinomial case, where we introduce…

Machine Learning · Statistics 2025-12-30 Jongmin Mun , Seungwoo Kwak , Ilmun Kim

We study the setup where each of $n$ users holds an element from a discrete set, and the goal is to count the number of distinct elements across all users, under the constraint of $(\epsilon, \delta)$-differentially privacy: - In the…

Cryptography and Security · Computer Science 2020-09-22 Lijie Chen , Badih Ghazi , Ravi Kumar , Pasin Manurangsi

We study the problem of subsampling in differential privacy (DP), a question that is the centerpiece behind many successful differentially private machine learning algorithms. Specifically, we provide a tight upper bound on the R\'enyi…

Machine Learning · Computer Science 2018-12-05 Yu-Xiang Wang , Borja Balle , Shiva Kasiviswanathan

The problem of estimating a parameter in the drift coefficient is addressed for $N$ discretely observed independent and identically distributed stochastic differential equations (SDEs). This is done considering additional constraints,…

Statistics Theory · Mathematics 2024-10-17 Chiara Amorino , Arnaud Gloter , Hélène Halconruy

Differential privacy (DP) has become the standard for private data analysis. Certain machine learning applications only require privacy protection for specific protected attributes. Using naive variants of differential privacy in such use…

Cryptography and Security · Computer Science 2025-06-25 Saeed Mahloujifar , Chuan Guo , G. Edward Suh , Kamalika Chaudhuri

The increased application of machine learning (ML) in sensitive domains requires protecting the training data through privacy frameworks, such as differential privacy (DP). DP requires to specify a uniform privacy level $\varepsilon$ that…

Machine Learning · Computer Science 2024-01-31 Krishna Acharya , Franziska Boenisch , Rakshit Naidu , Juba Ziani

Differential privacy (DP) provides robust privacy guarantees for statistical inference, but this can lead to unreliable results and biases in downstream applications. While several noise-aware approaches have been proposed which integrate…

Machine Learning · Statistics 2026-05-29 Talal Alrawajfeh , Joonas Jälkö , Antti Honkela

Local differential privacy (LDP) has been deemed as the de facto measure for privacy-preserving distributed data collection and analysis. Recently, researchers have extended LDP to the basic data type in NoSQL systems: the key-value data,…

Cryptography and Security · Computer Science 2019-07-12 Lin Sun , Jun Zhao , Xiaojun Ye , Shuo Feng , Teng Wang , Tao Bai

The iterative nature of the expectation maximization (EM) algorithm presents a challenge for privacy-preserving estimation, as each iteration increases the amount of noise needed. We propose a practical private EM algorithm that overcomes…

Machine Learning · Computer Science 2016-11-01 Mijung Park , Jimmy Foulds , Kamalika Chaudhuri , Max Welling

In this work, we study the task of estimating the numbers of distinct and $k$-occurring items in a time window under the constraint of differential privacy (DP). We consider several variants depending on whether the queries are on general…

Data Structures and Algorithms · Computer Science 2022-11-22 Badih Ghazi , Ravi Kumar , Pasin Manurangsi , Jelani Nelson

Traditional differential privacy is independent of the data distribution. However, this is not well-matched with the modern machine learning context, where models are trained on specific data. As a result, achieving meaningful privacy…

Machine Learning · Computer Science 2020-08-21 Aleksei Triastcyn , Boi Faltings