English
Related papers

Related papers: Hadamard Response: Estimating Distributions Privat…

200 papers

We study the private $k$-median and $k$-means clustering problem in $d$ dimensional Euclidean space. By leveraging tree embeddings, we give an efficient and easy to implement algorithm, that is empirically competitive with state of the art…

We propose, implement, and evaluate a new algorithm for releasing answers to very large numbers of statistical queries like $k$-way marginals, subject to differential privacy. Our algorithm makes adaptive use of a continuous relaxation of…

Machine Learning · Computer Science 2021-06-24 Sergul Aydore , William Brown , Michael Kearns , Krishnaram Kenthapadi , Luca Melis , Aaron Roth , Ankit Siva

This paper identifies that a group of latest locally-differentially-private (LDP) algorithms for frequency estimation, including all the Hadamard-matrix-based algorithms, are equivalent to the private Count-Mean Sketch (CMS) algorithm with…

Cryptography and Security · Computer Science 2025-07-28 Mingen Pan

We provide an approximation algorithm for k-means clustering in the one-round (aka non-interactive) local model of differential privacy (DP). This algorithm achieves an approximation ratio arbitrarily close to the best non private…

Data Structures and Algorithms · Computer Science 2021-05-18 Alisa Chang , Badih Ghazi , Ravi Kumar , Pasin Manurangsi

A key task in managing distributed, sensitive data is to measure the extent to which a distribution changes. Understanding this drift can effectively support a variety of federated learning and analytics tasks. However, in many practical…

Machine Learning · Computer Science 2024-12-02 Mary Scott , Sayan Biswas , Graham Cormode , Carsten Maple

Subsampled Randomized Hadamard Transform (SRHT), a popular random projection method that can efficiently project a $d$-dimensional data into $r$-dimensional space ($r \ll d$) in $O(dlog(d))$ time, has been widely used to address the…

Machine Learning · Computer Science 2020-10-07 Zijian Lei , Liang Lan

We consider the minimax estimation problem of a discrete distribution with support size $k$ under locally differential privacy constraints. A privatization scheme is applied to each raw sample independently, and we need to estimate the…

Statistics Theory · Mathematics 2018-10-18 Min Ye , Alexander Barg

We study discrete distribution estimation under user-level local differential privacy (LDP). In user-level $\varepsilon$-LDP, each user has $m\ge1$ samples and the privacy of all $m$ samples must be preserved simultaneously. We resolve the…

Machine Learning · Computer Science 2022-11-08 Jayadev Acharya , Yuhan Liu , Ziteng Sun

We study the fundamental problem of estimating an unknown discrete distribution $p$ over $d$ symbols, given $n$ i.i.d. samples from the distribution. We are interested in minimizing the KL divergence between the true distribution and the…

Machine Learning · Statistics 2025-05-30 Jiayuan Ye , Vitaly Feldman , Kunal Talwar

Electronic health records (EHRs) offer great promises for advancing precision medicine and, at the same time, present significant analytical challenges. Particularly, it is often the case that patient-level data in EHRs cannot be shared…

Methodology · Statistics 2022-07-04 Changgee Chang , Zhiqi Bu , Qi Long

We study the problem of privately computing the anonymized histogram (a.k.a. unattributed histogram), which is defined as the histogram without item labels. Previous works have provided algorithms with $\ell_1$- and $\ell_2^2$-errors of…

Data Structures and Algorithms · Computer Science 2022-10-28 Badih Ghazi , Pritish Kamath , Ravi Kumar , Pasin Manurangsi

An open problem in differentially private deep learning is hyperparameter optimization (HPO). DP-SGD introduces new hyperparameters and complicates existing ones, forcing researchers to painstakingly tune hyperparameters with hundreds of…

Machine Learning · Computer Science 2024-05-07 Ashwinee Panda , Xinyu Tang , Saeed Mahloujifar , Vikash Sehwag , Prateek Mittal

We consider the problem of model selection in a high-dimensional sparse linear regression model under privacy constraints. We propose a differentially private (DP) best subset selection method with strong statistical utility properties by…

Machine Learning · Statistics 2024-10-30 Saptarshi Roy , Zehua Wang , Ambuj Tewari

We investigate the problem of estimating a random variable $Y\in \mathcal{Y}$ under a privacy constraint dictated by another random variable $X\in \mathcal{X}$, where estimation efficiency and privacy are assessed in terms of two different…

Information Theory · Computer Science 2018-08-14 Shahab Asoodeh , Mario Diaz , Fady Alajaji , Tamas Linder

This paper investigates the incremental-redundancy hybrid-automatic repeat request (IR-HARQ) transmission over independent block-fading channels in the presence of an eavesdropper, where the secrecy of the transmission is ensured via…

Information Theory · Computer Science 2018-04-17 Maël Le Treust , Leszek Szczecinski , Fabrice Labeau

Privacy protection of users' entire contribution of samples is important in distributed systems. The most effective approach is the two-stage scheme, which finds a small interval first and then gets a refined estimate by clipping samples…

Machine Learning · Computer Science 2024-10-25 Puning Zhao , Lifeng Lai , Li Shen , Qingming Li , Jiafei Wu , Zhe Liu

A central server needs to perform statistical inference based on samples that are distributed over multiple users who can each send a message of limited length to the center. We study problems of distribution learning and identity testing…

Data Structures and Algorithms · Computer Science 2020-10-02 Jayadev Acharya , Clément L. Canonne , Himanshu Tyagi

We study distributed estimation and learning problems in a networked environment where agents exchange information to estimate unknown statistical properties of random variables from their privately observed samples. The agents can…

Machine Learning · Computer Science 2024-04-02 Marios Papachristou , M. Amin Rahimian

Although robust learning and local differential privacy are both widely studied fields of research, combining the two settings is just starting to be explored. We consider the problem of estimating a discrete distribution in total variation…

Statistics Theory · Mathematics 2022-04-21 Julien Chhor , Flore Sentenac

Novel technological achievements in the fields of business intelligence, business management and data science are based on real-time and complex virtual networks. Sharing data between a large number of organizations that leads to a system…

Cryptography and Security · Computer Science 2023-12-29 Mohsen Kazemian , Markus Helfert