English
Related papers

Related papers: Universal Shuffle Asymptotics: Sharp Privacy Analy…

200 papers

We study a setting of collecting and learning from private data distributed across end users. In the shuffled model of differential privacy, the end users partially protect their data locally before sharing it, and their data is also…

Machine Learning · Computer Science 2025-02-21 Tal Wagner

With the rapid growth of digital platforms, there is increasing apprehension about how personal data is collected, stored, and used by various entities. These concerns arise from the increasing frequency of data breaches, cyber-attacks, and…

Cryptography and Security · Computer Science 2025-04-28 Christopher C. Zawacki , Eyad H. Abed

We study $d$-dimensional unbiased mean estimation in the single-message shuffle model, where each user sends a single privatized message and the analyzer only observes the shuffled multiset of reports. While minimax-optimal mechanisms are…

Machine Learning · Computer Science 2026-05-01 Shun Takagi , Seng Pei Liew

Image data collected in the wild often contains private information such as faces and license plates, and responsible data release must ensure that this information stays hidden. At the same time, released data should retain its usefulness…

Machine Learning · Computer Science 2025-12-19 Saeed Mahloujifar , Narine Kokhlikyan , Chuan Guo , Kamalika Chaudhuri

We investigate the problem of estimating a random variable $Y\in \mathcal{Y}$ under a privacy constraint dictated by another random variable $X\in \mathcal{X}$, where estimation efficiency and privacy are assessed in terms of two different…

Information Theory · Computer Science 2018-08-14 Shahab Asoodeh , Mario Diaz , Fady Alajaji , Tamas Linder

Much of the literature on differential privacy focuses on item-level privacy, where loosely speaking, the goal is to provide privacy per item or training example. However, recently many practical applications such as federated learning…

Machine Learning · Computer Science 2021-01-13 Yuhan Liu , Ananda Theertha Suresh , Felix Yu , Sanjiv Kumar , Michael Riley

We study how to communicate findings of Bayesian inference to third parties, while preserving the strong guarantee of differential privacy. Our main contributions are four different algorithms for private Bayesian inference on…

Artificial Intelligence · Computer Science 2015-12-23 Zuhe Zhang , Benjamin Rubinstein , Christos Dimitrakakis

Federated Learning has gained traction in privacy-sensitive collaborative environments, with local SGD emerging as a key optimization method in decentralized settings. While its convergence properties are well-studied, asymptotic…

Machine Learning · Statistics 2026-05-08 Soham Bonnerjee , Sayar Karmakar , Wei Biao Wu

In this work, we give efficient algorithms for privately estimating a Gaussian distribution in both pure and approximate differential privacy (DP) models with optimal dependence on the dimension in the sample complexity. In the pure DP…

Data Structures and Algorithms · Computer Science 2023-06-02 Daniel Alabi , Pravesh K. Kothari , Pranay Tankala , Prayaag Venkat , Fred Zhang

The framework of differential privacy protects an individual's privacy while publishing query responses on congregated data. In this work, a new noise addition mechanism for differential privacy is introduced where the noise added is…

Cryptography and Security · Computer Science 2023-07-06 Gokularam Muthukrishnan , Sheetal Kalyani

We provide exact asymptotic expressions for the performance of regression by an $L-$layer deep random feature (RF) model, where the input is mapped through multiple random embedding and non-linear activation functions. For this purpose, we…

Machine Learning · Statistics 2023-02-14 David Bosch , Ashkan Panahi , Babak Hassibi

We study privacy in a distributed learning framework, where clients collaboratively build a learning model iteratively through interactions with a server from whom we need privacy. Motivated by stochastic optimization and the federated…

Machine Learning · Computer Science 2021-07-20 Antonious M. Girgis , Deepesh Data , Suhas Diggavi

We establish a one-shot strong converse bound for privacy amplification against quantum side information using trace distance as a security criterion. This strong converse bound implies that in the independent and identical scenario, the…

Quantum Physics · Physics 2022-02-22 Yu-Chen Shen , Li Gao , Hao-Chung Cheng

We study asymptotic anytime-valid confidence sequences for degree-two U-statistics under continuous monitoring. In the nondegenerate case, Hoeffding's projection reduces the problem to a time-uniform central limit theory for the partial…

Statistics Theory · Mathematics 2026-05-19 Leheng Cai , Qirui Hu , Weijia Li

Publishing open graph data while preserving individual privacy remains challenging when data publishers and data users are distinct entities. Although differential privacy (DP) provides rigorous guarantees, most existing approaches enforce…

Machine Learning · Computer Science 2026-03-25 Muhao Guo , Jiaqi Wu , Yizheng Liao , Wenke Lee , Shengzhe Chen , Yang Weng

In this paper, we propose a novel Heterogeneous Gaussian Mechanism (HGM) to preserve differential privacy in deep neural networks, with provable robustness against adversarial examples. We first relax the constraint of the privacy budget in…

Cryptography and Security · Computer Science 2019-06-05 NhatHai Phan , Minh Vu , Yang Liu , Ruoming Jin , Dejing Dou , Xintao Wu , My T. Thai

In this paper, we present a notion of differential privacy (DP) for data that comes from different classes. Here, the class-membership is private information that needs to be protected. The proposed method is an output perturbation…

Signal Processing · Electrical Eng. & Systems 2023-06-12 Raksha Ramakrishna , Anna Scaglione , Tong Wu , Nikhil Ravi , Sean Peisert

We study the problem of privately computing the anonymized histogram (a.k.a. unattributed histogram), which is defined as the histogram without item labels. Previous works have provided algorithms with $\ell_1$- and $\ell_2^2$-errors of…

Data Structures and Algorithms · Computer Science 2022-10-28 Badih Ghazi , Pritish Kamath , Ravi Kumar , Pasin Manurangsi

We revisit Wald's celebrated Sequential Probability Ratio Test for sequential tests of two simple hypotheses, under privacy constraints. We propose DP-SPRT, a wrapper that can be calibrated to achieve desired error probabilities and privacy…

Machine Learning · Statistics 2026-02-05 Thomas Michel , Debabrota Basu , Emilie Kaufmann

Differential privacy (DP) considers a scenario, where an adversary has almost complete information about the entries of a database This worst-case assumption is likely to overestimate the privacy thread for an individual in real life.…

Cryptography and Security · Computer Science 2025-04-16 Dennis Breutigam , Rüdiger Reischuk