English
Related papers

Related papers: A One-Pass Private Sketch for Most Machine Learnin…

200 papers

We introduce a refined differentially private (DP) data structure for kernel density estimation (KDE), offering not only improved privacy-utility tradeoff but also better efficiency over prior results. Specifically, we study the…

Data Structures and Algorithms · Computer Science 2025-03-25 Erzhi Liu , Jerry Yao-Chieh Hu , Alex Reneau , Zhao Song , Han Liu

In this work, we study the applications of differential privacy (DP) in the context of graph-structured data. We discuss the formulations of DP applicable to the publication of graphs and their associated statistics as well as machine…

Cryptography and Security · Computer Science 2022-03-18 Tamara T. Mueller , Dmitrii Usynin , Johannes C. Paetzold , Daniel Rueckert , Georgios Kaissis

The shuffle model of Differential Privacy (DP) is an enhanced privacy protocol which introduces an intermediate trusted server between local users and a central data curator. It significantly amplifies the central DP guarantee by…

Cryptography and Security · Computer Science 2024-07-26 Yixuan Liu , Yuhan Liu , Li Xiong , Yujie Gu , Hong Chen

Preserving privacy in contemporary NLP models allows us to work with sensitive data, but unfortunately comes at a price. We know that stricter privacy guarantees in differentially-private stochastic gradient descent (DP-SGD) generally…

Computation and Language · Computer Science 2023-02-01 Manuel Senge , Timour Igamberdiev , Ivan Habernal

This paper proposes new methodologies for conducting practical differentially private (DP) estimation and inference in high-dimensional linear regression. We first introduce a DP Bayesian Information Criterion (DP-BIC) for selecting the…

Methodology · Statistics 2026-04-13 Zhanrui Cai , Sai Li , Xintao Xia , Linjun Zhang

Previous work on user-level differential privacy (DP) [Ghazi et al. NeurIPS 2021, Bun et al. STOC 2023] obtained generic algorithms that work for various learning tasks. However, their focus was on the example-rich regime, where the users…

Data Structures and Algorithms · Computer Science 2023-09-25 Badih Ghazi , Pritish Kamath , Ravi Kumar , Pasin Manurangsi , Raghu Meka , Chiyuan Zhang

Conformal prediction (CP) has attracted broad attention as a simple and flexible framework for uncertainty quantification through prediction sets. In this work, we study how to deploy CP under differential privacy (DP) in a statistically…

Machine Learning · Statistics 2026-04-21 Jiamei Wu , Ce Zhang , Zhipeng Cai , Jingsen Kong , Bei Jiang , Linglong Kong , Lingchen Kong

Differential Privacy (DP) provides a formal framework for training machine learning models with individual example level privacy. In the field of deep learning, Differentially Private Stochastic Gradient Descent (DP-SGD) has emerged as a…

Machine Learning · Computer Science 2022-05-24 Harsh Mehta , Abhradeep Thakurta , Alexey Kurakin , Ashok Cutkosky

We consider the problem of secret protection, in which a business or organization wishes to train a model on their own data, while attempting to not leak secrets potentially contained in that data via the model. The standard method for…

Cryptography and Security · Computer Science 2025-06-03 Arun Ganesh , Brendan McMahan , Milad Nasr , Thomas Steinke , Abhradeep Thakurta

We propose $\mathtt{PrivHP}$, a lightweight synthetic data generator with \textit{differential privacy} guarantees. $\mathtt{PrivHP}$ uses a novel hierarchical decomposition that approximates the input's cumulative distribution function…

Cryptography and Security · Computer Science 2025-12-10 Rayne Holland , Seyit Camtepe , Chandra Thapa , Minhui Xue

In this work, we propose a novel framework for privacy-preserving client-distributed machine learning. It is motivated by the desire to achieve differential privacy guarantees in the local model of privacy in a way that satisfies all…

Cryptography and Security · Computer Science 2018-10-12 Vasyl Pihur , Aleksandra Korolova , Frederick Liu , Subhash Sankuratripati , Moti Yung , Dachuan Huang , Ruogu Zeng

Estimating causal effects from randomized experiments is only possible if participants are willing to disclose their potentially sensitive responses. Differential privacy, a widely used framework for ensuring an algorithms privacy…

Machine Learning · Statistics 2025-05-29 Adel Javanmard , Vahab Mirrokni , Jean Pouget-Abadie

We consider three different variants of differential privacy (DP), namely approximate DP, R\'enyi DP (RDP), and hypothesis test DP. In the first part, we develop a machinery for optimally relating approximate DP to RDP based on the joint…

Information Theory · Computer Science 2021-01-26 Shahab Asoodeh , Jiachun Liao , Flavio P. Calmon , Oliver Kosut , Lalitha Sankar

Local differential privacy (LDP) can provide each user with strong privacy guarantees under untrusted data curators while ensuring accurate statistics derived from privatized data. Due to its powerfulness, LDP has been widely adopted to…

Cryptography and Security · Computer Science 2019-06-06 Teng Wang , Jun Zhao , Xinyu Yang , Xuebin Ren

Prior work on differential privacy analysis of randomized SGD algorithms relies on composition theorems, where the implicit (unrealistic) assumption is that the internal state of the iterative algorithm is revealed to the adversary. As a…

Machine Learning · Statistics 2022-10-18 Jiayuan Ye , Reza Shokri

Differentially private (DP) synthetic data generation is a practical method for improving access to data as a means to encourage productive partnerships. One issue inherent to DP is that the "privacy budget" is generally "spent" evenly…

Machine Learning · Computer Science 2022-08-11 Lucas Rosenblatt , Joshua Allen , Julia Stoyanovich

Networks are crucial components of many sectors, including telecommunications, healthcare, finance, energy, and transportation.The information carried in such networks often contains sensitive user data, like location data for commuters and…

Cryptography and Security · Computer Science 2024-08-13 Ferdinando Fioretto , Diptangshu Sen , Juba Ziani

Differential privacy (DP) considers a scenario, where an adversary has almost complete information about the entries of a database This worst-case assumption is likely to overestimate the privacy thread for an individual in real life.…

Cryptography and Security · Computer Science 2025-04-16 Dennis Breutigam , Rüdiger Reischuk

Traditional differential privacy is independent of the data distribution. However, this is not well-matched with the modern machine learning context, where models are trained on specific data. As a result, achieving meaningful privacy…

Machine Learning · Computer Science 2020-08-21 Aleksei Triastcyn , Boi Faltings

Differential privacy (DP) is widely employed in machine learning to protect confidential or sensitive training data from being revealed. As data owners gain greater control over their data due to personal data ownership, they are more…

Machine Learning · Computer Science 2026-05-11 Xiao Tian , Jue Fan , Rachael Hwee Ling Sim , Bryan Kian Hsiang Low