English
Related papers

Related papers: Differentially Private Learning Beyond the Classic…

200 papers

We consider a setup in which confidential i.i.d. samples $X_1,\dotsc,X_n$ from an unknown finite-support distribution $\boldsymbol{p}$ are passed through $n$ copies of a discrete privatization channel (a.k.a. mechanism) producing outputs…

Machine Learning · Computer Science 2018-11-30 Adriano Pastore , Michael Gastpar

We present a series of new differentially private (DP) algorithms with dimension-independent margin guarantees. For the family of linear hypotheses, we give a pure DP learning algorithm that benefits from relative deviation margin…

Machine Learning · Computer Science 2022-04-25 Raef Bassily , Mehryar Mohri , Ananda Theertha Suresh

Given a dataset of $n$ user-contributed strings, each of length at most $\ell$, a key problem is how to identify all frequent substrings while preserving each user's privacy. Recent work by Bernardini et al. (PODS'25) introduced a…

Data Structures and Algorithms · Computer Science 2026-03-11 Peaker Guo , Rayne Holland , Hao Wu

We initiate an investigation of private sampling from distributions. Given a dataset with $n$ independent observations from an unknown distribution $P$, a sampling algorithm must output a single observation from a distribution that is close…

Machine Learning · Computer Science 2022-11-16 Sofya Raskhodnikova , Satchit Sivakumar , Adam Smith , Marika Swanberg

Differential Privacy (DP) provides a formal framework for training machine learning models with individual example level privacy. In the field of deep learning, Differentially Private Stochastic Gradient Descent (DP-SGD) has emerged as a…

Machine Learning · Computer Science 2022-05-24 Harsh Mehta , Abhradeep Thakurta , Alexey Kurakin , Ashok Cutkosky

Differential privacy is a restriction on data processing algorithms that provides strong confidentiality guarantees for individual records in the data. However, research on proper statistical inference, that is, research on properly…

Cryptography and Security · Computer Science 2021-07-06 Joerg Drechsler , Ira Globus-Harris , Audra McMillan , Jayshree Sarathy , Adam Smith

A recent study by De et al. (2022) has reported that large-scale representation learning through pre-training on a public dataset significantly enhances differentially private (DP) learning in downstream tasks, despite the high…

Machine Learning · Computer Science 2024-10-15 Chendi Wang , Yuqing Zhu , Weijie J. Su , Yu-Xiang Wang

Data is continuously generated by modern data sources, and a recent challenge in machine learning has been to develop techniques that perform well in an incremental (streaming) setting. In this paper, we investigate the problem of private…

Data Structures and Algorithms · Computer Science 2017-01-05 Shiva Prasad Kasiviswanathan , Kobbi Nissim , Hongxia Jin

This work addresses the problem of revenue maximization in a repeated, unlimited supply item-pricing auction while preserving buyer privacy. We present a novel algorithm that provides differential privacy with respect to the buyer's input…

Computer Science and Game Theory · Computer Science 2023-10-31 Joon Suk Huh

We study the canonical statistical task of computing the principal component from $n$ i.i.d.~data in $d$ dimensions under $(\varepsilon,\delta)$-differential privacy. Although extensively studied in literature, existing solutions fall short…

Machine Learning · Computer Science 2022-05-30 Xiyang Liu , Weihao Kong , Prateek Jain , Sewoong Oh

Most existing decentralized learning methods with differential privacy (DP) guarantee rely on constant gradient clipping bounds and fixed-level DP Gaussian noises for each node throughout the training process, leading to a significant…

Machine Learning · Computer Science 2025-05-13 Zehan Zhu , Yan Huang , Xin Wang , Shouling Ji , Jinming Xu

Iterative algorithms, like gradient descent, are common tools for solving a variety of problems, such as model fitting. For this reason, there is interest in creating differentially private versions of them. However, their conversion to…

Machine Learning · Computer Science 2018-08-30 Jaewoo Lee , Daniel Kifer

Motivated by personalized healthcare and other applications involving sensitive data, we study online exploration in reinforcement learning with differential privacy (DP) constraints. Existing work on this problem established that no-regret…

Machine Learning · Computer Science 2023-02-23 Dan Qiao , Yu-Xiang Wang

In machine learning, privacy requirements at inference or deployment time often evolve due to changing policies, regulations, or user preferences. In this work, we aim to construct a magnitude of models to satisfy any target differential…

Machine Learning · Computer Science 2026-05-21 Qichuan Yin , Manzil Zaheer , Tian Li

We provide a new algorithmic framework for differentially private estimation of general functions that adapts to the hardness of the underlying dataset. We build upon previous work that gives a paradigm for selecting an output through the…

Data Structures and Algorithms · Computer Science 2023-11-28 David Durfee

Large pretrained models can be privately fine-tuned to achieve performance approaching that of non-private models. A common theme in these results is the surprising observation that high-dimensional models can achieve favorable…

Differential privacy has become a cornerstone in the development of privacy-preserving learning algorithms. This work addresses optimizing differentially private kernel learning within the empirical risk minimization (ERM) framework. We…

Machine Learning · Statistics 2026-04-30 Bonwoo Lee , Cheolwoo Park , Jeongyoun Ahn

In many modern data sets, High dimension low sample size (HDLSS) data is prevalent in many fields of studies. There has been an increased focus recently on using machine learning and statistical methods to mine valuable information out of…

Optimization and Control · Mathematics 2023-05-23 Srivathsan Amruth , Xin Yee Lam

We present the first differentially private algorithms for reinforcement learning, which apply to the task of evaluating a fixed policy. We establish two approaches for achieving differential privacy, provide a theoretical analysis of the…

Machine Learning · Computer Science 2016-03-08 Borja Balle , Maziar Gomrokchi , Doina Precup

We develop differentially private hypothesis testing methods for the small sample regime. Given a sample $\cal D$ from a categorical distribution $p$ over some domain $\Sigma$, an explicitly described distribution $q$ over $\Sigma$, some…

Data Structures and Algorithms · Computer Science 2017-06-08 Bryan Cai , Constantinos Daskalakis , Gautam Kamath