English
Related papers

Related papers: On Differential Privacy for Adaptively Solving Sea…

200 papers

In large-scale statistical learning, data collection and model fitting are moving increasingly toward peripheral devices---phones, watches, fitness trackers---away from centralized data collection. Concomitant with this rise in…

Machine Learning · Statistics 2019-06-04 Abhishek Bhowmick , John Duchi , Julien Freudiger , Gaurav Kapoor , Ryan Rogers

Differential Privacy has become a widely popular method for data protection in machine learning, especially since it allows formulating strict mathematical privacy guarantees. This survey provides an overview of the state-of-the-art of…

Machine Learning · Computer Science 2025-10-03 Lea Demelius , Roman Kern , Andreas Trügler

Differential privacy is a widely accepted measure of privacy in the context of deep learning algorithms, and achieving it relies on a noisy training approach known as differentially private stochastic gradient descent (DP-SGD). DP-SGD…

Machine Learning · Computer Science 2023-07-26 Ce Feng , Nuo Xu , Wujie Wen , Parv Venkitasubramaniam , Caiwen Ding

Differential Privacy (DP) is the current gold-standard for ensuring privacy for statistical queries. Estimation problems under DP constraints appearing in the literature have largely focused on providing equal privacy to all users. We…

Machine Learning · Computer Science 2025-04-22 Syomantak Chaudhuri , Thomas A. Courtade

Privacy-preserving distributed machine learning becomes increasingly important due to the recent rapid growth of data. This paper focuses on a class of regularized empirical risk minimization (ERM) machine learning problems, and develops…

Machine Learning · Computer Science 2016-03-11 Tao Zhang , Quanyan Zhu

This paper investigates differentially private analysis of distance-based outliers. The problem of outlier detection is to find a small number of instances that are apparently distant from the remaining instances. On the other hand, the…

Machine Learning · Statistics 2015-07-28 Rina Okada , Kazuto Fukuchi , Kazuya Kakizaki , Jun Sakuma

Differential privacy (DP) is a widely used notion for reasoning about privacy when publishing aggregate data. In this paper, we observe that certain DP mechanisms are amenable to a posteriori privacy analysis that exploits the fact that…

Cryptography and Security · Computer Science 2023-06-21 Valentin Hartmann , Vincent Bindschaedler , Alexander Bentkamp , Robert West

While differentially private synthetic data generation has been explored extensively in the literature, how to update this data in the future if the underlying private data changes is much less understood. We propose an algorithmic…

Cryptography and Security · Computer Science 2024-09-04 Girish Kumar , Thomas Strohmer , Roman Vershynin

In many practical applications of differential privacy, practitioners seek to provide the best privacy guarantees subject to a target level of accuracy. A recent line of work by Ligett et al. '17 and Whitehouse et al. '22 has developed such…

Cryptography and Security · Computer Science 2023-12-07 Ryan Rogers , Gennady Samorodnitsky , Zhiwei Steven Wu , Aaditya Ramdas

The application of Differential Privacy to Natural Language Processing techniques has emerged in relevance in recent years, with an increasing number of studies published in established NLP outlets. In particular, the adaptation of…

Computation and Language · Computer Science 2024-04-05 Stephen Meisenbacher , Nihildev Nandakumar , Alexandra Klymenko , Florian Matthes

With the development of big data and machine learning, privacy concerns have become increasingly critical, especially when handling heterogeneous datasets containing sensitive personal information. Differential privacy provides a rigorous…

Machine Learning · Statistics 2025-08-08 Ziliang Shen , Caixing Wang , Shaoli Wang , Yibo Yan

In the differentially private top-$k$ selection problem, we are given a dataset $X \in \{\pm 1\}^{n \times d}$, in which each row belongs to an individual and each column corresponds to some binary attribute, and our goal is to find a set…

Data Structures and Algorithms · Computer Science 2017-02-13 Mitali Bafna , Jonathan Ullman

In this paper, we tackle the problem of answering multi-dimensional range queries under local differential privacy. There are three key technical challenges: capturing the correlations among attributes, avoiding the curse of dimensionality,…

Cryptography and Security · Computer Science 2020-09-15 Jianyu Yang , Tianhao Wang , Ninghui Li , Xiang Cheng , Sen Su

Concerns on location privacy frequently arise with the rapid development of GPS enabled devices and location-based applications. While spatial transformation techniques such as location perturbation or generalization have been studied…

Databases · Computer Science 2015-11-05 Yonghui Xiao , Li Xiong

We study the privatization of distributed learning and optimization strategies. We focus on differential privacy schemes and study their effect on performance. We show that the popular additive random perturbation scheme degrades…

Machine Learning · Computer Science 2023-01-18 Elsa Rizk , Stefan Vlaski , Ali H. Sayed

Differential Privacy (DP) is becoming central to large-scale training as privacy regulations tighten. We revisit how DP noise interacts with adaptivity in optimization through the lens of stochastic differential equations, providing the…

We develop theory for using heuristics to solve computationally hard problems in differential privacy. Heuristic approaches have enjoyed tremendous success in machine learning, for which performance can be empirically evaluated. However,…

Machine Learning · Computer Science 2018-11-20 Seth Neel , Aaron Roth , Zhiwei Steven Wu

Discovering frequent graph patterns in a graph database offers valuable information in a variety of applications. However, if the graph dataset contains sensitive data of individuals such as mobile phone-call graphs and web-click graphs,…

Databases · Computer Science 2013-03-05 Entong Shen , Ting Yu

We give a fast algorithm to optimally compose privacy guarantees of differentially private (DP) algorithms to arbitrary accuracy. Our method is based on the notion of privacy loss random variables to quantify the privacy loss of DP…

Data Structures and Algorithms · Computer Science 2021-10-27 Sivakanth Gopi , Yin Tat Lee , Lukas Wutschitz

This paper proposes a locally differentially private federated learning algorithm for strongly convex but possibly nonsmooth problems that protects the gradients of each worker against an honest but curious server. The proposed algorithm…

Machine Learning · Computer Science 2023-08-03 Jiaojiao Zhang , Dominik Fay , Mikael Johansson