English
Related papers

Related papers: Near-Universally-Optimal Differentially Private Mi…

200 papers

We study the relation between the minimal spanning tree (MST) on many random points and the "near-minimal" tree which is optimal subject to the constraint that a proportion $\delta$ of its edges must be different from those of the MST.…

Probability · Mathematics 2007-07-24 David Aldous , Charles Bordenave , Marc Lelarge

Differential privacy has become a cornerstone in the development of privacy-preserving learning algorithms. This work addresses optimizing differentially private kernel learning within the empirical risk minimization (ERM) framework. We…

Machine Learning · Statistics 2026-04-30 Bonwoo Lee , Cheolwoo Park , Jeongyoun Ahn

Differential privacy (DP) ensures that training a machine learning model does not leak private data. In practice, we may have access to auxiliary public data that is free of privacy concerns. In this work, we assume access to a given amount…

Machine Learning · Computer Science 2024-09-11 Andrew Lowy , Zeman Li , Tianjian Huang , Meisam Razaviyayn

We study differentially private (DP) estimation of a rank-$r$ matrix $M \in \mathbb{R}^{d_1\times d_2}$ under the trace regression model with Gaussian measurement matrices. Theoretically, the sensitivity of non-private spectral…

Machine Learning · Statistics 2024-03-26 Mengyue Zha

We consider a refinement of differential privacy --- per instance differential privacy (pDP), which captures the privacy of a specific individual with respect to a fixed data set. We show that this is a strict generalization of the standard…

Machine Learning · Statistics 2018-11-15 Yu-Xiang Wang

In this paper, we develop a privacy implementation for symbolic control systems. Such systems generate sequences of non-numerical data, and these sequences can be represented by words or strings over a finite alphabet. This work uses the…

Cryptography and Security · Computer Science 2018-09-25 Austin Jones , Kevin Leahy , Matthew Hale

We investigate a problem of finding the minimum, in which each user has a real value and we want to estimate the minimum of these values under the local differential privacy constraint. We reveal that this problem is fundamentally…

Statistics Theory · Mathematics 2019-05-28 Kazuto Fukuchi , Chia-Mu Yu , Arashi Haishima , Jun Sakuma

Distributed model predictive control (DMPC) has attracted extensive attention as it can explicitly handle system constraints and achieve optimal control in a decentralized manner. However, the deployment of DMPC strategies generally…

Systems and Control · Electrical Eng. & Systems 2025-11-21 Kaixiang Zhang , Yongqiang Wang , Ziyou Song , Zhaojian Li

We study the canonical statistical estimation problem of linear regression from $n$ i.i.d.~examples under $(\varepsilon,\delta)$-differential privacy when some response variables are adversarially corrupted. We propose a variant of the…

Machine Learning · Computer Science 2023-02-01 Xiyang Liu , Prateek Jain , Weihao Kong , Sewoong Oh , Arun Sai Suggala

We characterize the minimum noise amplitude and power for noise-adding mechanisms in $(\epsilon, \delta)$-differential privacy for single real-valued query function. We derive new lower bounds using the duality of linear programming, and…

Cryptography and Security · Computer Science 2019-02-06 Quan Geng , Wei Ding , Ruiqi Guo , Sanjiv Kumar

Economics and social science research often require analyzing datasets of sensitive personal information at fine granularity, with models fit to small subsets of the data. Unfortunately, such fine-grained analysis can easily reveal…

Machine Learning · Computer Science 2020-07-13 Daniel Alabi , Audra McMillan , Jayshree Sarathy , Adam Smith , Salil Vadhan

We propose and analyze a general-purpose dataset-distance-based utility function family, Duff, for differential privacy's exponential mechanism. Given a particular dataset and a statistic (e.g., median, mode), this function family assigns…

Cryptography and Security · Computer Science 2021-01-25 Andrés Muñoz Medina , Jenny Gillenwater

In this paper, we design user-centric obfuscation mechanisms that impose the minimum utility loss for guaranteeing user's privacy. We optimize utility subject to a joint guarantee of differential privacy (indistinguishability) and…

Cryptography and Security · Computer Science 2015-05-29 Reza Shokri

Computing matchings in graphs is a foundational algorithmic task. Despite extensive interest in differentially private (DP) graph analysis, work on privately computing matching solutions, rather than just their size, has been sparse. The…

Data Structures and Algorithms · Computer Science 2026-02-18 Michael Dinitz , George Z. Li , Quanquan C. Liu , Felix Zhou

We consider a platform's problem of collecting data from privacy sensitive users to estimate an underlying parameter of interest. We formulate this question as a Bayesian-optimal mechanism design problem, in which an individual can share…

Computer Science and Game Theory · Computer Science 2023-09-07 Alireza Fallah , Ali Makhdoumi , Azarakhsh Malekian , Asuman Ozdaglar

We introduce a universal framework for characterizing the statistical efficiency of a statistical estimation problem with differential privacy guarantees. Our framework, which we call High-dimensional Propose-Test-Release (HPTR), builds…

Statistics Theory · Mathematics 2021-11-15 Xiyang Liu , Weihao Kong , Sewoong Oh

In this work, we study local minimax convergence estimation rates subject to $\epsilon$-differential privacy. Unlike worst-case rates, which may be conservative, algorithms that are locally minimax optimal must adapt to easy instances of…

Statistics Theory · Mathematics 2022-10-31 Audra McMillan , Adam Smith , Jon Ullman

Amplification by subsampling is one of the main primitives in machine learning with differential privacy (DP): Training a model on random batches instead of complete datasets results in stronger privacy. This is traditionally formalized via…

Cryptography and Security · Computer Science 2024-11-04 Jan Schuchardt , Mihail Stoian , Arthur Kosmala , Stephan Günnemann

We consider data release protocols for data $X=(S,U)$, where $S$ is sensitive; the released data $Y$ contains as much information about $X$ as possible, measured as $\operatorname{I}(X;Y)$, without leaking too much about $S$. We introduce…

Cryptography and Security · Computer Science 2021-01-25 Milan Lopuhaä-Zwakenberg , Jasper Goseling

Traditional approaches to differential privacy assume a fixed privacy requirement $\epsilon$ for a computation, and attempt to maximize the accuracy of the computation subject to the privacy constraint. As differential privacy is…

Machine Learning · Computer Science 2017-06-01 Katrina Ligett , Seth Neel , Aaron Roth , Bo Waggoner , Z. Steven Wu