English
Related papers

Related papers: Privacy Risk for anisotropic Langevin dynamics usi…

200 papers

Repeated use of a data sample via adaptively chosen queries can rapidly lead to overfitting, wherein the empirical evaluation of queries on the sample significantly deviates from their mean with respect to the underlying data distribution.…

Machine Learning · Computer Science 2024-04-26 Moshe Shenfeld , Katrina Ligett

The problem of estimating a parameter in the drift coefficient is addressed for $N$ discretely observed independent and identically distributed stochastic differential equations (SDEs). This is done considering additional constraints,…

Statistics Theory · Mathematics 2024-10-17 Chiara Amorino , Arnaud Gloter , Hélène Halconruy

In this paper, we establish anti-concentration inequalities for additive noise mechanisms which achieve $f$-differential privacy ($f$-DP), a notion of privacy phrased in terms of a tradeoff function $f$ which limits the ability of an…

Cryptography and Security · Computer Science 2024-11-12 Jordan Awan , Aishwarya Ramasethu

Modern machine learning algorithms aim to extract fine-grained information from data to provide accurate predictions, which often conflicts with the goal of privacy protection. This paper addresses the practical and theoretical importance…

Machine Learning · Statistics 2023-07-17 Puyu Wang , Yunwen Lei , Yiming Ying , Ding-Xuan Zhou

This paper studies the design of an optimal privacyaware estimator of a public random variable based on noisy measurements which contain private information. The public random variable carries non-private information, however, its estimate…

Optimization and Control · Mathematics 2018-08-08 Ehsan Nekouei , Henrik Sandberg , Mikael Skoglund , Karl H. Johansson

Convex optimization finds many real-life applications, where--optimized on real data--optimization results may expose private data attributes (e.g., individual health records, commercial information), thus leading to privacy breaches. To…

Optimization and Control · Mathematics 2024-06-25 Vladimir Dvorkin , Ferdinando Fioretto , Pascal Van Hentenryck , Pierre Pinson , Jalal Kazempour

We propose and analyze algorithms to solve a range of learning tasks under user-level differential privacy constraints. Rather than guaranteeing only the privacy of individual samples, user-level DP protects a user's entire contribution ($m…

Machine Learning · Computer Science 2021-12-06 Daniel Levy , Ziteng Sun , Kareem Amin , Satyen Kale , Alex Kulesza , Mehryar Mohri , Ananda Theertha Suresh

Pairwise learning focuses on learning tasks with pairwise loss functions, depends on pairs of training instances, and naturally fits for modeling relationships between pairs of samples. In this paper, we focus on the privacy of pairwise…

Machine Learning · Computer Science 2021-06-02 Yilin Kang , Yong Liu , Jian Li , Weiping Wang

We address the problem of maximizing privacy of stochastic dynamical systems whose state information is released through quantized sensor data. In particular, we consider the setting where information about the system state is obtained…

Systems and Control · Electrical Eng. & Systems 2021-01-25 Carlos Murguia , Iman Shames , Farhad Farokhi. Dragan Nesic , Vincent Poor

Privacy-preserving data analysis is a rising challenge in contemporary statistics, as the privacy guarantees of statistical methods are often achieved at the expense of accuracy. In this paper, we investigate the tradeoff between…

Machine Learning · Statistics 2020-11-11 T. Tony Cai , Yichen Wang , Linjun Zhang

A central challenge in machine learning is to understand how noise or measurement errors affect low-rank approximations, particularly in the spectral norm. This question is especially important in differentially private low-rank…

Machine Learning · Computer Science 2025-10-30 Phuc Tran , Nisheeth K. Vishnoi , Van H. Vu

We study the mixing time of the projected Langevin algorithm (LA) and the privacy curve of noisy Stochastic Gradient Descent (SGD), beyond nonexpansive iterations. Specifically, we derive new mixing time bounds for the projected LA which…

Machine Learning · Statistics 2026-03-03 Mario Bravo , Juan P. Flores-Mella , Cristóbal Guzmán

Gradient perturbation, widely used for differentially private optimization, injects noise at every iterative update to guarantee differential privacy. Previous work first determines the noise level that can satisfy the privacy requirement…

Machine Learning · Computer Science 2020-10-27 Da Yu , Huishuai Zhang , Wei Chen , Tie-Yan Liu , Jian Yin

In the last years we have witnessed the appearance of a variety of strategies to design optimal location privacy-preserving mechanisms, in terms of maximizing the adversary's expected error with respect to the users' whereabouts. In this…

Cryptography and Security · Computer Science 2017-08-25 Simon Oya , Carmela Troncoso , Fernando Pérez-González

We study statistical risk minimization problems under a privacy model in which the data is kept confidential even from the learner. In this local privacy framework, we establish sharp upper and lower bounds on the convergence rates of…

Machine Learning · Statistics 2013-10-11 John C. Duchi , Michael I. Jordan , Martin J. Wainwright

While Local Differential Privacy (LDP) serves as a foundational primitive for distributed data collection, its stringent noise injection requirement often leads to severe degradation in data utility. This degradation stems from the…

Machine Learning · Computer Science 2026-05-21 Youngmok Ha , Viktor Schlegel , Yidan Sun , Anil Anthony Bharath

The Noisy-SGD algorithm is widely used for privately training machine learning models. Traditional privacy analyses of this algorithm assume that the internal state is publicly revealed, resulting in privacy loss bounds that increase…

Machine Learning · Computer Science 2023-05-18 Shahab Asoodeh , Mario Diaz

There is a disconnect between how researchers and practitioners handle privacy-utility tradeoffs. Researchers primarily operate from a privacy first perspective, setting strict privacy requirements and minimizing risk subject to these…

Machine Learning · Computer Science 2023-11-14 Justin Whitehouse , Zhiwei Steven Wu , Aaditya Ramdas , Ryan Rogers

Datasets containing sensitive information are often sequentially analyzed by many algorithms. This raises a fundamental question in differential privacy regarding how the overall privacy bound degrades under composition. To address this…

Machine Learning · Statistics 2020-03-26 Qinqing Zheng , Jinshuo Dong , Qi Long , Weijie J. Su

We consider a finite horizon linear discrete time varying system whose input is a random noise with an imprecisely known probability law. The statistical uncertainty is described by a nonnegative parameter a which constrains the anisotropy…

Systems and Control · Computer Science 2012-08-21 Eugene A. Maximov , Alexander P. Kurdyukov , Igor G. Vladimirov