English
Related papers

Related papers: The Cost of Privacy: Optimal Rates of Convergence …

200 papers

The exponential growth of data collection necessitates robust privacy protections that preserve data utility. We address information disclosure against adversaries with bounded prior knowledge, modeled by an entropy constraint $H(X) \geq…

Cryptography and Security · Computer Science 2026-03-27 Genqiang Wu , Xiaoying Zhang , Yu Qi , Hao Wang , Jikui Wang , Yeping He

We propose a general privacy-preserving optimization-based framework for real-time environments without requiring trusted data curators. In particular, we introduce a noisy stochastic gradient descent algorithm for online statistical…

Methodology · Statistics 2025-06-11 Jinhan Xie , Enze Shi , Bei Jiang , Linglong Kong , Xuming He

Constructing a differentially private (DP) estimator requires deriving the maximum influence of an observation, which can be difficult in the absence of exogenous bounds on the input data or the estimator, especially in high dimensional…

Machine Learning · Statistics 2022-07-27 Ryan Cumings-Menon

This work proposes an algorithmic method to verify differential privacy for estimation mechanisms with performance guarantees. Differential privacy makes it hard to distinguish outputs of a mechanism produced by adjacent inputs. While…

Systems and Control · Electrical Eng. & Systems 2021-12-03 Yunhai Han , Sonia Martínez

In this paper, we investigate the problem of differentially private distributed optimization. Recognizing that lower sensitivity leads to higher accuracy, we analyze the key factors influencing the sensitivity of differentially private…

Optimization and Control · Mathematics 2026-01-05 Furan Xie , Bing Liu , Li Chai

Differential privacy is a privacy measure based on the difficulty of discriminating between similar input data. In differential privacy analysis, similar data usually implies that their distance does not exceed a predetermined threshold.…

Optimization and Control · Mathematics 2021-06-25 Genki Sugiura , Kaito Ito , Kenji Kashima

In this paper, we study what price one has to pay to release {\em differentially private low-rank factorization} of a matrix. We consider various settings that are close to the real world applications of low-rank factorization: (i) the…

Data Structures and Algorithms · Computer Science 2018-04-19 Jalaj Upadhyay

We study the fundamental problems of identity testing (goodness of fit), and closeness testing (two sample test) of distributions over $k$ elements, under differential privacy. While the problems have a long history in statistics, finite…

Machine Learning · Computer Science 2017-11-01 Jayadev Acharya , Ziteng Sun , Huanyu Zhang

Private regression has received attention from both database and security communities. Recent work by Fredrikson et al. (USENIX Security 2014) analyzed the functional mechanism (Zhang et al. VLDB 2012) for training linear regression models…

Cryptography and Security · Computer Science 2015-12-22 Xi Wu , Matthew Fredrikson , Wentao Wu , Somesh Jha , Jeffrey F. Naughton

Two major challenges in distributed learning and estimation are 1) preserving the privacy of the local samples; and 2) communicating them efficiently to a central server, while achieving high accuracy for the end-to-end task. While there…

Machine Learning · Computer Science 2021-04-23 Wei-Ning Chen , Peter Kairouz , Ayfer Özgür

Motivated by understanding the dynamics of sensitive social networks over time, we consider the problem of continual release of statistics in a network that arrives online, while preserving privacy of its participants. For our privacy…

Cryptography and Security · Computer Science 2018-09-20 Shuang Song , Susan Little , Sanjay Mehta , Staal Vinterbo , Kamalika Chaudhuri

Although robust learning and local differential privacy are both widely studied fields of research, combining the two settings is just starting to be explored. We consider the problem of estimating a discrete distribution in total variation…

Statistics Theory · Mathematics 2022-04-21 Julien Chhor , Flore Sentenac

This paper establishes the strict optimality in precision for frequency and distribution estimation under local differential privacy (LDP). We prove that a linear estimator with a symmetric and extremal configuration, and a constant support…

Information Theory · Computer Science 2026-03-24 Mingen Pan

We study two foundational problems in distributed survival analysis under federated differential privacy (FDP): estimation of the Cox regression coefficients and of the cumulative baseline hazard functions, allowing for heterogeneous…

Statistics Theory · Mathematics 2026-04-07 Elly K. H. Hung , Yi Yu

Preference-based fine-tuning has become an important component in training large language models, and the data used at this stage may contain sensitive user information. A central question is how to design a differentially private pipeline…

Machine Learning · Statistics 2026-03-25 Young Hyun Cho , Will Wei Sun

The privacy of machine learning models has become a significant concern in many emerging Machine-Learning-as-a-Service applications, where prediction services based on well-trained models are offered to users via pay-per-query. The lack of…

Machine Learning · Computer Science 2022-06-24 Xun Xian , Mingyi Hong , Jie Ding

We study person-level differentially private (DP) mean estimation in the case where each person holds multiple samples. DP here requires the usual notion of distributional stability when $\textit{all}$ of a person's datapoints can be…

Data Structures and Algorithms · Computer Science 2024-07-22 Sushant Agarwal , Gautam Kamath , Mahbod Majid , Argyris Mouzakis , Rose Silver , Jonathan Ullman

The increased application of machine learning (ML) in sensitive domains requires protecting the training data through privacy frameworks, such as differential privacy (DP). DP requires to specify a uniform privacy level $\varepsilon$ that…

Machine Learning · Computer Science 2024-01-31 Krishna Acharya , Franziska Boenisch , Rakshit Naidu , Juba Ziani

In this work, we study high-dimensional mean estimation under user-level differential privacy, and design an $(\varepsilon,\delta)$-differentially private mechanism using as few users as possible. In particular, we provide a nearly optimal…

Data Structures and Algorithms · Computer Science 2022-06-14 Hossein Esfandiari , Vahab Mirrokni , Shyam Narayanan

This paper is motivated by applications of a Census Bureau interested in releasing aggregate socio-economic data about a large population without revealing sensitive information about any individual. The released information can be the…

Databases · Computer Science 2021-05-11 Ferdinando Fioretto , Pascal Van Hentenryck , Keyu Zhu