English
Related papers

Related papers: Private Adaptive Covariance Estimation via Gaussia…

200 papers

We present simple differentially private estimators for the mean and covariance of multivariate sub-Gaussian data that are accurate at small sample sizes. We demonstrate the effectiveness of our algorithms both theoretically and empirically…

Machine Learning · Statistics 2026-02-10 Sourav Biswas , Yihe Dong , Gautam Kamath , Jonathan Ullman

We consider the problem of generating private synthetic versions of real-world graphs containing private information while maintaining the utility of generated graphs. Differential privacy is a gold standard for data privacy, and the…

Machine Learning · Computer Science 2021-11-18 Xu Zheng , Nicholas McCarthy , Jer Hayes

Many privacy mechanisms reveal high-level information about a data distribution through noisy measurements. It is common to use this information to estimate the answers to new queries. In this work, we provide an approach to solve this…

Machine Learning · Computer Science 2019-01-29 Ryan McKenna , Daniel Sheldon , Gerome Miklau

Data-dependent privacy accounting frameworks such as per-instance differential privacy (pDP) and Fisher information loss (FIL) confer fine-grained privacy guarantees for individuals in a fixed training dataset. These guarantees can be…

Cryptography and Security · Computer Science 2024-03-12 Shengyuan Hu , Saeed Mahloujifar , Virginia Smith , Kamalika Chaudhuri , Chuan Guo

A key tool for building differentially private systems is adding Gaussian noise to the output of a function evaluated on a sensitive dataset. Unfortunately, using a continuous distribution presents several practical challenges. First and…

Data Structures and Algorithms · Computer Science 2024-11-19 Clément L. Canonne , Gautam Kamath , Thomas Steinke

Multivariate time series analysis is becoming an integral part of data analysis pipelines. Understanding the individual time point connections between covariates as well as how these connections change in time is non-trivial. To this aim,…

Machine Learning · Statistics 2021-02-04 Federico Ciech , Veronica Tozzo

The Collective Graphical Model (CGM) models a population of independent and identically distributed individuals when only collective statistics (i.e., counts of individuals) are observed. Exact inference in CGMs is intractable, and previous…

Machine Learning · Computer Science 2014-05-21 Li-Ping Liu , Daniel Sheldon , Thomas G. Dietterich

Privacy in AI remains a topic that draws attention from researchers and the general public in recent years. As one way to implement privacy-preserving AI, differentially private learning is a framework that enables AI models to use…

Machine Learning · Computer Science 2023-05-03 Tianyu Xia , Shuheng Shen , Su Yao , Xinyi Fu , Ke Xu , Xiaolong Xu , Xing Fu

Differential privacy mechanisms such as the Gaussian or Laplace mechanism have been widely used in data analytics for preserving individual privacy. However, they are mostly designed for continuous outputs and are unsuitable for scenarios…

Cryptography and Security · Computer Science 2024-06-06 Zhongteng Cai , Xueru Zhang , Mohammad Mahdi Khalili

While generative models have proved successful in many domains, they may pose a privacy leakage risk in practical deployment. To address this issue, differentially private generative model learning has emerged as a solution to train private…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Bochao Liu , Pengju Wang , Weijia Guo , Yong Li , Liansheng Zhuang , Weiping Wang , Shiming Ge

The covariance matrix plays a fundamental role in the analysis of high-dimensional data. This paper studies minimax and adaptive estimation of high-dimensional bandable covariance matrices under differential privacy constraints. We propose…

Statistics Theory · Mathematics 2026-03-23 T. Tony Cai , Yicheng Li

Ordinary differential equation (ODE)-based diffusion models enable deterministic image synthesis, establishing a reversible mapping suitable for generative steganography. While prevailing methods strictly adhere to a standard normal prior,…

Cryptography and Security · Computer Science 2025-12-16 Yuhua Xu , Wei Sun , Chengpei Tang , Jiaxing Lu , Jingying Zhou , Chen Gu

Estimating covariances between financial assets plays an important role in risk management. In practice, when the sample size is small compared to the number of variables, the empirical estimate is known to be very unstable. Here, we…

Computational Engineering, Finance, and Science · Computer Science 2019-04-19 Rajbir-Singh Nirwan , Nils Bertschinger

This paper proposes an online learning method of Gaussian process state-space model (GP-SSM). GP-SSM is a probabilistic representation learning scheme that represents unknown state transition and/or measurement models as Gaussian processes…

Robotics · Computer Science 2024-10-30 Soon-Seo Park , Young-Jin Park , Youngjae Min , Han-Lim Choi

Federated learning is distributed model training across several clients without disclosing raw data. Despite advancements in data privacy, risks still remain. Differential Privacy (DP) is a technique to protect sensitive data by adding…

Machine Learning · Computer Science 2025-10-14 Tejash Varsani

Auditing Differentially Private Stochastic Gradient Descent (DP-SGD) in the final model setting is challenging and often results in empirical lower bounds that are significantly looser than theoretical privacy guarantees. We introduce a…

Cryptography and Security · Computer Science 2025-02-25 Sangyeon Yoon , Wonje Jeung , Albert No

Differential privacy is the leading mathematical framework for privacy protection, providing a probabilistic guarantee that safeguards individuals' private information when publishing statistics from a dataset. This guarantee is achieved by…

Methodology · Statistics 2025-08-19 Yuki Ohnishi , Jordan Awan

In this work, a Gaussian process regression(GPR) model incorporated with given physical information in partial differential equations(PDEs) is developed: physics-assisted Gaussian processes(PAGP). The targets of this model can be divided…

Machine Learning · Statistics 2022-04-07 Jiahao Zhang , Shiqi Zhang , Guang Lin

We study adaptive methods for differentially private convex optimization, proposing and analyzing differentially private variants of a Stochastic Gradient Descent (SGD) algorithm with adaptive stepsizes, as well as the AdaGrad algorithm. We…

Machine Learning · Computer Science 2021-06-28 Hilal Asi , John Duchi , Alireza Fallah , Omid Javidbakht , Kunal Talwar

Recent advances have sparked significant interest in the development of privacy-preserving Principal Component Analysis (PCA). However, many existing approaches rely on restrictive assumptions, such as assuming sub-Gaussian data or being…

Methodology · Statistics 2025-07-22 Minwoo Kim , Sungkyu Jung