English
Related papers

Related papers: Privately Learning Smooth Distributions on the Hyp…

200 papers

In the era of big data, leveraging information from multiple clients while preserving data privacy has emerged as a critical challenge in modern statistical modeling and forecasting. This paper introduces a privacy-preserving federated…

Methodology · Statistics 2026-04-09 Kejun Chen , Qianqian Zhu

This paper provides the first analysis of the differentially private computation of three centrality measures, namely eigenvector, Laplacian and closeness centralities, on arbitrary weighted graphs, using the smooth sensitivity approach. We…

Social and Information Networks · Computer Science 2021-08-17 Jesse Laeuchli , Yunior Ramírez-Cruz , Rolando Trujillo-Rasua

This paper considers the generalization performance of differentially private convex learning. We demonstrate that the convergence analysis of Langevin algorithms can be used to obtain new generalization bounds with differential privacy…

Machine Learning · Computer Science 2022-06-07 Yi-An Ma , Teodor Vanislavov Marinov , Tong Zhang

Temporal difference (TD) learning is a widely used method to evaluate policies in reinforcement learning. While many TD learning methods have been developed in recent years, little attention has been paid to preserving privacy and most of…

Machine Learning · Computer Science 2022-01-26 Canzhe Zhao , Yanjie Ze , Jing Dong , Baoxiang Wang , Shuai Li

Differential privacy (DP) is a widely-accepted and widely-applied notion of privacy based on worst-case analysis. Often, DP classifies most mechanisms without additive noise as non-private (Dwork et al., 2014). Thus, additive noises are…

Cryptography and Security · Computer Science 2023-12-14 Ao Liu , Yu-Xiang Wang , Lirong Xia

Pairwise learning focuses on learning tasks with pairwise loss functions, depends on pairs of training instances, and naturally fits for modeling relationships between pairs of samples. In this paper, we focus on the privacy of pairwise…

Machine Learning · Computer Science 2021-06-02 Yilin Kang , Yong Liu , Jian Li , Weiping Wang

In this paper we revisit the classical method of partitioning classification and study its convergence rate under relaxed conditions, both for observable (non-privatised) and for privatised data. We consider the problem of classification in…

Machine Learning · Statistics 2025-09-09 Balázs Csanád Csáji , László Györfi , Ambrus Tamás , Harro Walk

Users of a personalised recommendation system face a dilemma: recommendations can be improved by learning from data, but only if the other users are willing to share their private information. Good personalised predictions are vitally…

Machine Learning · Statistics 2018-02-12 Antti Honkela , Mrinal Das , Arttu Nieminen , Onur Dikmen , Samuel Kaski

We present an approach for generating differentially private synthetic text using large language models (LLMs), via private prediction. In the private prediction framework, we only require the output synthetic data to satisfy differential…

Machine Learning · Computer Science 2024-10-10 Kareem Amin , Alex Bie , Weiwei Kong , Alexey Kurakin , Natalia Ponomareva , Umar Syed , Andreas Terzis , Sergei Vassilvitskii

Popular approaches to differential privacy, such as the Laplace and exponential mechanisms, calibrate randomised smoothing through global sensitivity of the target non-private function. Bounding such sensitivity is often a prohibitively…

Machine Learning · Computer Science 2017-06-12 Benjamin I. P. Rubinstein , Francesco Aldà

In this paper we revisit the classical problem of nonparametric regression, but impose local differential privacy constraints. Under such constraints, the raw data $(X_1,Y_1),\ldots,(X_n,Y_n)$, taking values in $\mathbb{R}^d \times…

Statistics Theory · Mathematics 2020-11-03 Thomas Berrett , László Györfi , Harro Walk

Federated learning enables training machine learning models while preserving the privacy of participants. Surprisingly, there is no differentially private distributed method for smooth, non-convex optimization problems. The reason is that…

Machine Learning · Computer Science 2025-02-20 Egor Shulgin , Sarit Khirirat , Peter Richtárik

We study the problem of estimating high dimensional models with underlying sparse structures while preserving the privacy of each training example. We develop a differentially private high-dimensional sparse learning framework using the…

Machine Learning · Statistics 2019-09-16 Lingxiao Wang , Quanquan Gu

Density estimation plays a key role in many tasks in machine learning, statistical inference, and visualization. The main bottleneck in high-dimensional density estimation is the prohibitive computational cost and the slow convergence rate.…

Machine Learning · Computer Science 2021-10-22 Liang Ding , Lu Zou , Wenjia Wang , Shahin Shahrampour , Rui Tuo

Differentially private federated learning is crucial for maintaining privacy in distributed environments. This paper investigates the challenges of high-dimensional estimation and inference under the constraints of differential privacy.…

Machine Learning · Statistics 2024-04-26 Zhe Zhang , Ryumei Nakada , Linjun Zhang

Differential privacy is a recent notion of privacy for statistical databases that provides rigorous, meaningful confidentiality guarantees, even in the presence of an attacker with access to arbitrary side information. We show that for a…

Cryptography and Security · Computer Science 2008-09-30 Adam Smith

Private data analysis faces a significant challenge known as the curse of dimensionality, leading to increased costs. However, many datasets possess an inherent low-dimensional structure. For instance, during optimization via gradient…

Machine Learning · Computer Science 2024-10-29 Eliad Tsfadia

We study statistical estimation under local differential privacy (LDP) when users may hold heterogeneous privacy levels and accuracy must be guaranteed with high probability. Departing from the common in-expectation analyses, and for…

Machine Learning · Statistics 2025-10-15 Maryam Aliakbarpour , Alireza Fallah , Swaha Roy , Ria Stevens

Constructing a differentially private (DP) estimator requires deriving the maximum influence of an observation, which can be difficult in the absence of exogenous bounds on the input data or the estimator, especially in high dimensional…

Machine Learning · Statistics 2022-07-27 Ryan Cumings-Menon

In the arena of privacy-preserving machine learning, differentially private stochastic gradient descent (DP-SGD) has outstripped the objective perturbation mechanism in popularity and interest. Though unrivaled in versatility, DP-SGD…

Machine Learning · Computer Science 2024-01-02 Rachel Redberg , Antti Koskela , Yu-Xiang Wang