English
Related papers

Related papers: Nonparametric spectral density estimation using in…

200 papers

We address nonconvex learning problems over undirected networks. In particular, we focus on the challenge of designing an algorithm that is both communication-efficient and that guarantees the privacy of the agents' data. The first goal is…

Machine Learning · Computer Science 2026-04-06 Xiaoxing Ren , Yuwen Ma , Nicola Bastianello , Karl H. Johansson , Thomas Parisini , Andreas A. Malikopoulos

In this paper, we investigate the differentially private estimation of data depth functions and their associated medians. We introduce several methods for privatizing depth values at a fixed point, and show that for some depth functions,…

Statistics Theory · Mathematics 2021-04-09 Kelly Ramsay , Shoja'eddin Chenouri

We consider stochastic systems of interacting particles or agents, with dynamics determined by an interaction kernel which only depends on pairwise distances. We study the problem of inferring this interaction kernel from observations of…

Statistics Theory · Mathematics 2020-07-31 Fei Lu , Mauro Maggioni , Sui Tang

Real-time data-driven optimization and control problems over networks may require sensitive information of participating users to calculate solutions and decision variables, such as in traffic or energy systems. Adversaries with access to…

Optimization and Control · Mathematics 2020-05-25 Roel Dobbe , Ye Pu , Jingge Zhu , Kannan Ramchandran , Claire Tomlin

We study the role of interactivity in distributed statistical inference under information constraints, e.g., communication constraints and local differential privacy. We focus on the tasks of goodness-of-fit testing and estimation of…

Data Structures and Algorithms · Computer Science 2021-10-26 Jayadev Acharya , Clément L. Canonne , Yuhan Liu , Ziteng Sun , Himanshu Tyagi

We present a simple perturbation mechanism for the release of $d$-dimensional covariance matrices $\Sigma$ under pure differential privacy. For large datasets with at least $n\geq d^2/\varepsilon$ elements, our mechanism recovers the…

Machine Learning · Computer Science 2026-02-03 Tommaso d'Orsi , Gleb Novikov

Koufogiannis et al. (2016) showed a $\textit{gradual release}$ result for Laplace noise-based differentially private mechanisms: given an $\varepsilon$-DP release, a new release with privacy parameter $\varepsilon' > \varepsilon$ can be…

Cryptography and Security · Computer Science 2025-05-29 Joel Daniel Andersson , Lukas Retschmeier , Boel Nelson , Rasmus Pagh

Privacy preservation in machine learning, particularly through Differentially Private Stochastic Gradient Descent (DP-SGD), is critical for sensitive data analysis. However, existing statistical inference methods for SGD predominantly focus…

Machine Learning · Statistics 2025-12-15 Xintao Xia , Linjun Zhang , Zhanrui Cai

This paper furthers current research into the notion of guaranteed privacy, which provides a deterministic characterization of the privacy of output signals of a dynamical system or mechanism. Unlike stochastic differential privacy,…

Systems and Control · Electrical Eng. & Systems 2024-09-12 Mohammad Khajenejad , Sonia Martinez

In this paper, we develop a general framework to design differentially private expectation-maximization (EM) algorithms in high-dimensional latent variable models, based on the noisy iterative hard-thresholding. We derive the statistical…

Machine Learning · Statistics 2021-09-10 Zhe Zhang , Linjun Zhang

Differential privacy provides a rigorous framework to quantify data privacy, and has received considerable interest recently. A randomized mechanism satisfying $(\epsilon, \delta)$-differential privacy (DP) roughly means that, except with a…

Cryptography and Security · Computer Science 2019-12-10 Jun Zhao , Teng Wang , Tao Bai , Kwok-Yan Lam , Zhiying Xu , Shuyu Shi , Xuebin Ren , Xinyu Yang , Yang Liu , Han Yu

We propose a flexible nonparametric regression method for ultrahigh-dimensional data. As a first step, we propose a fast screening method based on the favored smoothing bandwidth of the marginal local constant regression. Then, an iterative…

Methodology · Statistics 2018-07-30 Yang Feng , Yichao Wu , Leonard Stefanski

We investigate the framework of privacy amplification by iteration, recently proposed by Feldman et al., from an information-theoretic lens. We demonstrate that differential privacy guarantees of iterative mappings can be determined by a…

Information Theory · Computer Science 2020-01-22 Shahab Asoodeh , Mario Diaz , Flavio P. Calmon

In this paper, we propose a differentially private decentralized learning method (termed PrivSGP-VR) which employs stochastic gradient push with variance reduction and guarantees $(\epsilon, \delta)$-differential privacy (DP) for each node.…

Machine Learning · Computer Science 2024-05-07 Zehan Zhu , Yan Huang , Xin Wang , Jinming Xu

User-level differentially private stochastic convex optimization (DP-SCO) has garnered significant attention due to the paramount importance of safeguarding user privacy in modern large-scale machine learning applications. Current methods,…

Machine Learning · Computer Science 2025-02-14 Badih Ghazi , Ravi Kumar , Daogao Liu , Pasin Manurangsi

We explore the edge-flipping mechanism, a type of input perturbation, to release the directed graph under edge-local differential privacy. By using the noisy bi-degree sequence from the output graph, we construct the moment equations to…

Statistics Theory · Mathematics 2025-12-29 Xueying Sun , Ting Yan , Binyan Jiang

In this paper, we focus on developing a novel mechanism to preserve differential privacy in deep neural networks, such that: (1) The privacy budget consumption is totally independent of the number of training steps; (2) It has the ability…

Cryptography and Security · Computer Science 2018-04-24 NhatHai Phan , Xintao Wu , Han Hu , Dejing Dou

We study differentially private (DP) algorithms for stochastic non-convex optimization. In this problem, the goal is to minimize the population loss over a $p$-dimensional space given $n$ i.i.d. samples drawn from a distribution. We improve…

Machine Learning · Computer Science 2020-08-12 Yingxue Zhou , Xiangyi Chen , Mingyi Hong , Zhiwei Steven Wu , Arindam Banerjee

Differentially private distributed stochastic optimization has become a hot topic due to the urgent need of privacy protection in distributed stochastic optimization. In this paper, two-time scale stochastic approximation-type algorithms…

Systems and Control · Electrical Eng. & Systems 2024-03-19 Jimin Wang , Ji-Feng Zhang

Motivated by the rapid rise in statistical tools in Functional Data Analysis, we consider the Gaussian mechanism for achieving differential privacy with parameter estimates taking values in a, potentially infinite-dimensional, separable…

Statistics Theory · Mathematics 2019-01-29 Ardalan Mirshani , Matthew Reimherr , Aleksandra Slavkovic