中文
相关论文

相关论文: A Fast Algorithm for Adaptive Private Mean Estimat…

200 篇论文

We study the algorithmic problem of sparse mean estimation in the presence of adversarial outliers. Specifically, the algorithm observes a \emph{corrupted} set of samples from $\mathcal{N}(\mu,\mathbf{I}_d)$, where the unknown mean $\mu \in…

数据结构与算法 · 计算机科学 2024-03-08 Ankit Pensia

Differentially private distributed stochastic optimization has become a hot topic due to the urgent need of privacy protection in distributed stochastic optimization. In this paper, two-time scale stochastic approximation-type algorithms…

系统与控制 · 电气工程与系统科学 2024-03-19 Jimin Wang , Ji-Feng Zhang

We develop and analyze an asynchronous algorithm for distributed convex optimization when the objective writes a sum of smooth functions, local to each worker, and a non-smooth function. Unlike many existing methods, our distributed…

最优化与控制 · 数学 2019-12-13 Konstantin Mishchenko , Franck Iutzeler , Jérôme Malick

An algorithm is given for determining an optimal $b$-step approximation of weighted data, where the error is measured with respect to the $L_\infty$ norm. For data presorted by the independent variable the algorithm takes $\Theta(n + \log n…

数据结构与算法 · 计算机科学 2015-05-05 Quentin F. Stout

We study the problem of computationally efficient robust estimation of the covariance/scatter matrix of elliptical distributions -- that is, affine transformations of spherically symmetric distributions -- under the strong contamination…

数据结构与算法 · 计算机科学 2025-04-15 Gleb Novikov

We investigate the problem of center estimation in the high dimensional binary sub-Gaussian Mixture Model with Hidden Markov structure on the labels. We first study the limitations of existing results in the high dimensional setting and…

统计理论 · 数学 2024-06-19 Vahe Karagulyan , Mohamed Ndaoud

Modern data workflows are inherently adaptive, repeatedly querying the same dataset to refine and validate sequential decisions, but such adaptivity can lead to overfitting and invalid statistical inference. Adaptive Data Analysis (ADA)…

机器学习 · 计算机科学 2026-02-10 Joon Suk Huh

Statistical and machine-learning algorithms are frequently applied to high-dimensional data. In many of these applications data is scarce, and often much more costly than computation time. We provide the first sample-efficient…

机器学习 · 计算机科学 2014-02-20 Jayadev Acharya , Ashkan Jafarpour , Alon Orlitsky , Ananda Theertha Suresh

We consider the problem of estimating the common mean of independently sampled data, where samples are drawn in a possibly non-identical manner from symmetric, unimodal distributions with a common mean. This generalizes the setting of…

统计理论 · 数学 2019-07-09 Ankit Pensia , Varun Jog , Po-Ling Loh

We consider the problem of estimation of a linear functional in the Gaussian sequence model where the unknown vector theta in R^d belongs to a class of s-sparse vectors with unknown s. We suggest an adaptive estimator achieving a…

We present an asymptotically optimal $(\epsilon,\delta)$ differentially private mechanism for answering multiple, adaptively asked, $\Delta$-sensitive queries, settling the conjecture of Steinke and Ullman [2020]. Our algorithm has a…

数据结构与算法 · 计算机科学 2021-11-09 Yuval Dagan , Gil Kur

Differentially private (DP) linear regression has received significant attention in the recent theoretical literature, with several approaches proposed to improve error rates. Our work considers the popular high-dimensional regime with…

机器学习 · 统计学 2026-04-28 Simone Bombari , Jialei Luo , Inbar Seroussi , Marco Mondelli

We study the problem of differentially private second moment estimation and present a new algorithm that achieve strong privacy-utility trade-offs even for worst-case inputs under subsamplability assumptions on the data. We call an input…

机器学习 · 计算机科学 2025-05-21 Bar Mahpud , Or Sheffet

We study the problem of robustly estimating the mean or location parameter without moment assumptions. We show that for a large class of symmetric distributions, the same error as in the Gaussian setting can be achieved efficiently. The…

数据结构与算法 · 计算机科学 2023-11-09 Gleb Novikov , David Steurer , Stefan Tiegel

We investigate unbiased high-dimensional mean estimators in differential privacy. We consider differentially private mechanisms whose expected output equals the mean of the input dataset, for every dataset drawn from a fixed bounded…

统计理论 · 数学 2023-12-22 Aleksandar Nikolov , Haohua Tang

For many machine learning algorithms such as $k$-Nearest Neighbor ($k$-NN) classifiers and $ k $-means clustering, often their success heavily depends on the metric used to calculate distances between different data points. An effective…

计算机视觉与模式识别 · 计算机科学 2010-03-03 Chunhua Shen , Junae Kim , Lei Wang

We present novel algorithms for simulation optimization using random directions stochastic approximation (RDSA). These include first-order (gradient) as well as second-order (Newton) schemes. We incorporate both continuous-valued as well as…

最优化与控制 · 数学 2015-08-11 Prashanth L. A. , Shalabh Bhatnagar , Michael Fu , Steve Marcus

Multivariate Gaussian is often used as a first approximation to the distribution of high-dimensional data. Determining the parameters of this distribution under various constraints is a widely studied problem in statistics, and is often…

统计理论 · 数学 2016-02-09 Samuel Balmand , Arnak Dalalyan

We study the estimation of distributional parameters when samples are shown only if they fall in some unknown set $S \subseteq \mathbb{R}^d$. Kontonis, Tzamos, and Zampetakis (FOCS'19) gave a $d^{\mathrm{poly}(1/\varepsilon)}$ time…

统计理论 · 数学 2026-05-12 Jane H. Lee , Anay Mehrotra , Manolis Zampetakis

We present new algorithms for estimating and testing \emph{collision probability}, a fundamental measure of the spread of a discrete distribution that is widely used in many scientific fields. We describe an algorithm that satisfies…

机器学习 · 统计学 2025-04-21 Robert Busa-Fekete , Umar Syed