中文
相关论文

相关论文: Statistically Optimal Robust Mean and Covariance E…

200 篇论文

For normal canonical models with $X \sim N_p(\theta, \sigma^{2} I_{p}), \;\; S^{2} \sim \sigma^{2}\chi^{2}_{k}, \;{independent}$, we consider the problem of estimating $\theta$ under scale invariant squared error loss $\frac{\|d-\theta…

统计理论 · 数学 2012-04-30 Othmane Kortbi , Éric Marchand

We study the problem of estimating the mean of a random vector $X$ given a sample of $N$ independent, identically distributed points. We introduce a new estimator that achieves a purely sub-Gaussian performance under the only condition that…

统计理论 · 数学 2017-02-03 Gábor Lugosi , Shahar Mendelson

In this paper, we introduce a class of improved estimators for the mean parameter matrix of a multivariate normal distribution with an unknown variance-covariance matrix. In particular, the main results of [D.Ch\'etelat and M. T.…

统计理论 · 数学 2024-06-25 Arash A. Foroushani , Severien Nkurunziza

Let $Y$ be a $d$-dimensional random vector with unknown mean $\mu$ and covariance matrix $\Sigma$. This paper is motivated by the problem of designing an estimator of $\Sigma$ that admits tight deviation bounds in the operator norm under…

统计理论 · 数学 2018-03-09 Stanislav Minsker , Xiaohan Wei

We consider the eigenvalues of sample covariance matrices of the form $\mathcal{Q}=(\Sigma^{1/2}X)(\Sigma^{1/2}X)^*$. The sample $X$ is an $M\times N$ rectangular random matrix with real independent entries and the population covariance…

概率论 · 数学 2020-09-16 Jinwoong Kwak , Ji Oon Lee , Jaewhi Park

Let $X_1,..., X_N\in\R^n$ be independent centered random vectors with log-concave distribution and with the identity as covariance matrix. We show that with overwhelming probability at least $1 - 3 \exp(-c\sqrt{n}\r)$ one has $ \sup_{x\in…

We provide an estimator of the covariance matrix that achieves the optimal rate of convergence (up to constant factors) in the operator norm under two standard notions of data contamination: We allow the adversary to corrupt an…

统计理论 · 数学 2023-07-21 Pedro Abdalla , Nikita Zhivotovskiy

We consider the estimation problem for jointly stable random variables. Under two specific dependency models: a linear transformation of two independent stable variables and a sub-Gaussian symmetric $\alpha$-stable (S$\alpha$S) vector, we…

信息论 · 计算机科学 2026-01-15 Rayan Chouity , Charbel Hannoun , Jihad Fahs , Ibrahim Abou-Faycal

Differential entropy and log determinant of the covariance matrix of a multivariate Gaussian distribution have many applications in coding, communications, signal processing and statistical inference. In this paper we consider in the high…

统计理论 · 数学 2015-03-10 T. Tony Cai , Tengyuan Liang , Harrison H. Zhou

We study the problem of robust estimation under heterogeneous corruption rates, where each sample may be independently corrupted with a known but non-identical probability. This setting arises naturally in distributed and federated…

机器学习 · 计算机科学 2025-10-02 Syomantak Chaudhuri , Jerry Li , Thomas A. Courtade

We provide improved differentially private algorithms for identity testing of high-dimensional distributions. Specifically, for $d$-dimensional Gaussian distributions with known covariance $\Sigma$, we can test whether the distribution…

数据结构与算法 · 计算机科学 2022-07-26 Shyam Narayanan

Cumulative sum (CUSUM) statistics are widely used in the change point inference and identification. For the problem of testing for existence of a change point in an independent sample generated from the mean-shift model, we introduce a…

统计理论 · 数学 2021-01-05 Mengjia Yu , Xiaohui Chen

High-dimensional covariance estimation is notoriously sensitive to outliers. While statistically optimal estimators exist for general heavy-tailed distributions, they often rely on computationally expensive techniques like semidefinite…

机器学习 · 统计学 2026-01-06 Even He

The asymptotic behaviour of Linear Spectral Statistics (LSS) of the smoothed periodogram estimator of the spectral coherency matrix of a complex Gaussian high-dimensional time series $(\y_n)_{n \in \mathbb{Z}}$ with independent components…

信息论 · 计算机科学 2021-12-01 Philippe Loubaton , Alexis Rosuel

Let $\varepsilon_1,\ldots,\varepsilon_n$ be independent identically distributed Rademacher random variables, that is $\mathbb{P}\{\varepsilon_i=\pm1\}=1/2$. Let $S_n=a_1\varepsilon_1+\cdots+a_n\varepsilon_n$, where…

概率论 · 数学 2015-06-02 Vidmantas Kastytis Bentkus , Dainius Dzindzalieta

The use of massive survival data has become common in survival analysis. In this study, a subsampling algorithm is proposed for the Cox proportional hazards model with time-dependent covariates when the sample is extraordinarily large but…

统计计算 · 统计学 2023-02-07 Nan Qiao , Wangcheng Li , Feng Xiao , Cunjie Lin , Yong Zhou

Regularized linear regression under the $\ell_1$ penalty, such as the Lasso, has been shown to be effective in variable selection and sparse modeling. The sampling distribution of an $\ell_1$-penalized estimator $\hat{\beta}$ is hard to…

统计方法学 · 统计学 2014-12-24 Qing Zhou

Consider the sample covariance matrix $$\Sigma^{1/2}XX^T\Sigma^{1/2}$$ where $X$ is an $M\times N$ random matrix with independent entries and $\Sigma$ is an $M\times M$ diagonal matrix. It is known that if $\Sigma$ is deterministic, then…

概率论 · 数学 2023-02-27 Ji Oon Lee , Yiting Li

We study the problem of estimating the covariance matrix of a high-dimensional distribution when a small constant fraction of the samples can be arbitrarily corrupted. Recent work gave the first polynomial time algorithms for this problem…

机器学习 · 计算机科学 2019-06-12 Yu Cheng , Ilias Diakonikolas , Rong Ge , David Woodruff

We present an optimal transport framework for performing regression when both the covariate and the response are probability distributions on a compact Euclidean subset $\Omega\subset\mathbb{R}^d$, where $d>1$. Extending beyond compactly…

统计理论 · 数学 2024-03-05 Laya Ghodrati , Victor M. Panaretos