中文
相关论文

相关论文: Optimal Shrinkage Estimator for High-Dimensional M…

200 篇论文

For any finite point set in $D$-dimensional space equipped with the 1-norm, we present random linear embeddings to $k$-dimensional space, with a new metric, having the following properties. For any pair of points from the point set that are…

概率论 · 数学 2020-11-09 Michael P. Casey

This paper is concerned with estimation and inference for ultrahigh dimensional partially linear single-index models. The presence of high dimensional nuisance parameter and nuisance unknown function makes the estimation and inference…

统计方法学 · 统计学 2024-04-09 Shijie Cui , Xu Guo , Zhe Zhang

In this paper, we are basically discussing on a class of Baranchik type shrinkage estimators of the vector parameter in a location model, with errors belonging to a sub-class of elliptically contoured distributions. We derive conditions…

统计理论 · 数学 2012-03-07 Mohammad Arashi

Many statistical $M$-estimators are based on convex optimization problems formed by the combination of a data-dependent loss function with a norm-based regularizer. We analyze the convergence rates of projected gradient and composite…

机器学习 · 统计学 2012-07-26 Alekh Agarwal , Sahand N. Negahban , Martin J. Wainwright

This paper proposes a novel non-parametric multidimensional convex regression estimator which is designed to be robust to adversarial perturbations in the empirical measure. We minimize over convex functions the maximum (over Wasserstein…

统计理论 · 数学 2020-07-28 Jose Blanchet , Peter W. Glynn , Jun Yan , Zhengqing Zhou

High dimensionality comparable to sample size is common in many statistical problems. We examine covariance matrix estimation in the asymptotic framework that the dimensionality $p$ tends to $\infty$ as the sample size $n$ increases.…

统计理论 · 数学 2007-06-13 Jianqing Fan , Yingying Fan , Jinchi Lv

We are interested in testing general linear hypotheses in a high-dimensional multivariate linear regression model. The framework includes many well-studied problems such as two-sample tests for equality of population means, MANOVA and…

统计方法学 · 统计学 2018-10-05 Haoran Li , Alexander Aue , Debashis Paul

This paper aims to develop an optimality theory for linear discriminant analysis in the high-dimensional setting. A data-driven and tuning free classification rule, which is based on an adaptive constrained $\ell_1$ minimization approach,…

统计方法学 · 统计学 2018-04-10 T. Tony Cai , Linjun Zhang

As an alternative to variable selection or shrinkage in high dimensional regression, we propose to randomly compress the predictors prior to analysis. This dramatically reduces storage and computational bottlenecks, performing well when the…

机器学习 · 统计学 2013-03-26 Rajarshi Guhaniyogi , David B. Dunson

We consider the problem of extracting a low-dimensional, linear latent variable structure from high-dimensional random variables. Specifically, we show that under mild conditions and when this structure manifests itself as a linear space…

机器学习 · 统计学 2015-10-14 Xiongzhi Chen , John D. Storey

We introduce an estimation method for the scaled skewness coefficient of the sample mean of short and long memory linear processes. This method can be extended to estimate higher moments such as curtosis coefficient of the sample mean. Also…

统计理论 · 数学 2020-05-25 Masoud M Nasari , Mohamedou Ould-Haye

We establish minimax optimal rates of convergence for estimation in a high dimensional additive model assuming that it is approximately sparse. Our results reveal an interesting phase transition behavior universal to this class of high…

统计理论 · 数学 2015-03-11 Ming Yuan , Ding-Xuan Zhou

Many statistical settings call for estimating a population parameter, most typically the population mean, based on a sample of matrices. The most natural estimate of the population mean is the arithmetic mean, but there are many other…

统计理论 · 数学 2021-07-16 Asad Lodhia , Keith Levin , Elizaveta Levina

Stein's paradox holds considerable sway in high-dimensional statistics, highlighting that the sample mean, traditionally considered the de facto estimator, might not be the most efficacious in higher dimensions. To address this, the…

计算机视觉与模式识别 · 计算机科学 2023-12-04 Seyedalireza Khoshsirat , Chandra Kambhamettu

In this paper we propose an optimal predictor of a random variable that has either an infinite mean or an infinite variance. The method consists of transforming the random variable such that the transformed variable has a finite mean and…

统计理论 · 数学 2023-03-28 Victor de la Pena , Henryk Gzyl , Silvia Mayoral , Haolin Zou , Demissie Alemayehu

We develop an asymptotic theory for $L^2$ norms of sample mean vectors of high-dimensional data. An invariance principle for the $L^2$ norms is derived under conditions that involve a delicate interplay between the dimension $p$, the sample…

统计理论 · 数学 2015-03-13 Mengyu Xu , Danna Zhang , Wei Biao Wu

Model averaging is an important alternative to model selection with attractive prediction accuracy. However, its application to high-dimensional data remains under-explored. We propose a high-dimensional model averaging method via…

统计理论 · 数学 2025-06-11 Zhengyan Wan , Fang Fang , Binyan Jiang

We study the problem of estimating the mean of a random vector in $\mathbb{R}^d$ based on an i.i.d.\ sample, when the accuracy of the estimator is measured by a general norm on $\mathbb{R}^d$. We construct an estimator (that depends on the…

统计理论 · 数学 2018-06-19 Gábor Lugosi , Shahar Mendelson

We consider the problem of recovering the unknown noise variance in the linear regression model. To estimate the nuisance (a vector of regression coefficients) we use a family of spectral regularisers of the maximum likelihood estimator.…

统计理论 · 数学 2017-11-28 Yuri Golubev , Ekaterina Krymova

Density estimation plays a key role in many tasks in machine learning, statistical inference, and visualization. The main bottleneck in high-dimensional density estimation is the prohibitive computational cost and the slow convergence rate.…

机器学习 · 计算机科学 2021-10-22 Liang Ding , Lu Zou , Wenjia Wang , Shahin Shahrampour , Rui Tuo