中文
相关论文

相关论文: Optimal Shrinkage of Eigenvalues in the Spiked Cov…

200 篇论文

A class of robust estimators of scatter applied to information-plus-impulsive noise samples is studied, where the sample information matrix is assumed of low rank; this generalizes the study of (Couillet et al., 2013b) to spiked random…

概率论 · 数学 2014-05-01 Romain Couillet

This paper proposes a statistically optimal approach for learning a function value using a confidence interval in a wide range of models, including general non-parametric estimation of an expected loss described as a stochastic programming…

机器学习 · 统计学 2025-08-07 Arnab Ganguly , Tobias Sutter

We study the problem of high-dimensional covariance estimation under the constraint that the partial correlations are nonnegative. The sign constraints dramatically simplify estimation: the Gaussian maximum likelihood estimator is well…

统计理论 · 数学 2020-07-31 Jake A. Soloff , Adityanand Guntuboyina , Michael I. Jordan

We develop an adaptive monotone shrinkage estimator for regression models with the following characteristics: i) dense coefficients with small but important effects; ii) a priori ordering that indicates the probable predictive importance of…

统计方法学 · 统计学 2015-05-08 Zhuang Ma , Dean Foster , Robert Stine

We study risk of the minimum norm linear least squares estimator in when the number of parameters $d$ depends on $n$, and $\frac{d}{n} \rightarrow \infty$. We assume that data has an underlying low rank structure by restricting ourselves to…

机器学习 · 统计学 2020-02-19 Yasaman Mahdaviyeh , Zacharie Naulet

We develop a general framework for estimating function-valued parameters under equality or inequality constraints in infinite-dimensional statistical models. Such constrained learning problems are common across many areas of statistics and…

机器学习 · 统计学 2025-07-22 Razieh Nabi , Nima S. Hejazi , Mark J. van der Laan , David Benkeser

The determination of the covariance matrix and its inverse, the precision matrix, is critical in the statistical analysis of cosmological measurements. The covariance matrix is typically estimated with a limited number of simulations at…

宇宙学与河外天体物理 · 物理学 2025-01-22 Marnix J. Looijmans , Mike Shengbo Wang , Florian Beutler

In a linear regression model with random design, we consider a family of candidate models from which we want to select a `good' model for prediction out-of-sample. We fit the models using block shrinkage estimators, and we focus on the…

统计理论 · 数学 2018-09-13 Hannes Leeb , Nina Senitschnig

The Metropolis-Hastings algorithm has been extensively studied in the estimation and simulation literature, with most prior work focusing on convergence behavior and asymptotic theory. However, its covariance structure-an important…

统计计算 · 统计学 2026-03-03 Jingyi Zhang , James C. Spall

We develop and evaluate point and interval estimates for the random effects $\theta_i$, having made observations $y_i|\theta_i\stackrel{\m athit{ind}}{\sim}N[\theta_i,V_i],i=1,...,k$ that follow a two-level Normal hierarchical model.…

统计方法学 · 统计学 2011-08-17 Carl Morris , Ruoxi Tang

We consider general high-dimensional spiked sample covariance models and show that their leading sample spiked eigenvalues and their linear spectral statistics are asymptotically independent when the sample size and dimension are…

统计理论 · 数学 2020-09-25 Zhixiang Zhang , Shurong Zheng , Guangming Pan , Pingshou Zhong

In recent years, sparse principal component analysis has emerged as an extremely popular dimension reduction technique for high-dimensional data. The theoretical challenge, in the simplest case, is to estimate the leading eigenvector of a…

统计理论 · 数学 2016-09-29 Tengyao Wang , Quentin Berthet , Richard J. Samworth

Estimating covariance matrices is a problem of fundamental importance in multivariate statistics. In practice it is increasingly frequent to work with data matrices $X$ of dimension $n\times p$, where $p$ and $n$ are both large. Results…

统计理论 · 数学 2009-01-22 Noureddine El Karoui

In this paper, we prove that functional sliced inverse regression (FSIR) achieves the optimal (minimax) rate for estimating the central space in functional sufficient dimension reduction problems. First, we provide a concentration…

统计理论 · 数学 2025-04-16 Rui Chen , Songtao Tian , Dongming Huang , Qian Lin , Jun S. Liu

We consider in this paper the problem of optimal experiment design where a decision maker can choose which points to sample to obtain an estimate $\hat{\beta}$ of the hidden parameter $\beta^{\star}$ of an underlying linear model. The key…

机器学习 · 统计学 2021-01-01 Xavier Fontaine , Pierre Perrault , Michal Valko , Vianney Perchet

In this paper we propose a dimension-reduction strategy in order to improve the performance of importance sampling in high dimension. The idea is to estimate variance terms in a small number of suitably chosen directions. We first prove…

统计计算 · 统计学 2022-03-24 Maxime ElMasri , Jérôme Morio , Florian Simatos

The beta regression model is a useful framework to model response variables that are rates or proportions, that is to say, response variables which are continuous and restricted to the interval (0,1). As with any other regression model,…

统计方法学 · 统计学 2024-06-27 Luis Firinguetti , Manuel González-Navarrete , Romer Machaca-Aguilar

Survey sampling is concerned with the estimation of finite population parameters. In practice, survey data suffer from item nonresponse, which is commonly handled through imputation, i.e., replacing missing values with predicted values. As…

统计方法学 · 统计学 2026-03-06 Ziming An , Mehdi Dagdoug , David Haziza

Longitudinal biomedical studies monitor individuals over time to capture dynamics in brain development, disease progression, and treatment effects. However, estimating trajectories of brain biomarkers is challenging due to biological…

机器学习 · 计算机科学 2025-04-15 Vasiliki Tassopoulou , Haochang Shou , Christos Davatzikos

The problem of estimating sparse eigenvectors of a symmetric matrix attracts a lot of attention in many applications, especially those with high dimensional data set. While classical eigenvectors can be obtained as the solution of a…

机器学习 · 统计学 2016-11-03 Konstantinos Benidis , Ying Sun , Prabhu Babu , Daniel P. Palomar