English
Related papers

Related papers: Consistent model selection in the spiked Wigner mo…

200 papers

Using the Coulomb Fluid method, this paper derives central limit theorems (CLTs) for linear spectral statistics of three "spiked" Hermitian random matrix ensembles. These include Johnstone's spiked model (i.e., central Wishart with spiked…

Statistics Theory · Mathematics 2015-06-18 Damien Passemier , Matthew R. Mckay , Yang Chen

The stochastic block model (SBM) provides a popular framework for modeling community structures in networks. However, more attention has been devoted to problems concerning estimating the latent node labels and the model parameters than the…

Statistics Theory · Mathematics 2016-03-02 Y. X. Rachel Wang , Peter J. Bickel

Variable selection in the linear regression model takes many apparent faces from both frequentist and Bayesian standpoints. In this paper we introduce a variable selection method referred to as a rescaled spike and slab model. We study the…

Statistics Theory · Mathematics 2007-06-13 Hemant Ishwaran , J. Sunil Rao

We introduce a generalized information criterion that contains other well-known information criteria, such as Bayesian information Criterion (BIC) and Akaike information criterion (AIC), as special cases. Furthermore, the proposed spectral…

Methodology · Statistics 2023-08-21 L. Martino , R. San Millan-Castillo , E. Morgado

Generalized $k$-means can be incorporated with any similarity or dissimilarity measure for clustering. By choosing the dissimilarity measure as the well known likelihood ratio or $F$-statistic, this work proposes a method based on…

Methodology · Statistics 2020-08-11 Tonglin Zhang , Ge Lin

This paper considers the problem of approximating a density when it can be evaluated up to a normalizing constant at a limited number of points. We call this problem the Boltzmann approximation (BA) problem. The BA problem is ubiquitous in…

Methodology · Statistics 2020-10-08 Youngjun Choe , Yen-Chi Chen , Nick Terry

Consider a spiked random tensor obtained as a mixture of two components: noise in the form of a symmetric Gaussian $p$-tensor for $p\geq 3$ and signal in the form of a symmetric low-rank random tensor. The latter is defined as a linear…

Probability · Mathematics 2021-10-11 Wei-Kuo Chen , Madeline Handschy , Gilad Lerman

We propose new model selection criteria based on generalized ridge estimators dominating the maximum likelihood estimator under the squared risk and the Kullback-Leibler risk in multivariate linear regression. Our model selection criteria…

Statistics Theory · Mathematics 2016-04-08 Yuichi Mori , Taiji Suzuki

This paper analyzes the generalization error of minimum-norm interpolating solutions in linear regression using spiked covariance data models. The paper characterizes how varying spike strengths and target-spike alignments can affect risk,…

Machine Learning · Statistics 2025-10-03 Jiping Li , Rishi Sonthalia

This short study presents an opportunistic approach to a (more) reliable validation method for prediction uncertainty average calibration. Considering that variance-based calibration metrics (ZMS, NLL, RCE...) are quite sensitive to the…

Machine Learning · Statistics 2024-08-27 Pascal Pernot

We consider a Bayesian approach to variable selection in the presence of high dimensional covariates based on a hierarchical model that places prior distributions on the regression coefficients as well as on the model space. We adopt the…

Statistics Theory · Mathematics 2014-07-28 Naveen Naidu Narisetty , Xuming He

We consider the problem of detecting signals in the rank-one signal-plus-noise data matrix models that generalize the spiked Wishart matrices. We show that the principal component analysis can be improved by pre-transforming the matrix…

Statistics Theory · Mathematics 2021-04-29 Ji Hyung Jung , Hye Won Chung , Ji Oon Lee

Accurate model selection is a fundamental requirement for statistical analysis. In many real-world applications of graphical modelling, correct model structure identification is the ultimate objective. Standard model validation procedures…

Machine Learning · Statistics 2019-08-28 Robert O'Shea

We consider a spiked random matrix model obtained by applying a function entrywise to a signal-plus-noise symmetric data matrix. We prove that the largest eigenvalue of this model, which we call a transformed spiked Wigner matrix, exhibits…

Probability · Mathematics 2025-08-13 Aro Lee , Ji Oon Lee

The statistical regression technique is an extraordinarily essential data fitting tool to explore the potential possible generation mechanism of the random phenomenon. Therefore, the model selection or the variable selection is becoming…

Methodology · Statistics 2020-03-25 Yue Su , Patrick Kandege Mwanakatwe

In statistical learning, models are classified as regular or singular depending on whether the mapping from parameters to probability distributions is injective. Most models with hierarchical structures or latent variables are singular, for…

Machine Learning · Statistics 2025-11-26 Naoki Hayashi , Takuro Kutsuna , Sawa Takamuku

In this article, we investigate the properties of the EBIC in variable selection for generalized linear models with non-canonical links and diverging number of parameters in ultra-high dimensional feature space. The selection consistency of…

Statistics Theory · Mathematics 2011-12-14 Shan Luo , Zehua Chen

Let $\{X_k,k\in{\mathbb{Z}}\}$ be an autoregressive process of order $q$. Various estimators for the order $q$ and the parameters ${\bolds \Theta}_q=(\theta_1,...,\theta_q)^T$ are known; the order is usually determined with Akaike's…

Statistics Theory · Mathematics 2012-05-31 Moritz Jirak

The present manuscript studies signal detection by likelihood ratio tests in a number of spiked random matrix models, including but not limited to Gaussian mixtures and spiked Wishart covariance matrices. We work directly with multi-spiked…

Statistics Theory · Mathematics 2018-04-03 Debapratim Banerjee , Zongming Ma

In this paper, I develop a formula for estimating Bayes factors directly from minimal summary statistics produced in repeated measures analysis of variance designs. The formula, which requires knowing only the $F$-statistic, the number of…

Methodology · Statistics 2022-09-20 Thomas J. Faulkenberry