English
Related papers

Related papers: Learning under Singularity: An Information Criteri…

200 papers

Model selection and order selection problems frequently arise in statistical practice. A popular approach to addressing these problems in the frequentist setting involves information criteria based on penalised maxima of log-likelihoods for…

Statistics Theory · Mathematics 2025-10-29 Hien Duy Nguyen , Mayetri Gupta , Jacob Westerhout , TrungTin Nguyen

We introduce a generalized information criterion that contains other well-known information criteria, such as Bayesian information Criterion (BIC) and Akaike information criterion (AIC), as special cases. Furthermore, the proposed spectral…

Methodology · Statistics 2023-08-21 L. Martino , R. San Millan-Castillo , E. Morgado

In this work, we propose a modified Bayesian Information Criterion (BIC) specifically designed for mixture models and hierarchical structures. This criterion incorporates the determinant of the Hessian matrix of the log-likelihood function,…

In the problem of selecting variables in a multivariate linear regression model, we derive new Bayesian information criteria based on a prior mixing a smooth distribution and a delta distribution. Each of them can be interpreted as a fusion…

Statistics Theory · Mathematics 2022-09-29 Haruki Kono , Tatsuya Kubokawa

In regular statistical models, the leave-one-out cross-validation is asymptotically equivalent to the Akaike information criterion. However, since many learning machines are singular statistical models, the asymptotic behavior of the…

Machine Learning · Computer Science 2010-10-15 Sumio Watanabe

The widely applicable information criterion (WAIC) has been used as a model selection criterion for Bayesian statistics in recent years. It is an asymptotically unbiased estimator of the Kullback-Leibler divergence between a Bayesian…

Methodology · Statistics 2022-08-09 Yoshiyuki Ninomiya

We consider a sparse linear regression model, when the number of available predictors, $p$, is much larger than the sample size, $n$, and the number of non-zero coefficients, $p_0$, is small. To choose the regression model in this…

Statistics Theory · Mathematics 2018-05-31 Piotr Szulc

For linear models with a diverging number of parameters, it has recently been shown that modified versions of Bayesian information criterion (BIC) can identify the true model consistently. However, in many cases there is little…

Methodology · Statistics 2011-07-26 Heng Lian

The Bayesian and Akaike information criteria aim at finding a good balance between under- and over-fitting. They are extensively used every day by practitioners. Yet we contend they suffer from at least two afflictions: their penalty…

Statistics Theory · Mathematics 2026-03-20 Sylvain Sardy , Maxime van Cutsem , Sara van de Geer

When the training data in a two-class classification problem is overwhelmed by one class, most classification techniques fail to correctly identify the data points belonging to the underrepresented class. We propose Similarity-based…

Machine Learning · Statistics 2019-03-07 Arash Pourhabib

Unmeasured covariates constitute one of the important problems in causal inference. Even if there are some unmeasured covariates, some instrumental variable methods such as a two-stage residual inclusion (2SRI) estimator, or a…

Methodology · Statistics 2021-12-30 Shunichiro Orihara

The efficacy of family-based approaches to mixture model-based clustering and classification depends on the selection of parsimonious models. Current wisdom suggests the Bayesian information criterion (BIC) for mixture model selection.…

Methodology · Statistics 2013-11-12 Sakyajit Bhattacharya , Paul D. McNicholas

Model selection is of fundamental importance to high dimensional modeling featured in many contemporary applications. Classical principles of model selection include the Kullback-Leibler divergence principle and the Bayesian principle,…

Statistics Theory · Mathematics 2016-05-12 Jinchi Lv , Jun S. Liu

In the field of spatial data analysis, spatially varying coefficients (SVC) models, which allow regression coefficients to vary by region and flexibly capture spatial heterogeneity, have continued to be developed in various directions.…

Methodology · Statistics 2025-10-14 Yuko Kakikawa , Yoshiyuki Ninomiya

Popular statistical software provides Bayesian information criterion (BIC) for multilevel models or linear mixed models. However, it has been observed that the combination of statistical literature and software documentation has led to…

Methodology · Statistics 2022-06-24 Sun-Joo Cho , Hao Wu , Matthew Naveiras

Finite mixture models are ubiquitous in modern statistical modeling, and a recurring practical issue is choosing the model order. In \citet[Sankhy\=a Series A, \textbf62, pp. 49--66]{keribin2000consistent}, the Bayesian information…

Statistics Theory · Mathematics 2026-02-03 Hien Duy Nguyen , TrungTin Nguyen

Bayesian model averaging is a practical method for dealing with uncertainty due to model specification. Use of this technique requires the estimation of model probability weights. In this work, we revisit the derivation of estimators for…

Methodology · Statistics 2024-02-05 Ethan T. Neil , Jacob W. Sitison

In model selection literature, two classes of criteria perform well asymptotically in different situations: Bayesian information criterion (BIC) (as a representative) is consistent in selection when the true model is finite dimensional…

Statistics Theory · Mathematics 2012-02-03 Wei Liu , Yuhong Yang

We view the Information Bottleneck Principle (IBP: Tishby et al., 1999; Schwartz-Ziv and Tishby, 2017) and Predictive Information Bottleneck Principle (PIBP: Still et al., 2007; Alemi, 2019) as special cases of a family of general…

Machine Learning · Computer Science 2019-12-24 Sayandev Mukherjee

The uncertainty-penalized information criterion (UBIC) has been proposed as a new model-selection criterion for data-driven partial differential equation (PDE) discovery. In this paper, we show that using the UBIC is equivalent to employing…

Machine Learning · Computer Science 2024-04-29 Pongpisit Thanasutives , Ken-ichi Fukui