English
Related papers

Related papers: Getting the model right; an information criterion …

200 papers

Classical confidence intervals after best subset selection are widely implemented in statistical software and are routinely used to guide practitioners in scientific fields to conclude significance. However, there are increasing concerns in…

Methodology · Statistics 2023-11-27 Huiming Lin , Meng Li

Model selection is a pivotal process in the quantitative sciences, where researchers must navigate between numerous candidate models of varying complexity. Traditional information criteria, such as the corrected Akaike Information Criterion…

Quantitative Methods · Quantitative Biology 2025-12-16 Jakob Vanhoefer , Antonia Körner , Domagoj Doresic , Jan Hasenauer , Dilan Pathirana

In segmented regression, when the regression function is continuous at the change-points that are the boundaries of the segments, it is also called joinpoint regression, and the analysis package developed by \cite{KimFFM00} has become a…

Methodology · Statistics 2025-06-11 Kazuki Nakajima , Yoshiyuki Ninomiya

Selecting the number of regimes in Hidden Markov models is an important problem. There are many criteria that are used to select this number, such as Akaike information criterion (AIC), Bayesian information criterion (BIC), integrated…

Methodology · Statistics 2024-09-23 Bouchra R Nasri , Bruno N Rémillard , Mamadou Y Thioub

Double-descent refers to the unexpected drop in test loss of a learning algorithm beyond an interpolating threshold with over-parameterization, which is not predicted by information criteria in their classical forms due to the limitations…

Machine Learning · Computer Science 2023-11-15 Haobo Chen , Yuheng Bu , Gregory W. Wornell

This paper considers the problem of approximating a density when it can be evaluated up to a normalizing constant at a limited number of points. We call this problem the Boltzmann approximation (BA) problem. The BA problem is ubiquitous in…

Methodology · Statistics 2020-10-08 Youngjun Choe , Yen-Chi Chen , Nick Terry

We have recently proposed a new information-based approach to model selection, the Frequentist Information Criterion (FIC), that reconciles information-based and frequentist inference. The purpose of this current paper is to provide a…

Data Analysis, Statistics and Probability · Physics 2015-06-23 Paul A. Wiggins

The uncertainty-penalized information criterion (UBIC) has been proposed as a new model-selection criterion for data-driven partial differential equation (PDE) discovery. In this paper, we show that using the UBIC is equivalent to employing…

Machine Learning · Computer Science 2024-04-29 Pongpisit Thanasutives , Ken-ichi Fukui

Smoothed AIC (S-AIC) and Smoothed BIC (S-BIC) are very widely used in model averaging and are very easily to implement. Especially, the optimal model averaging method MMA and JMA have only been well developed in linear models. Only by…

Methodology · Statistics 2019-10-29 Miaomiao Wang , Xinyu Zhang , Alan T. K. Wan , Guohua Zou

Non-concave penalized maximum likelihood methods, such as the Bridge, the SCAD, and the MCP, are widely used because they not only do parameter estimation and variable selection simultaneously but also have a high efficiency as compared to…

Methodology · Statistics 2015-12-31 Yuta Umezu , Yusuke Shimizu , Hiroki Masuda , Yoshiyuki Ninomiya

There are several methods for model selection in cosmology which have at least two major goals, that of finding the correct model or predicting well. In this work we discuss through a study of well-known model selection methods like Akaike…

Cosmology and Nongalactic Astrophysics · Physics 2021-02-23 Mehdi Rezaei , Mohammad Malekjani

The widely applicable Bayesian information criterion (WBIC) is a simple and fast approximation to the model evidence that has received little practical consideration. WBIC uses the fact that the log evidence can be written as an…

Methodology · Statistics 2016-04-29 N. Friel , J. P. McKeone , C. J. Oates , A. N. Pettitt

Information criteria are an appropriate and widely used tool for solving model selection problems. However, different ways to use them exist, each leading to a more or less precise approximation of the sought model. In this paper, we mainly…

Statistics Theory · Mathematics 2007-06-13 Guilhem Coq , Olivier Alata , Marc Arnaudon , Christian Olivier

The statistical analysis of measurement data has become a key component of many quantum engineering experiments. As standard full state tomography becomes unfeasible for large dimensional quantum systems, one needs to exploit prior…

Quantum Physics · Physics 2012-11-27 Madalin Guta , Theodore Kypraios , Ian Dryden

The Schwarz or Bayesian information criterion (BIC) is one of the most widely used tools for model comparison in social science research. The BIC however is not suitable for evaluating models with order constraints on the parameters of…

Methodology · Statistics 2019-05-01 Joris Mulder , Adrian E. Raftery

Accurate model selection is a fundamental requirement for statistical analysis. In many real-world applications of graphical modelling, correct model structure identification is the ultimate objective. Standard model validation procedures…

Machine Learning · Statistics 2019-08-28 Robert O'Shea

Noting the erroneous proclivity of information-theoretic approaches, like the Akaike information criterion (AIC), to select simpler models while performing model selection with a small sample size, we address the problem of new physics…

High Energy Physics - Phenomenology · Physics 2020-08-12 Srimoy Bhattacharya , Soumitra Nandi , Sunando Kumar Patra , Shantanu Sahoo

For prediction models developed on clustered data that do not account for cluster heterogeneity in model parameterization, it is crucial to use cluster-based validation to assess model generalizability on unseen clusters. This paper…

Methodology · Statistics 2025-06-23 Jiaxing Qiu , Douglas E. Lake , Pavel Chernyavskiy , Teague R. Henry

We emphasize that it is possible to improve the principle of unbiased risk estimation for model selection by addressing excess risk deviations in the design of penalization procedures. Indeed, we propose a modification of Akaike's…

Statistics Theory · Mathematics 2018-07-23 Adrien Saumard , Fabien Navarro

A statistical model or a learning machine is called regular if the map taking a parameter to a probability distribution is one-to-one and if its Fisher information matrix is always positive definite. If otherwise, it is called singular. In…

Machine Learning · Computer Science 2012-09-03 Sumio Watanabe