English
Related papers

Related papers: Information Criteria Fail for Dynamical Systems: S…

200 papers

In this paper we introduce a new feature selection algorithm to remove the irrelevant or redundant features in the data sets. In this algorithm the importance of a feature is based on its fitting to the Catastrophe model. Akaike information…

Machine Learning · Computer Science 2017-04-25 Mahdi Zarei

Real-life statistical samples are often plagued by selection bias, which complicates drawing conclusions about the general population. When learning causal relationships between the variables is of interest, the sample may be assumed to be…

Statistics Theory · Mathematics 2018-11-15 Angelos P. Armen , Robin J. Evans

Approximate Bayesian computation (ABC) is a class of algorithmic methods in Bayesian inference using statistical summaries and computer simulations. ABC has become popular in evolutionary genetics and in other branches of biology. However…

Computation · Statistics 2011-05-03 Olivier Francois , Guillaume Laval

For prediction models developed on clustered data that do not account for cluster heterogeneity in model parameterization, it is crucial to use cluster-based validation to assess model generalizability on unseen clusters. This paper…

Methodology · Statistics 2025-06-23 Jiaxing Qiu , Douglas E. Lake , Pavel Chernyavskiy , Teague R. Henry

Aim: The Akaike information Criterion (AIC) is widely used science to make predictions about complex phenomena based on an entire set of models weighted by Akaike weights. This approach (AIC model averaging; hereafter AvgAICc) is often…

Quantitative Methods · Quantitative Biology 2018-07-13 Eliecer E. Gutierrez , Neander M. Heming

In the framework of general relativity, dark energy was proposed to explain the cosmic acceleration. A pivotal inquiry in cosmology is to determine whether dark energy is the cosmological constant, and if not, the challenge lies in…

Cosmology and Nongalactic Astrophysics · Physics 2025-08-08 Peng-Ju Wu

We propose two methods to evaluate the conditional Akaike information (cAI) for nonlinear mixed-effects models with no restriction on cluster size. Method 1 is designed for continuous data and includes formulae for the derivatives of fixed…

Methodology · Statistics 2024-11-22 Nan Zheng , Noel Cadigan , James T. Thorson

Mixture models are becoming a popular tool for the clustering and classification of high-dimensional data. In such high dimensional applications, model selection is problematic. The Bayesian information criterion, which is popular in lower…

Methodology · Statistics 2014-06-06 Sakyajit Bhattacharya , Paul D. McNicholas

Watanabe-Akaike information criterion (WAIC; Watanabe, 2010) and leave-one-out cross validation (LOO) are two fully Bayesian model selection methods that have been shown to perform better than other traditional information-criterion based…

Applications · Statistics 2018-06-27 Luo Yong

The work reported here aims to address the effects of time-dependent parameters and stochasticity on decision-making in biological systems. We achieve this by extending previous studies that resorted to simple normal forms. Yet, we focus…

Quantitative Methods · Quantitative Biology 2018-08-29 Nuno R. Nené , James Rivington , Alexey Zaikin

Smoothed AIC (S-AIC) and Smoothed BIC (S-BIC) are very widely used in model averaging and are very easily to implement. Especially, the optimal model averaging method MMA and JMA have only been well developed in linear models. Only by…

Methodology · Statistics 2019-10-29 Miaomiao Wang , Xinyu Zhang , Alan T. K. Wan , Guohua Zou

Similarity choice data occur when humans make choices among alternatives based on their similarity to a target, e.g., in the context of information retrieval and in embedding learning settings. Classical metric-based models of similarity…

Machine Learning · Computer Science 2025-08-21 Hugo Sales Corrêa , Suryanarayana Sankagiri , Daniel Ratton Figueiredo , Matthias Grossglauser

The Schwarz or Bayesian information criterion (BIC) is one of the most widely used tools for model comparison in social science research. The BIC however is not suitable for evaluating models with order constraints on the parameters of…

Methodology · Statistics 2019-05-01 Joris Mulder , Adrian E. Raftery

It is well understood that Bayesian decision theory and average case analysis are essentially identical. However, if one is interested in performing uncertainty quantification for a numerical task, it can be argued that standard approaches…

Methodology · Statistics 2020-07-16 Chris. J. Oates , Jon Cockayne , Dennis Prangle , T. J. Sullivan , Mark Girolami

Useful chemical processes often involve a desired steady state probability distribution, equilibrium or not, from which product is extracted. Given many different ways to attain the same steady state, which candidate "loses" the least in…

Statistical Mechanics · Physics 2025-07-30 Brendan Lucas , Google Gemini 2. 5 Pro Preview 05-06

The task of item recommendation requires ranking a large catalogue of items given a context. Item recommendation algorithms are evaluated using ranking metrics that depend on the positions of relevant items. To speed up the computation of…

Information Retrieval · Computer Science 2019-12-06 Steffen Rendle

The efficacy of family-based approaches to mixture model-based clustering and classification depends on the selection of parsimonious models. Current wisdom suggests the Bayesian information criterion (BIC) for mixture model selection.…

Methodology · Statistics 2013-11-12 Sakyajit Bhattacharya , Paul D. McNicholas

We consider Bayesian model selection in generalized linear models that are high-dimensional, with the number of covariates p being large relative to the sample size n, but sparse in that the number of active covariates is small compared to…

Statistics Theory · Mathematics 2011-12-26 Rina Foygel , Mathias Drton

Dynamical systems modeling, particularly via systems of ordinary differential equations, has been used to effectively capture the temporal behavior of different biochemical components in signal transduction networks. Despite the recent…

Quantitative Methods · Quantitative Biology 2023-01-06 Nathaniel J. Linden , Boris Kramer , Padmini Rangamani

Datasets encountered when examining deeper issues in ecology and evolution are often complex. This calls for careful strategies for both model building, model selection, and model averaging. Our paper aims at motivating, exhibiting, and…

Applications · Statistics 2026-03-19 Gerda Claeskens , Céline Cunen , Nils Lid Hjort