English
Related papers

Related papers: A generalized AIC for models with singularities an…

200 papers

We have recently proposed a new information-based approach to model selection, the Frequentist Information Criterion (FIC), that reconciles information-based and frequentist inference. The purpose of this current paper is to provide a…

Data Analysis, Statistics and Probability · Physics 2015-06-23 Paul A. Wiggins

Information criteria have had a profound impact on modern ecological science. They allow researchers to estimate which probabilistic approximating models are closest to the generating process. Unfortunately, information criterion comparison…

Methodology · Statistics 2018-05-23 Jose-Miguel Ponciano , Mark L Taper

Model selection in mixed models based on the conditional distribution is appropriate for many practical applications and has been a focus of recent statistical research. In this paper we introduce the R-package cAIC4 that allows for the…

Computation · Statistics 2018-03-20 Benjamin Säfken , David Rügamer , Thomas Kneib , Sonja Greven

Methods for combining predictions from different models in a supervised learning setting must somehow estimate/predict the quality of a model's predictions at unknown future inputs. Many of these methods (often implicitly) make the…

Methodology · Statistics 2014-06-25 Thijs van Ommen

Principal component analysis (PCA) is the most commonly used statistical procedure for dimension reduction. An important issue for applying PCA is to determine the rank, which is the number of dominant eigenvalues of the covariance matrix.…

Methodology · Statistics 2020-08-06 Hung Hung , Su-Yun Huang , Ching-Kang Ing

This paper introduces an estimator of the relative directed distance between an estimated model and the true model, based on the Kulback-Leibler divergence and is motivated by the generalized information criterion proposed by Konishi and…

Methodology · Statistics 2014-03-06 Antonino Abbruzzo , Ivan Vujačić , Ernst Wit , Angelo M. Mineo

We propose two methods to evaluate the conditional Akaike information (cAI) for nonlinear mixed-effects models with no restriction on cluster size. Method 1 is designed for continuous data and includes formulae for the derivatives of fixed…

Methodology · Statistics 2024-11-22 Nan Zheng , Noel Cadigan , James T. Thorson

The information criterion for determining the number of explanatory variables in a subset regression modeling is discussed. Information criterion such as AIC is effective and frequently used in model selection for ordinary regression models…

Methodology · Statistics 2023-09-18 Genshiro Kitagawa

Akaike's Bayesian information criterion (ABIC) has been widely used in geophysical inversion and beyond. However, little has been done to investigate its statistical aspects. We present an alternative derivation of the marginal distribution…

Methodology · Statistics 2023-02-10 Peiliang Xu

Determining how to appropriately select the tuning parameter is essential in penalized likelihood methods for high-dimensional data analysis. We examine this problem in the setting of penalized likelihood methods for generalized linear…

Methodology · Statistics 2016-05-12 Yingying Fan , Cheng Yong Tang

Information theoretic criteria (ITC) have been widely adopted in engineering and statistics for selecting, among an ordered set of candidate models, the one that better fits the observed sample data. The selected model minimizes a penalized…

Machine Learning · Statistics 2019-10-10 Andrea Mariani , Andrea Giorgetti , Marco Chiani

For linear models with a diverging number of parameters, it has recently been shown that modified versions of Bayesian information criterion (BIC) can identify the true model consistently. However, in many cases there is little…

Methodology · Statistics 2011-07-26 Heng Lian

We present a model selection framework for the extraction of the CKM matrix element $|V_{cb}|$ from exclusive $B \to D^* l \nu$ decays. By framing the truncation of the Boyd-Grinstein-Lebed (BGL) parameterization as a model selection task,…

High Energy Physics - Phenomenology · Physics 2024-12-11 Eric Persson , Florian Bernlochner

The first investigation is made of designs for screening experiments where the response variable is approximated by a generalised linear model. A Bayesian information capacity criterion is defined for the selection of designs that are…

Methodology · Statistics 2016-10-27 David C. Woods , James M. McGree , Susan M. Lewis

In data-driven optimization, the sample performance of the obtained decision typically incurs an optimistic bias against the true performance, a phenomenon commonly known as the Optimizer's Curse and intimately related to overfitting in…

Machine Learning · Computer Science 2025-07-22 Garud Iyengar , Henry Lam , Tianyu Wang

In the field of spatial data analysis, spatially varying coefficients (SVC) models, which allow regression coefficients to vary by region and flexibly capture spatial heterogeneity, have continued to be developed in various directions.…

Methodology · Statistics 2025-10-14 Yuko Kakikawa , Yoshiyuki Ninomiya

Non-concave penalized maximum likelihood methods, such as the Bridge, the SCAD, and the MCP, are widely used because they not only do parameter estimation and variable selection simultaneously but also have a high efficiency as compared to…

Methodology · Statistics 2015-12-31 Yuta Umezu , Yusuke Shimizu , Hiroki Masuda , Yoshiyuki Ninomiya

Many problems in statistics and machine learning can be formulated as model selection problems, where the goal is to choose an optimal parsimonious model among a set of candidate models. It is typical to conduct model selection by…

Methodology · Statistics 2024-04-29 Qingyuan Zhang , Hien Duy Nguyen

Model selection in linear regression models is a major challenge when dealing with high-dimensional data where the number of available measurements (sample size) is much smaller than the dimension of the parameter space. Traditional methods…

Signal Processing · Electrical Eng. & Systems 2023-07-05 Prakash B. Gohain , Magnus Jansson

In this paper we have introduced a generalized version of alpha beta skew normal distribution in the same line of Sharafi et al. (2017) and investigated some of its basic properties. The extensions of the proposed distribution have also…

Statistics Theory · Mathematics 2019-10-22 Sricharan Shah , Subrata Chakraborty , Partha Jyoti Hazarika , M. Masoom Ali