English
Related papers

Related papers: A Comparative Study of Model Selection Criteria fo…

200 papers

Model selection criteria are one of the most important tools in statistics. Proofs showing a model selection criterion is asymptotically optimal are tailored to the type of model (linear regression, quantile regression, penalized…

Statistics Theory · Mathematics 2025-10-17 Amaze Lusompa

The first investigation is made of designs for screening experiments where the response variable is approximated by a generalised linear model. A Bayesian information capacity criterion is defined for the selection of designs that are…

Methodology · Statistics 2016-10-27 David C. Woods , James M. McGree , Susan M. Lewis

This paper derives a Minimum Message Length (MML) criterion for the model selection of the Autoregressive Moving Average (ARMA) time series model. The MML87 performances on the ARMA model compared with other well known model selection…

Information Theory · Computer Science 2022-03-02 Zheng Fang , David L. Dowe , Shelton Peiris , Dedi Rosadi

Watanabe-Akaike information criterion (WAIC; Watanabe, 2010) and leave-one-out cross validation (LOO) are two fully Bayesian model selection methods that have been shown to perform better than other traditional information-criterion based…

Applications · Statistics 2018-06-27 Luo Yong

Longitudinal data are common in clinical trials and observational studies, where missing outcomes due to dropouts are always encountered. Under such context with the assumption of missing at random, the weighted generalized estimating…

Methodology · Statistics 2019-04-30 Chixiang Chen , Biyi Shen , Lijun Zhang , Yuan Xue , Ming Wang

Many promising approaches to symbolic regression have been presented in recent years, yet progress in the field continues to suffer from a lack of uniform, robust, and transparent benchmarking standards. In this paper, we address this…

Neural and Evolutionary Computing · Computer Science 2021-08-02 William La Cava , Patryk Orzechowski , Bogdan Burlacu , Fabrício Olivetti de França , Marco Virgolin , Ying Jin , Michael Kommenda , Jason H. Moore

Unmeasured covariates constitute one of the important problems in causal inference. Even if there are some unmeasured covariates, some instrumental variable methods such as a two-stage residual inclusion (2SRI) estimator, or a…

Methodology · Statistics 2021-12-30 Shunichiro Orihara

The Akaike information criterion (AIC) is a common tool for model selection. It is frequently used in violation of regularity conditions at parameter space singularities and boundaries. The expected AIC is generally not asymptotically…

Statistics Theory · Mathematics 2022-11-09 Jonathan D. Mitchell , Elizabeth S. Allman , John A. Rhodes

We test three common information criteria (IC) for selecting the order of a Hawkes process with an intensity kernel that can be expressed as a mixture of exponential terms. These processes find application in high-frequency financial data…

Statistical Finance · Quantitative Finance 2017-04-05 J. M. Chen , A. G. Hawkes , E. Scalas , M. Trinh

This paper introduces a new method for model selection and more generally hyperparameter selection in machine learning. Minimum description length (MDL) is an established method for model selection, which is however not directly aimed at…

Machine Learning · Computer Science 2019-05-23 Mojtaba Abolfazli , Anders Host-Madsen , June Zhang

Non-concave penalized maximum likelihood methods, such as the Bridge, the SCAD, and the MCP, are widely used because they not only do parameter estimation and variable selection simultaneously but also have a high efficiency as compared to…

Methodology · Statistics 2015-12-31 Yuta Umezu , Yusuke Shimizu , Hiroki Masuda , Yoshiyuki Ninomiya

This paper examines the limit properties of information criteria (such as AIC, BIC, HQIC) for distinguishing between the unit root model and the various kinds of explosive models. The explosive models include the local-to-unit-root model,…

Statistics Theory · Mathematics 2021-07-22 Yubo Tao , Jun Yu

Linear mixed effects models are highly flexible in handling a broad range of data types and are therefore widely used in applications. A key part in the analysis of data is model selection, which often aims to choose a parsimonious model…

Methodology · Statistics 2013-06-12 Samuel Müller , J. L. Scealy , A. H. Welsh

Symbolic Regression aims to automatically identify compact and interpretable mathematical expressions that model the functional relationship between input and output variables. Most existing search-based symbolic regression methods…

Machine Learning · Computer Science 2026-01-22 Jianwen Sun , Xinrui Li , Fuqing Li , Xiaoxuan Shen

Symbolic regression is a nonlinear regression method which is commonly performed by an evolutionary computation method such as genetic programming. Quantification of uncertainty of regression models is important for the interpretation of…

Machine Learning · Computer Science 2022-09-15 Fabricio Olivetti de Franca , Gabriel Kronberger

Symbolic regression is an important but challenging research topic in data mining. It can detect the underlying mathematical models. Genetic programming (GP) is one of the most popular methods for symbolic regression. However, its…

Data Structures and Algorithms · Computer Science 2017-05-16 Chen Chen , Changtong Luo , Zonglin Jiang

In segmented regression, when the regression function is continuous at the change-points that are the boundaries of the segments, it is also called joinpoint regression, and the analysis package developed by \cite{KimFFM00} has become a…

Methodology · Statistics 2025-06-11 Kazuki Nakajima , Yoshiyuki Ninomiya

A better understanding of dispersion in natural streams requires knowledge of longitudinal dispersion coefficient(LDC). Various methods have been proposed for predictions of LDC. Those studies can be grouped into three types: analytical,…

Machine Learning · Computer Science 2021-07-19 Yifeng Zhao , Zicheng Liu , Pei Zhang , S. A. Galindo-Torres , Stan Z. Li

The Misspecification-Resistant Information Criterion (MRIC) proposed in [H.-L. Hsu, C.-K. Ing, H. Tong: On model selection from a finite family of possibly misspecified time series models. The Annals of Statistics. 47 (2), 1061--1087…

Statistics Theory · Mathematics 2022-02-21 Gery Andrés Díaz Rubio , Simone Giannerini , Greta Goracci

Given a random sample from a multivariate population, estimating the number of large eigenvalues of the population covariance matrix is an important problem in Statistics with wide applications in many areas. In the context of Principal…

Statistics Theory · Mathematics 2020-11-10 Abhinav Chakraborty , Soumendu Sundar Mukherjee , Arijit Chakrabarti