English
Related papers

Related papers: An information criterion for model selection with …

200 papers

Information of interest can often only be extracted from data by model fitting. When the functional form of such a model can not be deduced from first principles, one has to make a choice between different possible models. A common approach…

Methodology · Statistics 2022-06-22 Jens Thomas , Mathias Lipka

The uncertainty-penalized information criterion (UBIC) has been proposed as a new model-selection criterion for data-driven partial differential equation (PDE) discovery. In this paper, we show that using the UBIC is equivalent to employing…

Machine Learning · Computer Science 2024-04-29 Pongpisit Thanasutives , Ken-ichi Fukui

To characterize the Kullback-Leibler divergence and Fisher information in general parametrized hidden Markov models, in this paper, we first show that the log likelihood and its derivatives can be represented as an additive functional of a…

Statistics Theory · Mathematics 2023-03-15 Cheng-Der Fuh , Chu-Lan Michael Kao , Tianxiao Pang

Penalized likelihood methods with an $\ell_{\gamma}$-type penalty, such as the Bridge, the SCAD, and the MCP, allow us to estimate a parameter and to do variable selection, simultaneously, if $\gamma\in (0,1]$. In this method, it is…

Methodology · Statistics 2016-03-28 Yuta Umezu , Yoshiyuki Ninomiya

Double-descent refers to the unexpected drop in test loss of a learning algorithm beyond an interpolating threshold with over-parameterization, which is not predicted by information criteria in their classical forms due to the limitations…

Machine Learning · Computer Science 2023-11-15 Haobo Chen , Yuheng Bu , Gregory W. Wornell

For the multivariate linear regression model with unknown covariance, the corrected Akaike information criterion is the minimum variance unbiased estimator of the expected Kullback--Leibler discrepancy. In this study, based on the loss…

Statistics Theory · Mathematics 2023-03-20 Takeru Matsuda

Missing data are frequently encountered in high-dimensional problems, but they are usually difficult to deal with using standard algorithms, such as the expectation-maximization (EM) algorithm and its variants. To tackle this difficulty,…

Methodology · Statistics 2018-02-08 Faming Liang , Bochao Jia , Jingnan Xue , Qizhai Li , Ye Luo

The semiparametric estimation approach, which includes inverse-probability-weighted and doubly robust estimation using propensity scores, is a standard tool in causal inference, and it is rapidly being extended in various directions. On the…

Methodology · Statistics 2022-12-29 Takamichi Baba , Yoshiyuki Ninomiya

In this article, we develop a modern perspective on Akaike's Information Criterion and Mallows' Cp for model selection. Despite the diff erences in their respective motivation, they are equivalent in the special case of Gaussian linear…

Statistics Theory · Mathematics 2014-05-27 Aurélie Boisbunon , Stephane Canu , Dominique Fourdrinier , William Strawderman , Martin T. Wells

We consider the problem of full information maximum likelihood (FIML) estimation in a factor analysis model when a majority of the data values are missing. The expectation-maximization (EM) algorithm is often used to find the FIML…

Computation · Statistics 2013-12-20 Kei Hirose , Sunyong Kim , Yutaka Kano , Miyuki Imada , Manabu Yoshida , Masato Matsuo

Missing data has the potential to affect analyses conducted in all fields of scientific study, including healthcare, economics, and the social sciences. Several approaches to unbiased inference in the presence of non-ignorable missingness…

Methodology · Statistics 2020-09-01 Razieh Nabi , Rohit Bhattacharya , Ilya Shpitser

In the information-based paradigm of inference, model selection is performed by selecting the candidate model with the best estimated predictive performance. The success of this approach depends on the accuracy of the estimate of the…

Machine Learning · Statistics 2018-06-11 Colin H. LaMont , Paul A. Wiggins

In statistical modeling area, the Akaike information criterion AIC, is a widely known and extensively used tool for model choice. The {\phi}-divergence test statistic is a recently developed tool for statistical model selection. The…

Methodology · Statistics 2011-10-28 Papa Ngom , Bertrand Ntep

In a Gaussian graphical model, the conditional independence between two variables are characterized by the corresponding zero entries in the inverse covariance matrix. Maximum likelihood method using the smoothly clipped absolute deviation…

Methodology · Statistics 2009-09-07 Xin Gao , Daniel Q. Pu , Yuehua Wu , Hong Xu

The information criterion AIC has been used successfully in many areas of statistical modeling, and since it is derived based on the Taylor expansion of the log-likelihood function and the asymptotic distribution of the maximum likelihood…

Methodology · Statistics 2025-03-12 Genshiro Kitagawa

The problem of model selection is inevitable in an increasingly large number of applications involving partial theoretical knowledge and vast amounts of information, like in medicine, biology or economics. The associated techniques are…

Methodology · Statistics 2015-11-17 Stephane Guerrier , Maria-Pia Victoria-Feser

Selecting an optimal subset of features or instances under an information theoretic criterion has become an effective preprocessing strategy for reducing data complexity while preserving essential information. This study investigates two…

Optimization and Control · Mathematics 2025-08-25 Taotao He , Jun Luo , Junkai Zhao

Pattern-mixture models provide a transparent approach for handling missing data, where the full-data distribution is factorized in a way that explicitly shows the parts that can be estimated from observed data alone, and the parts that…

Methodology · Statistics 2019-04-26 Yen-Chi Chen , Mauricio Sadinle

We introduce a generalized information criterion that contains other well-known information criteria, such as Bayesian information Criterion (BIC) and Akaike information criterion (AIC), as special cases. Furthermore, the proposed spectral…

Methodology · Statistics 2023-08-21 L. Martino , R. San Millan-Castillo , E. Morgado

Model selection based on classical information criteria, such as BIC, is generally computationally demanding, but its properties are well studied. On the other hand, model selection based on parameter shrinkage by $\ell_1$-type penalties is…

Machine Learning · Statistics 2013-07-10 Kun Zhang , Heng Peng , Laiwan Chan , Aapo Hyvarinen