English
Related papers

Related papers: Generalized information criterion for model select…

200 papers

A common failure mode of density models trained as variational autoencoders is to model the data without relying on their latent variables, rendering these variables useless. Two contributing factors, the underspecification of the model and…

Machine Learning · Statistics 2022-05-10 Gábor Melis , András György , Phil Blunsom

In this paper, we consider the partially linear single-index models with longitudinal data. To deal with the variable selection problem in this context, we propose a penalized procedure combined with two bias correction methods, resulting…

Methodology · Statistics 2014-02-10 Gaorong Li , Peng Lai , Heng Lian

Motivated by regression analysis for microbiome compositional data, this paper considers generalized linear regression analysis with compositional covariates, where a group of linear constraints on regression coefficients are imposed to…

Methodology · Statistics 2018-01-11 Jiarui Lu , Pixu Shi , Hongzhe Li

After reviewing unnormalized and normalized information distances based on incomputable notions of Kolmogorov complexity, we discuss how Kolmogorov complexity can be approximated by data compression algorithms. We argue that optimal…

Computational Complexity · Computer Science 2007-05-23 Alexei Kaltchenko

Classic Bayesian methods with complex models are frequently infeasible due to an intractable likelihood. Simulation-based inference methods, such as Approximate Bayesian Computing (ABC), calculate posteriors without accessing a likelihood…

Computation · Statistics 2026-01-09 Elliot Maceda , Emily C. Hector , Amanda Lenzi , Brian J. Reich

The performance of machine learning classification algorithms are evaluated by estimating metrics, often from the confusion matrix, using training data and cross-validation. However, these do not prove that the best possible performance has…

Machine Learning · Statistics 2024-03-05 L. Crow , S. J. Watts

Recent progress has shown that the generalization error of the Gibbs algorithm can be exactly characterized using the symmetrized KL information between the learned hypothesis and the entire training dataset. However, evaluating such a…

Information Theory · Computer Science 2024-10-17 Youheng Zhu , Yuheng Bu

We consider a distributed estimation method in a setting with heterogeneous streams of correlated data distributed across nodes in a network. In the considered approach, linear models are estimated locally (i.e., with only local data)…

Machine Learning · Computer Science 2021-02-11 Lingzhou Hong , Alfredo Garcia , Ceyhun Eksin

High-dimensional data pose challenges in statistical learning and modeling. Sometimes the predictors can be naturally grouped where pursuing the between-group sparsity is desired. Collinearity may occur in real-world high-dimensional…

Machine Learning · Statistics 2011-11-11 Yiyuan She

Covariate adjustment is a commonly used method for total causal effect estimation. In recent years, graphical criteria have been developed to identify all valid adjustment sets, that is, all covariate sets that can be used for this purpose.…

Statistics Theory · Mathematics 2022-05-11 Leonard Henckel , Emilija Perković , Marloes H. Maathuis

Non-random sample selection is a commonplace amongst many empirical studies and it appears when an output variable of interest is available only for a restricted non-random sub-sample of data. We introduce an extension of the generalized…

Statistics Theory · Mathematics 2015-08-18 M. Wojtyś , G. Marra

Various approaches have been developed to upper bound the generalization error of a supervised learning algorithm. However, existing bounds are often loose and even vacuous when evaluated in practice. As a result, they may fail to…

Information Theory · Computer Science 2022-10-19 Gholamali Aminian , Yuheng Bu , Laura Toni , Miguel R. D. Rodrigues , Gregory W. Wornell

We propose a new sparse estimation method, termed MIC (Minimum approximated Information Criterion), for generalized linear models (GLM) in fixed dimensions. What is essentially involved in MIC is the approximation of the $\ell_0$-norm with…

Methodology · Statistics 2018-07-23 Xiaogang Su , Juanjuan Fan , Richard A. Levine , Martha E. Nunn , Chih-Ling Tsai

This article explores the estimation of precision matrices in high-dimensional Gaussian graphical models. We address the challenge of improving the accuracy of maximum likelihood-based precision estimation through penalization.…

Methodology · Statistics 2023-12-27 A. Bekker , A. Kheyri , M. Arashi

If the probability distribution model aims to approximate the hidden mother distribution, it is imperative to establish a useful criterion for the resemblance between the mother and the model distributions. This study proposes a criterion…

Statistics Theory · Mathematics 2025-11-13 Yo Sheena

In this paper we study algorithms to find a Gaussian approximation to a target measure defined on a Hilbert space of functions; the target measure itself is defined via its density with respect to a reference Gaussian measure. We employ the…

Numerical Analysis · Mathematics 2014-08-11 Frank J. Pinski , Gideon Simpson , Andrew M. Stuart , Hendrik Weber

The uncertainty-penalized information criterion (UBIC) has been proposed as a new model-selection criterion for data-driven partial differential equation (PDE) discovery. In this paper, we show that using the UBIC is equivalent to employing…

Machine Learning · Computer Science 2024-04-29 Pongpisit Thanasutives , Ken-ichi Fukui

Adequacy for estimation between an inferential method and a model can be de{\ldots}ned through two main requirements: {\ldots}rstly the inferential tool should de{\ldots}ne a well posed problem when applied to the model; secondly the…

Statistics Theory · Mathematics 2025-07-30 Michel Broniatowski , Justin Moutsouka

We interpret likelihood-based test functions from a geometric perspective where the Kullback-Leibler (KL) divergence is adopted to quantify the distance from a distribution to another. Such a test function can be seen as a sub-Gaussian…

Information Theory · Computer Science 2021-01-05 Yan Wang

For linear models with a diverging number of parameters, it has recently been shown that modified versions of Bayesian information criterion (BIC) can identify the true model consistently. However, in many cases there is little…

Methodology · Statistics 2011-07-26 Heng Lian