English
Related papers

Related papers: Model Selection for Explosive Models

200 papers

Recent works have shown explainability and robustness are two crucial ingredients of trustworthy and reliable text classification. However, previous works usually address one of two aspects: i) how to extract accurate rationales for…

Computation and Language · Computer Science 2021-12-21 Dongfang Li , Baotian Hu , Qingcai Chen , Tujie Xu , Jingcong Tao , Yunan Zhang

The linear hazard regression model developed by Aalen is becoming an increasingly popular alternative to the Cox multiplicative hazard regression model. There are no methods in the literature for selecting among different candidate models…

Methodology · Statistics 2026-05-07 Nils Lid Hjort

Many statistical models are given in the form of non-normalized densities with an intractable normalization constant. Since maximum likelihood estimation is computationally intensive for these models, several estimation methods have been…

Statistics Theory · Mathematics 2021-09-01 Takeru Matsuda , Masatoshi Uehara , Aapo Hyvarinen

There are three principle paradigms of statistical inference: (i) Bayesian, (ii) information-based and (iii) frequentist inference. We describe an objective prior (the weighting or $w$-prior) which unifies objective Bayes and…

Machine Learning · Statistics 2015-06-26 Colin H. LaMont , Paul A. Wiggins

Machine learning (ML) enables the development of interatomic potentials that promise the accuracy of first principles methods while retaining the low cost and parallel efficiency of empirical potentials. While ML potentials traditionally…

In-context learning (ICL) allows Transformers to adapt to novel tasks without weight updates, yet the underlying algorithms remain poorly understood. We adopt a statistical decision-theoretic perspective by investigating simple binary…

Machine Learning · Computer Science 2026-03-13 Faris Chaudhry , Siddhant Gadkari

Classical confidence intervals after best subset selection are widely implemented in statistical software and are routinely used to guide practitioners in scientific fields to conclude significance. However, there are increasing concerns in…

Methodology · Statistics 2023-11-27 Huiming Lin , Meng Li

Few-shot Intent Classification (FSIC) is one of the key challenges in modular task-oriented dialog systems. While advanced FSIC methods are similar in using pretrained language models to encode texts and nearest neighbour-based inference…

Computation and Language · Computer Science 2022-10-13 Mohsen Mesgar , Thy Thy Tran , Goran Glavas , Iryna Gurevych

This paper compares three approaches to the problem of selecting among probability models to fit data (1) use of statistical criteria such as Akaike's information criterion and Schwarz's "Bayesian information criterion," (2) maximization of…

Methodology · Statistics 2016-11-04 William B. Poland , Ross D. Shachter

Regularized m-estimators are widely used due to their ability of recovering a low-dimensional model in high-dimensional scenarios. Some recent efforts on this subject focused on creating a unified framework for establishing oracle bounds,…

Methodology · Statistics 2023-09-06 Eduardo F. Mendes , Gabriel J. P. Pinto

Incremental value (IncV) evaluates the performance change from an existing risk model to a new model. It is one of the key considerations in deciding whether a new risk model performs better than the existing one. Problems arise when…

Methodology · Statistics 2020-12-16 Qian M. Zhou , Zhe Lu , Russell J. Brooke , Melissa M Hudson , Yan Yuan

Leave-one-out cross-validation (LOO) and the widely applicable information criterion (WAIC) are methods for estimating pointwise out-of-sample prediction accuracy from a fitted Bayesian model using the log-likelihood evaluated at the…

Computation · Statistics 2017-12-18 Aki Vehtari , Andrew Gelman , Jonah Gabry

There are several methods for model selection in cosmology which have at least two major goals, that of finding the correct model or predicting well. In this work we discuss through a study of well-known model selection methods like Akaike…

Cosmology and Nongalactic Astrophysics · Physics 2021-02-23 Mehdi Rezaei , Mohammad Malekjani

The Bayesian information criterion (BIC), defined as the observed data log likelihood minus a penalty term based on the sample size $N$, is a popular model selection criterion for factor analysis with complete data. This definition has also…

Machine Learning · Statistics 2022-04-21 Jianhua Zhao , Changchun Shang , Shulan Li , Ling Xin , Philip L. H. Yu

In model-based reinforcement learning, planning with an imperfect model of the environment has the potential to harm learning progress. But even when a model is imperfect, it may still contain information that is useful for planning. In…

Machine Learning · Computer Science 2021-03-09 Zaheer Abbas , Samuel Sokota , Erin J. Talvitie , Martha White

Class incremental learning (CIL) aims to learn a model that can not only incrementally accommodate new classes, but also maintain the learned knowledge of old classes. Out-of-distribution (OOD) detection in CIL is to retain this incremental…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Wenjun Miao , Guansong Pang , Trong-Tung Nguyen , Ruohang Fang , Jin Zheng , Xiao Bai

Noting the erroneous proclivity of information-theoretic approaches, like the Akaike information criterion (AIC), to select simpler models while performing model selection with a small sample size, we address the problem of new physics…

High Energy Physics - Phenomenology · Physics 2020-08-12 Srimoy Bhattacharya , Soumitra Nandi , Sunando Kumar Patra , Shantanu Sahoo

The semiparametric linear hazard regression model introduced by McKeague and Sasieni (1994) is an extension of the linear hazard regression model developed by Aalen (1980). Methods of model selection for this type of model are still…

Methodology · Statistics 2026-03-04 Axel Gandy , Nils Lid Hjort

This paper applies the recently axiomatized Optimum Information Principle (minimize the Kullback-Leibler information subject to all relevant information) to nonparametric density estimation, which provides a theoretical foundation as well…

Statistics Theory · Mathematics 2011-03-28 Alexis Akira Toda

We consider a sparse linear regression model, when the number of available predictors, $p$, is much larger than the sample size, $n$, and the number of non-zero coefficients, $p_0$, is small. To choose the regression model in this…

Statistics Theory · Mathematics 2018-05-31 Piotr Szulc