English
Related papers

Related papers: Parsimony in Model Selection: Tools for Assessing …

200 papers

The Rashomon effect -- the existence of multiple, distinct models that achieve nearly equivalent predictive performance -- has emerged as a fundamental phenomenon in modern machine learning and statistics. In this paper, we explore the…

Machine Learning · Computer Science 2026-01-15 Harsh Parikh

We use decision theory to confront uncertainty that is sufficiently broad to incorporate "models as approximations." We presume the existence of a featured collection of what we call "structured models" that have explicit substantive…

Theoretical Economics · Economics 2022-08-22 Simone Cerreia-Vioglio , Lars Peter Hansen , Fabio Maccheroni , Massimo Marinacci

Optimization in engineering requires appropriate models. In this article, a regression method for enhancing the predictive power of a model by exploiting expert knowledge in the form of shape constraints, or more specifically, monotonicity…

Ordinal user-provided ratings across multiple items are frequently encountered in both scientific and commercial applications. Whilst recommender systems are known to do well on these type of data from a predictive point of view, their…

Methodology · Statistics 2025-03-05 Sjoerd Hermes

We introduce two new tools to assess the validity of statistical distributions. These tools are based on components derived from a new statistical quantity, the $comparison$ $curve$. The first tool is a graphical representation of these…

Methodology · Statistics 2024-05-16 Gilles R. Ducharme , Teresa Ledwina

We try to establish a unified information theoretic approach to learning and to explore some of its applications. First, we define {\em predictive information} as the mutual information between the past and the future of a time series,…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Ilya Nemenman

Functional linear models are one of the most fundamental tools to assess the relation between two random variables of a functional or scalar nature. This contribution proposes a goodness-of-fit test for the functional linear model with…

In both observational data and randomized control trials, researchers select statistical models to articulate how the outcome of interest varies with combinations of observable covariates. Choosing a model that is too simple can obfuscate…

We explore the arguments for maximizing the `evidence' as an algorithm for model selection. We show, using a new definition of model complexity which we term `flexibility', that maximizing the evidence should appeal to both Bayesian and…

Statistics Theory · Mathematics 2020-04-16 Jonathan Rougier , Carey Priebe

In a regression context, when the relevant subset of explanatory variables is uncertain, it is common to use a data-driven model selection procedure. Classical linear model theory, applied naively to the selected sub-model, may not be valid…

Statistics Theory · Mathematics 2017-12-08 Liang Hong , Todd A. Kuffner , Ryan Martin

Three-dimensional panel models are widely used in empirical analysis. Researchers use various combinations of fixed effects for three-dimensional panels. When one imposes a parsimonious model and the true model is rich, then it incurs…

Econometrics · Economics 2019-05-02 Harold D. Chiang , Joel Rodrigue , Yuya Sasaki

In any given machine learning problem, there may be many models that could explain the data almost equally well. However, most learning algorithms return only one of these models, leaving practitioners with no practical way to explore…

Machine Learning · Computer Science 2022-10-27 Rui Xin , Chudi Zhong , Zhi Chen , Takuya Takagi , Margo Seltzer , Cynthia Rudin

In this work, the distributional properties of the goodness-of-fit term in likelihood-based information criteria are explored. These properties are then leveraged to construct a novel goodness-of-fit test for normal linear regression models…

Methodology · Statistics 2023-09-20 Scott H. Koeneman , Joseph E. Cavanaugh

Networks describe the, often complex, relationships between individual actors. In this work, we address the question of how to determine whether a parametric model, such as a stochastic block model or latent space model, fits a dataset well…

Methodology · Statistics 2025-09-10 Shane Lubold , Bolun Liu , Tyler H. McCormick

The analysis of experimental data with mixed-effects models requires decisions about the specification of the appropriate random-effects structure. Recently, Barr, Levy, Scheepers, and Tily, 2013 recommended fitting `maximal' models with…

Methodology · Statistics 2018-05-29 Douglas Bates , Reinhold Kliegl , Shravan Vasishth , Harald Baayen

Model selection criteria are rules used to select the best statistical model among a set of candidate models, striking a trade-off between goodness of fit and model complexity. Most popular model selection criteria measure the goodness of…

Statistics Theory · Mathematics 2023-04-13 Angel Felipe , Maria Jaenada , Pedro Miranda , Leandro Pardo

Evidence theory is widely used in decision-making and reasoning systems. In previous research, Transferable Belief Model (TBM) is a commonly used evidential decision making model, but TBM is a non-preference model. In order to better fit…

Artificial Intelligence · Computer Science 2024-03-12 Tianxiang Zhan , Zhen Li , Yong Deng

We consider the problem of goodness-of-fit testing for a model that has at least one unknown parameter that cannot be eliminated by transformation. Examples of such problems can be as simple as testing whether a sample consists of…

Methodology · Statistics 2021-04-28 Sean van der Merwe

System identification aims to build models of dynamical systems from data. Traditionally, choosing the model requires the designer to balance between two goals of conflicting nature; the model must be rich enough to capture the system…

Machine Learning · Computer Science 2021-08-09 Antônio H. Ribeiro , Johannes N. Hendriks , Adrian G. Wills , Thomas B. Schön

In this paper we consider sparse and identifiable linear latent variable (factor) and linear Bayesian network models for parsimonious analysis of multivariate data. We propose a computationally efficient method for joint parameter and model…

Machine Learning · Statistics 2011-06-24 Ricardo Henao , Ole Winther