English
Related papers

Related papers: Generalized information criterion for model select…

200 papers

This paper presents a novel information value function that can be used in online sensor planning to monitor a spatial phenomenon in which the spatial phenomenon is modeled by nonparametric Gaussian processes. The information value function…

Information Theory · Computer Science 2014-06-13 Hongchuan Wei , Wenjie Lu , Silvia Ferrari

The first investigation is made of designs for screening experiments where the response variable is approximated by a generalised linear model. A Bayesian information capacity criterion is defined for the selection of designs that are…

Methodology · Statistics 2016-10-27 David C. Woods , James M. McGree , Susan M. Lewis

Longitudinal data are common in clinical trials and observational studies, where missing outcomes due to dropouts are always encountered. Under such context with the assumption of missing at random, the weighted generalized estimating…

Methodology · Statistics 2019-04-30 Chixiang Chen , Biyi Shen , Lijun Zhang , Yuan Xue , Ming Wang

In segmented regression, when the regression function is continuous at the change-points that are the boundaries of the segments, it is also called joinpoint regression, and the analysis package developed by \cite{KimFFM00} has become a…

Methodology · Statistics 2025-06-11 Kazuki Nakajima , Yoshiyuki Ninomiya

We derive a closed form solution for the Kullback-Leibler divergence between two generalized gamma distributions. These notes are meant as a reference and provide a guided tour towards a result of practical interest that is rarely…

Information Theory · Computer Science 2014-01-28 Christian Bauckhage

Bayesian methodologies prioritising accurate associations above sparsity in Gaussian graphical model (GGM) estimation remain relatively scarce in scientific literature. It is well accepted that the $\ell_2$ penalty enjoys a smaller…

Methodology · Statistics 2022-10-31 J. Smith , M. Arashi , A. Bekker

Model averaging is a useful and robust method for dealing with model uncertainty in statistical analysis. Often, it is useful to consider data subset selection at the same time, in which model selection criteria are used to compare models…

Methodology · Statistics 2023-10-26 Ethan T. Neil , Jacob W. Sitison

In data-driven optimization, the sample performance of the obtained decision typically incurs an optimistic bias against the true performance, a phenomenon commonly known as the Optimizer's Curse and intimately related to overfitting in…

Machine Learning · Computer Science 2025-07-22 Garud Iyengar , Henry Lam , Tianyu Wang

This paper addresses the use of experimental data for calibrating a computer model and improving its predictions of the underlying physical system. A global statistical approach is proposed in which the bias between the computer model and…

Applications · Statistics 2013-02-27 François Bachoc , Guillaume Bois , Josselin Garnier , Jean-Marc Martinez

We introduce Generalized Integrated Gradients (GIG), a formal extension of the Integrated Gradients (IG) (Sundararajan et al., 2017) method for attributing credit to the input variables of a predictive model. GIG improves IG by explaining a…

Machine Learning · Computer Science 2019-09-10 John Merrill , Geoff Ward , Sean Kamkar , Jay Budzik , Douglas Merrill

The use of Bayesian information criterion (BIC) in the model selection procedure is under the assumption that the observations are independent and identically distributed (i.i.d.). However, in practice, we do not always have i.i.d. samples.…

Applications · Statistics 2021-05-03 Nan Shen , Bárbara González

A generalized information formula related to logical probability and fuzzy set is deduced from the classical information formula. The new information measure accords with to Popper's criterion for knowledge evolution very much. In…

Information Theory · Computer Science 2007-07-25 Chenguang Lu

The Akaike information criterion (AIC) has been used as a statistical criterion to compare the appropriateness of different dark energy candidate models underlying a particular data set. Under suitable conditions, the AIC is an indirect…

Cosmology and Nongalactic Astrophysics · Physics 2015-05-28 Ming Yang Jeremy Tan , Rahul Biswas

We investigate the problem of estimating the causal effect of a treatment on individual subjects from observational data, this is a central problem in various application domains, including healthcare, social sciences, and online…

Methodology · Statistics 2019-01-30 Ahmed M. Alaa , Mihaela van der Schaar

Inferential challenges that arise when data are censored have been extensively studied under the classical frameworks. In this paper, we provide an alternative generalized inferential model approach whose output is a data-dependent…

Methodology · Statistics 2021-11-16 Joyce Cahoon , Ryan Martin

We introduce a new criterion to determine the order of an autoregressive model fitted to time series data. It has the benefits of the two well-known model selection techniques, the Akaike information criterion and the Bayesian information…

Statistics Theory · Mathematics 2016-08-25 Jie Ding , Vahid Tarokh , Yuhong Yang

Directed acyclic graphs (DAGs) are commonly used to represent causal relationships among random variables in graphical models. Applications of these models arise in the study of physical, as well as biological systems, where directed edges…

Machine Learning · Statistics 2009-12-01 Ali Shojaie , George Michailidis

Modern machine learning approaches excel in static settings where a large amount of i.i.d. training data are available for a given task. In a dynamic environment, though, an intelligent agent needs to be able to transfer knowledge and…

Machine Learning · Computer Science 2023-03-13 Jonas Wildberger , Siyuan Guo , Arnab Bhattacharyya , Bernhard Schölkopf

Penalized generalized estimating equations with Elastic Net or L2-Smoothly Clipped Absolute Deviation penalization are proposed to simultaneously select the most important variables and estimate their effects for longitudinal Gaussian data…

Methodology · Statistics 2012-11-26 Adriaan Blommaert , Niel Hens , Philippe Beutels

Directed acyclic graphs provide a fundamental tool for representing directed dependence structures in multivariate network data, and are widely used to model financial and economic networks. However, accurate and interpretable estimation…

Methodology · Statistics 2026-05-26 Huihang Liu , Wenhui Li , Xinyu Zhang