English
Related papers

Related papers: Bayesian leave-one-out cross-validation for large …

200 papers

We derive information theoretic generalization bounds for supervised learning algorithms based on a new measure of leave-one-out conditional mutual information (loo-CMI). Contrary to other CMI bounds, which are black-box bounds that do not…

Machine Learning · Computer Science 2022-07-04 Mohamad Rida Rammal , Alessandro Achille , Aditya Golatkar , Suhas Diggavi , Stefano Soatto

Many domain experts do not have the time or expertise to write formal Bayesian models. This paper takes an informal problem description as input, and combines a large language model and a probabilistic programming language to define a joint…

Machine Learning · Computer Science 2025-10-27 Justin Domke

Usually one compares the accuracy of two competing classifiers via null hypothesis significance tests (nhst). Yet the nhst tests suffer from important shortcomings, which can be overcome by switching to Bayesian hypothesis testing. We…

Machine Learning · Computer Science 2016-11-23 Giorgio Corani , Alessio Benavoli , Janez Demšar , Francesca Mangili , Marco Zaffalon

We generalize fast Gaussian process leave-one-out formulae to multiple-fold cross-validation, highlighting in turn the covariance structure of cross-validation residuals in both Simple and Universal Kriging frameworks. We illustrate how…

Methodology · Statistics 2023-06-06 David Ginsbourger , Cedric Schärer

Modeling non-linear temporal trajectories is of fundamental interest in many application areas, such as in longitudinal microbiome analysis. Many existing methods focus on estimating mean trajectories, but it is also often of value to…

Methodology · Statistics 2020-12-02 Lingjing Jiang , Yuan Zhong , Chris Elrod , Loki Natarajan , Rob Knight , Wesley K. Thompson

We describe a fast computation method for leave-one-out cross-validation (LOOCV) for $k$-nearest neighbours ($k$-NN) regression. We show that, under a tie-breaking condition for nearest neighbours, the LOOCV estimate of the mean square…

Machine Learning · Statistics 2024-12-05 Motonobu Kanagawa

Penalized logistic regression methods are frequently used to investigate the relationship between a binary outcome and a set of explanatory variables. The model performance can be assessed by measures such as the concordance statistic…

Methodology · Statistics 2021-01-20 Angelika Geroldinger , Lara Lusa , Mariana Nold , Georg Heinze

Statistical models can involve implicitly defined quantities, such as solutions to nonlinear ordinary differential equations (ODEs), that unavoidably need to be numerically approximated in order to evaluate the model. The approximation…

Computation · Statistics 2024-09-16 Juho Timonen , Nikolas Siccha , Ben Bales , Harri Lähdesmäki , Aki Vehtari

Subject-exclusive cross-validation is the standard evaluation protocol for facial Action Unit (AU) detection, yet reported improvements are often small. We show that cross-validation itself introduces measurable stochastic variance. On…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Saurabh Hinduja , Gurmeet Kaur , Maneesh Bilalpur , Jeffrey Cohn , Shaun Canavan

The masking-one-out (MOO) procedure, masking an observed entry and comparing it versus its imputed values, is a very common procedure for comparing imputation models. We study the optimum of this procedure and generalize it to a missing…

Methodology · Statistics 2025-11-14 Yanjiao Yang , Daniel Suen , Yen-Chi Chen

Estimating out-of-sample risk for models trained on large high-dimensional datasets is an expensive but essential part of the machine learning process, enabling practitioners to optimally tune hyperparameters. Cross-validation (CV) serves…

Statistics Theory · Mathematics 2025-04-28 Parth Nobel , Daniel LeJeune , Emmanuel J. Candès

Emulating the mapping between quantities of interest and their control parameters using surrogate models finds widespread application in engineering design, including in numerical optimization and uncertainty quantification. Gaussian…

Computation · Statistics 2024-07-02 S. Ashwin Renganathan , Kade Carlson

Many varieties of cross validation would be statistically appealing for the estimation of smoothing and other penalized regression hyperparameters, were it not for the high cost of evaluating such criteria. Here it is shown how to…

Methodology · Statistics 2025-11-06 Simon N. Wood

Large Language Models (LLMs) often suffer from overconfidence during inference, particularly when adapted to downstream domain-specific tasks with limited data. Previous work addresses this issue by employing approximate Bayesian estimation…

Machine Learning · Computer Science 2025-01-28 Yibin Wang , Haizhou Shi , Ligong Han , Dimitris Metaxas , Hao Wang

Recent likelihood theory produces $p$-values that have remarkable accuracy and wide applicability. The calculations use familiar tools such as maximum likelihood values (MLEs), observed information and parameter rescaling. The usual…

Methodology · Statistics 2008-02-08 M. Bédard , D. A. S. Fraser , A. Wong

Importance sampling (IS) is an efficient stand-in for model refitting in performing (LOO) cross-validation (CV) on a Bayesian model. IS inverts the Bayesian update for a single observation by reweighting posterior samples. The so-called…

Methodology · Statistics 2026-03-26 Joshua C Chang , Xiangting Li , Tianyi Su , Shixin Xu , Hao-Ren Yao , Julia Porcino , Carson Chow

Bayesian optimization (BO) is a sequential decision-making tool widely used for optimizing expensive black-box functions. Recently, Large Language Models (LLMs) have shown remarkable adaptability in low-data regimes, making them promising…

Machine Learning · Computer Science 2025-10-10 Chih-Yu Chang , Milad Azvar , Chinedum Okwudire , Raed Al Kontar

Cross-validation (CV) is a popular method for model-selection. Unfortunately, it is not immediately obvious how to apply CV to unsupervised or exploratory contexts. This thesis discusses some extensions of cross-validation to unsupervised…

Methodology · Statistics 2009-09-17 Patrick O. Perry

Cross-validation is a widely used technique for evaluating the performance of prediction models, ranging from simple binary classification to complex precision medicine strategies. It helps correct for optimism bias in error estimates,…

The problem of validating or criticising models for georeferenced data is challenging, since the conclusions can vary significantly depending on the locations of the validation set. This work proposes the use of cross-validation techniques…

Computation · Statistics 2018-02-19 Viviana G R Lobo , Thaís C O da Fonseca , Fernando A S Moura