English
Related papers

Related papers: Cross-Validation for Correlated Data

200 papers

This text is a survey on cross-validation. We define all classical cross-validation procedures, and we study their properties for two different goals: estimating the risk of a given estimator, and selecting the best estimator among a given…

Statistics Theory · Mathematics 2017-03-10 Sylvain Arlot

Linear principal component analysis (PCA) can be extended to a nonlinear PCA by using artificial neural networks. But the benefit of curved components requires a careful control of the model complexity. Moreover, standard techniques for…

Machine Learning · Computer Science 2012-04-04 Matthias Scholz

Structural estimation is an important methodology in empirical economics, and a large class of structural models are estimated through the generalized method of moments (GMM). Traditionally, selection of structural models has been performed…

Econometrics · Economics 2018-07-19 Junpei Komiyama , Hajime Shimao

We analyze the statistical properties of generalized cross-validation (GCV) and leave-one-out cross-validation (LOOCV) applied to early-stopped gradient descent (GD) in high-dimensional least squares regression. We prove that GCV is…

Statistics Theory · Mathematics 2024-02-27 Pratik Patil , Yuchen Wu , Ryan J. Tibshirani

Conformal prediction (CP) offers a principled framework for uncertainty quantification, but it fails to guarantee coverage when faced with missing covariates. In addressing the heterogeneity induced by various missing patterns,…

Machine Learning · Statistics 2025-12-17 Jiarong Fan , Juhyun Park. Thi Phuong Thuy Vo , Nicolas Brunel

Variable selection plays a fundamental role in high-dimensional data analysis. Various methods have been developed for variable selection in recent years. Well-known examples are forward stepwise regression (FSR) and least angle regression…

Methodology · Statistics 2018-02-01 Siliang Gong , Kai Zhang , Yufeng Liu

This study examines generalized cross-validation for the tuning parameter selection for ridge regression in high-dimensional misspecified linear models. The set of candidates for the tuning parameter includes not only positive values but…

Statistics Theory · Mathematics 2026-01-21 Akira Shinkyu

Model comparison is the cornerstone of theoretical progress in psychological research. Common practice overwhelmingly relies on tools that evaluate competing models by balancing in-sample descriptive adequacy against model flexibility, with…

Applications · Statistics 2021-10-11 Viet-Hung Dao , David Gunawan , Minh-Ngoc Tran , Robert Kohn , Guy E. Hawkins , Scott D. Brown

The problem of validating or criticising models for georeferenced data is challenging, since the conclusions can vary significantly depending on the locations of the validation set. This work proposes the use of cross-validation techniques…

Computation · Statistics 2018-02-19 Viviana G R Lobo , Thaís C O da Fonseca , Fernando A S Moura

We derive the asymptotic risk function of regularized empirical risk minimization (ERM) estimators tuned by $n$-fold cross-validation (CV). The out-of-sample prediction loss of such estimators converges in distribution to the squared-error…

Statistics Theory · Mathematics 2026-03-24 Karun Adusumilli , Maximilian Kasy , Ashia Wilson

Evaluating the predictive performance of species distribution models (SDMs) under realistic deployment scenarios requires careful handling of spatial and temporal dependencies in the data. Cross-validation (CV) is the standard approach for…

Applications · Statistics 2025-12-22 Diana Koldasbayeva , Alexey Zaytsev

Determining the lack of association between an outcome variable and a number of different explanatory variables is frequently necessary in order to disregard a proposed model. This paper proposes a non-inferiority test for the coefficient…

Methodology · Statistics 2020-02-24 Harlan Campbell

This paper analyzes the approximate control variate (ACV) approach to multifidelity uncertainty quantification in the case where weighted estimators are combined to form the components of the ACV. The weighted estimators enable one to…

Computation · Statistics 2024-02-23 Alex A. Gorodetsky , John D. Jakeman , Michael S. Eldred

Inferring linear relationships lies at the heart of many empirical investigations. A measure of linear dependence should correctly evaluate the strength of the relationship as well as qualify whether it is meaningful for the population.…

Methodology · Statistics 2022-08-16 Kaustubh R. Patil , Simon B. Eickhoff , Robert Langner

When evaluating and comparing models using leave-one-out cross-validation (LOO-CV), the uncertainty of the estimate is typically assessed using the variance of the sampling distribution. Considering the uncertainty is important, as the…

Methodology · Statistics 2022-02-16 Tuomas Sivula , Måns Magnusson , Aki Vehtari

Neural control variates (NCVs) have emerged as a powerful tool for variance reduction in Monte Carlo (MC) simulations, particularly in high-dimensional problems where traditional control variates are difficult to construct analytically. By…

High Energy Physics - Lattice · Physics 2025-08-22 Hyunwoo Oh

Randomized artificial neural networks such as extreme learning machines provide an attractive and efficient method for supervised learning under limited computing ressources and green machine learning. This especially applies when equipping…

Machine Learning · Statistics 2022-01-02 Ansgar Steland , Bart E. Pieters

The (relevance) weighted likelihood was introduced to formally embrace a variety of statistical procedures that trade bias for precision. Unlike its classical counterpart, the weighted likelihood combines all relevant information while…

Statistics Theory · Mathematics 2007-06-13 Xiaogang Wang , James V. Zidek

Post-click conversion rate (CVR) is a reliable indicator of online customers' preferences, making it crucial for developing recommender systems. A major challenge in predicting CVR is severe selection bias, arising from users' inherent…

Artificial Intelligence · Computer Science 2025-12-02 Wenbo Hu , Xin Sun , Qiang liu , Le Wu , Liang Wang

We study the mean-squared error of $k$-fold cross-validation as a risk estimator, with particular emphasis on how its accuracy depends on the number of folds $k$. Despite the widespread use of cross-validation, principled guidance for…

Statistics Theory · Mathematics 2026-05-26 Ido Nachum , Rüdiger Urbanke , Thomas Weinberger