English
Related papers

Related papers: Optimal Hold-Out Size in Cross-Validation

200 papers

Reproducibility is a cornerstone of scientific validation and of the authority it confers on its results. Reproducibility in machine learning evaluations leads to greater trust, confidence, and value. However, the ground truth responses…

Machine Learning · Computer Science 2025-12-12 Deepak Pandita , Flip Korn , Chris Welty , Christopher M. Homan

Careful tuning of a regularization parameter is indispensable in many machine learning tasks because it has a significant impact on generalization performances. Nevertheless, current practice of regularization parameter tuning is more of an…

Machine Learning · Statistics 2015-06-23 Atsushi Shibagaki , Yoshiki Suzuki , Masayuki Karasuyama , Ichiro Takeuchi

Contemporary sample size calculations for external validation of risk prediction models require users to specify fixed values of assumed model performance metrics alongside target precision levels (e.g., 95% CI widths). However, due to the…

Applications · Statistics 2026-02-13 Mohsen Sadatsafavi , Paul Gustafson , Solmaz Setayeshgar , Laure Wynants , Richard D Riley

We characterize the maximal attainable power-size gap in overidentified instrumental variables models with heteroskedastic or autocorrelated (HAC) errors. Using total variation distance and Kraft's theorem, we define the decision theoretic…

Econometrics · Economics 2026-03-24 Marcelo J. Moreira , Geert Ridder , Mahrad Sharifvaghefi

Given a high-dimensional covariate matrix and a response vector, ridge-regularized sparse linear regression selects a subset of features that explains the relationship between covariates and the response in an interpretable manner. To…

Optimization and Control · Mathematics 2026-02-13 Ryan Cory-Wright , Andrés Gómez

In computing, as in many aspects of life, changes incur cost. Many optimization problems are formulated as a one-time instance starting from scratch. However, a common case that arises is when we already have a set of prior assignments, and…

Data Structures and Algorithms · Computer Science 2013-02-11 Edith Cohen , Graham Cormode , Nick Duffield , Carsten Lund

Prediction sets provide a means of quantifying the uncertainty in predictive tasks. Using held out calibration data, conformal prediction and risk control can produce prediction sets that exhibit statistically valid error control in a…

Machine Learning · Statistics 2026-02-05 Bror Hultberg , Dave Zachariah , Antônio H. Ribeiro

One of the common goals of time series analysis is to use the observed series to inform predictions for future observations. In the absence of any actual new data to predict, cross-validation can be used to estimate a model's future…

Methodology · Statistics 2020-07-02 Paul-Christian Bürkner , Jonah Gabry , Aki Vehtari

Cross-validation (CV) is known to provide asymptotically exact tests and confidence intervals for model improvement but only when the model comparison is relatively stable. Surprisingly, we prove that even simple, individually stable models…

Machine Learning · Statistics 2026-02-10 Alexandre Bayle , Lucas Janson , Lester Mackey

Recently, there has been substantial interest in statistical guarantees for cross-validation (CV) methods of uncertainty quantification in statistical learning (cf. Barber et al. 2021a, Liang and Barber 2024, Steinberger and Leeb 2023).…

Statistics Theory · Mathematics 2025-05-09 Nicolai Amann , Hannes Leeb , Lukas Steinberger

Although the leave-subject-out cross-validation (CV) has been widely used in practice for tuning parameter selection for various nonparametric and semiparametric models of longitudinal data, its theoretical property is unknown and solving…

Statistics Theory · Mathematics 2013-02-20 Ganggang Xu , Jianhua Z. Huang

This paper describes a method for performing inference on models chosen by cross-validation. When the test error being minimized in cross-validation is a residual sum of squares it can be written as a quadratic form. This allows us to apply…

Methodology · Statistics 2015-12-01 Joshua R. Loftus

In spite of the wealth of literature on the theoretical properties of the Lasso, there is very little known when the value of the tuning parameter is chosen using the data, even though this is what actually happens in practice. We give a…

Statistics Theory · Mathematics 2016-09-02 Sourav Chatterjee , Jafar Jafarov

Process capability indices such as $C_{pk}$ are widely used in manufacturing quality control to support supplier qualification and product release decisions based on fixed acceptance thresholds (e.g., $C_{pk} \geq 1.33$). In practice, these…

Applications · Statistics 2026-03-13 Fei Jiang , Lei Yang

Consider the following class of learning schemes: \begin{equation} \label{eq:main-problem1} \hat{\boldsymbol{\beta}} := \underset{\boldsymbol{\beta} \in \mathcal{C}}{\arg\min} \;\sum_{j=1}^n \ell(\boldsymbol{x}_j^\top\boldsymbol{\beta};…

Machine Learning · Computer Science 2018-10-08 Shuaiwen Wang , Wenda Zhou , Arian Maleki , Haihao Lu , Vahab Mirrokni

Evaluation metrics for prediction error, model selection and model averaging on space-time data are understudied and poorly understood. The absence of independent replication makes prediction ambiguous as a concept and renders evaluation…

Methodology · Statistics 2022-11-08 Gregory L. Watson , Colleen E. Reid , Michael Jerrett , Donatello Telesca

Least absolute shrinkage and selection operator or Lasso is one of the widely used regularization methods in regression. Statisticians usually implement Lasso in practice by choosing the penalty parameter in a data-dependent way, the most…

Methodology · Statistics 2026-05-08 Mayukh Choudhury , Debraj Das

Reliable estimation of predictive performance is essential for spatial environmental modeling, where machine-learning models are used to generate maps from unevenly distributed observations. Standard cross-validation (CV) assumes that…

Machine Learning · Computer Science 2026-05-22 Alexander Brenning , Thomas Suesse

Decoding, ie prediction from brain images or signals, calls for empirical evaluation of its predictive power. Such evaluation is achieved via cross-validation, a method also used to tune decoders' hyper-parameters. This paper is a review on…

This paper begins with a general theory of error in cross-validation testing of algorithms for supervised learning from examples. It is assumed that the examples are described by attribute-value pairs, where the values are symbolic.…

Machine Learning · Computer Science 2007-05-23 Peter D. Turney