English
Related papers

Related papers: Cross validating extensions of kernel, sparse or r…

200 papers

We introduce a framework to build a survival/risk bump hunting model with a censored time-to-event response. Our Survival Bump Hunting (SBH) method is based on a recursive peeling procedure that uses a specific survival peeling criterion…

Methodology · Statistics 2015-11-24 Jean-Eudes Dazard , Michael Choe , Michael LeBlanc , J. Sunil Rao

Survival analysis is a challenging variation of regression modeling because of the presence of censoring, where the outcome measurement is only partially known, due to, for example, loss to follow up. Such problems come up frequently in…

Machine Learning · Computer Science 2022-06-28 Chirag Nagpal , Steve Yadlowsky , Negar Rostamzadeh , Katherine Heller

We present a methodology for model evaluation and selection where the sampling mechanism violates the i.i.d. assumption. Our methodology involves a formulation of the bias between the standard Cross-Validation (CV) estimator and the mean…

Methodology · Statistics 2025-03-14 Oren Yuval , Saharon Rosset

Cross-validation (CV) is a popular method for model-selection. Unfortunately, it is not immediately obvious how to apply CV to unsupervised or exploratory contexts. This thesis discusses some extensions of cross-validation to unsupervised…

Methodology · Statistics 2009-09-17 Patrick O. Perry

It is crucial to assess the predictive performance of a model to establish its practicality and relevance in real-world scenarios, particularly for high-dimensional data analysis. Among data splitting or resampling methods, cross-validation…

Methodology · Statistics 2025-11-26 Iris Ivy Gauran , Hernando Ombao , Zhaoxia Yu

The asymptotic optimality (a.o.) of various hyper-parameter estimators with different optimality criteria has been studied in the literature for regularized least squares regression problems. The estimators include e.g., the maximum…

Statistics Theory · Mathematics 2021-04-28 Biqiang Mu , Tianshi Chen , Lennart Ljung

Probabilistic regression models typically use the Maximum Likelihood Estimation or Cross-Validation to fit parameters. These methods can give an advantage to the solutions that fit observations on average, but they do not pay attention to…

Applications · Statistics 2022-05-24 Naoufal Acharki , Antoine Bertoncello , Josselin Garnier

Cross-validation is a statistical tool that can be used to improve large covariance matrix estimation. Although its efficiency is observed in practical applications and a convergence result towards the error of the non linear shrinkage is…

Statistics Theory · Mathematics 2025-09-18 Lamia Lamrani , Christian Bongiorno , Marc Potters

We consider the problem of bandwidth selection by cross-validation from a sequential point of view in a nonparametric regression model. Having in mind that in applications one often aims at estimation, prediction and change detection…

Statistics Theory · Mathematics 2018-03-20 Ansgar Steland

The problem of how to best select variables for confounding adjustment forms one of the key challenges in the evaluation of exposure effects in observational studies, and has been the subject of vigorous recent activity in causal inference.…

Methodology · Statistics 2021-12-02 Kelly Van Lancker , Oliver Dukes , Stijn Vansteelandt

The aim of the plsRglm package is to deal with complete and incomplete datasets through several new techniques or, at least, some which were not yet implemented in R. Indeed, not only does it make available the extension of the PLS…

Computation · Statistics 2018-10-03 F. Bertrand , M. Maumy-Bertrand

This study examines generalized cross-validation for the tuning parameter selection for ridge regression in high-dimensional misspecified linear models. The set of candidates for the tuning parameter includes not only positive values but…

Statistics Theory · Mathematics 2026-01-21 Akira Shinkyu

This paper describes a method for performing inference on models chosen by cross-validation. When the test error being minimized in cross-validation is a residual sum of squares it can be written as a quadratic form. This allows us to apply…

Methodology · Statistics 2015-12-01 Joshua R. Loftus

We derive high-dimensional Gaussian comparison results for the standard $V$-fold cross-validated risk estimates. Our results combine a recent stability-based argument for the low-dimensional central limit theorem of cross-validation with…

Statistics Theory · Mathematics 2023-11-15 Nicholas Kissel , Jing Lei

The covariance matrix plays a fundamental role in many modern exploratory and inferential statistical procedures, including dimensionality reduction, hypothesis testing, and regression. In low-dimensional regimes, where the number of…

Methodology · Statistics 2024-11-12 Philippe Boileau , Nima S. Hejazi , Mark J. van der Laan , Sandrine Dudoit

The proportional hazards assumption in the commonly used Cox model for censored failure time data is often violated in scientific studies. Yang and Prentice (2005) proposed a novel semiparametric two-sample model that includes the…

Methodology · Statistics 2012-06-06 Guoqing Diao , Donglin Zeng , Song Yang

Choosing relevant predictors is central to the analysis of biomedical time-to-event data. Classical frequentist inference, however, presumes that the set of covariates is fixed in advance and does not account for data-driven variable…

Methodology · Statistics 2026-02-10 Lena Schemet , Sarah Friedrich-Welz

This paper develops a new scalable sparse Cox regression tool for sparse high-dimensional massive sample size (sHDMSS) survival data. The method is a local $L_0$-penalized Cox regression via repeatedly performing reweighted $L_2$-penalized…

Methodology · Statistics 2020-06-30 Eric S. Kawaguchi , Marc A. Suchard , Zhenqiu Liu , Gang Li

Cox proportional hazard regression model is a popular tool to analyze the relationship between a censored lifetime variable with other relevant factors. The semi-parametric Cox model is widely used to study different types of data arising…

Methodology · Statistics 2018-10-09 Abhik Ghosh , Ayanendranath Basu

Prediction error is critical to assessing the performance of statistical methods and selecting statistical models. We propose the cross-validation and approximated cross-validation methods for estimating prediction error under a broad…

Statistics Theory · Mathematics 2007-06-13 Jianqing Fan , Chunming Zhang