中文
相关论文

相关论文: Cross validation in LASSO and its acceleration

200 篇论文

With machine learning being a popular topic in current computational materials science literature, creating representations for compounds has become common place. These representations are rarely compared, as evaluating their performance -…

机器学习 · 计算机科学 2023-05-26 Samantha Durdy , Michael Gaultois , Vladimir Gusev , Danushka Bollegala , Matthew J. Rosseinsky

Cross-validation (CV) is a popular method for model-selection. Unfortunately, it is not immediately obvious how to apply CV to unsupervised or exploratory contexts. This thesis discusses some extensions of cross-validation to unsupervised…

统计方法学 · 统计学 2009-09-17 Patrick O. Perry

We conduct a non asymptotic study of the Cross Validation (CV) estimate of the generalization risk for learning algorithms dedicated to extreme regions of the covariates space. In this Extreme Value Analysis context, the risk function…

统计理论 · 数学 2024-09-12 Anass Aghbalou , Patrice Bertail , François Portier , Anne Sabourin

It is useful to estimate the expected predictive performance of models planned to be used for prediction. We focus on leave-one-out cross-validation (LOO-CV), which has become a popular method for estimating predictive performance of…

统计方法学 · 统计学 2025-10-29 Tuomas Sivula , Måns Magnusson , Asael Alonzo Matamoros , Aki Vehtari

Common cross-validation (CV) methods like k-fold cross-validation or Monte-Carlo cross-validation estimate the predictive performance of a learner by repeatedly training it on a large portion of the given data and testing on the remaining…

机器学习 · 计算机科学 2021-11-30 Felix Mohr , Jan N. van Rijn

Cross-validation (CV) is a popular approach for assessing and selecting predictive models. However, when the number of folds is large, CV suffers from a need to repeatedly refit a learning procedure on a large number of training datasets.…

机器学习 · 统计学 2020-06-12 Ashia Wilson , Maximilian Kasy , Lester Mackey

Cross-validation (CV) is often used to select the regularization parameter in high dimensional problems. However, when applied to the sparse modeling method Lasso, CV leads to models that are unstable in high-dimensions, and consequently…

统计方法学 · 统计学 2015-10-28 Chinghway Lim , Bin Yu

Recent advances in genomics have underscored the surprising ubiquity of DNA copy number variation (CNV). Fortunately, modern genotyping platforms also detect CNVs with fairly high reliability. Hidden Markov models and algorithms have played…

统计方法学 · 统计学 2011-01-11 Zhongyang Zhang , Kenneth Lange , Roel Ophoff , Chiara Sabatti

Cross-validation (CV) methods are popular for selecting the tuning parameter in the high-dimensional variable selection problem. We show the mis-alignment of the CV is one possible reason of its over-selection behavior. To fix this issue,…

统计方法学 · 统计学 2018-01-17 Yang Feng , Yi Yu

The lasso procedure is ubiquitous in the statistical and signal processing literature, and as such, is the target of substantial theoretical and applied research. While much of this research focuses on the desirable properties that lasso…

统计理论 · 数学 2013-08-06 Darren Homrighausen , Daniel J. McDonald

Bayesian cross-validation (CV) is a popular method for predictive model assessment that is simple to implement and broadly applicable. A wide range of CV schemes is available for time series applications, including generic leave-one-out…

统计方法学 · 统计学 2023-10-12 Alex Cooper , Dan Simpson , Lauren Kennedy , Catherine Forbes , Aki Vehtari

We present a weighted version of Leave-One-Out (LOO) cross-validation for estimating the Integrated Squared Error (ISE) when approximating an unknown function by a predictor that depends linearly on evaluations of the function over a finite…

机器学习 · 统计学 2025-05-27 Luc Pronzato , Maria-João Rendas

Model selection is difficult to analyse yet theoretically and empirically important, especially for high-dimensional data analysis. Recently the least absolute shrinkage and selection operator (Lasso) has been applied in the statistical and…

机器学习 · 统计学 2016-06-02 Ning Xu , Jian Hong , Timothy C. G. Fisher

Cross-validation (CV) is a technique used to estimate generalization error for prediction models. For pipeline modeling algorithms (i.e. modeling procedures with multiple steps), it has been recommended the entire sequence of steps be…

机器学习 · 统计学 2020-10-05 Byron C. Jaeger , Nicholas J. Tierney , Noah R. Simon

Robust estimators for linear regression require non-convex objective functions to shield against adverse affects of outliers. This non-convexity brings challenges, particularly when combined with penalization in high-dimensional settings.…

统计计算 · 统计学 2025-08-08 David Kepplinger , Siqi Wei

Estimating out-of-sample risk for models trained on large high-dimensional datasets is an expensive but essential part of the machine learning process, enabling practitioners to optimally tune hyperparameters. Cross-validation (CV) serves…

统计理论 · 数学 2025-04-28 Parth Nobel , Daniel LeJeune , Emmanuel J. Candès

Cross validation is widely used for selecting tuning parameters in regularization methods, but it is computationally intensive in general. To lessen its computational burden, approximation schemes such as generalized approximate cross…

统计方法学 · 统计学 2024-12-02 Shanshan Tu , Yunzhang Zhu , Yoonkyung Lee , Qiuyu Gu , Haozhen Yu

Cross-validation (CV) is a widely-used method of predictive assessment based on repeated model fits to different subsets of the available data. CV is applicable in a wide range of statistical settings. However, in cases where data are not…

统计方法学 · 统计学 2025-04-23 Alex Cooper , Aki Vehtari , Catherine Forbes

Evaluating the predictive performance of a statistical model is commonly done using cross-validation. Among the various methods, leave-one-out cross-validation (LOOCV) is frequently used. Originally designed for exchangeable observations,…

统计计算 · 统计学 2025-07-04 Zhedong Liu , Janet Van Niekerk , Haavard Rue

Cross-validation (CV) is known to provide asymptotically exact tests and confidence intervals for model improvement but only when the model comparison is relatively stable. Surprisingly, we prove that even simple, individually stable models…

机器学习 · 统计学 2026-02-10 Alexandre Bayle , Lucas Janson , Lester Mackey