English
Related papers

Related papers: Cross validating extensions of kernel, sparse or r…

200 papers

Partial Least Squares (PLS) methods have been heavily exploited to analyse the association between two blocs of data. These powerful approaches can be applied to data sets where the number of variables is greater than the number of…

Machine Learning · Statistics 2017-02-24 Pierre Lafaye de Micheaux , Benoit Liquet , Matthew Sutton

Randomized artificial neural networks such as extreme learning machines provide an attractive and efficient method for supervised learning under limited computing ressources and green machine learning. This especially applies when equipping…

Machine Learning · Statistics 2022-01-02 Ansgar Steland , Bart E. Pieters

We develop an approximate formula for evaluating a cross-validation estimator of predictive likelihood for multinomial logistic regression regularized by an $\ell_1$-norm. This allows us to avoid repeated optimizations required for…

Machine Learning · Statistics 2018-09-19 Tomoyuki Obuchi , Yoshiyuki Kabashima

Longitudinal and high-dimensional measurements have become increasingly common in biomedical research. However, methods to predict survival outcomes using covariates that are both longitudinal and high-dimensional are currently missing. In…

Typically, case-control studies to estimate odds-ratios associating risk factors with disease incidence from logistic regression only include cases with newly diagnosed disease. Recently proposed methods allow incorporating information on…

Methodology · Statistics 2020-10-19 Soutrik Mandal , Jing Qin , Ruth M. Pfeiffer

Methods based on partial least squares (PLS) regression, which has recently gained much attention in the analysis of high-dimensional genomic datasets, have been developed since the early 2000s for performing variable selection. Most of…

Methodology · Statistics 2021-08-31 Jérémy Magnanensi , Myriam Maumy-Bertrand , Nicolas Meyer , Frédéric Bertrand

In this paper we address the challenges posed by non-proportional hazards and informative censoring, offering a path toward more meaningful causal inference conclusions. We start from the marginal structural Cox model, which has been widely…

Methodology · Statistics 2023-11-15 Jiyu Luo , Denise Rava , Jelena Bradic , Ronghui Xu

IMPORTANCE: Time-to-event outcomes are commonly used in clinical trials and biomarker discovery studies and have been primarily analyzed using Cox proportional hazards models. But it's unclear which statistical models should be recommended…

Methodology · Statistics 2022-08-23 Rong Lu

K-fold cross validation (CV) is a popular method for estimating the true performance of machine learning models, allowing model selection and parameter tuning. However, the very process of CV requires random partitioning of the data and so…

Computation and Language · Computer Science 2018-06-20 Henry B. Moss , David S. Leslie , Paul Rayson

Variable selection plays a fundamental role in high-dimensional data analysis. Various methods have been developed for variable selection in recent years. Well-known examples are forward stepwise regression (FSR) and least angle regression…

Methodology · Statistics 2018-02-01 Siliang Gong , Kai Zhang , Yufeng Liu

Relating a set of variables X to a response y is crucial in chemometrics. A quantitative prediction objective can be enriched by qualitative data interpretation, for instance by locating the most influential features. When high-dimensional…

Machine Learning · Statistics 2023-04-21 Louna Alsouki , Laurent Duval , Clément Marteau , Rami El Haddad , François Wahl

The use of massive survival data has become common in survival analysis. In this study, a subsampling algorithm is proposed for the Cox proportional hazards model with time-dependent covariates when the sample is extraordinarily large but…

Computation · Statistics 2023-02-07 Nan Qiao , Wangcheng Li , Feng Xiao , Cunjie Lin , Yong Zhou

This study's first purpose is to provide quantitative evidence that would incentivize researchers to instead use the more robust method of nested cross-validation. The second purpose is to present methods and MATLAB codes for doing power…

Machine Learning · Computer Science 2024-03-19 Hamzeh Ghasemzadeh , Robert E. Hillman , Daryush D. Mehta

The tuning parameter selection strategy for penalized estimation is crucial to identify a model that is both interpretable and predictive. However, popular strategies (e.g., minimizing average squared prediction error via cross-validation)…

Methodology · Statistics 2022-11-10 Julia Holter , Jonathan Stallrich

Cross-validation (CV) is a technique for evaluating the ability of statistical models/learning systems based on a given data set. Despite its wide applicability, the rather heavy computational cost can prevent its use as the system size…

Machine Learning · Statistics 2016-10-26 Yoshiyuki Kabashima , Tomoyuki Obuchi , Makoto Uemura

High-dimensional prediction with multiple data types needs to account for potentially strong differences in predictive signal. Ridge regression is a simple model for high-dimensional data that has challenged the predictive performance of…

Methodology · Statistics 2021-04-02 Mark A. van de Wiel , Mirrelijn M. van Nee , Armin Rauschenberger

We consider functional linear regression models where functional outcomes are associated with scalar predictors by coefficient functions with shape constraints, such as monotonicity and convexity, that apply to sub-domains of interest. To…

Methodology · Statistics 2025-05-09 Kyunghee Han , Yeonjoo Park , Soo-Young Kim

This paper addresses theoretical issues associated with probabilistic partial least squares (PLS) regression. As in the case of factor analysis, the probabilistic PLS regression with unique variance suffers from the issues of improper…

Methodology · Statistics 2025-12-08 Takashi Arai

Bayesian cross-validation (CV) is a popular method for predictive model assessment that is simple to implement and broadly applicable. A wide range of CV schemes is available for time series applications, including generic leave-one-out…

Methodology · Statistics 2023-10-12 Alex Cooper , Dan Simpson , Lauren Kennedy , Catherine Forbes , Aki Vehtari

The change-plane Cox model is a popular tool for the subgroup analysis of survival data. Despite the rich literature on this model, there has been limited investigation into the asymptotic properties of the estimators of the…

Statistics Theory · Mathematics 2023-02-14 Shota Takeishi