English
Related papers

Related papers: Hold-out estimates of prediction models for Markov…

200 papers

Early stopping based on hold-out data is a popular regularization technique designed to mitigate overfitting and increase the predictive accuracy of neural networks. Models trained with early stopping often provide relatively accurate…

Machine Learning · Statistics 2023-06-28 Ziyi Liang , Yanfei Zhou , Matteo Sesia

Statistical models for networks with complex dependencies pose particular challenges for model selection and evaluation. In particular, many well-established statistical tools for selecting between models assume conditional independence of…

Methodology · Statistics 2019-08-20 Fan Yin , Nolan Edward Phillips , Carter T. Butts

We study prediction intervals based on leave-one-out residuals in a linear regression model where the number of explanatory variables can be large compared to sample size. We establish uniform asymptotic validity (conditional on the…

Statistics Theory · Mathematics 2016-02-19 Lukas Steinberger , Hannes Leeb

In a linear regression model with random design, we consider a family of candidate models from which we want to select a `good' model for prediction out-of-sample. We fit the models using block shrinkage estimators, and we focus on the…

Statistics Theory · Mathematics 2018-09-13 Hannes Leeb , Nina Senitschnig

Clinical prediction models are statistical or machine learning models used to quantify the risk of a certain health outcome using patient data. These can then inform potential interventions on patients, causing an effect called performative…

Machine Learning · Computer Science 2024-06-06 Louis Chislett , Louis JM Aslett , Alisha R Davies , Catalina A Vallejos , James Liley

We propose the holdout randomization test (HRT), an approach to feature selection using black box predictive models. The HRT is a specialized version of the conditional randomization test (CRT; Candes et al., 2018) that uses data splitting…

Methodology · Statistics 2021-03-23 Wesley Tansey , Victor Veitch , Haoran Zhang , Raul Rabadan , David M. Blei

Performance estimation aims at estimating the loss that a predictive model will incur on unseen data. These procedures are part of the pipeline in every machine learning project and are used for assessing the overall generalisation ability…

Machine Learning · Computer Science 2021-08-31 Vitor Cerqueira , Luis Torgo , Igor Mozetic

The stochastic properties of a Langevin-type Markov process can be extracted from a given time series by a Markov analysis. Also processes that obey a stochastically forced second order differential equation can be analyzed this way by…

Data Analysis, Statistics and Probability · Physics 2014-12-09 Bernd Lehle , Joachim Peinke

This paper is concerned with detecting the presence of out of sample predictability in linear predictive regressions with a potentially large set of candidate predictors. We propose a procedure based on out of sample MSE comparisons that is…

Econometrics · Economics 2023-10-17 Jesus Gonzalo , Jean-Yves Pitarakis

The correct use of model evaluation, model selection, and algorithm selection techniques is vital in academic machine learning research as well as in many industrial settings. This article reviews different techniques that can be used for…

Machine Learning · Computer Science 2020-11-12 Sebastian Raschka

Stochastic processes find applications in modelling systems in a variety of disciplines. A large number of stochastic models considered are Markovian in nature. It is often observed that higher order Markov processes can model the data…

Probability · Mathematics 2021-04-13 Suryadeepto Nag

Reachability analysis is an important method in providing safety guarantees for systems with unknown or uncertain dynamics. Due to the computational intractability of exact reachability analysis for general nonlinear, high-dimensional…

Systems and Control · Electrical Eng. & Systems 2025-09-12 Elizabeth Dietrich , Rosalyn Devonport , Stephen Tu , Murat Arcak

Dropout represents a typical issue to be addressed when dealing with longitudinal studies. If the mechanism leading to missing information is non-ignorable, inference based on the observed data only may be severely biased. A frequent…

Methodology · Statistics 2018-03-23 Maria Francesca Marino , Marco Alfo'

This paper presents a fast methodology, called ROBOUT, to identify outliers in a response variable conditional on a set of linearly related predictors, retrieved from a large granular dataset. ROBOUT is shown to be effective and…

Methodology · Statistics 2021-04-27 Matteo Farnè , Angelos Vouldis

The aim of this paper is to propose a methodology for testing general hypothesis in a Markovian setting with random sampling. A discrete Markov chain X is observed at random time intervals $\tau$ k, assumed to be iid with unknown…

Statistics Theory · Mathematics 2015-05-25 Flavia Barsotti , Anne Philippe , Paul Rochet

Cross-validation is one of the most widely used methods for model selection and evaluation; its efficiency for large covariance matrix estimation appears robust in practice, but little is known about the theoretical behavior of its error.…

Statistical Finance · Quantitative Finance 2025-09-18 Lamia Lamrani , Benoît Collins , Jean-Philippe Bouchaud

A generic out-of-sample error estimate is proposed for robust $M$-estimators regularized with a convex penalty in high-dimensional linear regression where $(X,y)$ is observed and $p,n$ are of the same order. If $\psi$ is the derivative of…

Statistics Theory · Mathematics 2023-03-31 Pierre C Bellec

Evaluating predictive models is a crucial task in predictive analytics. This process is especially challenging with time series data where the observations show temporal dependencies. Several studies have analysed how different performance…

Machine Learning · Statistics 2022-02-14 Vitor Cerqueira , Luis Torgo , Carlos Soares

It is common for researchers to holdout data from a study pool to be used for external validation as well as for future research, and the same desire is true to those using machine learning modeling research. For this discussion, the…

Machine Learning · Computer Science 2022-05-10 Michele Bennett , Mehdi Nekouei , Armand Prieditis Rajesh Mehta , Ewa Kleczyk , Karin Hayes

In regression with random design, we study the problem of selecting a model that performs well for out-of-sample prediction. We do not assume that any of the candidate models under consideration are correct. Our analysis is based on…

Methodology · Statistics 2008-10-24 Hannes Leeb
‹ Prev 1 2 3 10 Next ›