English
Related papers

Related papers: A note on adjusting $R^2$ for using with cross-val…

200 papers

This article describes an extension of classical \chi^2 goodness-of-fit tests to Bayesian model assessment. The extension, which essentially involves evaluating Pearson's goodness-of-fit statistic at a parameter value drawn from its…

Statistics Theory · Mathematics 2007-06-13 Valen E. Johnson

We consider prediction in multiple studies with potential differences in the relationships between predictors and outcomes. Our objective is to integrate data from multiple studies to develop prediction models for unseen studies. We propose…

Methodology · Statistics 2024-07-23 Boyu Ren , Prasad Patil , Francesca Dominici , Giovanni Parmigiani , Lorenzo Trippa

We introduce a novel measure of dependence that captures the extent to which a random variable $Y$ is determined by a random vector $X$. The measure equals zero precisely when $Y$ and $X$ are independent, and it attains one exactly when $Y$…

Statistics Theory · Mathematics 2026-01-14 Mona Azadkia , Pouya Roudaki

We develop a new method for selecting the penalty parameter for $\ell_{1}$-penalized M-estimators in high dimensions, which we refer to as bootstrapping after cross-validation. We derive rates of convergence for the corresponding…

Statistics Theory · Mathematics 2024-11-14 Denis Chetverikov , Jesper Riis-Vestergaard Sørensen

We propose a method for variable selection in multiple regression with random predictors. This method is based on a criterion that permits to reduce the variable selection problem to a problem of estimating suitable permutation and…

Statistics Theory · Mathematics 2015-06-29 Alban Mbina Mbina , Guy Martial Nkiet , Assi Nguessan

Covariate adjustment aims to improve the statistical efficiency of randomized trials by incorporating information from baseline covariates. Popular methods for covariate adjustment include analysis of covariance for continuous endpoints and…

Methodology · Statistics 2025-05-09 Zhiwei Zhang , Ya Wang , Dong Xi

Background: Adaptive interventions provide a guide for using ongoing information about individuals to decide whether and how to modify the type, amount, delivery modality, or timing of treatment, to improve intervention effectiveness while…

Methodology · Statistics 2026-03-12 John J. Dziak , Inbal Nahum-Shani

Adjusting for covariates is a well established method to estimate the total causal effect of an exposure variable on an outcome of interest. Depending on the causal structure of the mechanism under study there may be different adjustment…

Statistics Theory · Mathematics 2021-04-27 Jack Kuipers , Giusi Moffa

We propose leave-out estimators of quadratic forms designed for the study of linear models with unrestricted heteroscedasticity. Applications include analysis of variance and tests of linear restrictions in models with many regressors. An…

Econometrics · Economics 2019-08-28 Patrick Kline , Raffaele Saggio , Mikkel Sølvsten

Difference in proportions is frequently used to measure treatment effect for binary outcomes in randomized clinical trials. The estimation of difference in proportions can be assisted by adjusting for prognostic baseline covariates to…

Methodology · Statistics 2023-08-31 Jialuo Liu , Dong Xi

In clinical prediction modeling, model updating refers to the practice of modifying a prediction model before it is used in a new setting. In the context of logistic regression for a binary outcome, one of the simplest updating methods is a…

Applications · Statistics 2022-04-12 Mohsen Sadatsafavi , Hamid Tavakoli , Abdollah Safari

Recursive partitioning approaches producing tree-like models are a long standing staple of predictive modeling, in the last decade mostly as ``sub-learners'' within state of the art ensemble methods like Boosting and Random Forest. However,…

Machine Learning · Statistics 2015-12-14 Amichai Painsky , Saharon Rosset

We study prediction intervals based on leave-one-out residuals in a linear regression model where the number of explanatory variables can be large compared to sample size. We establish uniform asymptotic validity (conditional on the…

Statistics Theory · Mathematics 2016-02-19 Lukas Steinberger , Hannes Leeb

Empirical researchers often use diagnostic checks to assess the plausibility of their modeling assumptions, such as testing for covariate balance in RCTs, pre-trends in event studies, or instrument validity in IV designs. While these checks…

Econometrics · Economics 2026-04-21 Reca Sarfati , Vod Vilfort

The QED Coulomb correction is one of the most important corrections to the e+ e- --> W+ W- total cross section near threshold. We calculate these corrections through second order, and discuss the implications for extracting M_W from a…

High Energy Physics - Phenomenology · Physics 2009-10-28 V. S. Fadin , V. A. Khoze , A. D. Martin , W. J. Stirling

We investigate how to improve efficiency using regression adjustments with covariates in covariate-adaptive randomizations (CARs) with imperfect subject compliance. Our regression-adjusted estimators, which are based on the doubly robust…

Econometrics · Economics 2023-06-19 Liang Jiang , Oliver B. Linton , Haihan Tang , Yichong Zhang

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

Cross validation residuals are well known for the ordinary least squares model. Here leave-M-out cross validation is extended to generalised least squares. The relationship between cross validation residuals and Cook's distance is…

Methodology · Statistics 2018-09-06 Ingrid Annette Baade

This paper identifies a problem with the usual procedure for L2-regularization parameter estimation in a domain adaptation setting. In such a setting, there are differences between the distributions generating the training data (source…

Machine Learning · Computer Science 2018-04-23 Wouter M. Kouw , Marco Loog

To use machine learning in high stakes applications (e.g. medicine), we need tools for building confidence in the system and evaluating whether it is reliable. Methods to improve model reliability often require new learning algorithms (e.g.…

Machine Learning · Statistics 2019-03-04 Peter Schulam , Suchi Saria