English
Related papers

Related papers: Improved inference for nonparametric regression an…

200 papers

The bootstrap procedure has emerged as a general framework to construct prediction intervals for future observations in autoregressive time series models. Such models with outlying data points are standard in real data applications,…

Methodology · Statistics 2020-11-17 Ufuk Beyaztas , Han Lin Shang

Complex survey data are usually collected following complex sampling designs. Accounting for the sampling design is essential to obtain unbiased estimates and valid inferences when analyzing complex survey data. The area under the receiver…

Methodology · Statistics 2026-03-31 Amaia Iparragirre , Thomas Lumley , Irantzu Barrio

Distribution forecast can quantify forecast uncertainty and provide various forecast scenarios with their corresponding estimated probabilities. Accurate distribution forecast is crucial for planning - for example when making production…

In the recent paper [5], a Bayesian approach for constructing confidence intervals in monotone regression problems is proposed, based on credible intervals. We view this method from a frequentist point of view, and show that it corresponds…

Statistics Theory · Mathematics 2023-08-01 Piet Groeneboom , Geurt Jongbloed

Model misspecification is ubiquitous in data analysis because the data-generating process is often complex and mathematically intractable. Therefore, assessing estimation uncertainty and conducting statistical inference under a possibly…

Methodology · Statistics 2023-12-19 Rong Li , Yichen Qin , Yang Li

Several new methods have been proposed for performing valid inference after model selection. An older method is sampling splitting: use part of the data for model selection and part for inference. In this paper we revisit sample splitting…

Statistics Theory · Mathematics 2018-04-04 Alessandro Rinaldo , Larry Wasserman , Max G'Sell , Jing Lei

Bootstrapping is often applied to get confidence limits for semiparametric inference of a target parameter in the presence of nuisance parameters. Bootstrapping with replacement can be computationally expensive and problematic when…

Inference methods for computing confidence intervals in parametric settings usually rely on consistent estimators of the parameter of interest. However, it may be computationally and/or analytically burdensome to obtain such estimators in…

Methodology · Statistics 2024-09-20 Samuel Orso , Mucyo Karemera , Maria-Pia Victoria-Feser , Stéphane Guerrier

In a regression model, prediction is typically performed after model selection. The large variability in the model selection makes the prediction unstable. Thus, it is essential to reduce the variability in model selection and improve…

Computation · Statistics 2024-04-11 Wataru Yoshida , Kei Hirose

Monitoring machine learning models once they are deployed is challenging. It is even more challenging to decide when to retrain models in real-case scenarios when labeled data is beyond reach, and monitoring performance metrics becomes…

Machine Learning · Computer Science 2022-11-23 Carlos Mougan , Dan Saattrup Nielsen

We focus on the construction of confidence corridors for multivariate nonparametric generalized quantile regression functions. This construction is based on asymptotic results for the maximal deviation between a suitable nonparametric…

Statistics Theory · Mathematics 2015-02-03 Shih-Kang Chao , Katharina Proksch , Holger Dette , Wolfgang Härdle

Quasi-experimental evaluations are central for generating real-world causal evidence and complementing insights from randomized trials. The regression discontinuity design (RDD) is a quasi-experimental design that can be used to estimate…

Machine Learning · Statistics 2026-04-07 Maximilian Schuessler , Erik Sverdrup , Robert Tibshirani , Stefan Wager

This study proposes a debiasing method for smooth nonparametric estimators. While machine learning techniques such as random forests and neural networks have demonstrated strong predictive performance, their theoretical properties remain…

Methodology · Statistics 2025-03-19 Masahiro Kato

Having a regression model, we are interested in finding two-sided intervals that are guaranteed to contain at least a desired proportion of the conditional distribution of the response variable given a specific combination of predictors. We…

Machine Learning · Computer Science 2016-03-22 Mohammad Ghasemi Hamed , Mathieu Serrurier , Nicolas Durand

Penalized spline regression is a popular method for scatterplot smoothing, but there has long been a debate on how to construct confidence intervals for penalized spline fits. Due to the penalty, the fitted smooth curve is a biased estimate…

Methodology · Statistics 2017-06-06 Ning Dai

The regression discontinuity (RD) design is a popular approach to causal inference in non-randomized studies. This is because it can be used to identify and estimate causal effects under mild conditions. Specifically, for each subject, the…

Methodology · Statistics 2014-02-11 George Karabatsos , Stephen G. Walker

Nonparametric regression models offer a way to understand and quantify relationships between variables without having to identify an appropriate family of possible regression functions. Although many estimation methods for these models have…

Methodology · Statistics 2023-04-07 Matias Salibian-Barrera

Regression problems with bounded continuous outcomes frequently arise in real-world statistical and machine learning applications, such as the analysis of rates and proportions. A central challenge in this setting is predicting a response…

Machine Learning · Statistics 2025-07-21 Zhanli Wu , Fabrizio Leisen , F. Javier Rubio

Nonparametric methods play a central role in modern empirical work. While they provide inference procedures that are more robust to parametric misspecification bias, they may be quite sensitive to tuning parameter choices. We study the…

Statistics Theory · Mathematics 2018-07-27 Sebastian Calonico , Matias D. Cattaneo , Max H. Farrell

We consider inference for the parameters of a linear model when the covariates are random and the relationship between response and covariates is possibly non-linear. Conventional inference methods such as z-intervals perform poorly in…

Methodology · Statistics 2017-01-17 Daniel McCarthy , Kai Zhang , Lawrence Brown , Richard Berk , Andreas Buja , Edward George , Linda Zhao