English
Related papers

Related papers: Asymptotic optimality of a cross-validatory predic…

200 papers

In randomized controlled trials without interference, regression adjustment is widely used to enhance the efficiency of treatment effect estimation. This paper extends this efficiency principle to settings with network interference, where a…

Methodology · Statistics 2025-02-18 Xinyuan Fan , Chenlei Leng , Weichi Wu

We study the asymptotic properties of Lasso+mLS and Lasso+Ridge under the sparse high-dimensional linear regression model: Lasso selecting predictors and then modified Least Squares (mLS) or Ridge estimating their coefficients. First, we…

Statistics Theory · Mathematics 2014-01-14 Hanzhong Liu , Bin Yu

We study a class of iterated empirical risk minimization (ERM) procedures in which two successive ERMs are performed on the same dataset, and the predictions of the first estimator enter as an argument in the loss function of the second.…

Machine Learning · Statistics 2026-02-02 Hugo Cui , Yue M. Lu

We propose an iterative estimating equations procedure for analysis of longitudinal data. We show that, under very mild conditions, the probability that the procedure converges at an exponential rate tends to one as the sample size…

Statistics Theory · Mathematics 2007-12-18 Jiming Jiang , Yihui Luan , You-Gan Wang

We study the problem of nonparametric estimation under $\bL_p$-loss, $p\in [1,\infty)$, in the framework of the convolution structure density model on $\bR^d$. This observation scheme is a generalization of two classical statistical models,…

Statistics Theory · Mathematics 2017-04-17 Oleg Lepski , Thomas Willer

This paper studies the asymptotic properties of the adaptive elastic net in ultra-high dimensional sparse linear regression models and proposes a new method called SSLS (Separate Selection from Least Squares) to improve prediction accuracy.…

Methodology · Statistics 2014-10-15 Yuehan Yang , Hu Yang

In this paper, we propose a propensity score adapted variable selection procedure to select covariates for inclusion in propensity score models, in order to eliminate confounding bias and improve statistical efficiency in observational…

Methodology · Statistics 2021-09-14 Kangjie Zhou , Jinzhu Jia

In this paper, we consider the estimation of generalized linear models with covariates that are missing completely at random. We propose a model averaging estimation method and prove that the corresponding model averaging estimator is…

Statistics Theory · Mathematics 2017-10-26 Qingfeng Liu , Miaomiao Zheng

We analyze the (unconditional) distribution of a linear predictor that is constructed after a data-driven model selection step in a linear regression model. First, we derive the exact finite-sample cumulative distribution function (cdf) of…

Statistics Theory · Mathematics 2008-12-02 Hannes Leeb

Problem of damping of an arbitrary number of linear oscillators under common bounded control is considered. We are looking for a feedback control steering the system to the equilibrium. The obtained control is asymptotically optimal: the…

Optimization and Control · Mathematics 2016-12-02 Alexander Ovseevich , Aleksey Fedorov

Model-based reinforcement learning has the potential to be more sample efficient than model-free approaches. However, existing model-based methods are vulnerable to model bias, which leads to poor generalization and asymptotic performance…

Machine Learning · Computer Science 2019-06-27 Tung-Long Vuong , Kenneth Tran

Subsampling is a computationally effective approach to extract information from massive data sets when computing resources are limited. After a subsample is taken from the full data, most available methods use an inverse probability…

Statistics Theory · Mathematics 2022-10-11 HaiYing Wang , Jae Kwang Kim

Bagging is a commonly used ensemble technique in statistics and machine learning to improve the performance of prediction procedures. In this paper, we study the prediction risk of variants of bagged predictors under the proportional…

Statistics Theory · Mathematics 2023-10-26 Pratik Patil , Jin-Hong Du , Arun Kumar Kuchibhotla

The maximum-likelihood estimator of nonlinear panel data models with fixed effects is consistent but asymptotically-biased under rectangular-array asymptotics. The literature has thus far concentrated its effort on devising methods to…

Econometrics · Economics 2022-01-28 Ayden Higgins , Koen Jochmans

In this paper we construct optimal designs for frequentist model averaging estimation. We derive the asymptotic distribution of the model averaging estimate with fixed weights in the case where the competing models are non-nested and none…

Methodology · Statistics 2019-08-27 Kira Alhorn , Holger Dette , Kirsten Schorning

This paper is concerned with inference on the regression function of a high-dimensional linear model when outcomes are missing at random. We propose an estimator which combines a Lasso pilot estimate of the regression function with a bias…

Methodology · Statistics 2024-12-11 Yikun Zhang , Alexander Giessing , Yen-Chi Chen

We discuss the optimal design problem in regression models with long-range dependence error structure. Asymptotic optimal designs are derived and it is demonstrated that these designs depend only indirectly on the correlation function.…

Statistics Theory · Mathematics 2012-05-15 Holger Dette , Nikolai Leonenko , Andrey Pepelyshev , Anatoly Zhigljavsky

In modern experimental science, there is a common problem of estimating the coefficients of a linear regression in a context where the variables of interest cannot be observed simultaneously. When there is a categorical variable that is…

Methodology · Statistics 2025-03-10 Polina Arsenteva , Mohamed Amine Benadjaoud , Hervé Cardot

We consider building predictors when the data have missing values. We study the seemingly-simple case where the target to predict is a linear function of the fully-observed data and we show that, in the presence of missing values, the…

Machine Learning · Computer Science 2020-07-02 Marine Le Morvan , Nicolas Prost , Julie Josse , Erwan Scornet , Gaël Varoquaux

This paper considers the problem of robust adaptive efficient estimating of a periodic function in a continuous time regression model with the dependent noises given by a general square integrable semimartingale with a conditionally…

Statistics Theory · Mathematics 2019-09-24 Evgeny Pchelintsev , Serguei Pergamenshchikov