English
Related papers

Related papers: Uniform convergence rates and automatic variable s…

200 papers

Semiparametric models are often considered for analyzing longitudinal data for a good balance between flexibility and parsimony. In this paper, we study a class of marginal partially linear quantile models with possibly varying…

Statistics Theory · Mathematics 2009-11-19 Huixia Judy Wang , Zhongyi Zhu , Jianhui Zhou

Causal inference with observational studies often relies on the assumptions of unconfoundedness and overlap of covariate distributions in different treatment groups. The overlap assumption is violated when some units have propensity scores…

Methodology · Statistics 2022-07-19 Shu Yang , Peng Ding

Compositional data arise in many real-life applications and versatile methods for properly analyzing this type of data in the regression context are needed. When parametric assumptions do not hold or are difficult to verify, non-parametric…

Methodology · Statistics 2023-09-07 Michail Tsagris , Abdulaziz Alenazi , Connie Stewart

We consider the problem of fitting a relationship (e.g. a potential scientific law) to data involving multiple variables. Ordinary (least squares) regression is not suitable for this because the estimated relationship will differ according…

Methodology · Statistics 2024-09-05 Chris Tofallis

We study a regression problem where for some part of the data we observe both the label variable ($Y$) and the predictors (${\bf X}$), while for other part of the data only the predictors are given. Such a problem arises, for example, when…

Statistics Theory · Mathematics 2021-04-14 David Azriel , Lawrence D. Brown , Michael Sklar , Richard Berk , Andreas Buja , Linda Zhao

We analyze the statistical properties of nonparametric regression estimators using covariates which are not directly observable, but have be estimated from data in a preliminary step. These so-called generated covariates appear in numerous…

Statistics Theory · Mathematics 2012-07-25 Enno Mammen , Christoph Rothe , Melanie Schienle

Recently, Tibshirani et al. (2016) proposed a method for making inferences about parameters defined by model selection, in a typical regression setting with normally distributed errors. Here, we study the large sample properties of this…

Statistics Theory · Mathematics 2017-08-10 Ryan J. Tibshirani , Alessandro Rinaldo , Robert Tibshirani , Larry Wasserman

With regard to a three-step estimation procedure, proposed without theoretical discussion by Li and You in Journal of Applied Statistics and Management, for a nonparametric regression model with time-varying regression function, local…

Statistics Theory · Mathematics 2020-10-27 Jiyanglin Li , Tao Li

This paper provides new uniform rate results for kernel estimators of absolutely regular stationary processes that are uniform in the bandwidth and in infinite-dimensional classes of dependent variables and regressors. Our results are…

Econometrics · Economics 2020-05-21 Juan Carlos Escanciano

In the context of statistical supervised learning, the noiseless linear model assumes that there exists a deterministic linear relation $Y = \langle \theta_*, X \rangle$ between the random output $Y$ and the random feature vector $\Phi(U)$,…

Machine Learning · Computer Science 2020-10-28 Raphaël Berthier , Francis Bach , Pierre Gaillard

We consider nonparametric regression under covariate shift, where we observe samples from both the target distribution and a related but distinct source distribution. We introduce a novel object, the transfer function, and show that…

Statistics Theory · Mathematics 2026-03-09 Petr Zamolodtchikov

In this paper we will discuss a procedure to improve the usual estimator of a linear functional of the unknown regression function in inverse nonparametric regression models. In Klaassen, Lee, and Ruymgaart (2001) it has been proved that…

Statistics Theory · Mathematics 2007-06-13 Chris A. J. Klaassen , Eun-Joo Lee , Frits H. Ruymgaart

Instrumental variables (IVs) provide a powerful strategy for identifying causal effects in the presence of unobservable confounders. Within the nonparametric setting (NPIV), recent methods have been based on nonlinear generalizations of…

Machine Learning · Statistics 2024-12-24 Yuri Fonseca , Caio Peixoto , Yuri Saporito

Model averaging has demonstrated superior performance for ensemble forecasting in high-dimensional framework, its extension to incomplete datasets remains a critical but underexplored challenge. Moreover, identifying the parsimonious model…

Methodology · Statistics 2025-09-03 Wei Xiong , Dianliang Deng , Dehui Wang

In this paper for the first time the nonparametric autoregression estimation problem for the quadratic risks is considered. To this end we develop a new adaptive sequential model selection method based on the efficient sequential kernel…

Statistics Theory · Mathematics 2018-09-10 Ouerdia Arkoun , Jean-Yves Brua , Serguei Pergamenshchikov

We investigate a semiparametric regression model where one gets noisy non linear non invertible functions of the observations. We focus on the application to bearings-only tracking. We first investigate the least squares estimator and prove…

Statistics Theory · Mathematics 2008-12-17 Elisabeth Gassiat , Benoit Landelle

We consider nonparametric testing in a non-asymptotic framework. Our statistical guarantees are exact in the sense that Type I and II errors are controlled for any finite sample size. Meanwhile, one proposed test is shown to achieve minimax…

Statistics Theory · Mathematics 2017-02-07 Yun Yang , Zuofeng Shang , Guang Cheng

We propose a new \textit{quadratic programming-based} method of approximating a nonstandard density using a multivariate Gaussian density. Such nonstandard densities usually arise while developing posterior samplers for unobserved…

Econometrics · Economics 2023-02-14 Abhishek K. Umrawal , Joshua C. C. Chan

This paper is concerned with forecasting probability density functions. Density functions are nonnegative and have a constrained integral; thus, they do not constitute a vector space. Implementing unconstrained functional time-series…

Methodology · Statistics 2025-10-14 Frédéric Ferraty , Han Lin Shang

This paper studies density estimation and regression analysis with contaminated data observed on the unit hypersphere S^d. Our methodology and theory are based on harmonic analysis on general S^d. We establish novel nonparametric density…

Statistics Theory · Mathematics 2023-01-10 Jeong Min Jeon , Ingrid Van Keilegom