English
Related papers

Related papers: Robust and efficient estimation of nonparametric g…

200 papers

This study proposes a debiasing method for smooth nonparametric estimators. While machine learning techniques such as random forests and neural networks have demonstrated strong predictive performance, their theoretical properties remain…

Methodology · Statistics 2025-03-19 Masahiro Kato

Inference for the parameters indexing generalised linear models is routinely based on the assumption that the model is correct and a priori specified. This is unsatisfactory because the chosen model is usually the result of a data-adaptive…

Methodology · Statistics 2020-06-16 Stijn Vansteelandt , Oliver Dukes

We provide a unified approach to a method of estimation of the regression parameter in balanced linear models with a structured covariance matrix that combines a high breakdown point and bounded influence with high asymptotic efficiency at…

Statistics Theory · Mathematics 2023-03-22 Hendrik Paul Lopuhaä

Generalised regression estimation allows one to make use of available auxiliary information in survey sampling. We develop three types of generalised regression estimator when the auxiliary data cannot be matched perfectly to the sample…

Methodology · Statistics 2020-05-20 Li-Chun Zhang

Non-random sample selection is a commonplace amongst many empirical studies and it appears when an output variable of interest is available only for a restricted non-random sub-sample of data. We introduce an extension of the generalized…

Statistics Theory · Mathematics 2015-08-18 M. Wojtyś , G. Marra

This paper proposes distributed estimation procedures for three scalar-on-function regression models: the functional linear model (FLM), the functional non-parametric model (FNPM), and the functional partial linear model (FPLM). The…

Computation · Statistics 2026-01-08 Peilun He , Han Lin Shang , Nan Zou

We consider regression models with parametric (linear or nonlinear) regression function and allow responses to be ``missing at random.'' We assume that the errors have mean zero and are independent of the covariates. In order to estimate…

Statistics Theory · Mathematics 2009-08-24 Ursula U. Müller

We propose an approach to multivariate nonparametric regression that generalizes reduced rank regression for linear models. An additive model is estimated for each dimension of a $q$-dimensional response, with a shared $p$-dimensional…

Machine Learning · Statistics 2013-01-10 Rina Foygel , Michael Horrell , Mathias Drton , John Lafferty

Consider semiparametric estimation where a doubly robust estimating function for a low-dimensional parameter is available, depending on two working models. With high-dimensional data, we develop regularized calibrated estimation as a…

Methodology · Statistics 2020-09-28 Satyajit Ghosh , Zhiqiang Tan

Under the Neyman causal model, it is well-known that OLS with treatment-by-covariate interactions cannot harm asymptotic precision of estimated treatment effects in completely randomized experiments. But do such guarantees extend to…

Statistics Theory · Mathematics 2018-03-19 Joel A. Middleton

We propose, for multivariate Gaussian copula models with unknown margins and structured correlation matrices, a rank-based, semiparametrically efficient estimator for the Euclidean copula parameter. This estimator is defined as a one-step…

Methodology · Statistics 2014-10-02 Johan Segers , Ramon van den Akker , Bas J. M. Werker

We consider an additive partially linear framework for modelling massive heterogeneous data. The major goal is to extract multiple common features simultaneously across all sub-populations while exploring heterogeneity of each…

Methodology · Statistics 2019-01-01 Binhuan Wang , Yixin Fang , Heng Lian , Hua Liang

We construct efficient robust truncated sequential estimators for the pointwise estimation problem in nonparametric autoregression models with smooth coefficients. For Gaussian models we propose an adaptive procedure based on the…

Statistics Theory · Mathematics 2013-04-18 Ouerdia Arkoun , Serguei Pergamenchtchikov

This paper tackles the problem of robust covariance matrix estimation when the data is incomplete. Classical statistical estimation methodologies are usually built upon the Gaussian assumption, whereas existing robust estimation ones assume…

In this paper we consider the trace regression model. Assume that we observe a small set of entries or linear combinations of entries of an unknown matrix $A_0$ corrupted by noise. We propose a new rank penalized estimator of $A_0$. For…

Statistics Theory · Mathematics 2011-09-14 Olga Klopp

In a standard classification framework a set of trustworthy learning data are employed to build a decision rule, with the final aim of classifying unlabelled units belonging to the test set. Therefore, unreliable labelled observations,…

Applications · Statistics 2019-11-20 Andrea Cappozzo , Francesca Greselin , Thomas Brendan Murphy

Multiple linear regression is a basic statistical tool, yielding a prediction formula with the input variables, slopes, and an intercept. But is it really easy to see which terms have the largest effect, or to explain why the prediction of…

Methodology · Statistics 2025-07-23 Peter J. Rousseeuw

A general class of models is proposed that is able to estimate the whole predictive distribution of a dependent variable $Y$ given a vector of explanatory variables $\xb$. The models exploit that the strength of explanatory variables to…

Methodology · Statistics 2021-03-25 Gerhard Tutz

We reexamine the classical linear regression model when the model is subject to two types of uncertainty: (i) some of covariates are either missing or completely inaccessible, and (ii) the variance of the measurement error is undetermined…

Statistics Theory · Mathematics 2021-08-05 Shuzhen Yang , Jianfeng Yao

In scientific applications, multivariate observations often come in tandem with temporal or spatial covariates, with which the underlying signals vary smoothly. The standard approaches such as principal component analysis and factor…

Statistics Theory · Mathematics 2019-10-15 Mark Koudstaal , Dengdeng Yu , Dehan Kong , Fang Yao