English
Related papers

Related papers: Efficient robust nonparametric estimation in a sem…

200 papers

This paper considers the effect of least squares procedures for nearly unstable linear time series with strongly dependent innovations. Under a general framework and appropriate scaling, it is shown that ordinary least squares procedures…

Statistics Theory · Mathematics 2009-09-29 Boris Buchmann , Ngai Hang Chan

We construct an efficient estimator for the error distribution function of the nonparametric regression model Y = r(Z) + e. Our estimator is a kernel smoothed empirical distribution function based on residuals from an under-smoothed local…

Statistics Theory · Mathematics 2018-10-26 Ursula U. Müller , Anton Schick , Wolfgang Wefelmeyer

Many problems in signal processing require finding sparse solutions to under-determined, or ill-conditioned, linear systems of equations. When dealing with real-world data, the presence of outliers and impulsive noise must also be accounted…

Statistics Theory · Mathematics 2017-05-08 Jasin Machkour , Michael Muma , Bastian Alt , Abdelhak M. Zoubir

Compared to the nominal scale, the ordinal scale for a categorical outcome variable has the property of making a monotonicity assumption for the covariate effects meaningful. This assumption is encoded in the commonly used proportional odds…

Methodology · Statistics 2023-10-04 Olli Saarela , Christian Rohrbeck , Elja Arjas

The ill-posedness of the inverse problem of recovering a regression function in a nonparametric instrumental variable model leads to estimators that may suffer from a very slow, logarithmic rate of convergence. In this paper, we show that…

Applications · Statistics 2017-09-27 Denis Chetverikov , Daniel Wilhelm

In this work we are interested in the problems of supervised learning and variable selection when the input-output dependence is described by a nonlinear function depending on a few variables. Our goal is to consider a sparse nonparametric…

Machine Learning · Statistics 2012-08-14 Lorenzo Rosasco , Silvia Villa , Sofia Mosci , Matteo Santoro , Alessandro verri

Non-conservative uncertainty bounds are key for both assessing an estimation algorithm's accuracy and in view of downstream tasks, such as its deployment in safety-critical contexts. In this paper, we derive a tight, non-asymptotic…

Machine Learning · Computer Science 2026-01-16 Amon Lahr , Johannes Köhler , Anna Scampicchio , Melanie N. Zeilinger

In the nonparametric regression setting, we construct an estimator which is a continuous function interpolating the data points with high probability, while attaining minimax optimal rates under mean squared risk on the scale of H\"older…

Statistics Theory · Mathematics 2022-06-28 Julien Chhor , Suzanne Sigalla , Alexandre B. Tsybakov

In this paper, we propose a robust profile estimation method for the parametric and nonparametric components of a single index model when the errors have a strongly unimodal density with unknown nuisance parameter. Under regularity…

Methodology · Statistics 2018-01-25 Claudio Agostinelli , Ana M. Bianco , Graciela Boente

This paper provides some extended results on estimating parameter matrix of several regression models when the covariate or response possesses weaker moment condition. We study the $M$-estimator of Fan et al. (Ann Stat 49(3):1239--1266,…

Statistics Theory · Mathematics 2022-09-08 Kangqiang Li , Songqiao Tang , Lixin Zhang

Semiparametric discrete choice models are widely used in a variety of practical applications. While these models are point identified in the presence of continuous covariates, they can become partially identified when covariates are…

Econometrics · Economics 2024-05-29 Shakeeb Khan , Tatiana Komarova , Denis Nekipelov

In the framework of nonparametric multivariate function estimation we are interested in structural adaptation. We assume that the function to be estimated has the "single-index" structure where neither the link function nor the index vector…

Statistics Theory · Mathematics 2013-04-30 Oleg Lepski , Nora Serdyukova

We study the multiplicative hazards model with intermittently observed longitudinal covariates and time-varying coefficients. For such models, the existing ad hoc approach, such as the last value carried forward, is biased. We propose a…

Methodology · Statistics 2025-03-13 Zhuowei Sun , Hongyuan Cao

The research is about a systematic investigation on the following issues. First, we construct different outcome regression-based estimators for conditional average treatment effect under, respectively, true (oracle), parametric,…

Statistics Theory · Mathematics 2020-09-23 Lu Li , Niwen Zhou , Lixing Zhu

This study proposes a debiasing method for smooth nonparametric estimators. While machine learning techniques such as random forests and neural networks have demonstrated strong predictive performance, their theoretical properties remain…

Methodology · Statistics 2025-03-19 Masahiro Kato

We consider the problem of estimating the structural function in nonparametric instrumental regression, where in the presence of an instrument W a response Y is modeled in dependence of an endogenous explanatory variable Z. The proposed…

Statistics Theory · Mathematics 2015-03-13 Jan Johannes , Maik Schwarz

The consistency of doubly robust estimators relies on consistent estimation of at least one of two nuisance regression parameters. In moderate to large dimensions, the use of flexible data-adaptive regression estimators may aid in achieving…

Machine Learning · Statistics 2019-01-30 Iván Díaz

In this paper, we establish minimax optimal rates of convergence for prediction in a semi-functional linear model that consists of a functional component and a less smooth nonparametric component. Our results reveal that the smoother…

Statistics Theory · Mathematics 2021-11-01 Keli Guo , Jun Fan , Lixing Zhu

Estimating linear regression using least squares and reporting robust standard errors is very common in financial economics, and indeed, much of the social sciences and elsewhere. For thick tailed predictors under heteroskedasticity this…

Methodology · Statistics 2020-08-17 Neil Shephard

The partially observed linear Gaussian system of stochastic differential equations with low noise in observations is considered. A kernel-type estimators are used for estimation of the quadratic variation of the derivative of the limit of…

Statistics Theory · Mathematics 2022-11-23 Yury A. Kutoyants