English
Related papers

Related papers: Nonparametric regression estimation for random fie…

200 papers

This paper discusses a design-dependent nature of variance in nonparametric link regression aiming at predicting a mean outcome at a link, i.e., a pair of nodes, based on currently observed data comprising covariates at nodes and outcomes…

Statistics Theory · Mathematics 2022-10-14 Akifumi Okuno , Keisuke Yano

In the regression model $Y = b(X) +\sigma(X)\varepsilon$, where $X$ has a density $f$, this paper deals with an oracle inequality for an estimator of $bf$, involving a kernel in the sense of Lerasle et al. (2016), selected via the PCO…

Statistics Theory · Mathematics 2021-06-07 Hélène Halconruy , Nicolas Marie

Nonparametric estimation of a mixing density based on observations from the corresponding mixture is a challenging statistical problem. This paper surveys the literature on a fast, recursive estimator based on the predictive recursion…

Methodology · Statistics 2022-09-15 Ryan Martin

In order to certify performance and safety, feedback control requires precise characterization of sensor errors. In this paper, we provide guarantees on such feedback systems when sensors are characterized by solving a supervised learning…

Machine Learning · Computer Science 2021-04-20 Sarah Dean , Benjamin Recht

In this paper, we propose a new and unified approach for nonparametric regression and conditional distribution learning. Our approach simultaneously estimates a regression function and a conditional generator using a generative learning…

Machine Learning · Statistics 2023-06-28 Shanshan Song , Tong Wang , Guohao Shen , Yuanyuan Lin , Jian Huang

Imputation is a popular technique for handling missing data. We consider a nonparametric approach to imputation using the kernel ridge regression technique and propose consistent variance estimation. The proposed variance estimator is based…

Methodology · Statistics 2021-02-02 Hengfang Wang , Jae-Kwang Kim

Deep nonparametric regression, characterized by the utilization of deep neural networks to learn target functions, has emerged as a focus of research attention in recent years. Despite considerable progress in understanding convergence…

Machine Learning · Statistics 2024-08-01 Yuling Jiao , Lican Kang , Jin Liu , Heng Peng , Heng Zuo

A scheme is developed for estimating state-dependent drift and diffusion coefficients in a stochastic differential equation from time-series data. The scheme does not require to specify parametric forms for the drift and diffusion…

Biological Physics · Physics 2012-09-28 Jun Ohkubo

We consider regression models with parametric (linear or nonlinear) regression function and allow responses to be ``missing at random.'' We assume that the errors have mean zero and are independent of the covariates. In order to estimate…

Statistics Theory · Mathematics 2009-08-24 Ursula U. Müller

We construct a family of estimators for a regression function based on a sample following a qdistribution. Our approach is nonparametric, using kernel methods built from operations that leverage the properties of q-calculus. Furthermore,…

Statistics Theory · Mathematics 2025-03-11 Emmanuel De Dieu Nkou , Fridolin Melong

Consider a researcher estimating the parameters of a regression function based on data for all 50 states in the United States or on data for all visits to a website. What is the interpretation of the estimated parameters and the standard…

Statistics Theory · Mathematics 2019-06-25 Alberto Abadie , Susan Athey , Guido W. Imbens , Jeffrey M. Wooldridge

Conditional estimation given specific covariate values (i.e., local conditional estimation or functional estimation) is ubiquitously useful with applications in engineering, social and natural sciences. Existing data-driven non-parametric…

Machine Learning · Statistics 2020-10-13 Viet Anh Nguyen , Fan Zhang , Jose Blanchet , Erick Delage , Yinyu Ye

In the context of estimating local modes of a conditional density based on kernel density estimators, we show that existing bandwidth selection methods developed for kernel density estimation are unsuitable for mode estimation. We propose…

Computation · Statistics 2017-11-02 Haiming Zhou , Xianzheng Huang

This paper proposes consistent estimators for transformation parameters in semiparametric models. The problem is to find the optimal transformation into the space of models with a predetermined regression structure like additive or…

Statistics Theory · Mathematics 2008-12-18 Oliver Linton , Stefan Sperlich , Ingrid Van Keilegom

In this paper, we consider the nonparametric regression problem with multivariate predictors. We provide a characterization of the degrees of freedom and divergence for estimators of the unknown regression function, which are obtained as…

Statistics Theory · Mathematics 2018-10-09 Xi Chen , Qihang Lin , Bodhisattva Sen

We consider nonparametric regression under covariate shift, where we observe samples from both the target distribution and a related but distinct source distribution. We introduce a novel object, the transfer function, and show that…

Statistics Theory · Mathematics 2026-03-09 Petr Zamolodtchikov

It is common in nonparametric estimation problems to impose a certain low-dimensional structure on the unknown parameter to avoid the curse of dimensionality. This paper considers a nonparametric distribution estimation problem with a…

Statistics Theory · Mathematics 2025-02-28 Jeyong Lee , Hyeok Kyu Kwon , Minwoo Chae

Regression adjustments are often made to experimental data. Since randomization does not justify the models, bias is likely; nor are the usual variance calculations to be trusted. Here, we evaluate regression adjustments using Neyman's…

Applications · Statistics 2008-12-18 David A. Freedman

Penalties that induce smoothness are common in nonparametric regression. In many settings, the amount of smoothness in the data generating function will not be known. Simon and Shojaie (2021) derived convergence rates for nonparametric…

Statistics Theory · Mathematics 2023-08-04 Marlena S. Bannick , Noah Simon

Tree structured graphical models are powerful at expressing long range or hierarchical dependency among many variables, and have been widely applied in different areas of computer science and statistics. However, existing methods for…

Machine Learning · Statistics 2014-01-17 Le Song , Han Liu , Ankur Parikh , Eric Xing