English
Related papers

Related papers: On Affine and Conjugate Nonparametric Regression

200 papers

In this paper, we consider a functional linear regression model, where both the covariate and the response variable are functional random variables. We address the problem of optimal nonparametric estimation of the conditional expectation…

Statistics Theory · Mathematics 2022-03-02 Gaëlle Chagny , Anouar Meynaoui , Angelina Roche

The main purpose is to estimate the regression function of a real random variable with functional explanatory variable by using a recursive nonparametric kernel approach. The mean square error and the almost sure convergence of a family of…

Statistics Theory · Mathematics 2013-08-07 Aboubacar Amiri , Christophe Crambes , Baba Thiam

We propose nonparametric methods for functional linear regression which are designed for sparse longitudinal data, where both the predictor and response are functions of a covariate such as time. Predictor and response processes have smooth…

Statistics Theory · Mathematics 2016-08-16 Fang Yao , Hans-Georg Müller , Jane-Ling Wang

We suggest two nonparametric approaches, based on kernel methods and orthogonal series to estimating regression functions in the presence of instrumental variables. For the first time in this class of problems, we derive optimal convergence…

Statistics Theory · Mathematics 2007-06-13 Peter Hall , Joel L. Horowitz

Let $(X, \mathbf{Z})$ be a continuous random vector in $\mathbb{R} \times \mathbb{R}^d$, $d \ge 1$. In this paper, we define the notion of a nonparametric residual of $X$ on $\mathbf{Z}$ that is always independent of the predictor…

Methodology · Statistics 2015-10-02 Rohit Kumar Patra , Bodhisattva Sen , Gabor Szekely

High-dimensional covariates often admit linear factor structure. To effectively screen correlated covariates in high-dimension, we propose a conditional variable screening test based on non-parametric regression using neural networks due to…

Econometrics · Economics 2024-08-21 Jianqing Fan , Weining Wang , Yue Zhao

We study parameter estimation and asymptotic inference for sparse nonlinear regression. More specifically, we assume the data are given by $y = f( x^\top \beta^* ) + \epsilon$, where $f$ is nonlinear. To recover $\beta^*$, we propose an…

Machine Learning · Statistics 2015-11-17 Zhuoran Yang , Zhaoran Wang , Han Liu , Yonina C. Eldar , Tong Zhang

We develop nonparametric regression methods for the case when the true regression function is not necessarily smooth. More specifically, our approach is using the fractional Laplacian and is designed to handle the case when the true…

Statistics Theory · Mathematics 2025-06-11 Zhaoyang Shi , Krishnakumar Balasubramanian , Wolfgang Polonik

We consider nonparametric prediction with multiple covariates, in particular categorical or functional predictors, or a mixture of both. The method proposed bases on an extension of the Nadaraya-Watson estimator where a kernel function is…

Methodology · Statistics 2022-08-05 Leonie Selk , Jan Gertheiss

This paper studies the problem of nonparametric testing for the effect of a random functional covariate on a real-valued error term. The covariate takes values in $L^2[0,1]$, the Hilbert space of the square-integrable real-valued functions…

Statistics Theory · Mathematics 2012-05-28 Valentin Patilea , Cesar Sanchez-Sellero , Matthieu Saumard

We consider a general nonparametric regression model called the compound model. It includes, as special cases, sparse additive regression and nonparametric (or linear) regression with many covariates but possibly a small number of relevant…

Statistics Theory · Mathematics 2013-01-04 Arnak Dalalyan , Yuri Ingster , Alexandre Tsybakov

We develop a model-free theory of general types of parametric regression for iid observations. The theory replaces the parameters of parametric models with statistical functionals, to be called "regression functionals'', defined on large…

Statistics Theory · Mathematics 2019-07-09 Andreas Buja , Lawrence Brown , Arun Kumar Kuchibhotla , Richard Berk , Ed George , Linda Zhao

Univariate or multivariate ordinal responses are often assumed to arise from a latent continuous parametric distribution, with covariate effects which enter linearly. We introduce a Bayesian nonparametric modeling approach for univariate…

Methodology · Statistics 2016-09-21 Maria DeYoreo , Athanasios Kottas

We consider the estimation of a structural function which models a non-parametric relationship between a response and an endogenous regressor given an instrument in presence of dependence in the data generating process. Assuming an…

Statistics Theory · Mathematics 2016-04-08 Nicolas Asin , Jan Johannes

Max-affine regression refers to a model where the unknown regression function is modeled as a maximum of $k$ unknown affine functions for a fixed $k \geq 1$. This generalizes linear regression and (real) phase retrieval, and is closely…

Machine Learning · Statistics 2019-06-24 Avishek Ghosh , Ashwin Pananjady , Adityanand Guntuboyina , Kannan Ramchandran

We consider nonparametric estimation of a regression curve when the data are observed with multiplicative distortion which depends on an observed confounding variable. We suggest several estimators, ranging from a relatively simple one that…

Statistics Theory · Mathematics 2016-01-13 Aurore Delaigle , Peter Hall , Wen-Xin Zhou

We develop a general estimation and inference procedure for the common parameters in linear panel data regression models with nonparametric two-way specification of unobserved heterogeneity. The procedure takes as input any first-step…

Econometrics · Economics 2026-05-08 Hugo Freeman , Dennis Kristensen

In this article, we propose a new nonparametric data analysis tool, which we call nonparametric modal regression, to investigate the relationship among interested variables based on estimating the mode of the conditional density of a…

Methodology · Statistics 2016-02-23 Weixin Yao , Sijia Xiang

In the nonparametric regression setting, we construct an estimator which is a continuous function interpolating the data points with high probability, while attaining minimax optimal rates under mean squared risk on the scale of H\"older…

Statistics Theory · Mathematics 2022-06-28 Julien Chhor , Suzanne Sigalla , Alexandre B. Tsybakov

Regressing a function $F$ on $\mathbb{R}^d$ without the statistical and computational curse of dimensionality requires special statistical models, for example that impose geometric assumptions on the distribution of the data (e.g., that its…

Machine Learning · Statistics 2026-02-06 Yantao Wu , Mauro Maggioni