English
Related papers

Related papers: Nonparametric Regression and Classification with F…

200 papers

In this paper, we study nonparametric models allowing for locally stationary regressors and a regression function that changes smoothly over time. These models are a natural extension of time series models with time-varying coefficients. We…

Statistics Theory · Mathematics 2013-02-19 Michael Vogt

Nonparametric regression is a standard statistical tool with increased importance in the Big Data era. Boundary points pose additional difficulties but local polynomial regression can be used to alleviate them. Local linear regression, for…

Other Statistics · Statistics 2017-04-04 Srinjoy Das , Dimitris N. Politis

This study introduces a debiasing method for regression estimators, including high-dimensional and nonparametric regression estimators. For example, nonparametric regression methods allow for the estimation of regression functions in a…

Machine Learning · Statistics 2024-11-27 Masahiro Kato

In this paper, we propose a Network-Weighted Functional Regression (NWFR) model, an extension of Spatially Weighted Functional Regression (SWFR) to functional data defined on network-structured settings. To asses predictive uncertainity, we…

Methodology · Statistics 2025-06-02 Elvira Romano , Antonio Irpino , Claire Miller

In this paper, we consider an unknown functional estimation problem in a general nonparametric regression model with the feature of having both multiplicative and additive noise.We propose two new wavelet estimators in this general context.…

Statistics Theory · Mathematics 2020-12-25 Christophe Chesneau , Salima El Kolei , Junke Kou , Fabien Navarro

In this paper, we prove large deviations principle for the Nadaraya-Watson estimator and for the semi-recursive kernel estimator of the regression in the multidimensional case. Under suitable conditions, we show that the rate function is a…

Statistics Theory · Mathematics 2007-06-13 Abdelkader Mokkadem , Mariane Pelletier , Baba Thiam

Challenging research in various fields has driven a wide range of methodological advances in variable selection for regression models with high-dimensional predictors. In comparison, selection of nonlinear functions in models with additive…

Methodology · Statistics 2013-03-05 Fabian Scheipl , Thomas Kneib , Ludwig Fahrmeir

Although there is a rich literature on methods for allowing the variance in a univariate regression model to vary with predictors, time and other factors, relatively little has been done in the multivariate case. Our focus is on developing…

Methodology · Statistics 2015-03-17 Emily Fox , David Dunson

We propose a new method for input variable selection in nonlinear regression. The method is embedded into a kernel regression machine that can model general nonlinear functions, not being a priori limited to additive models. This is the…

Machine Learning · Computer Science 2018-09-05 Magda Gregorová , Jason Ramapuram , Alexandros Kalousis , Stéphane Marchand-Maillet

Functional linear regression is an important topic in functional data analysis. It is commonly assumed that samples of the functional predictor are independent realizations of an underlying stochastic process, and are observed over a grid…

Methodology · Statistics 2020-09-15 Cheng Chen , Shaojun Guo , Xinghao Qiao

Probabilistic Regression refers to predicting a full probability density function for the target conditional on the features. We present a nonparametric approach to this problem which combines base classifiers (typically gradient boosted…

Machine Learning · Computer Science 2022-10-31 Brian Lucena

We consider nonparametric estimation of a regression function for a situation where precisely measured predictors are used to estimate the regression curve for coarsened, that is, less precise or contaminated predictors. Specifically, while…

Statistics Theory · Mathematics 2008-12-18 Aurore Delaigle , Peter Hall , Hans-Georg Müller

Nonresponse frequently arises in practice, and simply ignoring it may lead to erroneous inference. Besides, the number of collected covariates may increase as the sample size in modern statistics, so parametric imputation or propensity…

Methodology · Statistics 2022-09-29 Xin He , Xiaojun Mao , Zhonglei Wang

Nonparametric regression models offer a way to understand and quantify relationships between variables without having to identify an appropriate family of possible regression functions. Although many estimation methods for these models have…

Methodology · Statistics 2023-04-07 Matias Salibian-Barrera

Machine learning models will often fail when deployed in an environment with a data distribution that is different than the training distribution. When multiple environments are available during training, many methods exist that learn…

Machine Learning · Computer Science 2023-09-26 Alan Q. Wang , Minh Nguyen , Mert R. Sabuncu

We study nonparametric covariance function estimation for functional data observed with noise at discrete locations on a $d$-dimensional domain. Estimating the covariance function from discretely observed data is a challenging nonparametric…

Statistics Theory · Mathematics 2026-03-25 Yoshikazu Terada , Atsutomo Yara

Many scientific problems involve data exhibiting both temporal and cross-sectional dependencies. While linear dependencies have been extensively studied, the theoretical analysis of regression estimators under nonlinear dependencies remains…

Statistics Theory · Mathematics 2025-02-27 Marie-Christine Düker , Adam Waterbury

In practice, data often contain discrete variables. But most of the popular nonparametric estimation methods have been developed in a purely continuous framework. A common trick among practitioners is to make discrete variables continuous…

Methodology · Statistics 2018-01-08 Thomas Nagler

Fully nonparametric methods for regression from functional data have poor accuracy from a statistical viewpoint, reflecting the fact that their convergence rates are slower than nonparametric rates for the estimation of high-dimensional…

Statistics Theory · Mathematics 2012-11-22 Dong Chen , Peter Hall , Hans-Georg Müller

We consider the functional regression model with multivariate response and functional predictors. Compared to fitting each individual response variable separately, taking advantage of the correlation between the response variables can…

Methodology · Statistics 2026-02-04 Ruiyan Luo , Xin Qi