English
Related papers

Related papers: Nonparametric Model Checking and Variable Selectio…

200 papers

We investigate structured sparsity methods for variable selection in regression problems where the target depends nonlinearly on the inputs. We focus on general nonlinear functions not limiting a priori the function space to additive…

Machine Learning · Statistics 2018-05-17 Magda Gregorová , Alexandros Kalousis , Stéphane Marchand-Maillet

We propose a new method for input variable selection in nonlinear regression. The method is embedded into a kernel regression machine that can model general nonlinear functions, not being a priori limited to additive models. This is the…

Machine Learning · Computer Science 2018-09-05 Magda Gregorová , Jason Ramapuram , Alexandros Kalousis , Stéphane Marchand-Maillet

Many methods have been developed to estimate the set of relevant variables in a sparse linear model Y= XB+e where the dimension p of B can be much higher than the length n of Y. Here we propose two new methods based on multiple hypotheses…

Statistics Theory · Mathematics 2012-06-12 Florian Rohart

We consider the problem of testing significance of predictors in multivariate nonparametric quantile regression. A stochastic process is proposed, which is based on a comparison of the responses with a nonparametric quantile regression…

Methodology · Statistics 2012-06-15 Stanislav Volgushev , Melanie Birke , Holger Dette , Natalie Neumeyer

Analysis of covariance is a crucial method for improving precision of statistical tests for factor effects in randomized experiments. However, existing solutions suffer from one or more of the following limitations: (i) they are not…

Methodology · Statistics 2024-12-24 Konstantin Emil Thiel , Paavo Sattler , Arne C Bathke , Georg Zimmermann

Variable selection comprises an important step in many modern statistical inference procedures. In the regression setting, when estimators cannot shrink irrelevant signals to zero, covariates without relationships to the response often…

Statistics Theory · Mathematics 2025-03-28 Ka Long Keith Ho , Hien Duy Nguyen

The varying-coefficient model is an important nonparametric statistical model that allows us to examine how the effects of covariates vary with exposure variables. When the number of covariates is big, the issue of variable selection…

Statistics Theory · Mathematics 2013-03-05 Jianqing Fan , Yunbei Ma , Wei Dai

The normality assumption for random errors is fundamental in the analysis of variance (ANOVA) models. However, it is rarely subjected to formal testing in practice, and theoretically justified procedures are largely unavailable, especially…

Econometrics · Economics 2026-03-31 Peiwen Jia , Xiaojun Song , Haoyu Wei

In the context of regressing a response $Y$ on a predictor $X$, we consider estimating the local modes of the distribution of $Y$ given $X=x$ when $X$ is prone to measurement error. We propose two nonparametric estimation methods, with one…

Methodology · Statistics 2016-10-28 Haiming Zhou , Xianzheng Huang

Inference and prediction under the sparsity assumption have been a hot research topic in recent years. However, in practice, the sparsity assumption is difficult to test, and more importantly can usually be violated. In this paper, to study…

Statistics Theory · Mathematics 2022-10-18 Yanmei Shi , Zhiruo Li , Qi Zhang

This paper derives limit properties of nonparametric kernel regression estimators without requiring existence of density for regressors in $\mathbb{R}^{q}.$ In functional regression limit properties are established for multivariate…

Econometrics · Economics 2026-01-08 Marcia Schafgans , Victoria Zinde-Walsh

The causal dose response curve is commonly selected as the statistical parameter of interest in studies where the goal is to understand the effect of a continuous exposure on an outcome.Most of the available methodology for statistical…

This study proposes a debiasing method for smooth nonparametric estimators. While machine learning techniques such as random forests and neural networks have demonstrated strong predictive performance, their theoretical properties remain…

Methodology · Statistics 2025-03-19 Masahiro Kato

Considering a regression model, we address the question of testing the nullity of the regression function. The testing procedure is available when the variance of the observations is unknown and does not depend on any prior information on…

Statistics Theory · Mathematics 2019-04-08 Thi Thien Trang Bui

We consider a stationary linear $AR(p)$ model with zero mean. The autoregression parameters as well as the distribution function (d.f.) $G(x)$ of innovations are unknown. We consider two situations. In the first situation the observations…

Statistics Theory · Mathematics 2022-07-12 M. V. Boldin , A. R. Shabakaeva

This paper provides a specification test for semiparametric models with nonparametrically generated regressors. Such variables are not observed by the researcher but are nonparametrically identified and estimable. Applications of the test…

Econometrics · Economics 2023-10-26 Elia Lapenta

Motivated by the importance of measuring the association between the response and predictors in high dimensional data, In this article, we propose a new mean variance test of independence between a categorical random variable and a…

Methodology · Statistics 2018-02-01 Hengjian Cui , Wei Zhong

To successfully work on variable selection, sparse model structure has become a basic assumption for all existing methods. However, this assumption is questionable as it is hard to hold in most of cases and none of existing methods may…

Methodology · Statistics 2011-12-06 Lu Lin , Lixing Zhu , Yujie Gai

This paper studies the problem of nonparametric testing for the effect of a random functional covariate on a real-valued error term. The covariate takes values in $L^2[0,1]$, the Hilbert space of the square-integrable real-valued functions…

Statistics Theory · Mathematics 2012-05-28 Valentin Patilea , Cesar Sanchez-Sellero , Matthieu Saumard

We study semiparametric varying-coefficient partially linear models when some linear covariates are not observed, but ancillary variables are available. Semiparametric profile least-square based estimation procedures are developed for…

Statistics Theory · Mathematics 2009-03-04 Yong Zhou , Hua Liang