English
Related papers

Related papers: Nonparametric Screening for Additive Quantile Regr…

200 papers

We consider a general nonparametric regression model called the compound model. It includes, as special cases, sparse additive regression and nonparametric (or linear) regression with many covariates but possibly a small number of relevant…

Statistics Theory · Mathematics 2013-01-04 Arnak Dalalyan , Yuri Ingster , Alexandre Tsybakov

In nonparametric regression analysis, errors are possibly correlated in practice, and neglecting error correlation can undermine most bandwidth selection methods. When no prior knowledge or parametric form of the correlation structure is…

Methodology · Statistics 2025-04-29 Sisheng Liu , Xiaoli Kong

Consider a linear model $Y=X\beta+z$, where $X=X_{n,p}$ and $z\sim N(0,I_n)$. The vector $\beta$ is unknown but is sparse in the sense that most of its coordinates are $0$. The main interest is to separate its nonzero coordinates from the…

Statistics Theory · Mathematics 2015-03-20 Zheng Tracy Ke , Jiashun Jin , Jianqing Fan

We consider non-parametric estimation and inference of conditional moment models in high dimensions. We show that even when the dimension $D$ of the conditioning variable is larger than the sample size $n$, estimation and inference is…

Machine Learning · Computer Science 2019-06-19 Khashayar Khosravi , Greg Lewis , Vasilis Syrgkanis

Decision trees and their ensembles are endowed with a rich set of diagnostic tools for ranking and screening variables in a predictive model. Despite the widespread use of tree based variable importance measures, pinning down their…

Machine Learning · Statistics 2020-12-14 Jason M. Klusowski , Peter M. Tian

We propose a new \textit{quadratic programming-based} method of approximating a nonstandard density using a multivariate Gaussian density. Such nonstandard densities usually arise while developing posterior samplers for unobserved…

Econometrics · Economics 2023-02-14 Abhishek K. Umrawal , Joshua C. C. Chan

Statistical inference in high dimensional settings has recently attracted enormous attention within the literature. However, most published work focuses on the parametric linear regression problem. This paper considers an important…

Methodology · Statistics 2019-11-14 Qi Gao , Randy C. S. Lai , Thomas C. M. Lee , Yao Li

We consider settings where data are available on a nonparametric function and various partial derivatives. Such circumstances arise in practice, for example in the joint estimation of cost and input functions in economics. We show that when…

Statistics Theory · Mathematics 2009-09-29 Peter Hall , Adonis Yatchew

In ultrahigh dimensional setting, independence screening has been both theoretically and empirically proved a useful variable selection framework with low computation cost. In this work, we propose a two-step framework by using marginal…

Methodology · Statistics 2017-08-11 Haolei Weng , Yang Feng , Xingye Qiao

We present a novel Bayesian nonparametric regression model for covariates X and continuous, real response variable Y. The model is parametrized in terms of marginal distributions for Y and X and a regression function which tunes the…

Methodology · Statistics 2015-06-25 Tristan Gray-Davies , Chris Holmes , Francois Caron

Semiparametric models are often considered for analyzing longitudinal data for a good balance between flexibility and parsimony. In this paper, we study a class of marginal partially linear quantile models with possibly varying…

Statistics Theory · Mathematics 2009-11-19 Huixia Judy Wang , Zhongyi Zhu , Jianhui Zhou

This study considers regression analysis of a circular response with an error-prone linear covariate. Starting with an existing estimator of the circular regression function that assumes error-free covariate, three approaches are proposed…

Methodology · Statistics 2025-08-25 Nicholas Woolsey , Xianzheng Huang

Shape constraints in nonparametric regression provide a powerful framework for estimating regression functions under realistic assumptions without tuning parameters. However, most existing methods$\unicode{x2013}$except additive…

Statistics Theory · Mathematics 2025-12-01 Dohyeong Ki , Adityanand Guntuboyina

Quantile regression has been successfully used to study heterogeneous and heavy-tailed data. Varying-coefficient models are frequently used to capture changes in the effect of input variables on the response as a function of an index or…

Methodology · Statistics 2021-10-18 Ran Dai , Mladen Kolar

Analysis of observational studies increasingly confronts the challenge of determining which of a possibly high-dimensional set of available covariates are required to satisfy the assumption of ignorable treatment assignment for estimation…

Methodology · Statistics 2022-03-23 Chanmin Kim , Mauricio Tec , Corwin M Zigler

Estimating the structures at high or low quantiles has become an important subject and attracted increasing attention across numerous fields. However, due to data sparsity at tails, it usually is a challenging task to obtain reliable…

Methodology · Statistics 2021-11-08 Yingying Zhang , Yuefeng Si , Guodong Li , Chil-Ling Tsai

Efficient estimation under bias sampling, censoring or truncation is a difficult question which has been partially answered and the usual estimators are not always consistent. Several biased designs are considered for models with variables…

Statistics Theory · Mathematics 2007-10-22 Odile Pons

We propose an approach to multivariate nonparametric regression that generalizes reduced rank regression for linear models. An additive model is estimated for each dimension of a $q$-dimensional response, with a shared $p$-dimensional…

Machine Learning · Statistics 2013-01-10 Rina Foygel , Michael Horrell , Mathias Drton , John Lafferty

We present alphaPDE, a new multivariate analysis technique for parameter estimation. The method is based on a direct construction of joint probability densities of known variables and the parameters to be estimated. We show how posterior…

Data Analysis, Statistics and Probability · Physics 2009-11-07 B. Knuteson , H. Miettinen , L. Holmstrom

Nonparanormal models describe the joint distribution of multivariate responses via latent Gaussian, and thus parametric, copulae while allowing flexible nonparametric marginals. Some aspects of such distributions, for example conditional…

Methodology · Statistics 2025-12-16 Torsten Hothorn