English
Related papers

Related papers: Asymptotic results for nonparametric regression es…

200 papers

Functional linear regression has recently attracted considerable interest. Many works focus on asymptotic inference. In this paper we consider in a non asymptotic framework a simple estimation procedure based on functional Principal…

Statistics Theory · Mathematics 2013-01-16 Elodie Brunel , André Mas , Angelina Roche

We provide new asymptotic theory for kernel density estimators, when these are applied to autoregressive processes exhibiting moderate deviations from a unit root. This fills a gap in the existing literature, which has to date considered…

Statistics Theory · Mathematics 2019-08-19 James A. Duffy

Sufficient dimension reduction (SDR) methods, which often rely on class precision matrices, are widely used in supervised statistical classification problems. However, when class-specific sample sizes are small relative to the original…

Methodology · Statistics 2025-06-25 Derik T. Boonstra , Rakheon Kim , Dean M. Young

We investigate the application of sufficient dimension reduction (SDR) to a noiseless data set derived from a deterministic function of several variables. In this context, SDR provides a framework for ridge recovery. In this second part, we…

Numerical Analysis · Mathematics 2018-08-10 Andrew Glaws , Paul G. Constantine , R. Dennis Cook

A novel general framework is proposed in this paper for dimension reduction in regression to fill the gap between linear and fully nonlinear dimension reduction. The main idea is to transform first each of the raw predictors monotonically,…

Methodology · Statistics 2014-01-03 Tao Wang , Xu Guo , Peirong Xu , Lixing Zhu

This is a tutorial and survey paper on various methods for Sufficient Dimension Reduction (SDR). We cover these methods with both statistical high-dimensional regression perspective and machine learning approach for dimensionality…

Methodology · Statistics 2021-10-20 Benyamin Ghojogh , Ali Ghodsi , Fakhri Karray , Mark Crowley

Recently, Tibshirani et al. (2016) proposed a method for making inferences about parameters defined by model selection, in a typical regression setting with normally distributed errors. Here, we study the large sample properties of this…

Statistics Theory · Mathematics 2017-08-10 Ryan J. Tibshirani , Alessandro Rinaldo , Robert Tibshirani , Larry Wasserman

Identifying low-dimensional sufficient structures in nonlinear sufficient dimension reduction (SDR) has long been a fundamental yet challenging problem. Most existing methods lack theoretical guarantees of exhaustiveness in identifying…

Machine Learning · Statistics 2025-12-23 Shuntuo Xu , Zhou Yu , Jian Huang

Dimensionality reduction (DR) algorithms compress high-dimensional data into a lower dimensional representation while preserving important features of the data. DR is a critical step in many analysis pipelines as it enables visualisation,…

Machine Learning · Statistics 2023-05-26 Aditya Ravuri , Francisco Vargas , Vidhi Lalchand , Neil D. Lawrence

Stochastic gradient descent (SGD) is an estimation tool for large data employed in machine learning and statistics. Due to the Markovian nature of the SGD process, inference is a challenging problem. An underlying asymptotic normality of…

Computation · Statistics 2025-03-27 Rahul Singh , Abhinek Shukla , Dootika Vats

We consider the problem of sufficient dimension reduction (SDR) for multi-index models. The estimators of the central mean subspace in prior works either have slow (non-parametric) convergence rates, or rely on stringent distributional…

Machine Learning · Statistics 2024-09-16 Gan Yuan , Mingyue Xu , Samory Kpotufe , Daniel Hsu

This paper deals with the asymptotic statistical properties of a class of redescending M-estimators in linear models with increasing dimension. This class is wide enough to include popular high breakdown point estimators such as…

Statistics Theory · Mathematics 2016-12-20 Ezequiel Smucler

For multiple index models, it has recently been shown that the sliced inverse regression (SIR) is consistent for estimating the sufficient dimension reduction (SDR) space if and only if $\rho=\lim\frac{p}{n}=0$, where $p$ is the dimension…

Statistics Theory · Mathematics 2018-06-19 Qian Lin , Zhigen Zhao , Jun S. Liu

Learning representations that capture both intrinsic data geometry and target-relevant structure remains a fundamental challenge, particularly in settings where data reduction must balance compression with predictive fidelity. While…

Machine Learning · Computer Science 2026-05-28 Sai-Aakash Ramesh , Archit Sood , Andrew Corbett , Tim Dodwell

We propose a novel and computationally efficient approach for nonparametric conditional density estimation in high-dimensional settings that achieves dimension reduction without imposing restrictive distributional or functional form…

Econometrics · Economics 2025-10-14 Jianhua Mei , Fu Ouyang , Thomas T. Yang

Recently, Su and Cook proposed a dimension reduction technique called the inner envelope which can be substantially more efficient than the original envelope or existing dimension reduction techniques for multivariate regression. However,…

Methodology · Statistics 2022-05-25 Linquan Ma , Hyunseung Kang , Lan Liu

It is proved that nonparametric autoregression is asymptotically equivalent in the sense of Le Cam's deficiency distance to nonparametric regression with random design as well as with regular nonrandom design.

Statistics Theory · Mathematics 2007-06-13 Ion G. Grama , Michael H. Neumann

We propose a new method, semi-penalized inference with direct false discovery rate control (SPIDR), for variable selection and confidence interval construction in high-dimensional linear regression. SPIDR first uses a semi-penalized…

Methodology · Statistics 2013-12-02 Jian Huang , Shuangge Ma , Cun-Hui Zhang , Yong Zhou

Simultaneous variable selection and statistical inference is challenging in high-dimensional data analysis. Most existing post-selection inference methods require explicitly specified regression models, which are often linear, as well as…

Methodology · Statistics 2026-03-19 Shangyuan Ye , Shauna Rakshe , Ye Liang

Nonparametric density and regression estimators commonly depend on a bandwidth. The asymptotic properties of these estimators have been widely studied when bandwidths are nonstochastic. In practice, however, in order to improve finite…

Statistics Theory · Mathematics 2014-09-02 Carlos Martins-Filho , Paulo Saraiva