English
Related papers

Related papers: Optimal Uniform Convergence Rates for Sieve Nonpar…

200 papers

This paper makes several important contributions to the literature about nonparametric instrumental variables (NPIV) estimation and inference on a structural function $h_0$ and its functionals. First, we derive sup-norm convergence rates…

Methodology · Statistics 2022-06-06 Xiaohong Chen , Timothy M. Christensen

In this paper, we clarify the relations between the existing sets of regularity conditions for convergence rates of nonparametric indirect regression (NPIR) and nonparametric instrumental variables (NPIV) regression models. We establish…

Statistics Theory · Mathematics 2007-09-14 Xiaohong Chen , Markus Reiss

This paper considers adaptive, minimax estimation of a quadratic functional in a nonparametric instrumental variables (NPIV) model, which is an important problem in optimal estimation of a nonlinear functional of an ill-posed inverse…

Statistics Theory · Mathematics 2022-02-10 Christoph Breunig , Xiaohong Chen

We show that spline and wavelet series regression estimators for weakly dependent regressors attain the optimal uniform (i.e. sup-norm) convergence rate $(n/\log n)^{-p/(2p+d)}$ of Stone (1982), where $d$ is the number of regressors and $p$…

Statistics Theory · Mathematics 2022-06-06 Xiaohong Chen , Timothy Christensen

We study the kernel instrumental variable (KIV) algorithm, a kernel-based two-stage least-squares method for nonparametric instrumental variable regression. We provide a convergence analysis covering both identified and non-identified…

Machine Learning · Statistics 2026-04-09 Dimitri Meunier , Zhu Li , Tim Christensen , Arthur Gretton

We study the off-policy evaluation (OPE) problem in an infinite-horizon Markov decision process with continuous states and actions. We recast the $Q$-function estimation into a special form of the nonparametric instrumental variables (NPIV)…

Statistics Theory · Mathematics 2022-06-28 Xiaohong Chen , Zhengling Qi

In high dimensional sparse regression, pivotal estimators are estimators for which the optimal regularization parameter is independent of the noise level. The canonical pivotal estimator is the square-root Lasso, formulated along with its…

Machine Learning · Statistics 2020-09-04 Mathurin Massias , Quentin Bertrand , Alexandre Gramfort , Joseph Salmon

Instrumental variables (IVs) provide a powerful strategy for identifying causal effects in the presence of unobservable confounders. Within the nonparametric setting (NPIV), recent methods have been based on nonlinear generalizations of…

Machine Learning · Statistics 2024-12-24 Yuri Fonseca , Caio Peixoto , Yuri Saporito

Several causal parameters in short panel data models are functionals of a nested nonparametric instrumental variable regression (nested NPIV). Recent examples include mediated, time varying, and long term treatment effects identified using…

Machine Learning · Statistics 2025-06-02 Isaac Meza , Rahul Singh

We propose a new adaptive hypothesis test for inequality (e.g., monotonicity, convexity) and equality (e.g., parametric, semiparametric) restrictions on a structural function in a nonparametric instrumental variables (NPIV) model. Our test…

Econometrics · Economics 2024-11-08 Christoph Breunig , Xiaohong Chen

We suggest two nonparametric approaches, based on kernel methods and orthogonal series to estimating regression functions in the presence of instrumental variables. For the first time in this class of problems, we derive optimal convergence…

Statistics Theory · Mathematics 2007-06-13 Peter Hall , Joel L. Horowitz

We study inference on linear functionals in the nonparametric instrumental variable (NPIV) problem with a discretely-valued instrument under a many-weak-instruments asymptotic regime, where the number of instrument values grows with the…

Methodology · Statistics 2026-01-05 Lars van der Laan , Nathan Kallus , Aurélien Bibaut

We show the sup-norm convergence of deep neural network estimators with a novel adversarial training scheme. For the nonparametric regression problem, it has been shown that an estimator using deep neural networks can achieve better…

Machine Learning · Statistics 2023-07-11 Masaaki Imaizumi

We establish the optimal nonergodic sublinear convergence rate of the proximal point algorithm for maximal monotone inclusion problems. First, the optimal bound is formulated by the performance estimation framework, resulting in an infinite…

Optimization and Control · Mathematics 2019-07-15 Guoyong Gu , Junfeng Yang

We consider the nonparametric regression estimation problem of recovering an unknown response function f on the basis of spatially inhomogeneous data when the design points follow a known compactly supported density g with a finite number…

Methodology · Statistics 2012-10-29 Anestis Antoniadis , Marianna Pensky , Theofanis Sapatinas

In this paper, we analyze the behavior of various non-parametric local regression estimators, i.e. estimators that are based on local averaging, for estimating a Lipschitz regression function at a fixed point, or in sup-norm. We first prove…

Statistics Theory · Mathematics 2025-07-11 Jérémy Bettinger , François Portier , Adrien Saumard

We study the problem of nonparametric instrumental variable regression with observed covariates, which we refer to as NPIV-O. Compared with standard nonparametric instrumental variable regression (NPIV), the additional observed covariates…

Machine Learning · Statistics 2025-11-25 Zikai Shen , Zonghao Chen , Dimitri Meunier , Ingo Steinwart , Arthur Gretton , Zhu Li

This paper addresses the problem of estimating a convex regression function under both the sup-norm risk and the pointwise risk using B-splines. The presence of the convex constraint complicates various issues in asymptotic analysis,…

Statistics Theory · Mathematics 2012-05-02 Xiao Wang , Jinglai Shen

We provide a convergence analysis of deep feature instrumental variable (DFIV) regression (Xu et al., 2021), a nonparametric approach to IV regression using data-adaptive features learned by deep neural networks in two stages. We prove that…

Machine Learning · Statistics 2025-01-10 Juno Kim , Dimitri Meunier , Arthur Gretton , Taiji Suzuki , Zhu Li

In this paper, we investigate the statistical convergence rate of a Bayesian low-rank tensor estimator. Our problem setting is the regression problem where a tensor structure underlying the data is estimated. This problem setting occurs in…

Machine Learning · Statistics 2014-08-14 Taiji Suzuki
‹ Prev 1 2 3 10 Next ›