English
Related papers

Related papers: Nonparametric Regression, Confidence Regions and R…

200 papers

We propose confidence regions for the parameters of incomplete models with exact coverage of the true parameter in finite samples. Our confidence region inverts a test, which generalizes Monte Carlo tests to incomplete models. The test…

Econometrics · Economics 2025-10-07 Lixiong Li , Marc Henry

In nonparametric regression analysis, errors are possibly correlated in practice, and neglecting error correlation can undermine most bandwidth selection methods. When no prior knowledge or parametric form of the correlation structure is…

Methodology · Statistics 2025-04-29 Sisheng Liu , Xiaoli Kong

We demonstrate that the primal-dual witness proof method may be used to establish variable selection consistency and $\ell_\infty$-bounds for sparse regression problems, even when the loss function and/or regularizer are nonconvex. Using…

Statistics Theory · Mathematics 2014-12-19 Po-Ling Loh , Martin J. Wainwright

Classical trust region methods were designed to solve problems in which function and gradient information are exact. This paper considers the case when there are bounded errors (or noise) in the above computations and proposes a simple…

Optimization and Control · Mathematics 2022-01-05 Shigeng Sun , Jorge Nocedal

We consider nonparametric estimation of a covariance function on the unit square, given a sample of discretely observed fragments of functional data. When each sample path is only observed on a subinterval of length $\delta<1$, one has no…

Methodology · Statistics 2018-10-05 Marie-Hélène Descary , Victor M. Panaretos

We introduce a framework for subspace methods which approximate the spectra of self-adjoint, unbounded operators in a local region. Using the projection-valued measure, we derive integrated spectral inequalities that also apply to unbounded…

Numerical Analysis · Mathematics 2026-01-06 Timothy Stroschein

We consider heteroscedastic nonparametric regression models, when both the mean function and variance function are unknown and to be estimated with nonparametric approaches. We derive convergence rates of posterior distributions for this…

Statistics Theory · Mathematics 2010-10-07 Yuao Hu

Constructing distribution-free confidence intervals for the median, a classic problem in statistics, has seen numerous solutions in the literature. While coverage validity has received ample attention, less has been explored about interval…

Statistics Theory · Mathematics 2024-03-12 Manit Paul , Arun Kumar Kuchibhotla

This paper is devoted to the problem of determining the concentration bounds that are achievable in non-parametric regression. We consider the setting where features are supported on a bounded subset of $\mathbb{R}^d$, the regression…

Statistics Theory · Mathematics 2024-12-02 Anna Ben-Hamou , Arnaud Guyader

We consider nonparametric estimation of a regression curve when the data are observed with multiplicative distortion which depends on an observed confounding variable. We suggest several estimators, ranging from a relatively simple one that…

Statistics Theory · Mathematics 2016-01-13 Aurore Delaigle , Peter Hall , Wen-Xin Zhou

Adaptive confidence intervals for regression functions are constructed under shape constraints of monotonicity and convexity. A natural benchmark is established for the minimum expected length of confidence intervals at a given function in…

Statistics Theory · Mathematics 2013-05-27 T. Tony Cai , Mark G. Low , Yin Xia

A methodology is presented for the numerical solution of nonlinear elliptic systems in unbounded domains, consisting of three elements. First, the problem is posed on a finite domain by means of a proper nonlinear change of variables. The…

Numerical Analysis · Mathematics 2023-02-10 Francisco Bernal , Ali Safdari-Vaighani , Elisabeth Larsson

We propose a bootstrap-based calibrated projection procedure to build confidence intervals for single components and for smooth functions of a partially identified parameter vector in moment (in)equality models. The method controls…

Statistics Theory · Mathematics 2024-07-03 Hiroaki Kaido , Francesca Molinari , Jörg Stoye

In this work, we study the well-posedness of certain sparse regularized linear regression problems, i.e., the existence, uniqueness and continuity of the solution map with respect to the data. We focus on regularization functions that are…

Statistics Theory · Mathematics 2024-09-06 Jasper Marijn Everink , Yiqiu Dong , Martin Skovgaard Andersen

In the analysis of survey data it is of interest to estimate and quantify uncertainty about means or totals for each of several non-overlapping subpopulations, or areas. When the sample size for a given area is small, standard confidence…

Methodology · Statistics 2018-09-26 Kyle Burris , Peter Hoff

This article introduces a novel nonparametric methodology for Generalized Linear Models which combines the strengths of the binary regression and latent variable formulations for categorical data, while overcoming their disadvantages.…

Machine Learning · Statistics 2021-10-12 K. P. Chowdhury

We provide adaptive confidence intervals on a parameter of interest in the presence of nuisance parameters when some of the nuisance parameters have known signs. The confidence intervals are adaptive in the sense that they tend to be short…

Econometrics · Economics 2021-09-20 Philipp Ketz , Adam McCloskey

We consider neural networks with a single hidden layer and non-decreasing homogeneous activa-tion functions like the rectified linear units. By letting the number of hidden units grow unbounded and using classical non-Euclidean…

Machine Learning · Computer Science 2016-11-01 Francis Bach

We study the sample complexity of the Sign-Perturbed Sums (SPS) method, which constructs exact, non-asymptotic confidence regions for the true system parameters under mild statistical assumptions, such as independent and symmetric noise…

Machine Learning · Statistics 2024-09-04 Szabolcs Szentpéteri , Balázs Csanád Csáji

Machine learning in asset pricing typically predicts expected returns as point estimates, ignoring uncertainty. We develop new methods to construct forecast confidence intervals for expected returns obtained from neural networks. We show…

Econometrics · Economics 2025-03-04 Yuan Liao , Xinjie Ma , Andreas Neuhierl , Linda Schilling