English
Related papers

Related papers: Adaptive Inference in Multivariate Nonparametric R…

200 papers

The minimax theory for estimating linear functionals is extended to the case of a finite union of convex parameter spaces. Upper and lower bounds for the minimax risk can still be described in terms of a modulus of continuity. However in…

Statistics Theory · Mathematics 2007-06-13 T. Tony Cai , Mark G. Low

Conformal Inference (CI) is a popular approach for generating finite sample prediction intervals based on the output of any point prediction method when data are exchangeable. Adaptive Conformal Inference (ACI) algorithms extend CI to the…

Computation · Statistics 2023-12-04 Herbert Susmann , Antoine Chambaz , Julie Josse

This paper deals with estimation with functional covariates. More precisely, we aim at estimating the regression function $m$ of a continuous outcome $Y$ against a standard Wiener coprocess $W$. Following Cadre and Truquet (2015) and Cadre,…

Statistics Theory · Mathematics 2020-11-23 Karine Bertin , Nicolas Klutchnikoff

In this paper, we introduce the first principled adaptive-sampling procedure for learning a convex function in the $L_\infty$ norm, a problem that arises often in the behavioral and social sciences. We present a function-specific measure of…

Machine Learning · Computer Science 2018-08-28 Max Simchowitz , Kevin Jamieson , Jordan W. Suchow , Thomas L. Griffiths

We consider estimation and inference for a regression coefficient in panels with interactive fixed effects (i.e., with a factor structure). We demonstrate that existing estimators and confidence intervals (CIs) can be heavily biased and…

Econometrics · Economics 2025-05-13 Timothy B. Armstrong , Martin Weidner , Andrei Zeleneev

We consider the problem of estimating the value of a linear functional in nonparametric instrumental regression, where in the presence of an instrument W a response Y is modeled in dependence of an endogenous explanatory variable Z. The…

Statistics Theory · Mathematics 2009-02-13 Christoph Breunig , Jan Johannes

High-dimensional linear regression with interaction effects is broadly applied in research fields such as bioinformatics and social science. In this paper, we first investigate the minimax rate of convergence for regression estimation in…

Statistics Theory · Mathematics 2018-04-10 Chenglong Ye , Yuhong Yang

We address the inference problem concerning regression coefficients in a classical linear regression model using least squares estimates. The analysis is conducted under circumstances where network dependency exists across units in the…

Methodology · Statistics 2024-04-03 Jing Lei , Kehui Chen , Haeun Moon

Nonparametric series regression often involves specification search over the tuning parameter, i.e., evaluating estimates and confidence intervals with a different number of series terms. This paper develops pointwise and uniform inferences…

Econometrics · Economics 2020-02-26 Byunghoon Kang

Monotonicity is a key qualitative prediction of a wide array of economic models derived via robust comparative statics. It is therefore important to design effective and practical econometric methods for testing this prediction in empirical…

Statistics Theory · Mathematics 2019-07-10 Denis Chetverikov

We consider a regression framework where the design points are deterministic and the errors possibly non-i.i.d. and heavy-tailed (with a moment of order $p$ in $[1,2]$). Given a class of candidate regression functions, we propose a…

Statistics Theory · Mathematics 2025-06-03 Yannick Baraud , Guillaume Maillard

When training predictive models on data with missing entries, the most widely used and versatile approach is a pipeline technique where we first impute missing entries and then compute predictions. In this paper, we view prediction with…

Machine Learning · Computer Science 2025-02-25 Dimitris Bertsimas , Arthur Delarue , Jean Pauphilet

This paper studies minimax rates of convergence for nonparametric location-scale models, which include mean, quantile and expectile regression settings. Under Hellinger differentiability on the error distribution and other mild conditions,…

Statistics Theory · Mathematics 2023-07-06 Bingxin Zhao , Yuhong Yang

Machine learning models trained on uncurated datasets can often end up adversely affecting inputs belonging to underrepresented groups. To address this issue, we consider the problem of adaptively constructing training sets which allow us…

Machine Learning · Computer Science 2021-07-21 Shubhanshu Shekhar , Greg Fields , Mohammad Ghavamzadeh , Tara Javidi

We address the problem of learning an unknown smooth function and its derivatives from noisy pointwise evaluations under the supremum norm. While classical nonparametric regression provides a strong theoretical foundation, traditional…

Machine Learning · Computer Science 2026-03-10 Davide Maran , Marcello Restelli

The paper considers so-called adaptive estimations of regression, distribution density and spectral density of a Gaussian stationary sequence, asymptotically optimal in order at a growing number of observation on any regular subspace…

Probability · Mathematics 2007-05-23 Eugene Ostrovsky , Leonid Sirota

We study nonparametric regression under covariate shift with structured data, where a small amount of labeled target data is supplemented by a large labeled source dataset. In many real-world settings, the covariates in the target domain…

Statistics Theory · Mathematics 2025-07-02 Yuyao Wang , Nabarun Deb , Debarghya Mukherjee

We present a new active learning algorithm based on nonparametric estimators of the regression function. Our investigation provides probabilistic bounds for the rates of convergence of the generalization error achievable by proposed method…

Statistics Theory · Mathematics 2011-11-03 Stanislav Minsker

We consider the estimation of a structural function which models a non-parametric relationship between a response and an endogenous regressor given an instrument in presence of dependence in the data generating process. Assuming an…

Statistics Theory · Mathematics 2016-04-08 Nicolas Asin , Jan Johannes

A simple construction of adaptive confidence sets is proposed in isotonic, convex and unimodal regression. In univariate isotonic regression, the proposed confidence set enjoys uniform coverage over all non-decreasing regression functions.…

Statistics Theory · Mathematics 2019-04-10 Pierre C. Bellec
‹ Prev 1 3 4 5 6 7 10 Next ›