English
Related papers

Related papers: Adaptive confidence sets in shape restricted regre…

200 papers

We consider the problem of adaptive inference on a regression function at a point under a multivariate nonparametric regression setting. The regression function belongs to a H\"older class and is assumed to be monotone with respect to some…

Statistics Theory · Mathematics 2020-12-01 Koohyun Kwon , Soonwoo Kwon

Motivated by models for multiway comparison data, we consider the problem of estimating a coordinate-wise isotonic function on the domain $[0, 1]^d$ from noisy observations collected on a uniform lattice, but where the design points have…

Statistics Theory · Mathematics 2021-06-25 Ashwin Pananjady , Richard J. Samworth

We construct nonparametric confidence sets for regression functions using wavelets that are uniform over Besov balls. We consider both thresholding and modulation estimators for the wavelet coefficients. The confidence set is obtained by…

Statistics Theory · Mathematics 2007-06-13 Christopher R. Genovese , Larry Wasserman

Conformal prediction constructs a confidence set for an unobserved response of a feature vector based on previous identically distributed and exchangeable observations of responses and features. It has a coverage guarantee at any nominal…

Machine Learning · Statistics 2022-12-08 Eugene Ndiaye , Ichiro Takeuchi

We study the coverage properties of full conformal regression in the proportional asymptotic regime where the ratio of the dimension and the sample size converges to a constant. In this setting, existing theory tells us only that full…

Statistics Theory · Mathematics 2025-03-03 Isaac Gibbs , Emmanuel J. Candès

In many applications, the parameter of interest involves a simplex-valued weight which is identified as a solution to an optimization problem. Examples include synthetic control methods with group-level weights and various methods of model…

Econometrics · Economics 2026-01-08 Nathan Canen , Kyungchul Song

This manuscript studies a general approach to construct confidence sets for the solution of stochastic optimization, rendering empirical risk minimization as special cases. Statistical inference for stochastic optimization poses significant…

Statistics Theory · Mathematics 2026-05-22 Kenta Takatsu , Arun Kumar Kuchibhotla

We propose a multi-scale extension of conformal prediction, an approach that constructs prediction sets with finite-sample coverage guarantees under minimal statistical assumptions. Classic conformal prediction relies on a single notion of…

Statistics Theory · Mathematics 2025-02-11 Ali Baheri , Marzieh Amiri Shahbazi

We develop and analyze the HulC, an intuitive and general method for constructing confidence sets using the convex hull of estimates constructed from subsets of the data. Unlike classical methods which are based on estimating the (limiting)…

Statistics Theory · Mathematics 2023-09-12 Arun Kumar Kuchibhotla , Sivaraman Balakrishnan , Larry Wasserman

Confidence bands are confidence sets for an unknown function f, containing all functions within some sup-norm distance of an estimator. In the density estimation, regression, and white noise models, we consider the problem of constructing…

Statistics Theory · Mathematics 2013-02-19 Adam D. Bull

In a linear regression model of fixed dimension $p \leq n$, we construct confidence regions for the unknown parameter vector based on the Lasso estimator that uniformly and exactly hold the prescribed in finite samples as well as in an…

Statistics Theory · Mathematics 2018-10-08 Karl Ewald , Ulrike Schneider

Conformal prediction delivers prediction intervals with distribution-free coverage, but its intervals can look overconfident in regions where the model is extrapolating, because standard conformal scores do not explicitly represent…

Machine Learning · Statistics 2026-03-10 Luben M. C. Cabezas , Sabina J. Sloman , Bruno M. Resende , Fanyi Wu , Michele Caprio , Rafael Izbicki

We construct uniform and point-wise asymptotic confidence sets for the single edge in an otherwise smooth image function which are based on rotated differences of two one-sided kernel estimators. Using methods from M-estimation, we show…

Statistics Theory · Mathematics 2019-03-26 Viktor Bengs , Matthias Eulert , Hajo Holzmann

In observational causal inference, domain knowledge often leaves multiple covariate adjustments plausible, yet which sets satisfy ignorability is untestable. Different adjustment sets can yield conflicting estimates of the average treatment…

Methodology · Statistics 2026-03-23 Aditya Ghosh , Dominik Rothenhäusler

We consider the setting of linear regression in high dimension. We focus on the problem of constructing adaptive and honest confidence sets for the sparse parameter \theta, i.e. we want to construct a confidence set for theta that contains…

Machine Learning · Statistics 2015-01-20 Alexandra Carpentier

The geometric problem of estimating an unknown compact convex set from evaluations of its support function arises in a range of scientific and engineering applications. Traditional approaches typically rely on estimators that minimize the…

Statistics Theory · Mathematics 2021-02-26 Yong Sheng Soh , Venkat Chandrasekaran

This paper develops inferential methods for a very general class of ill-posed models in econometrics encompassing the nonparametric instrumental variable regression, various functional regressions, and the density deconvolution. We focus on…

Statistics Theory · Mathematics 2020-12-22 Andrii Babii

Conformal regression provides prediction intervals with global coverage guarantees, but often fails to capture local error distributions, leading to non-homogeneous coverage. We address this with a new adaptive method based on rescaling…

Machine Learning · Computer Science 2023-06-01 Nicolas Deutschmann , Mattia Rigotti , Maria Rodriguez Martinez

As one of data-driven approaches to computational mechanics in elasticity, this paper presents a method finding a bound for structural response, taking uncertainty in a material data set into account. For construction of an uncertainty set,…

Optimization and Control · Mathematics 2024-06-13 Yoshihiro Kanno

We study the problem of estimating a multivariate convex function defined on a convex body in a regression setting with random design. We are interested in optimal rates of convergence under a squared global continuous $l_2$ loss in the…

Statistics Theory · Mathematics 2016-01-27 Qiyang Han , Jon A. Wellner