English
Related papers

Related papers: Confidence Sets Based on Sparse Estimators Are Nec…

200 papers

The problem of constructing confidence sets in the high-dimensional linear model with $n$ response variables and $p$ parameters, possibly $p\ge n$, is considered. Full honest adaptive inference is possible if the rate of sparse estimation…

Statistics Theory · Mathematics 2013-12-19 Richard Nickl , Sara van de Geer

While conformal predictors reap the benefits of rigorous statistical guarantees on their error frequency, the size of their corresponding prediction sets is critical to their practical utility. Unfortunately, there is currently a lack of…

Machine Learning · Statistics 2024-03-12 Guneet S. Dhillon , George Deligiannidis , Tom Rainforth

We consider the setting of linear regression in high dimension. We focus on the problem of constructing adaptive and honest confidence sets for the sparse parameter \theta, i.e. we want to construct a confidence set for theta that contains…

Machine Learning · Statistics 2015-01-20 Alexandra Carpentier

We study confidence intervals based on hard-thresholding, soft-thresholding, and adaptive soft-thresholding in a linear regression model where the number of regressors $k$ may depend on and diverge with sample size $n$. In addition to the…

Statistics Theory · Mathematics 2018-10-08 Ulrike Schneider

The issue of honesty in constructing confidence sets arises in nonparametric regression. While optimal rate in nonparametric estimation can be achieved and utilized to construct sharp confidence sets, severe degradation of confidence level…

Methodology · Statistics 2021-07-30 Kun Zhou , Ker-Chau Li , Qing Zhou

In this paper, we propose a new framework to construct confidence sets for a $d$-dimensional unknown sparse parameter $\theta$ under the normal mean model $X\sim N(\theta,\sigma^2I)$. A key feature of the proposed confidence set is its…

Statistics Theory · Mathematics 2020-08-19 Yang Ning , Guang Cheng

In a sparse stochastic block model with two communities of unequal sizes we derive two posterior concentration inequalities, that imply (1) posterior (almost-)exact recovery of the community structure under sparsity bounds comparable to…

Statistics Theory · Mathematics 2021-08-17 B. J. K. Kleijn , J. van Waaij

Practical or scientific considerations often lead to selecting a subset of parameters as ``important.'' Inferences about those parameters often are based on the same data used to select them in the first place. That can make the reported…

Methodology · Statistics 2019-06-04 Yoav Benjamini , Yotam Hechtlinger , Philip B. Stark

Confidence sets play a fundamental role in statistical inference. In this paper, we consider confidence intervals for high dimensional linear regression with random design. We first establish the convergence rates of the minimax expected…

Statistics Theory · Mathematics 2015-11-30 T. Tony Cai , Zijian Guo

Many popular methods for building confidence intervals on causal effects under high-dimensional confounding require strong "ultra-sparsity" assumptions that may be difficult to validate in practice. To alleviate this difficulty, we here…

Statistics Theory · Mathematics 2019-05-06 Jelena Bradic , Stefan Wager , Yinchu Zhu

Confidence intervals based on penalized maximum likelihood estimators such as the LASSO, adaptive LASSO, and hard-thresholding are analyzed. In the known-variance case, the finite-sample coverage properties of such intervals are determined…

Statistics Theory · Mathematics 2010-03-16 Benedikt M. Pötscher , Ulrike Schneider

This paper revisits the simple, but empirically salient, problem of inference on a real-valued parameter that is partially identified through upper and lower bounds with asymptotically normal estimators. A simple confidence interval is…

Econometrics · Economics 2021-01-01 Jörg Stoye

Often it is not easy to choose between estimators, based on the estimated MSE and bias using simulation studies. Normality in small samples and a variance of the estimator, which is correct and easy to calculate using a single sample, give…

Applications · Statistics 2018-11-06 J. Martin van Zyl

We investigate the credible sets and marginal credible intervals resulting from the horseshoe prior in the sparse multivariate normal means model. We do so in an adaptive setting without assuming knowledge of the sparsity level (number of…

Statistics Theory · Mathematics 2017-02-14 Stéphanie van der Pas , Botond Szabó , Aad van der Vaart

In most prediction and estimation situations, scientists consider various statistical models for the same problem, and naturally want to select amongst the best. Hansen et al. (2011) provide a powerful solution to this problem by the…

Methodology · Statistics 2026-01-23 Sebastian Arnold , Georgios Gavrilopoulos , Benedikt Schulz , Johanna Ziegel

In this paper, we provide a general methodology to draw statistical inferences on individual signal coordinates or linear combinations of them in sparse phase retrieval. Given an initial estimator for the targeting parameter (some simple…

Methodology · Statistics 2020-09-29 Yisha Yao

Knowing when a classifier's prediction can be trusted is useful in many applications and critical for safely using AI. While the bulk of the effort in machine learning research has been towards improving classifier performance,…

Machine Learning · Statistics 2018-10-30 Heinrich Jiang , Been Kim , Melody Y. Guan , Maya Gupta

Confidence estimation (CE) indicates how reliable the answers of large language models are and impacts user trust and decision-making. Existing evaluations mainly concern the alignment between confidence and correctness, but ignore the…

Computation and Language · Computer Science 2026-05-29 Yuxi Xia , Dennis Ulmer , Terra Blevins , Yihong Liu , Hinrich Schütze , Benjamin Roth

In many statistical problems, several estimators are usually available for interval estimation of a parameter of interest, and hence, the selection of an appropriate estimator is important. The criterion for a good estimator is to have a…

Methodology · Statistics 2018-10-10 Richard Minkah , Tertius de Wet

Some large scale inference problems are considered based on using the relative belief ratio as a measure of statistical evidence. This approach is applied to the multiple testing problem. A particular application of this is concerned with…

Statistics Theory · Mathematics 2016-09-22 Michael Evans , Jabed Tomal
‹ Prev 1 2 3 10 Next ›