English
Related papers

Related papers: Alternative Likelihood Approximations for High-Dim…

200 papers

The Laplace approximation has been one of the workhorses of Bayesian inference. It often delivers good approximations in practice despite the fact that it does not strictly take into account where the volume of posterior density lies.…

Machine Learning · Statistics 2022-03-02 Nikolaos Gianniotis

Observational astrophysics consists of making inferences about the Universe by comparing data and models. The credible intervals placed on model parameters are often as important as the maximum a posteriori probability values, as the…

Instrumentation and Methods for Astrophysics · Physics 2021-12-15 Will J. Percival , Oliver Friedrich , Elena Sellentin , Alan Heavens

We study high-dimensional regression with missing entries in the covariates. A common strategy in practice is to \emph{impute} the missing entries with an appropriate substitute and then implement a standard statistical procedure acting as…

Statistics Theory · Mathematics 2020-01-28 Kabir Aladin Chandrasekher , Ahmed El Alaoui , Andrea Montanari

We consider statistical inference for a single coordinate of regression coefficients in high-dimensional linear models. Recently, the debiased estimators are popularly used for constructing confidence intervals and hypothesis testing in…

Statistics Theory · Mathematics 2020-10-20 Sai Li

Sparse high dimensional graphical model selection is a topic of much interest in modern day statistics. A popular approach is to apply l1-penalties to either (1) parametric likelihoods, or, (2) regularized regression/pseudo-likelihoods,…

Methodology · Statistics 2022-02-04 Kshitij Khare , Sang-Yun Oh , Bala Rajaratnam

We consider the classic problem of interval estimation of a proportion $p$ based on binomial sampling. The "exact" Clopper-Pearson confidence interval for $p$ is known to be unnecessarily conservative. We propose coverage-adjustments of the…

Methodology · Statistics 2015-03-11 Måns Thulin

Introductory texts on statistics typically only cover the classical "two sigma" confidence interval for the mean value and do not describe methods to obtain confidence intervals for other estimators. The present technical report fills this…

Methodology · Statistics 2018-07-11 Christoph Dalitz

Likelihood-free methods are an essential tool for performing inference for implicit models which can be simulated from, but for which the corresponding likelihood is intractable. However, common likelihood-free methods do not scale well to…

Methodology · Statistics 2022-07-15 Christopher Drovandi , David J Nott , David T Frazier

Confidence interval procedures used in low dimensional settings are often inappropriate for high dimensional applications. When a large number of parameters are estimated, marginal confidence intervals associated with the most significant…

Methodology · Statistics 2017-02-24 Jean Morrison , Noah Simon

Many estimators of the average effect of a treatment on an outcome require estimation of the propensity score, the outcome regression, or both. It is often beneficial to utilize flexible techniques such as semiparametric regression or…

Methodology · Statistics 2019-05-14 Cheng Ju , David Benkeser , Mark J. van der Laan

After selection with the Group LASSO (or generalized variants such as the overlapping, sparse, or standardized Group LASSO), inference for the selected parameters is unreliable in the absence of adjustments for selection bias. In the…

Methodology · Statistics 2022-08-16 Snigdha Panigrahi , Peter W. MacDonald , Daniel Kessler

Penalized regression methods, most notably the lasso, are a popular approach to analyzing high-dimensional data. An attractive property of the lasso is that it naturally performs variable selection. An important area of concern, however, is…

Methodology · Statistics 2026-05-13 Ryan Miller , Patrick Breheny

Bayesian inference requires specification of a single, precise prior distribution, whereas frequentist inference only accommodates a vacuous prior. Since virtually every real-world application falls somewhere in between these two extremes,…

Methodology · Statistics 2023-09-26 Ryan Martin

Linear models that contain a time-dependent response and explanatory variables have attracted much interest in recent years. The most general form of the existing approaches is of a linear regression model with autoregressive moving average…

Methodology · Statistics 2021-02-15 Hamed Haselimashhadi , Veronica Vinciotti

Well-recommended methods of forming `confidence intervals' for a binomial proportion give interval estimates that do not actually meet the definition of a confidence interval, in that their coverages are sometimes lower than the nominal…

Statistics Theory · Mathematics 2021-06-30 Paul H. Garthwaite , Maha W. Moustafa , Fadlalla G. Elfadaly

It is common to show the confidence intervals or $p$-values of selected features, or predictor variables in regression, but they often involve selection bias. The selective inference approach solves this bias by conditioning on the…

Methodology · Statistics 2022-06-02 Yoshikazu Terada , Hidetoshi Shimodaira

This paper extends three Lasso inferential methods, Debiased Lasso, $C(\alpha)$ and Selective Inference to a survey environment. We establish the asymptotic validity of the inference procedures in generalized linear models with survey…

Econometrics · Economics 2023-04-18 Joann Jasiak , Purevdorj Tuvaandorj

We propose a robust inferential procedure for assessing uncertainties of parameter estimation in high-dimensional linear models, where the dimension $p$ can grow exponentially fast with the sample size $n$. Our method combines the…

Machine Learning · Statistics 2015-03-19 Tianqi Zhao , Mladen Kolar , Han Liu

We study tools for inference conditioned on model selection events that are defined by the generalized lasso regularization path. The generalized lasso estimate is given by the solution of a penalized least squares regression problem, where…

Methodology · Statistics 2016-06-14 Sangwon Hyun , Max G'Sell , Ryan J. Tibshirani

The graphical lasso is a widely used algorithm for fitting undirected Gaussian graphical models. However, for inference on functionals of edge values in the learned graph, standard tools lack formal statistical guarantees, such as control…

Methodology · Statistics 2025-04-01 Sofia Guglielmini , Gerda Claeskens , Snigdha Panigrahi