English
Related papers

Related papers: Conditions for Posterior Contraction in the Sparse…

200 papers

Many approximate Bayesian inference methods assume a particular parametric form for approximating the posterior distribution. A multivariate Gaussian distribution provides a convenient density for such approaches; examples include the…

Methodology · Statistics 2023-02-20 Jackson Zhou , Clara Grazian , John Ormerod

The sparse structure of the solution for an inverse problem can be modelled using different sparsity enforcing priors when the Bayesian approach is considered. Analytical expression for the unknowns of the model can be obtained by building…

Applications · Statistics 2017-05-31 Mircea Dumitru

We study high-dimensional Bayesian linear regression with a general beta prime distribution for the scale parameter. Under the assumption of sparsity, we show that appropriate selection of the hyperparameters in the beta prime prior leads…

Methodology · Statistics 2019-07-19 Ray Bai , Malay Ghosh

We prove a general lemma for deriving contraction rates for linear inverse problems with non parametric nonconjugate priors. We then apply it to get contraction rates for both mildly and severely ill posed linear inverse problems with…

Statistics Theory · Mathematics 2017-02-21 Madhuresh

Posterior tempering reduces the influence of the likelihood in the calculation of the posterior by raising the likelihood to a fractional power $\alpha$. The resulting power posterior - also known as an $\alpha$-posterior or fractional…

Statistics Theory · Mathematics 2026-01-15 Ruchira Ray , Marco Avella Medina , Cynthia Rush

We provide a framework for assessing the default nature of a prior distribution using the property of regular variation, which we study for global-local shrinkage priors. In particular, we demonstrate the horseshoe priors, originally…

Methodology · Statistics 2016-05-17 Anindya Bhadra , Jyotishka Datta , Nicholas G. Polson , Brandon T. Willard

We consider a Bayesian framework for estimating a high-dimensional sparse precision matrix, in which adaptive shrinkage and sparsity are induced by a mixture of Laplace priors. Besides discussing our formulation from the Bayesian…

Machine Learning · Statistics 2018-05-22 Lingrui Gan , Naveen N. Narisetty , Feng Liang

Bayesian predictive inference provides a coherent description of entire predictive uncertainty through predictive distributions. We examine several widely used sparsity priors from the predictive (as opposed to estimation) inference…

Statistics Theory · Mathematics 2024-06-03 Veronika Rockova

We derive rates of contraction of posterior distributions on nonparametric models resulting from sieve priors. The aim of the paper is to provide general conditions to get posterior rates when the parameter space has a general structure,…

Statistics Theory · Mathematics 2016-05-03 Julyan Arbel , Ghislaine Gayraud , Judith Rousseau

We propose a new prior for ultra-sparse signal detection that we term the "horseshoe+ prior." The horseshoe+ prior is a natural extension of the horseshoe prior that has achieved success in the estimation and detection of sparse signals and…

Statistics Theory · Mathematics 2015-06-16 Anindya Bhadra , Jyotishka Datta , Nicholas G. Polson , Brandon Willard

We introduce GRASP, a simple Bayesian framework for regression with grouped predictors, built on the normal beta prime (NBP) prior. The NBP prior is an adaptive generalization of the horseshoe prior with tunable hyperparameters that control…

Methodology · Statistics 2025-06-24 Shu Yu Tew , Daniel F. Schmidt , Mario Boley

High-dimensional vector autoregressive (VAR) models offer a versatile framework for multivariate time series analysis, yet face critical challenges from over-parameterization and uncertain lag order. In this paper, we systematically compare…

Methodology · Statistics 2026-02-10 Harrison Katz , Robert E. Weiss

This paper considers the problem of using MCMC to fit sparse Bayesian models based on normal scale-mixture priors. Examples of this framework include the Bayesian LASSO and the horseshoe prior. We study the usefulness of parameter expansion…

Computation · Statistics 2010-10-27 James G. Scott

Sparseness of the regression coefficient vector is often a desirable property, since, among other benefits, sparseness improves interpretability. In practice, many true regression coefficients might be negligibly small, but non-zero, which…

Methodology · Statistics 2019-10-01 Daniel Andrade , Kenji Fukumizu

We study Bayesian inference in statistical linear inverse problems with Gaussian noise and priors in Hilbert space. We focus our interest on the posterior contraction rate in the small noise limit. Existing results suffer from a certain…

Statistics Theory · Mathematics 2014-09-24 Sergios Agapiou , Peter Mathé

This is a follow-up paper of Polson and Scott (2012, Bayesian Analysis), which claimed that the half-Cauchy prior is a sensible default prior for a scale parameter in hierarchical models. For estimation of a normal mean vector under the…

Statistics Theory · Mathematics 2023-08-21 Yuzo Maruyama , Takeru Matsuda

This paper introduces a rigorous approach to establish the sharp minimax optimalities of both LASSO and SLOPE within the framework of double sparse structures, notably without relying on RIP-type conditions. Crucially, our findings…

Statistics Theory · Mathematics 2023-08-21 Zhifan Li , Yanhang Zhang , Jianxin Yin

In the context of a vector autoregression (VAR) model, or any multivariate regression model, the number of relevant predictors may be small relative to the information set available from which to build a prediction equation. It is well…

Applications · Statistics 2017-09-25 Lendie Follett , Cindy Yu

Bayesian shrinkage methods have generated a lot of recent interest as tools for high-dimensional regression and model selection. These methods naturally facilitate tractable uncertainty quantification and incorporation of prior information.…

Methodology · Statistics 2017-04-21 Bala Rajaratnam , Doug Sparks , Kshitij Khare , Liyuan Zhang

This work establishes that sparse Bayesian neural networks achieve optimal posterior contraction rates over anisotropic Besov spaces and their hierarchical compositions. These structures reflect the intrinsic dimensionality of the…

Machine Learning · Statistics 2025-10-27 Kyeongwon Lee , Lizhen Lin , Jaewoo Park , Seonghyun Jeong
‹ Prev 1 3 4 5 6 7 10 Next ›