English
Related papers

Related papers: Bayesian Fused Lasso Modeling via Horseshoe Prior

200 papers

The horseshoe prior, defined as a half Cauchy scale mixture of normal, provides a state of the art approach to Bayesian sparse signal recovery. We provide a new representation of the horseshoe density as a scale mixture of the Laplace…

Methodology · Statistics 2023-01-04 Ksheera Sagar , Anindya Bhadra

We propose an efficient way to sample from a class of structured multivariate Gaussian distributions which routinely arise as conditional posteriors of model parameters that are assigned a conditionally Gaussian prior. The proposed…

Computation · Statistics 2016-06-28 Anirban Bhattacharya , Antik Chakraborty , Bani K. Mallick

The horseshoe prior is known to possess many desirable properties for Bayesian estimation of sparse parameter vectors, yet its density function lacks an analytic form. As such, it is challenging to find a closed-form solution for the…

Machine Learning · Statistics 2022-11-08 Shu Yu Tew , Daniel F. Schmidt , Enes Makalic

Although Bayesian variable selection methods have been intensively studied, their routine use in practice has not caught up with their non-Bayesian counterparts such as Lasso, likely due to difficulties in both computations and…

Methodology · Statistics 2021-07-07 Minsuk Shin , Jun S Liu

Due to developments in instruments and computers, functional observations are increasingly popular. However, effective methodologies for flexibly estimating the underlying trends with valid uncertainty quantification for a sequence of…

Methodology · Statistics 2022-09-22 Tomoya Wakayama , Shonosuke Sugasawa

We propose a new prior for ultra-sparse signal detection that we term the "horseshoe+ prior." The horseshoe+ prior is a natural extension of the horseshoe prior that has achieved success in the estimation and detection of sparse signals and…

Statistics Theory · Mathematics 2015-06-16 Anindya Bhadra , Jyotishka Datta , Nicholas G. Polson , Brandon Willard

Graphs have been commonly used to represent complex data structures. In models dealing with graph-structured data, multivariate parameters may not only exhibit sparse patterns but have structured sparsity and smoothness in the sense that…

Methodology · Statistics 2021-10-28 Changwoo J. Lee , Zhao Tang Luo , Huiyan Sang

Locally adaptive shrinkage in the Bayesian framework is achieved through the use of local-global prior distributions that model both the global level of sparsity as well as individual shrinkage parameters for mean structure parameters. The…

Statistics Theory · Mathematics 2019-03-05 Andrew Womack , Zikun Yang

We propose a new approach to mixed-frequency regressions in a high-dimensional environment that resorts to Group Lasso penalization and Bayesian techniques for estimation and inference. In particular, to improve the prediction properties of…

Econometrics · Economics 2020-06-12 Matteo Mogliani , Anna Simoni

We introduce a new shrinkage prior on function spaces, called the functional horseshoe prior (fHS), that encourages shrinkage towards parametric classes of functions. Unlike other shrinkage priors for parametric models, the fHS shrinkage…

Methodology · Statistics 2018-10-01 Minsuk Shin , Anirban Bhattacharya , Valen E. Johnson

This article proposes a Bayesian approach to regression with a scalar response against vector and tensor covariates. Tensor covariates are commonly vectorized prior to analysis, failing to exploit the structure of the tensor, and resulting…

Methodology · Statistics 2015-09-23 Rajarshi Guhaniyogi , Shaan Qamar , David B. Dunson

The horseshoe prior is frequently employed in Bayesian analysis of high-dimensional models, and has been shown to achieve minimax optimal risk properties when the truth is sparse. While optimization-based algorithms for the extremely…

Computation · Statistics 2018-10-16 James E. Johndrow , Paulo Orenstein , Anirban Bhattacharya

Gaussian graphical models provide a powerful framework for studying conditional dependencies in multivariate data, with widespread applications spanning biomedical, environmental sciences, and other data-rich scientific domains. While the…

Methodology · Statistics 2026-01-13 The Tien Mai , Sayantan Banerjee

In Bayesian statistics, horseshoe prior has attracted increasing attention as an approach to the sparse estimation. The estimation accuracy of compressed sensing with the horseshoe prior is evaluated by statistical mechanical method. It is…

Disordered Systems and Neural Networks · Physics 2023-03-29 Yasushi Nagano , Koji Hukushima

This article describes a full Bayesian treatment for simultaneous fixed-effect selection and parameter estimation in high-dimensional generalized linear mixed models. The approach consists of using a Bayesian adaptive Lasso penalty for…

Methodology · Statistics 2016-08-31 Dao Thanh Tung , Minh-Ngoc Tran , Tran Manh Cuong

We investigate the frequentist properties of Bayesian procedures for estimation based on the horseshoe prior in the sparse multivariate normal means model. Previous theoretical results assumed that the sparsity level, that is, the number of…

Statistics Theory · Mathematics 2017-02-14 Stéphanie van der Pas , Botond Szabó , Aad van der Vaart

Identifying homogeneous subgroups of variables can be challenging in high dimensional data analysis with highly correlated predictors. We propose a new method called Hexagonal Operator for Regression with Shrinkage and Equality Selection,…

Machine Learning · Statistics 2013-02-04 Woncheol Jang , Johan Lim , Nicole A. Lazar , Ji Meng Loh , Donghyeon Yu

The lasso and elastic net linear regression models impose a double-exponential prior distribution on the model parameters to achieve regression shrinkage and variable selection, allowing the inference of robust models from large data sets.…

Methodology · Statistics 2021-10-29 Tom Michoel

We propose a flexible Bayesian approach for sparse Gaussian graphical modeling of multivariate time series. We account for temporal correlation in the data by assuming that observations are characterized by an underlying and unobserved…

Methodology · Statistics 2025-08-21 Beniamino Hadj-Amar , Aaron M. Bornstein , Michele Guindani , Marina Vannucci

Robust Bayesian methods for high-dimensional regression problems under diverse sparse regimes are studied. Traditional shrinkage priors are primarily designed to detect a handful of signals from tens of thousands of predictors in the…

Statistics Theory · Mathematics 2024-10-25 Se Yoon Lee , Peng Zhao , Debdeep Pati , Bani K. Mallick