English
Related papers

Related papers: Horseshoe shrinkage methods for Bayesian fusion es…

200 papers

Graphical models describe associations between variables through the notion of conditional independence. Gaussian graphical models are a widely used class of such models where the relationships are formalized by non-null entries of the…

Methodology · Statistics 2023-08-08 Sagnik Bhadury , Riten Mitra , Jeremy T. Gaskins

In sparse signal processing, this study investigates the effect of the global shrinkage parameter $\tau$ of a horseshoe prior, one of the global-local shrinkage prior, on the linear regression. Statistical mechanics methods are employed to…

Disordered Systems and Neural Networks · Physics 2025-03-04 Yasushi Nagano , Koji Hukushima

Datasets in engineering applications are often limited and contaminated, mainly due to unavoidable measurement noise and signal distortion. Thus, using conventional data-driven approaches to build a reliable discriminative model, and…

Machine Learning · Statistics 2020-04-14 Xihaier Luo , Ahsan Kareem

The horseshoe prior is frequently employed in Bayesian analysis of high-dimensional models, and has been shown to achieve minimax optimal risk properties when the truth is sparse. While optimization-based algorithms for the extremely…

Computation · Statistics 2018-10-16 James E. Johndrow , Paulo Orenstein , Anirban Bhattacharya

Data fusion has become an active research topic in recent years. Growing computational performance has allowed the use of redundant sensors to measure a single phenomenon. While Bayesian fusion approaches are common in general applications,…

Robotics · Computer Science 2017-04-25 Andres F. Echeverri , Henry Medeiros , Ryan Walsh , Yevgeniy Reznichenko , Richard Povinelli

Boosting methods are widely used in statistical learning to deal with high-dimensional data due to their variable selection feature. However, those methods lack straightforward ways to construct estimators for the precision of the…

Methodology · Statistics 2021-06-10 Boyao Zhang , Colin Griesbach , Cora Kim , Nadia Müller-Voggel , Elisabeth Bergherr

This work proposes a Bayesian rule based on the mixture of a point mass function at zero and the logistic distribution to perform wavelet shrinkage in nonparametric regression models with stationary errors (with short or long-memory…

Methodology · Statistics 2024-04-24 Alex Rodrigo dos S. Sousa , Mauricio Zevallos

We provide a novel statistical perspective on a classical problem at the intersection of computer science and information theory: recovering the empirical frequency of a symbol in a large discrete dataset using only a compressed…

Methodology · Statistics 2025-04-11 Mario Beraha , Stefano Favaro , Matteo Sesia

Transfer learning enhances model performance in a target population with limited samples by leveraging knowledge from related studies. While many works focus on improving predictive performance, challenges of statistical inference persist.…

Methodology · Statistics 2024-12-05 Daoyuan Lai , Oscar Hernan Madrid Padilla , Tian Gu

We show that prediction performance for global-local shrinkage regression can overcome two major difficulties of global shrinkage regression: (i) the amount of relative shrinkage is monotone in the singular values of the design matrix and…

Statistics Theory · Mathematics 2019-03-07 Anindya Bhadra , Jyotishka Datta , Yunfan Li , Nicholas G. Polson , Brandon Willard

Bayesian regularization is a central tool in modern-day statistical and machine learning methods. Many applications involve high-dimensional sparse signal recovery problems. The goal of our paper is to provide a review of the literature on…

Methodology · Statistics 2019-02-19 Nicholas G. Polson , Vadim Sokolov

Precision matrix estimation in a multivariate Gaussian model is fundamental to network estimation. Although there exist both Bayesian and frequentist approaches to this, it is difficult to obtain good Bayesian and frequentist properties…

Statistics Theory · Mathematics 2022-01-19 Ksheera Sagar , Sayantan Banerjee , Jyotishka Datta , Anindya Bhadra

In this paper, we propose a new horseshoe-type prior hierarchy for adaptively shrinking spline-based functional effects towards a predefined vector space of parametric functions. Instead of shrinking each spline coefficient towards zero, we…

Methodology · Statistics 2021-01-15 Paul Wiemann , Thomas Kneib

Frequentist robust variable selection has been extensively investigated in high-dimensional regression. Despite success, developing the corresponding statistical inference procedures remains a challenging task. Recently, tackling this…

Methodology · Statistics 2025-07-24 Kun Fan , Srijana Subedi , Vishmi Ridmika Dissanayake Pathiranage , Cen Wu

We propose a new prior for ultra-sparse signal detection that we term the "horseshoe+ prior." The horseshoe+ prior is a natural extension of the horseshoe prior that has achieved success in the estimation and detection of sparse signals and…

Statistics Theory · Mathematics 2015-06-16 Anindya Bhadra , Jyotishka Datta , Nicholas G. Polson , Brandon Willard

During the past decade, shrinkage priors have received much attention in Bayesian analysis of high-dimensional data. This paper establishes the posterior consistency for high-dimensional linear regression with a class of shrinkage priors,…

Statistics Theory · Mathematics 2022-10-11 Qifan Song , Faming Liang

We introduce a sparse high-dimensional regression approach that can incorporate prior information on the regression parameters and can borrow information across a set of similar datasets. Prior information may for instance come from…

Bayesian optimization works effectively optimizing parameters in black-box problems. However, this method did not work for high-dimensional parameters in limited trials. Parameters can be efficiently explored by nonlinearly embedding them…

Machine Learning · Computer Science 2022-06-14 Shoki Miyagawa , Atsuyoshi Yano , Naoko Sawada , Isamu Ogawa

In this paper, a methodology is investigated for signal recovery in the presence of non-Gaussian noise. In contrast with regularized minimization approaches often adopted in the literature, in our algorithm the regularization parameter is…

Optimization and Control · Mathematics 2017-01-23 Yosra Marnissi , Yuling Zheng , Emilie Chouzenoux , Jean-Christophe Pesquet

The horseshoe prior is known to possess many desirable properties for Bayesian estimation of sparse parameter vectors, yet its density function lacks an analytic form. As such, it is challenging to find a closed-form solution for the…

Machine Learning · Statistics 2022-11-08 Shu Yu Tew , Daniel F. Schmidt , Enes Makalic