English
Related papers

Related papers: Horseshoe shrinkage methods for Bayesian fusion es…

200 papers

Estimating boundary curves has many applications such as economics, climate science, and medicine. Bayesian trend filtering has been developed as one of locally adaptive smoothing methods to estimate the non-stationary trend of data. This…

Methodology · Statistics 2023-11-13 Takahiro Onizuka , Fumiya Iwashige , Shintaro Hashimoto

Most estimates for penalised linear regression can be viewed as posterior modes for an appropriate choice of prior distribution. Bayesian shrinkage methods, particularly the horseshoe estimator, have recently attracted a great deal of…

Methodology · Statistics 2017-11-06 Zemei Xu , Daniel F. Schmidt , Enes Makalic , Guoqi Qian , John L. Hopper

Bounded continuous responses -- such as proportions -- arise frequently in diverse scientific fields including climatology, biostatistics, and finance. Beta regression is a widely adopted framework for modeling such data, due to the…

Methodology · Statistics 2025-05-29 The Tien Mai

We propose a new Bayesian model for flexible nonlinear regression and classification using tree ensembles. The model is based on the RuleFit approach in Friedman and Popescu (2008) where rules from decision trees and linear terms are used…

Methodology · Statistics 2018-02-16 Malte Nalenz , Mattias Villani

Seemingly unrelated regression is a natural framework for regressing multiple correlated responses on multiple predictors. The model is very flexible, with multiple linear regression and covariance selection models being special cases.…

Methodology · Statistics 2019-07-23 Yunfan Li , Jyotishka Datta , Bruce A. Craig , Anindya Bhadra

This paper presents a structure-preserving Bayesian approach for learning nonseparable Hamiltonian systems using stochastic dynamic models allowing for statistically-dependent, vector-valued additive and multiplicative measurement noise.…

Machine Learning · Statistics 2024-07-23 Nicholas Galioto , Harsh Sharma , Boris Kramer , Alex Arkady Gorodetsky

Deep Gaussian processes have recently been proposed as natural objects to fit, similarly to deep neural networks, possibly complex features present in modern data samples, such as compositional structures. Adopting a Bayesian nonparametric…

Statistics Theory · Mathematics 2025-02-04 Ismaël Castillo , Thibault Randrianarisoa

There has been an intense development of Bayes graphical model estimation approaches over the past decade - however, most of the existing methods are restricted to moderate dimensions. We propose a novel approach suitable for high…

Methodology · Statistics 2013-08-20 Suprateek Kundu , Veera Baladandayuthapani , Bani K. Mallick

We provide a framework for assessing the default nature of a prior distribution using the property of regular variation, which we study for global-local shrinkage priors. In particular, we demonstrate the horseshoe priors, originally…

Methodology · Statistics 2016-05-17 Anindya Bhadra , Jyotishka Datta , Nicholas G. Polson , Brandon T. Willard

Precision matrices are crucial in many fields such as social networks, neuroscience, and economics, representing the edge structure of Gaussian graphical models (GGMs), where a zero in an off-diagonal position of the precision matrix…

Statistics Theory · Mathematics 2025-01-24 The Tien Mai

L1-norm regularized logistic regression models are widely used for analyzing data with binary response. In those analyses, fusing regression coefficients is useful for detecting groups of variables. This paper proposes a binomial logistic…

Methodology · Statistics 2023-12-15 Yuko Kakikawa , Shuichi Kawano

We develop a novel full-Bayesian approach for multiple correlated precision matrices, called multiple Graphical Horseshoe (mGHS). The proposed approach relies on a novel multivariate shrinkage prior based on the Horseshoe prior that borrows…

Methodology · Statistics 2023-02-14 Claudio Busatto , Francesco Claudio Stingo

We present a Bayesian inference scheme for scaled Brownian motion, and investigate its performance on synthetic data for parameter estimation and model selection in a combined inference with fractional Brownian motion. We include the…

In many signal processing problems, it may be fruitful to represent the signal under study in a frame. If a probabilistic approach is adopted, it becomes then necessary to estimate the hyper-parameters characterizing the probability…

Methodology · Statistics 2015-05-14 L. Chaâri , J. -C. Pesquet , J. -Y. Tourneret , Ph. Ciuciu , A. Benazza-Benyahia

The goal of this paper is to contrast and survey the major advances in two of the most commonly used high-dimensional techniques, namely, the Lasso and horseshoe regularization. Lasso is a gold standard for predictor selection while…

Methodology · Statistics 2019-03-05 Anindya Bhadra , Jyotishka Datta , Nicholas G. Polson , Brandon T. Willard

The horseshoe prior has proven to be a noteworthy alternative for sparse Bayesian estimation, but as shown in this paper, the results can be sensitive to the prior choice for the global shrinkage hyperparameter. We argue that the previous…

Methodology · Statistics 2017-12-18 Juho Piironen , Aki Vehtari

Bayesian Neural Networks (BNNs) have recently received increasing attention for their ability to provide well-calibrated posterior uncertainties. However, model selection---even choosing the number of nodes---remains an open question. In…

Machine Learning · Statistics 2017-05-31 Soumya Ghosh , Finale Doshi-Velez

This paper presents a novel Bayesian strategy for the estimation of smooth signals corrupted by Gaussian noise. The method assumes a smooth evolution of a succession of continuous signals that can have a numerical or an analytical…

Applications · Statistics 2016-02-12 Abderrahim Halimi , Gerald S. Buller , Steve McLaughlin , Paul Honeine

This paper develops a mathematical and computational framework for analyzing the expected performance of Bayesian data fusion, or joint statistical inference, within a sensor network. We use variational techniques to obtain the posterior…

Statistics Theory · Mathematics 2016-02-23 Gaurav Thakur

Bayesian optimization (BO) is a popular technique for sequential black-box function optimization, with applications including parameter tuning, robotics, environmental monitoring, and more. One of the most important challenges in BO is the…

Machine Learning · Computer Science 2018-03-29 Paul Rolland , Jonathan Scarlett , Ilija Bogunovic , Volkan Cevher