中文
相关论文

相关论文: Neuronized Priors for Bayesian Sparse Linear Regre…

200 篇论文

As an alternative to variable selection or shrinkage in high dimensional regression, we propose to randomly compress the predictors prior to analysis. This dramatically reduces storage and computational bottlenecks, performing well when the…

机器学习 · 统计学 2013-03-26 Rajarshi Guhaniyogi , David B. Dunson

The horseshoe prior has proven to be a noteworthy alternative for sparse Bayesian estimation, but as shown in this paper, the results can be sensitive to the prior choice for the global shrinkage hyperparameter. We argue that the previous…

统计方法学 · 统计学 2017-12-18 Juho Piironen , Aki Vehtari

Posterior sampling with the spike-and-slab prior [MB88], a popular multimodal distribution used to model uncertainty in variable selection, is considered the theoretical gold standard method for Bayesian sparse linear regression [CPS09,…

机器学习 · 统计学 2025-03-05 Syamantak Kumar , Purnamrita Sarkar , Kevin Tian , Yusong Zhu

We consider a Bayesian approach to variable selection in the presence of high dimensional covariates based on a hierarchical model that places prior distributions on the regression coefficients as well as on the model space. We adopt the…

统计理论 · 数学 2014-07-28 Naveen Naidu Narisetty , Xuming He

This paper introduces a new neural network based prior for real valued functions on $\mathbb R^d$ which, by construction, is more easily and cheaply scaled up in the domain dimension $d$ compared to the usual Karhunen-Lo\`eve function space…

统计方法学 · 统计学 2022-09-09 Torben Sell , Sumeetpal S. Singh

We propose a flexible Bayesian approach for sparse Gaussian graphical modeling of multivariate time series. We account for temporal correlation in the data by assuming that observations are characterized by an underlying and unobserved…

统计方法学 · 统计学 2025-08-21 Beniamino Hadj-Amar , Aaron M. Bornstein , Michele Guindani , Marina Vannucci

Projected priors were originally introduced to accommodate parameter constraints, but have recently regained popularity due to their ability to assign probability mass to low-dimensional parameter sets, such as the spaces of sparse vectors,…

统计方法学 · 统计学 2026-05-15 Leo L Duan , Sunghyun Cho , Mingzhang Yin

We introduce a new class of distributions named log-adjusted shrinkage priors for the analysis of sparse signals, which extends the three parameter beta priors by multiplying an additional log-term to their densities. The proposed prior has…

统计方法学 · 统计学 2020-01-28 Yasuyuki Hamura , Kaoru Irie , Shonosuke Sugasawa

To adopt neural networks in safety critical domains, knowing whether we can trust their predictions is crucial. Bayesian neural networks (BNNs) provide uncertainty estimates by averaging predictions with respect to the posterior weight…

机器学习 · 计算机科学 2021-03-17 Jannik Schmitt , Stefan Roth

This paper extends the idea of decoupling shrinkage and sparsity for continuous priors to Bayesian Quantile Regression (BQR). The procedure follows two steps: In the first step, we shrink the quantile regression posterior through state of…

计量经济学 · 经济学 2021-07-20 David Kohns , Tibor Szendrei

Neural networks have shown great predictive power when dealing with various unstructured data such as images and natural languages. The Bayesian neural network captures the uncertainty of prediction by putting a prior distribution for the…

机器学习 · 统计学 2022-11-28 Kyeongwon Lee , Jaeyong Lee

We consider Bayesian linear regression with sparsity-inducing prior and design efficient sampling algorithms leveraging posterior contraction properties. A quasi-likelihood with Gaussian spike-and-slab (that is favorable both statistically…

统计计算 · 统计学 2023-07-13 Qijia Jiang

A Neural Process (NP) estimates a stochastic process implicitly defined with neural networks given a stream of data, rather than pre-specifying priors already known, such as Gaussian processes. An ideal NP would learn everything from data…

机器学习 · 计算机科学 2023-04-20 Hyungi Lee , Eunggu Yun , Giung Nam , Edwin Fong , Juho Lee

We propose a new approach to mixed-frequency regressions in a high-dimensional environment that resorts to Group Lasso penalization and Bayesian techniques for estimation and inference. In particular, to improve the prediction properties of…

计量经济学 · 经济学 2020-06-12 Matteo Mogliani , Anna Simoni

Bayesian computation of high dimensional linear regression models with a popular Gaussian scale mixture prior distribution using Markov Chain Monte Carlo (MCMC) or its variants can be extremely slow or completely prohibitive due to the…

统计方法学 · 统计学 2021-05-12 Rajarshi Guhaniyogi , Aaron Scheffler

We introduce a Bayesian framework for mixed-type multivariate regression using continuous shrinkage priors. Our framework enables joint analysis of mixed continuous and discrete outcomes and facilitates variable selection from the $p$…

统计理论 · 数学 2024-12-20 Shao-Hsuan Wang , Ray Bai , Hsin-Hsiung Huang

Variable selection techniques have become increasingly popular amongst statisticians due to an increased number of regression and classification applications involving high-dimensional data where we expect some predictors to be unimportant.…

统计方法学 · 统计学 2010-09-20 Anthony Lee , Francois Caron , Arnaud Doucet , Chris Holmes

We propose Bayesian methods for Gaussian graphical models that lead to sparse and adaptively shrunk estimators of the precision (inverse covariance) matrix. Our methods are based on lasso-type regularization priors leading to parsimonious…

统计方法学 · 统计学 2013-10-07 Rajesh Talluri , Veerabhadran Baladandayuthapani , Bani K. Mallick

We develop a Bayesian methodology aimed at simultaneously estimating low-rank and row-sparse matrices in a high-dimensional multiple-response linear regression model. We consider a carefully devised shrinkage prior on the matrix of…

统计方法学 · 统计学 2019-04-10 Antik Chakraborty , Anirban Bhattacharya , Bani K. Mallick

We introduce GRASP, a simple Bayesian framework for regression with grouped predictors, built on the normal beta prime (NBP) prior. The NBP prior is an adaptive generalization of the horseshoe prior with tunable hyperparameters that control…

统计方法学 · 统计学 2025-06-24 Shu Yu Tew , Daniel F. Schmidt , Mario Boley