English
Related papers

Related papers: Bayesian Effect Selection in Structured Additive D…

200 papers

We propose a novel adaptive empirical Bayesian method for sparse deep learning, where the sparsity is ensured via a class of self-adaptive spike-and-slab priors. The proposed method works by alternatively sampling from an adaptive…

Machine Learning · Statistics 2020-04-15 Wei Deng , Xiao Zhang , Faming Liang , Guang Lin

Methods for choosing a fixed set of knot locations in additive spline models are fairly well established in the statistical literature. While most of these methods are in principle directly extendable to non-additive surface models, they…

Computation · Statistics 2018-07-03 Feng Li , Mattias Villani

Bayesian inference allows us to define a posterior distribution over the weights of a generic neural network (NN). Exact posteriors are usually intractable, in which case approximations can be employed. One such approximation - variational…

Machine Learning · Computer Science 2026-01-30 Andrew Millard , Joshua Murphy , Peter Green , Simon Maskell

We study the use of spike and slab priors for consistent estimation of the number of change points and their locations. Leveraging recent results in the variable selection literature, we show that an estimator based on spike and slab priors…

Methodology · Statistics 2021-06-22 Lorenzo Cappello , Oscar Hernan Madrid Padilla , Julia A. Palacios

Global-local shrinkage hierarchies are an important innovation in Bayesian estimation. We propose the use of log-scale distributions as a novel basis for generating familes of prior distributions for local shrinkage hyperparameters. By…

Statistics Theory · Mathematics 2020-01-31 Daniel F. Schmidt , Enes Makalic

Additive regression models with interactions are widely studied in the literature, using methods such as splines or Gaussian process regression. However, these methods can pose challenges for estimation and model selection, due to the…

Statistics Theory · Mathematics 2023-06-14 Wicher Bergsma , Haziq Jamil

Shrinkage prior are becoming more and more popular in Bayesian modeling for high dimensional sparse problems due to its computational efficiency. Recent works show that a polynomially decaying prior leads to satisfactory posterior…

Statistics Theory · Mathematics 2020-04-14 Qifan Song

We introduce a Bayesian framework for mixed-type multivariate regression using continuous shrinkage priors. Our framework enables joint analysis of mixed continuous and discrete outcomes and facilitates variable selection from the $p$…

Statistics Theory · Mathematics 2024-12-20 Shao-Hsuan Wang , Ray Bai , Hsin-Hsiung Huang

A Bayesian non-parametric framework for studying time-to-event data is proposed, where the prior distribution is allowed to depend on an additional random source, and may update with the sample size. Such scenarios are natural, for…

Methodology · Statistics 2025-05-06 Martin Bladt , Jorge González Cázares

Standard Bayesian analyses can be difficult to perform when the full likelihood, and consequently the full posterior distribution, is too complex and difficult to specify or if robustness with respect to data or to model misspecifications…

Methodology · Statistics 2019-01-08 Federica Giummolè , Valentina Mameli , Erlis Ruli , Laura Ventura

In this paper, we present an innovative method for constructing proper priors for the skewness (shape) parameter in the skew-symmetric family of distributions. The proposed method is based on assigning a prior distribution on the…

Methodology · Statistics 2017-08-28 Holger Dette , Christophe Ley , Francisco Javier Rubio

We consider Bayesian variable selection for binary outcomes under a probit link with a spike-and-slab prior on the regression coefficients. Motivated by the computational challenges encountered by Markov chain Monte Carlo (MCMC) samplers in…

Computation · Statistics 2026-05-18 Augusto Fasano , Giovanni Rebaudo

Recently, fitting probabilistic models have gained importance in many areas but estimation of such distributional models with very large data sets is a difficult task. In particular, the use of rather complex models can easily lead to…

Large Bayesian VARs are now widely used in empirical macroeconomics. One popular shrinkage prior in this setting is the natural conjugate prior as it facilitates posterior simulation and leads to a range of useful analytical results. This…

Econometrics · Economics 2021-11-16 Joshua C. C. Chan

Popular statistical software provides Bayesian information criterion (BIC) for multilevel models or linear mixed models. However, it has been observed that the combination of statistical literature and software documentation has led to…

Methodology · Statistics 2022-06-24 Sun-Joo Cho , Hao Wu , Matthew Naveiras

We propose a Bayesian tensor regression model to accommodate the effect of multiple factors on phenotype prediction. We adopt a set of prior distributions that resolve identifiability issues that may arise between the parameters in the…

Machine Learning · Statistics 2025-11-04 Antonia A. L. Dos Santos , Danilo A. Sarti , Rafael A. Moral , Andrew C. Parnell

Factor models are widely used for dimension reduction. Bayesian approaches to these models often place a prior on the factor loadings that allows for infinitely many factors, with loadings increasingly shrunk toward zero as the column index…

Methodology · Statistics 2026-03-31 Shicheng Liu , Qingping Zhou , Yanan Fan , Xiongwen Ke

Variable selection in Gaussian processes (GPs) is typically undertaken by thresholding the inverse lengthscales of automatic relevance determination kernels, but in high-dimensional datasets this approach can be unreliable. A more…

Machine Learning · Statistics 2022-02-25 Hugh Dance , Brooks Paige

Small area estimation (SAE) plays a central role in survey statistics and epidemiology, providing reliable estimates for domains with limited sample sizes. The multivariate Fay-Herriot model has been extensively used for this purpose,…

Methodology · Statistics 2026-01-22 Shushi Nishina , Takahiro Onizuka , Shintaro Hashimoto

We incorporate a version of a spike and slab prior, comprising a pointmass at zero ("spike") and a Normal distribution around zero ("slab") into a dynamic panel data framework to model coefficient heterogeneity. In addition to homogeneity…

Econometrics · Economics 2024-02-07 Hyungsik Roger Moon , Frank Schorfheide , Boyuan Zhang