English
Related papers

Related papers: Block Hyper-g Priors in Bayesian Regression

200 papers

We study high-dimensional Bayesian linear regression with a general beta prime distribution for the scale parameter. Under the assumption of sparsity, we show that appropriate selection of the hyperparameters in the beta prime prior leads…

Methodology · Statistics 2019-07-19 Ray Bai , Malay Ghosh

We study central limit theorems for linear statistics in high-dimensional Bayesian linear regression with product priors. Unlike the existing literature where the focus is on posterior contraction, we work under a non-contracting regime…

Statistics Theory · Mathematics 2025-08-01 Seunghyun Lee , Nabarun Deb , Sumit Mukherjee

Prior distributions for high-dimensional linear regression require specifying a joint distribution for the unobserved regression coefficients, which is inherently difficult. We instead propose a new class of shrinkage priors for linear…

Methodology · Statistics 2020-07-09 Yan Dora Zhang , Brian P. Naughton , Howard D. Bondell , Brian J. Reich

We present a very simple yet powerful generalization of a previously described model and algorithm for estimation of multiple dipoles from magneto/electro-encephalographic data. Specifically, the generalization consists in the introduction…

Applications · Statistics 2020-06-09 Alessandro Viani , Gianvittorio Luria , Harald Bornfleth , Alberto Sorrentino

Bayesian inference in generalized linear models requires a prior on the coefficient vector $\beta$. Practitioners naturally reason about response probabilities at specific covariate values, not about abstract log-odds parameters. We develop…

Methodology · Statistics 2026-03-03 Nick Polson , Vadim Sokolov

Accurately quantifying tail risks-rare but high-impact events such as financial crashes or extreme weather-is a central challenge in risk management, with serially dependent data. We develop a Bayesian framework based on the Generalized…

Methodology · Statistics 2025-10-17 David L. Carl , Simone A. Padoan , Stefano Rizzelli

The recently developed semi-parametric generalized linear model (SPGLM) offers more flexibility as compared to the classical GLM by including the baseline or reference distribution of the response as an additional parameter in the model.…

Methodology · Statistics 2024-04-09 Entejar Alam , Peter Müller , Paul J. Rathouz

Consider semiparametric models that display local asymptotic exponentiality (Ibragimov and Has'minskii (1981)), an asymptotic property of the likelihood associated with discontinuities of densities. Our interest goes to estimation of the…

Statistics Theory · Mathematics 2013-12-19 Bas Kleijn , Bartek Knapik

The hyperparameters in Gaussian process regression (GPR) model with a specified kernel are often estimated from the data via the maximum marginal likelihood. Due to the non-convexity of marginal likelihood with respect to the…

Machine Learning · Statistics 2018-01-15 Zexun Chen , Bo Wang

We consider the specification of prior distributions for Bayesian model comparison, focusing on regression-type models. We propose a particular joint specification of the prior distribution across models so that sensitivity of posterior…

Methodology · Statistics 2012-07-25 Petros Dellaportas , Jonathan J. Forster , Ioannis Ntzoufras

We investigate Bayes posterior distributions in high-dimensional generalized linear models (GLMs) under the proportional asymptotics regime, where the number of features and samples diverge at a comparable rate. Specifically, we…

Statistics Theory · Mathematics 2026-01-05 Manuel Sáenz , Pragya Sur

In this paper we propose a novel framework for the construction of sparsity-inducing priors. In particular, we define such priors as a mixture of exponential power distributions with a generalized inverse Gaussian density (EP-GIG). EP-GIG…

Machine Learning · Statistics 2012-04-20 Zhihua Zhang , Shusen Wang , Dehua Liu , Michael I. Jordan

Bayesian inference for statistical models with a hierarchical structure is often characterized by specification of priors for parameters at different levels of the hierarchy. When higher level parameters are functions of the lower level…

Methodology · Statistics 2025-02-04 Ken B. Newman , Cristiano Villa , Ruth King

Penalized regression methods, such as $L_1$ regularization, are routinely used in high-dimensional applications, and there is a rich literature on optimality properties under sparsity assumptions. In the Bayesian paradigm, sparsity is…

Statistics Theory · Mathematics 2014-01-22 Anirban Bhattacharya , Debdeep Pati , Natesh S. Pillai , David B. Dunson

We propose an objective Bayesian approach to the selection of covariates and their penalised splines transformations in generalised additive models. Specification of a reasonable default prior for the model parameters and combination with a…

Methodology · Statistics 2012-08-21 Daniel Sabanés Bové , Leonhard Held , Göran Kauermann

Simultaneously achieving parsimony and good predictive power in high dimensions is a main challenge in statistics. Non-local priors (NLPs) possess appealing properties for high-dimensional model choice, but their use for estimation has not…

Statistics Theory · Mathematics 2015-01-22 David Rossell , Donatello Telesca

The practice of employing empirical likelihood (EL) components in place of parametric likelihood functions in the construction of Bayesian-type procedures has been well-addressed in the modern statistical literature. We rigorously derive…

Methodology · Statistics 2018-08-21 Albert Vexler , Li Zou , Alan D. Hutson

Bayesian mixture models are widely used for clustering of high-dimensional data with appropriate uncertainty quantification. However, as the dimension of the observations increases, posterior inference often tends to favor too many or too…

Methodology · Statistics 2022-11-22 Noirrit Kiran Chandra , Antonio Canale , David B. Dunson

In Generalised Bayesian Inference (GBI), the learning rate and hyperparameters of the loss must be estimated. These inference-hyperparameters can't be estimated jointly with the other parameters, from the data, by giving them a prior.…

Methodology · Statistics 2026-05-18 Jeong Eun Lee , Sitong Liu , Geoff K. Nicholls

Expected-posterior priors (EPP) have been proved to be extremely useful for testing hypothesis on the regression coefficients of normal linear models. One of the advantages of using EPPs is that impropriety of baseline priors causes no…

Computation · Statistics 2014-12-02 Dimitris Fouskakis , Ioannis Ntzoufras