English
Related papers

Related papers: Posterior Impropriety of some Sparse Bayesian Lear…

200 papers

Recent progress in variational inference has paid much attention to the flexibility of variational posteriors. One promising direction is to use implicit distributions, i.e., distributions without tractable densities as the variational…

Machine Learning · Statistics 2018-02-26 Jiaxin Shi , Shengyang Sun , Jun Zhu

Bayesian inference is often implemented using approximations, which can yield interval estimates that are too narrow, not fully capturing the uncertainty in the posterior distribution. We address the question of how to adjust these…

Methodology · Statistics 2026-03-23 Tiffany Cai , Philip Greengard , Ben Goodrich , Andrew Gelman

We introduce non-stationary Mat\'ern field priors with stochastic partial differential equations, and construct correlation length-scaling with hyperpriors. We model both the hyperprior and the Mat\'ern prior as continuous-parameter random…

Statistics Theory · Mathematics 2016-12-12 Lassi Roininen , Mark Girolami , Sari Lasanen , Markku Markkanen

This paper investigates sparse high-dimensional linear regression, particularly examining the properties of the posterior under conditions of random design and unknown error variance. We provide consistency results for the posterior and…

Statistics Theory · Mathematics 2024-05-30 The Tien Mai

The well-known Bayes theorem assumes that a posterior distribution is a probability distribution. However, the posterior distribution may no longer be a probability distribution if an improper prior distribution (non-probability measure)…

Instrumentation and Methods for Astrophysics · Physics 2018-08-28 Hyungsuk Tak , Sujit K. Ghosh , Justin A. Ellis

This work addresses the fundamental linear inverse problem in compressive sensing (CS) by introducing a new type of regularizing generative prior. Our proposed method utilizes ideas from classical dictionary-based CS and, in particular,…

Machine Learning · Statistics 2024-11-15 Benedikt Böck , Sadaf Syed , Wolfgang Utschick

Nested error regression models are useful tools for analysis of grouped data, especially in the case of small area estimation. This paper suggests a nested error regression model using uncertain random effects in which the random effect in…

Methodology · Statistics 2017-02-28 Shonosuke Sugasawa , Tatsuya Kubokawa

An empirical Bayes approach to the estimation of possibly sparse sequences observed in Gaussian white noise is set out and investigated. The prior considered is a mixture of an atom of probability at zero and a heavy-tailed density \gamma,…

Statistics Theory · Mathematics 2007-06-13 Iain M. Johnstone , Bernard W. Silverman

Sparseness of the regression coefficient vector is often a desirable property, since, among other benefits, sparseness improves interpretability. In practice, many true regression coefficients might be negligibly small, but non-zero, which…

Methodology · Statistics 2019-10-01 Daniel Andrade , Kenji Fukumizu

We introduce the concept of conjugate prior models for a given likelihood function in Bayesian spatial inversion. The conjugate class of prior models can be selection extended and still remain conjugate. We demonstrate the generality of…

Methodology · Statistics 2018-12-06 Henning Omre , Kjartan Rimstad

We consider a Bayesian nonparametric approach to a family of linear inverse problems in a separable Hilbert space setting with Gaussian noise. We assume Gaussian priors, which are conjugate to the model, and present a method of identifying…

Statistics Theory · Mathematics 2013-08-05 Sergios Agapiou , Stig Larsson , Andrew M. Stuart

Machine learning offers an exciting opportunity to improve the calibration of nearly all reconstructed objects in high-energy physics detectors. However, machine learning approaches often depend on the spectra of examples used during…

High Energy Physics - Phenomenology · Physics 2022-09-02 Rikab Gambhir , Benjamin Nachman , Jesse Thaler

Sample selection models are a widely used approach for correcting bias caused by data that are missing not at random. Their formulation requires specifying the variables that influence the outcome and those that drive the selection process.…

Computation · Statistics 2026-03-25 Adam J. Iqbal , Emmanuel O. Ogundimu , F. Javier Rubio

Probabilistic predictions from neural networks which account for predictive uncertainty during classification is crucial in many real-world and high-impact decision making settings. However, in practice most datasets are trained on…

Machine Learning · Computer Science 2022-09-30 Satya Borgohain , Klaus Ackermann , Ruben Loaiza-Maya

In Bayesian statistics, the choice of prior distribution is often debatable, especially if prior knowledge is limited or data are scarce. In imprecise probability, sets of priors are used to accurately model and reflect prior knowledge.…

Methodology · Statistics 2016-10-25 Gero Walter , Frank P. A. Coolen

Approximate Bayesian inference for neural networks is considered a robust alternative to standard training, often providing good performance on out-of-distribution data. However, Bayesian neural networks (BNNs) with high-fidelity…

Machine Learning · Computer Science 2021-12-07 Pavel Izmailov , Patrick Nicholson , Sanae Lotfi , Andrew Gordon Wilson

This paper addresses Bayesian inference related to partial differential equations (PDEs), particularly nonparametric regression constrained by PDEs. To effectively encode prior information, we propose a novel framework that learns a…

Statistics Theory · Mathematics 2026-02-09 Junxiong Jia , Deyu Meng , Zongben Xu , Fang Yao

When related learning tasks are naturally arranged in a hierarchy, an appealing approach for coping with scarcity of instances is that of transfer learning using a hierarchical Bayes framework. As fully Bayesian computations can be…

Machine Learning · Computer Science 2012-06-18 Gal Elidan , Ben Packer , Geremy Heitz , Daphne Koller

Bayesian posterior distributions arising in modern applications, including inverse problems in partial differential equation models in tomography and subsurface flow, are often computationally intractable due to the large computational cost…

Machine Learning · Statistics 2023-02-10 Tapio Helin , Andrew Stuart , Aretha Teckentrup , Konstantinos Zygalakis

This paper studies the problem of approximately unlearning a Bayesian model from a small subset of the training data to be erased. We frame this problem as one of minimizing the Kullback-Leibler divergence between the approximate posterior…

Machine Learning · Computer Science 2020-10-27 Quoc Phong Nguyen , Bryan Kian Hsiang Low , Patrick Jaillet