中文
相关论文

相关论文: Shrinkage priors for Bayesian prediction

200 篇论文

Uncertainty quantification is essential when dealing with ill-conditioned inverse problems due to the inherent nonuniqueness of the solution. Bayesian approaches allow us to determine how likely an estimation of the unknown parameters is…

机器学习 · 统计学 2020-01-16 Ali Siahkoohi , Gabrio Rizzuti , Felix J. Herrmann

A key sticking point of Bayesian analysis is the choice of prior distribution, and there is a vast literature on potential defaults including uniform priors, Jeffreys' priors, reference priors, maximum entropy priors, and weakly informative…

统计方法学 · 统计学 2017-11-22 Andrew Gelman , Daniel Simpson , Michael Betancourt

In statistical classification/multiple hypothesis testing and machine learning, a model distribution estimated from the training data is usually applied to replace the unknown true distribution in the Bayes decision rule, which introduces a…

信息论 · 计算机科学 2024-09-24 Zijian Yang , Vahe Eminyan , Ralf Schlüter , Hermann Ney

Current approaches in approximate inference for Bayesian neural networks minimise the Kullback-Leibler divergence to approximate the true posterior over the weights. However, this approximation is without knowledge of the final application,…

机器学习 · 统计学 2018-05-11 Adam D. Cobb , Stephen J. Roberts , Yarin Gal

The cumulative shrinkage process is an increasing shrinkage prior that can be employed within models in which additional terms are supposed to play a progressively negligible role. A natural application is to Gaussian factor models, where…

统计计算 · 统计学 2020-08-13 Sirio Legramanti

Shrinkage prior are becoming more and more popular in Bayesian modeling for high dimensional sparse problems due to its computational efficiency. Recent works show that a polynomially decaying prior leads to satisfactory posterior…

统计理论 · 数学 2020-04-14 Qifan Song

This paper proposes a new methodology for performing Bayesian inference in imaging inverse problems where the prior knowledge is available in the form of training data. Following the manifold hypothesis and adopting a generative modelling…

统计方法学 · 统计学 2021-03-19 Matthew Holden , Marcelo Pereyra , Konstantinos C. Zygalakis

Neural networks are the cornerstone of modern machine learning, yet can be difficult to interpret, give overconfident predictions and are vulnerable to adversarial attacks. Bayesian neural networks (BNNs) provide some alleviation of these…

机器学习 · 统计学 2026-02-24 August Arnstad , Leiv Rønneberg , Geir Storvik

Weight space symmetries in neural network architectures, such as permutation symmetries in MLPs, give rise to Bayesian neural network (BNN) posteriors with many equivalent modes. This multimodality poses a challenge for variational…

机器学习 · 计算机科学 2024-08-13 Yoav Gelberg , Tycho F. A. van der Ouderaa , Mark van der Wilk , Yarin Gal

An efficient algorithm is proposed for Bayesian model calibration, which is commonly used to estimate the model parameters of non-linear, computationally expensive models using measurement data. The approach is based on Bayesian statistics:…

We consider a situation where the distribution of a random variable is being estimated by the empirical distribution of noisy measurements of that variable. This is common practice in, for example, teacher value-added models and other…

计量经济学 · 经济学 2021-12-08 Koen Jochmans , Martin Weidner

Bayesian model comparison requires the specification of a prior distribution on the parameter space of each candidate model. In this connection two concerns arise: on the one hand the elicitation task rapidly becomes prohibitive as the…

统计方法学 · 统计学 2011-02-16 Guido Consonni , Piero Veronese

Global-local shrinkage hierarchies are an important innovation in Bayesian estimation. We propose the use of log-scale distributions as a novel basis for generating familes of prior distributions for local shrinkage hyperparameters. By…

统计理论 · 数学 2020-01-31 Daniel F. Schmidt , Enes Makalic

Gibbs posteriors are proportional to a prior distribution multiplied by an exponentiated loss function, with a key tuning parameter weighting information in the loss relative to the prior and providing a control of posterior uncertainty.…

统计方法学 · 统计学 2025-09-09 Steven Winter , Omar Melikechi , David B. Dunson

Researchers and managers model ecological communities to infer the biotic and abiotic variables that shape species' ranges, habitat use, and co-occurrence which, in turn, are used to support management decisions and test ecological…

应用统计 · 统计学 2020-06-01 Trevor Hefley

This paper develops a slice sampler for Bayesian linear regression models with arbitrary priors. The new sampler has two advantages over current approaches. One, it is faster than many custom implementations that rely on auxiliary latent…

统计计算 · 统计学 2018-06-18 P. Richard Hahn , Jingyu He , Hedibert Lopes

This paper considers the topic of finding prior distributions when a major component of the statistical model depends on a nonlinear function. Using results on how to construct uniform distributions in general metric spaces, we propose a…

统计计算 · 统计学 2014-05-09 Björn Bornkamp

Optimality results for two outstanding Bayesian estimation problems are given in this paper: the estimation of the sampling distribution for the squared total variation function and the estimation of the density for the $L^1$-squared loss…

统计理论 · 数学 2021-10-28 A. G. Nogales

Loss-based updating, including generalized Bayes, Gibbs, and quasi-posteriors, replaces likelihoods by a user-chosen loss and produces a posterior-like distribution via exponential tilt. We give a decision-theoretic characterization that…

统计方法学 · 统计学 2026-02-03 Kenichiro McAlinn , Kōsaku Takanashi

Transfer learning (TL) has emerged as a powerful tool to supplement data collected for a target task with data collected for a related source task. The Bayesian framework is natural for TL because information from the source data can be…

统计方法学 · 统计学 2024-06-06 Mohamed A. Abba , Jonathan P. Williams , Brian J. Reich