中文
相关论文

相关论文: Flexible Bayesian Last Layer Models Using Implicit…

200 篇论文

We introduce a novel class of Bayesian mixtures for normal linear regression models which incorporates a further Gaussian random component for the distribution of the predictor variables. The proposed cluster-weighted model aims to…

统计方法学 · 统计学 2026-05-26 Panagiotis Papastamoulis , Konstantinos Perrakis

The Bayesian Lasso is constructed in the linear regression framework and applies the Gibbs sampling to estimate the regression parameters. This paper develops a new sparse learning model, named the Bayesian Lasso Sparse (BLS) model, that…

机器学习 · 统计学 2022-07-15 Ingvild M. Helgøy , Yushu Li

We consider the optimal approximate posterior over the top-layer weights in a Bayesian neural network for regression, and show that it exhibits strong dependencies on the lower-layer weights. We adapt this result to develop a correlated…

机器学习 · 统计学 2021-06-23 Sebastian W. Ober , Laurence Aitchison

Many inverse problems are ill-posed and need to be complemented by prior information that restricts the class of admissible models. Bayesian approaches encode this information as prior distributions that impose generic properties on the…

机器学习 · 计算机科学 2024-12-20 Julian L. Möbius , Michael Habeck

We present Bayesian Diffusion Models (BDM), a prediction algorithm that performs effective Bayesian inference by tightly coupling the top-down (prior) information with the bottom-up (data-driven) procedure via joint diffusion processes. We…

计算机视觉与模式识别 · 计算机科学 2024-04-23 Haiyang Xu , Yu Lei , Zeyuan Chen , Xiang Zhang , Yue Zhao , Yilin Wang , Zhuowen Tu

Current methods for learning graphical models with latent variables and a fixed structure estimate optimal values for the model parameters. Whereas this approach usually produces overfitting and suboptimal generalization performance,…

机器学习 · 计算机科学 2013-01-30 Hagai Attias

We propose Diffusion Model Variational Inference (DMVI), a novel method for automated approximate inference in probabilistic programming languages (PPLs). DMVI utilizes diffusion models as variational approximations to the true posterior…

机器学习 · 计算机科学 2023-11-23 Simon Dirmeier , Fernando Perez-Cruz

This paper presents an improved implicit sampling method for hierarchical Bayesian inverse problems. A widely used approach for sampling posterior distribution is based on Markov chain Monte Carlo (MCMC). However, the samples generated by…

数值分析 · 数学 2018-11-27 Xiaoyan Song , Lijian Jiang , Guanghui Zheng

Bayesian neural networks provide a direct and natural way to extend standard deep neural networks to support probabilistic deep learning through the use of probabilistic layers that, traditionally, encode weight (and bias) uncertainty. In…

机器学习 · 计算机科学 2021-07-16 Daniel T. Chang

We consider the problem of sampling from a product-of-experts-type model that encompasses many standard prior and posterior distributions commonly found in Bayesian imaging. We show that this model can be easily lifted into a novel latent…

图像与视频处理 · 电气工程与系统科学 2026-04-16 Muhamed Kuric , Martin Zach , Andreas Habring , Michael Unser , Thomas Pock

We introduce implicit Bayesian neural networks, a simple and scalable approach for uncertainty representation in deep learning. Standard Bayesian approach to deep learning requires the impractical inference of the posterior distribution…

机器学习 · 统计学 2020-10-27 Trung Trinh , Samuel Kaski , Markus Heinonen

Deep feedforward neural networks (DFNNs) are a powerful tool for functional approximation. We describe flexible versions of generalized linear and generalized linear mixed models incorporating basis functions formed by a DFNN. The…

统计计算 · 统计学 2018-05-28 Minh-Ngoc Tran , Nghia Nguyen , David Nott , Robert Kohn

Variational Bayesian neural networks (BNNs) perform variational inference over weights, but it is difficult to specify meaningful priors and approximate posteriors in a high-dimensional weight space. We introduce functional variational…

机器学习 · 计算机科学 2019-03-15 Shengyang Sun , Guodong Zhang , Jiaxin Shi , Roger Grosse

Derivative-free Bayesian inversion is an important task in many science and engineering applications, particularly when computing the forward model derivative is computationally and practically challenging. In this paper, we introduce…

机器学习 · 计算机科学 2026-01-06 Hongkai Zheng , Austin Wang , Zihui Wu , Zhengyu Huang , Ricardo Baptista , Yisong Yue

In this paper we present a novel methodology to perform Bayesian model selection in linear models with heavy-tailed distributions. We consider a finite mixture of distributions to model a latent variable where each component of the mixture…

统计方法学 · 统计学 2017-08-21 Flávio B Gonçalves , Marcos O. Prates , Victor H. Lachos

We introduce BLAST, Bayesian Linear regression with Adaptive Shrinkage for Transfer, a Bayesian multi-source transfer learning framework for high-dimensional linear regression. The proposed analytical framework leverages global-local…

统计方法学 · 统计学 2026-03-10 Parsa Jamshidian , Donatello Telesca

Bayesian methods have become a popular way to incorporate prior knowledge and a notion of uncertainty into machine learning models. At the same time, the complexity of modern machine learning makes it challenging to comprehend a model's…

机器学习 · 计算机科学 2021-09-09 Sarem Seitz

We report the application of implicit likelihood inference to the prediction of the macro-parameters of strong lensing systems with neural networks. This allows us to perform deep learning analysis of lensing systems within a well-defined…

天体物理仪器与方法 · 物理学 2023-01-25 Ronan Legin , Yashar Hezaveh , Laurence Perreault-Levasseur , Benjamin Wandelt

Large Language Models (LLMs) demonstrate strong few-shot generalization through in-context learning, yet their reasoning in dynamic and stochastic environments remains opaque. Prior studies mainly focus on static tasks and overlook the…

人工智能 · 计算机科学 2025-12-23 Jensen Zhang , Jing Yang , Keze Wang

We propose a Bayesian approach using improper priors for hierarchical linear mixed models with flexible random effects and residual error distributions. The error distribution is modelled using scale mixtures of normals, which can capture…

统计方法学 · 统计学 2018-02-06 F. J. Rubio , M. F. J. Steel