English
Related papers

Related papers: Inverse decision-making using neural amortized Bay…

200 papers

Policy gradient methods are reinforcement learning algorithms that adapt a parameterized policy by following a performance gradient estimate. Conventional policy gradient methods use Monte-Carlo techniques to estimate the gradient, which…

Machine Learning · Computer Science 2026-05-01 Mohammad Ghavamzadeh , Yaakov Engel , Michal Valko

The present paper proposes a Bayesian framework for inverse problems that seamlessly integrates optimization and inversion to enable rapid surrogate modeling, accurate parameter inference, and rigorous uncertainty quantification. Bayesian…

Computational Engineering, Finance, and Science · Computer Science 2026-02-05 Mihaela Chiappetta , Massimo Carraturo , Alexander Raßloff , Markus Kästner , Ferdinando Auricchio

The Bayesian approach to solving inverse problems relies on the choice of a prior. This critical ingredient allows the formulation of expert knowledge or physical constraints in a probabilistic fashion and plays an important role for the…

Machine Learning · Statistics 2022-11-08 Manuel Marschall , Gerd Wübbeler , Franko Schmähling , Clemens Elster

Neural networks make accurate predictions but often fail to provide reliable uncertainty estimates, especially under covariate distribution shifts between training and testing. To address this problem, we propose a Bayesian framework for…

Machine Learning · Statistics 2025-12-22 Yuli Slavutsky , David M. Blei

We present an iterative framework to improve the amortized approximations of posterior distributions in the context of Bayesian inverse problems, which is inspired by loop-unrolled gradient descent methods and is theoretically grounded in…

Machine Learning · Computer Science 2023-05-16 Rafael Orozco , Ali Siahkoohi , Mathias Louboutin , Felix J. Herrmann

In distributed optimization and distributed numerical linear algebra, we often encounter an inversion bias: if we want to compute a quantity that depends on the inverse of a sum of distributed matrices, then the sum of the inverses does not…

Machine Learning · Computer Science 2019-05-29 Michał Dereziński , Michael W. Mahoney

When subjected to automated decision-making, decision subjects may strategically modify their observable features in ways they believe will maximize their chances of receiving a favorable decision. In many practical situations, the…

Computer Science and Game Theory · Computer Science 2022-10-10 Keegan Harris , Valerie Chen , Joon Sik Kim , Ameet Talwalkar , Hoda Heidari , Zhiwei Steven Wu

Bayesian inference for inverse problems involves computing expectations under posterior distributions -- e.g., posterior means, variances, or predictive quantities -- typically via Monte Carlo (MC) estimation. When the quantity of interest…

Machine Learning · Statistics 2026-02-26 Ali Siahkoohi , Hyunwoo Oh

In this article a novel approach for training deep neural networks using Bayesian techniques is presented. The Bayesian methodology allows for an easy evaluation of model uncertainty and additionally is robust to overfitting. These are…

Machine Learning · Computer Science 2019-04-03 Konstantin Posch , Jürgen Pilz

Modern Bayesian inference involves a mixture of computational techniques for estimating, validating, and drawing conclusions from probabilistic models as part of principled workflows for data analysis. Typical problems in Bayesian workflows…

Learning the kernel parameters for Gaussian processes is often the computational bottleneck in applications such as online learning, Bayesian optimization, or active learning. Amortizing parameter inference over different datasets is a…

Machine Learning · Computer Science 2023-06-19 Matthias Bitzer , Mona Meister , Christoph Zimmer

Covariance estimation and selection for multivariate datasets in a high-dimensional regime is a fundamental problem in modern statistics. Gaussian graphical models are a popular class of models used for this purpose. Current Bayesian…

Methodology · Statistics 2019-03-06 Xuan Cao , Shaojun Zhang

In Bayesian inverse problems sampling the posterior distribution is often a challenging task when the underlying models are computationally intensive. To this end, surrogates or reduced models are often used to accelerate the computation.…

Numerical Analysis · Mathematics 2019-09-04 Qifeng Liao , Jinglai Li

Recent advances in reconstruction methods for inverse problems leverage powerful data-driven models, e.g., deep neural networks. These techniques have demonstrated state-of-the-art performances for several imaging tasks, but they often do…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Riccardo Barbano , Chen Zhang , Simon Arridge , Bangti Jin

Bayesian methods are actively used for parameter identification and uncertainty quantification when solving nonlinear inverse problems with random noise. However, there are only few theoretical results justifying the Bayesian approach.…

Statistics Theory · Mathematics 2020-02-04 Vladimir Spokoiny

In indirect measurements, the measurand is determined by solving an inverse problem which requires a model of the measurement process. Such models are often approximations and introduce systematic errors leading to a bias of the posterior…

Methodology · Statistics 2025-09-22 Maren Casfor , Philipp Trunschke , Sebastian Heidenreich , Nando Hegemann

Inverse optimal control can be used to characterize behavior in sequential decision-making tasks. Most existing work, however, is limited to fully observable or linear systems, or requires the action signals to be known. Here, we introduce…

Machine Learning · Computer Science 2023-10-31 Dominik Straub , Matthias Schultheis , Heinz Koeppl , Constantin A. Rothkopf

This paper demonstrates the application of Bayesian Artificial Neural Networks to Ordinary Differential Equation (ODE) inverse problems. We consider the case of estimating an unknown chaotic dynamical system transition model from state…

Machine Learning · Computer Science 2020-05-28 David K. E. Green , Filip Rindler

Bayesian inference for inverse problems hinges critically on the choice of priors. In the absence of specific prior information, population-level distributions can serve as effective priors for parameters of interest. With the advent of…

Instrumentation and Methods for Astrophysics · Physics 2025-02-11 Gabriel Missael Barco , Alexandre Adam , Connor Stone , Yashar Hezaveh , Laurence Perreault-Levasseur

Perceptual estimates exhibit a reversal in bias depending on uncertainty: they shift toward prior expectations under high stimulus noise, but away from them when sensory noise dominates. The normative framework of a Bayesian observer model…

Neurons and Cognition · Quantitative Biology 2025-10-16 Hyun-Jun Jeon , Hansol Choi , Oh-Sang Kwon