English
Related papers

Related papers: Novel Deep neural networks for solving Bayesian st…

200 papers

This paper introduces a computationally efficient algorithm in system theory for solving inverse problems governed by linear partial differential equations (PDEs). We model solutions of linear PDEs using Gaussian processes with priors…

Machine Learning · Statistics 2025-06-16 Xin Li , Markus Lange-Hegermann , Bogdan Raiţă

Bayesian approaches for learning deep neural networks (BNN) have been received much attention and successfully applied to various applications. Particularly, BNNs have the merit of having better generalization ability as well as better…

Machine Learning · Statistics 2023-05-25 Insung Kong , Dongyoon Yang , Jongjin Lee , Ilsang Ohn , Gyuseung Baek , Yongdai Kim

Varying coefficient models (VCMs) are widely used for estimating nonlinear regression functions for functional data. Their Bayesian variants using Gaussian process priors on the functional coefficients, however, have received limited…

Methodology · Statistics 2022-03-01 Rajarshi Guhaniyogi , Cheng Li , Terrance D. Savitsky , Sanvesh Srivastava

We study the Electrical Impedance Tomography Bayesian inverse problem for recovering the conductivity given noisy measurements of the voltage on some boundary surface electrodes. The uncertain conductivity depends linearly on a countable…

Numerical Analysis · Mathematics 2023-06-16 Quang Huy Pham , Viet Ha Hoang

The resolution of many large-scale inverse problems using MCMC methods requires a step of drawing samples from a high dimensional Gaussian distribution. While direct Gaussian sampling techniques, such as those based on Cholesky…

Methodology · Statistics 2015-06-22 Clément Gilavert , Saïd Moussaoui , Jérôme Idier

In this work, we extend deep learning-based numerical methods to fully coupled forward-backward stochastic differential equations (FBSDEs) within a non-Markovian framework. Error estimates and convergence are provided. In contrast to the…

Mathematical Finance · Quantitative Finance 2025-11-25 Hasib Uddin Molla , Matthew Backhouse , Ankit Banarjee , Jinniao Qiu

It is one of the most challenging problems in applied mathematics to approximatively solve high-dimensional partial differential equations (PDEs). Recently, several deep learning-based approximation algorithms for attacking this problem…

Numerical Analysis · Mathematics 2023-02-10 Christian Beck , Martin Hutzenthaler , Arnulf Jentzen , Benno Kuckuck

In this chapter, we address the challenge of exploring the posterior distributions of Bayesian inverse problems with computationally intensive forward models. We consider various multivariate proposal distributions, and compare them with…

Computation · Statistics 2024-05-02 Mikkel B. Lykkegaard , Colin Fox , Dave Higdon , C. Shane Reese , J. David Moulton

Switching state-space models (SSSM) are a very popular class of time series models that have found many applications in statistics, econometrics and advanced signal processing. Bayesian inference for these models typically relies on Markov…

Computation · Statistics 2010-11-11 Nick Whiteley , Christophe Andrieu , Arnaud Doucet

Recent advances in stochastic gradient variational inference have made it possible to perform variational Bayesian inference with posterior approximations containing auxiliary random variables. This enables us to explore a new synthesis of…

Computation · Statistics 2015-05-20 Tim Salimans , Diederik P. Kingma , Max Welling

Classical numerical methods for solving partial differential equations suffer from the curse dimensionality mainly due to their reliance on meticulously generated spatio-temporal grids. Inspired by modern deep learning based techniques for…

Machine Learning · Statistics 2018-04-20 Maziar Raissi

Proximal Markov Chain Monte Carlo is a novel construct that lies at the intersection of Bayesian computation and convex optimization, which helped popularize the use of nondifferentiable priors in Bayesian statistics. Existing formulations…

Computation · Statistics 2023-01-24 Qiang Heng , Hua Zhou , Eric C. Chi

We propose a new class of Bayesian neural networks (BNNs) that can be trained using noisy data of variable fidelity, and we apply them to learn function approximations as well as to solve inverse problems based on partial differential…

Machine Learning · Computer Science 2021-06-02 Xuhui Meng , Hessam Babaee , George Em Karniadakis

Deriving Bayesian inference for exponential random graph models (ERGMs) is a challenging "doubly intractable" problem as the normalizing constants of the likelihood and posterior density are both intractable. Markov chain Monte Carlo (MCMC)…

Computation · Statistics 2019-11-26 Linda S. L. Tan , Nial Friel

Fractional diffusion equations have been an effective tool for modeling anomalous diffusion in complicated systems. However, traditional numerical methods require expensive computation cost and storage resources because of the memory effect…

Numerical Analysis · Mathematics 2022-11-23 Xiong-bin Yan , Zhi-Qin John Xu , Zheng Ma

A novel class of non-reversible Markov chain Monte Carlo schemes relying on continuous-time piecewise-deterministic Markov Processes has recently emerged. In these algorithms, the state of the Markov process evolves according to a…

Methodology · Statistics 2018-05-16 Paul Vanetti , Alexandre Bouchard-Côté , George Deligiannidis , Arnaud Doucet

Many large scale problems in computational fluid dynamics such as uncertainty quantification, Bayesian inversion, data assimilation and PDE constrained optimization are considered very challenging computationally as they require a large…

Computational Physics · Physics 2020-04-22 Kjetil O. Lye , Siddhartha Mishra , Deep Ray

Despite recent advances, sampling-based inference for Bayesian Neural Networks (BNNs) remains a significant challenge in probabilistic deep learning. While sampling-based approaches do not require a variational distribution assumption,…

Machine Learning · Computer Science 2025-02-11 Emanuel Sommer , Jakob Robnik , Giorgi Nozadze , Uros Seljak , David Rügamer

Integration over non-negative integrands is a central problem in machine learning (e.g. for model averaging, (hyper-)parameter marginalisation, and computing posterior predictive distributions). Bayesian Quadrature is a probabilistic…

Machine Learning · Statistics 2018-12-05 Ed Wagstaff , Saad Hamid , Michael Osborne

The past decades have seen enormous improvements in computational inference based on statistical models, with continual enhancement in a wide range of computational tools, in competition. In Bayesian inference, first and foremost, MCMC…

Computation · Statistics 2015-05-12 Peter J. Green , Krzysztof Łatuszyński , Marcelo Pereyra , Christian P. Robert