English
Related papers

Related papers: A data-driven and model-based accelerated Hamilton…

200 papers

By formulating the inverse problem of partial differential equations (PDEs) as a statistical inference problem, the Bayesian approach provides a general framework for quantifying uncertainties. In the inverse problem of PDEs, parameters are…

Numerical Analysis · Mathematics 2026-02-10 Haoyu Lu , Junxiong Jia , Deyu Meng

Bayesian Physics Informed Neural Networks (BPINN) have attracted considerable attention for inferring the system states and physical parameters of differential equations according to noisy observations. However, in practice, Hamiltonian…

Machine Learning · Computer Science 2025-05-06 Yilong Hou , Xi'an Li , Jinran Wu , You-Gan Wang

Hamiltonian Monte Carlo (HMC) is a popular Markov chain Monte Carlo (MCMC) algorithm that generates proposals for a Metropolis-Hastings algorithm by simulating the dynamics of a Hamiltonian system. However, HMC is sensitive to large time…

Machine Learning · Statistics 2016-09-15 Xiaoyu Lu , Valerio Perrone , Leonard Hasenclever , Yee Whye Teh , Sebastian J. Vollmer

Hessian operators arising in inverse problems governed by partial differential equations (PDEs) play a critical role in delivering efficient, dimension-independent convergence for both Newton solution of deterministic inverse problems, as…

Traditionally, the field of computational Bayesian statistics has been divided into two main subfields: variational methods and Markov chain Monte Carlo (MCMC). In recent years, however, several methods have been proposed based on combining…

Computation · Statistics 2017-04-19 Cheng Zhang , Babak Shahbaba , Hongkai Zhao

Bayesian statistical inverse problems are often solved with Markov chain Monte Carlo (MCMC)-type schemes. When the problems are governed by large-scale discrete nonlinear partial differential equations (PDEs), they are computationally…

Numerical Analysis · Mathematics 2019-09-06 Howard C. Elman , Akwum Onwunta

The Hamiltonian Monte Carlo method generates samples by introducing a mechanical system that explores the target density. For distributions on manifolds it is not always simple to perform the mechanics as a result of the lack of global…

Computation · Statistics 2019-04-22 Alessandro Barp , Anthony Kennedy , Mark Girolami

Integral equation based numerical methods are directly applicable to homogeneous elliptic PDEs, and offer the ability to solve these with high accuracy and speed on complex domains. In this paper, extensions to problems with inhomogeneous…

Numerical Analysis · Mathematics 2019-07-22 Fredrik Fryklund , Mary Catherine A. Kropinski , Anna-Karin Tornberg

We address the numerical solution of infinite-dimensional inverse problems in the framework of Bayesian inference. In the Part I companion to this paper (arXiv.org:1308.1313), we considered the linearized infinite-dimensional inverse…

Methodology · Statistics 2014-04-14 Noemi Petra , James Martin , Georg Stadler , Omar Ghattas

We propose a data-driven approach to solve multiscale elliptic PDEs with random coefficients based on the intrinsic low dimension structure of the underlying elliptic differential operators. Our method consists of offline and online stages.…

Numerical Analysis · Mathematics 2019-07-02 Sijing Li , Zhiwen Zhang , Hongkai Zhao

Modeling physical phenomena like heat transport and diffusion is crucially dependent on the numerical solution of partial differential equations (PDEs). A PDE solver finds the solution given coefficients and a boundary condition, whereas an…

Graphics · Computer Science 2022-08-04 Ekrem Fatih Yılmazer , Delio Vicini , Wenzel Jakob

This paper develops a probabilistic numerical method for solution of partial differential equations (PDEs) and studies application of that method to PDE-constrained inverse problems. This approach enables the solution of challenging inverse…

Methodology · Statistics 2017-07-12 Jon Cockayne , Chris Oates , Tim Sullivan , Mark Girolami

Hamiltonian Monte Carlo (HMC) is a popular Markov Chain Monte Carlo (MCMC) algorithm to sample from an unnormalized probability distribution. A leapfrog integrator is commonly used to implement HMC in practice, but its performance can be…

Computation · Statistics 2021-10-28 Marcel Hirt , Michalis K. Titsias , Petros Dellaportas

Inferring parameters of high-dimensional partial differential equations (PDEs) poses significant computational and inferential challenges, primarily due to the curse of dimensionality and the inherent limitations of traditional numerical…

Computational Engineering, Finance, and Science · Computer Science 2025-09-18 Weihao Yan , Christoph Brune , Mengwu Guo

Hamiltonian Monte Carlo (HMC) is a Markov chain algorithm for sampling from a high-dimensional distribution with density $e^{-f(x)}$, given access to the gradient of $f$. A particular case of interest is that of a $d$-dimensional Gaussian…

Machine Learning · Statistics 2022-09-27 Simon Apers , Sander Gribling , Dániel Szilágyi

We introduce a deep learning accelerated methodology to solve PDE-based Bayesian inverse problems with guaranteed accuracy. This is motivated by the ill-posed problem of inferring a spatio-temporal heat-flux parameter known as the Biot…

Numerical Analysis · Mathematics 2023-06-06 Teo Deveney , Eike Mueller , Tony Shardlow

We investigate solution methods for large-scale inverse problems governed by partial differential equations (PDEs) via Bayesian inference. The Bayesian framework provides a statistical setting to infer uncertain parameters from noisy…

Applications · Statistics 2023-02-08 Mina Karimi , Mehrdad Massoudi , Kaushik Dayal , Matteo Pozzi

Piecewise-deterministic Markov process (PDMP) samplers constitute a state-of-the-art Markov chain Monte Carlo paradigm in Bayesian computation, with examples including the zig-zag and bouncy particle sampler (bps). Recent work on the…

Computation · Statistics 2026-03-10 Andrew Chin , Akihiko Nishimura

Bayesian inverse problems often involve sampling posterior distributions on infinite-dimensional function spaces. Traditional Markov chain Monte Carlo (MCMC) algorithms are characterized by deteriorating mixing times upon mesh-refinement,…

Computation · Statistics 2017-03-08 Alexandros Beskos , Mark Girolami , Shiwei Lan , Patrick E. Farrell , Andrew M. Stuart

Bayesian inverse problems arise in various scientific and engineering domains, and solving them can be computationally demanding. This is especially the case for problems governed by partial differential equations, where the repeated…

Numerical Analysis · Mathematics 2025-11-04 Juntao Yang , Jeff Adie , Simon See , Adriano Gualandi , Gianmarco Mengaldo