English
Related papers

Related papers: Multi-variance replica exchange stochastic gradien…

200 papers

Neural networks have recently gained attention in solving inverse problems. One prominent methodology are Physics-Informed Neural Networks (PINNs) which can solve both forward and inverse problems. In the paper at hand, full waveform…

Numerical Analysis · Mathematics 2023-12-05 Leon Herrmann , Tim Bürchner , Felix Dietrich , Stefan Kollmannsberger

The Langevin algorithms are frequently used to sample the posterior distributions in Bayesian inference. In many practical problems, however, the posterior distributions often consist of non-differentiable components, posing challenges for…

Numerical Analysis · Mathematics 2023-04-11 Ziruo Cai , Jinglai Li , Xiaoqun Zhang

The thesis focuses on various techniques to find an alternate approximation method that could be universally used for a wide range of CFD problems but with low computational cost and low runtime. Various techniques have been explored within…

Machine Learning · Computer Science 2021-11-05 Siddharth Rout , Vikas Dwivedi , Balaji Srinivasan

Physics-informed neural networks (PINNs) have recently emerged as promising data-driven PDE solvers showing encouraging results on various PDEs. However, there is a fundamental limitation of training PINNs to solve multi-dimensional PDEs…

Machine Learning · Computer Science 2023-11-01 Junwoo Cho , Seungtae Nam , Hyunmo Yang , Seok-Bae Yun , Youngjoon Hong , Eunbyung Park

Langevin Dynamics is a Stochastic Differential Equation (SDE) central to sampling and generative modeling and is implemented via time discretization. Langevin Monte Carlo (LMC), based on the Euler-Maruyama discretization, is the simplest…

Machine Learning · Computer Science 2025-10-10 Saravanan Kandasamy , Dheeraj Nagaraj

In Bayesian inverse problems, the posterior distribution is used to quantify uncertainty about the reconstructed solution. In practice, Markov chain Monte Carlo algorithms often are used to draw samples from the posterior distribution.…

Numerical Analysis · Mathematics 2018-03-13 D. Andrew Brown , Arvind Saibaba , Sarah Vallélian

Approximating model predictive control (MPC) using imitation learning (IL) allows for fast control without solving expensive optimization problems online. However, methods that use neural networks in a simple L2-regression setup fail to…

Although Physics-Informed Neural Networks (PINNs) have been successfully applied in a wide variety of science and engineering fields, they can fail to accurately predict the underlying solution in slightly challenging…

Machine Learning · Computer Science 2023-03-27 Yufeng Wang , Cong Xu , Min Yang , Jin Zhang

We propose a framework to perform Bayesian inference using conditional score-based diffusion models to solve a class of inverse problems in mechanics involving the inference of a specimen's spatially varying material properties from noisy…

In recent years, Full-Waveform Inversion (FWI) has been extensively used to derive high-resolution subsurface velocity models from seismic data. However, due to the nonlinearity and ill-posed nature of the problem, FWI requires a good…

Inverse medium scattering is an ill-posed, nonlinear wave-based imaging problem arising in medical imaging, remote sensing, and non-destructive testing. Machine learning (ML) methods offer increased inference speed and flexibility in…

Computational Physics · Physics 2025-12-12 Olivia Tsang , Owen Melia , Vasileios Charisopoulos , Jeremy Hoskins , Yuehaw Khoo , Rebecca Willett

We develop a self-adaptive physics-informed neural network (PINN) framework that reliably solves forward Darcy flow and performs accurate permeability inversion in heterogeneous porous media. In the forward setting, the PINN predicts…

Fluid Dynamics · Physics 2025-12-17 Md. Abdul Aziz , Thilo Strauss , Muhammad Mohebujjaman , Taufiquar Khan

Langevin algorithms are gradient descent methods with additive noise. They have been used for decades in Markov chain Monte Carlo (MCMC) sampling, optimization, and learning. Their convergence properties for unconstrained non-convex…

Machine Learning · Computer Science 2020-12-23 Andrew Lamperski

Physics-informed neural networks (PINNs) provide a mesh-free framework for solving PDE-constrained inverse problems, but their extension to Bayesian inversion still faces a fundamental difficulty: prior distributions are typically defined…

Geophysics · Physics 2026-05-15 Ryoichiro Agata , Tomohisa Okazaki

Maxwell's equations are a collection of coupled partial differential equations (PDEs) that, together with the Lorentz force law, constitute the basis of classical electromagnetism and electric circuits. Effectively solving Maxwell's…

Machine Learning · Computer Science 2023-08-15 Shiyuan Piao , Hong Gu , Aina Wang , Pan Qin

There is a growing interest in the use of latent diffusion models (LDMs) for image restoration (IR) tasks due to their ability to model effectively the distribution of natural images. While significant progress has been made, there are…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Di You , Daniel Siromani , Pier Luigi Dragotti

We address the numerical solution of infinite-dimensional inverse problems in the framework of Bayesian inference. In the Part I companion to this paper (arXiv.org:1308.1313), we considered the linearized infinite-dimensional inverse…

Methodology · Statistics 2014-04-14 Noemi Petra , James Martin , Georg Stadler , Omar Ghattas

Deep learning-based numerical schemes such as Physically Informed Neural Networks (PINNs) have recently emerged as an alternative to classical numerical schemes for solving Partial Differential Equations (PDEs). They are very appealing at…

Numerical Analysis · Mathematics 2022-05-11 A. Beguinet , V. Ehrlacher , R. Flenghi , M. Fuente , O. Mula , A. Somacal

Bayesian inference allows us to define a posterior distribution over the weights of a generic neural network (NN). Exact posteriors are usually intractable, in which case approximations can be employed. One such approximation - variational…

Machine Learning · Computer Science 2026-01-30 Andrew Millard , Joshua Murphy , Peter Green , Simon Maskell

A pre-trained unconditional diffusion model, combined with posterior sampling or maximum a posteriori (MAP) estimation techniques, can solve arbitrary inverse problems without task-specific training or fine-tuning. However, existing…

Machine Learning · Computer Science 2026-02-09 Sai Bharath Chandra Gutha , Ricardo Vinuesa , Hossein Azizpour