English
Related papers

Related papers: Novel Deep neural networks for solving Bayesian st…

200 papers

Variable selection is a key issue when analyzing high-dimensional data. The explosion of data with large sample sizes and dimensionality brings new challenges to this problem in both inference accuracy and computational complexity. To…

Methodology · Statistics 2016-11-30 Xu Chen , Shaan Qamar , Surya T. Tokdar

This paper presents machine learning techniques and deep reinforcement learningbased algorithms for the efficient resolution of nonlinear partial differential equations and dynamic optimization problems arising in investment decisions and…

Optimization and Control · Mathematics 2021-04-19 Maximilien Germain , Huyên Pham , Xavier Warin

In the following article we consider approximate Bayesian computation (ABC) inference. We introduce a method for numerically approximating ABC posteriors using the multilevel Monte Carlo (MLMC). A sequential Monte Carlo version of the…

Methodology · Statistics 2017-02-14 Ajay Jasra , Seongil Jo , David Nott , Christine Shoemaker , Raul Tempone

Many problems in science and engineering can be represented by a set of partial differential equations (PDEs) through mathematical modeling. Mechanism-based computation following PDEs has long been an essential paradigm for studying topics…

Machine Learning · Computer Science 2022-11-21 Shudong Huang , Wentao Feng , Chenwei Tang , Jiancheng Lv

Developing efficient numerical algorithms for the solution of high dimensional random Partial Differential Equations (PDEs) has been a challenging task due to the well-known curse of dimensionality. We present a new solution framework for…

Machine Learning · Computer Science 2019-10-17 Mohammad Amin Nabian , Hadi Meidani

In the context of Bayesian inversion for scientific and engineering modeling, Markov chain Monte Carlo sampling strategies are the benchmark due to their flexibility and robustness in dealing with arbitrary posterior probability density…

Computation · Statistics 2021-12-07 Han Lu , Mohammad Khalil , Thomas Catanach , Jiefu Chen , Xuqing Wu , Xin Fu , Cosmin Safta , Yueqin Huang

Markov Chain Monte Carlo (MCMC) methods have become a cornerstone of many modern scientific analyses by providing a straightforward approach to numerically estimate uncertainties in the parameters of a model using a sequence of random…

Other Statistics · Statistics 2020-03-10 Joshua S. Speagle

This paper investigates the formulation and implementation of Bayesian inverse problems to learn input parameters of partial differential equations (PDEs) defined on manifolds. Specifically, we study the inverse problem of determining the…

Numerical Analysis · Mathematics 2019-10-24 John Harlim , Daniel Sanz-Alonso , Ruiyi Yang

Markov chain Monte Carlo (MCMC) algorithms are generally regarded as the gold standard technique for Bayesian inference. They are theoretically well-understood and conceptually simple to apply in practice. The drawback of MCMC is that in…

Computation · Statistics 2019-07-17 Christopher Nemeth , Paul Fearnhead

We introduce forward-backward stochastic differential equations, highlighting the connection between solutions of these and solutions of partial differential equations, related by the Feynman-Kac theorem. We review the technique of…

Numerical Analysis · Mathematics 2025-02-18 Oliver Sheridan-Methven

Markov chain Monte Carlo (MCMC) is a powerful tool for sampling from complex probability distributions. Despite its versatility, MCMC often suffers from strong autocorrelation and the negative sign problem, leading to slowing down the…

Statistical Mechanics · Physics 2024-12-05 Synge Todo

Posterior sampling is a task of central importance in Bayesian inference. For many applications in Bayesian meta-analysis and Bayesian transfer learning, the prior distribution is unknown and needs to be estimated from samples. In practice,…

Computation · Statistics 2024-08-06 Chenyang Zhong , Shouxuan Ji , Tian Zheng

Estimation of spatially-varying parameters for computationally expensive forward models governed by partial differential equations is addressed. A novel multiscale Bayesian inference approach is introduced based on deep probabilistic…

Machine Learning · Statistics 2022-03-02 Yingzhi Xia , Nicholas Zabaras

Bayesian Decision Trees (DTs) are generally considered a more advanced and accurate model than a regular Decision Tree (DT) because they can handle complex and uncertain data. Existing work on Bayesian DTs uses Markov Chain Monte Carlo…

Machine Learning · Computer Science 2023-05-31 Efthyvoulos Drousiotis , Alexander M. Phillips , Paul G. Spirakis , Simon Maskell

Markov chain Monte Calro methods (MCMC) are commonly used in Bayesian statistics. In the last twenty years, many results have been established for the calculation of the exact convergence rate of MCMC methods. We introduce another rate of…

Statistics Theory · Mathematics 2014-02-17 Kengo Kamatani

We investigate solution methods for large-scale inverse problems governed by partial differential equations (PDEs) via Bayesian inference. The Bayesian framework provides a statistical setting to infer uncertain parameters from noisy…

Applications · Statistics 2023-02-08 Mina Karimi , Mehrdad Massoudi , Kaushik Dayal , Matteo Pozzi

We address a three-tier data-driven approach to solve the inverse problem in complex systems modelling from spatio-temporal data produced by microscopic simulators using machine learning. In the first step, we exploit manifold learning and…

Dynamical Systems · Mathematics 2023-03-16 Evangelos Galaris , Gianluca Fabiani , Ioannis Gallos , Ioannis Kevrekidis , Constantinos Siettos

We propose algorithms for solving high-dimensional Partial Differential Equations (PDEs) that combine a probabilistic interpretation of PDEs, through Feynman-Kac representation, with sparse interpolation. Monte-Carlo methods and…

Numerical Analysis · Mathematics 2022-03-25 Marie Billaud-Friess , Arthur Macherey , Anthony Nouy , Clémentine Prieur

Uncertainty estimation in deep models is essential in many real-world applications and has benefited from developments over the last several years. Recent evidence suggests that existing solutions dependent on simple Gaussian formulations…

Machine Learning · Computer Science 2022-05-11 Jurijs Nazarovs , Ronak R. Mehta , Vishnu Suresh Lokhande , Vikas Singh

In this paper we present an extension of population-based Markov chain Monte Carlo (MCMC) to the trans-dimensional case. One of the main challenges in MCMC-based inference is that of simulating from high and trans-dimensional target…

Computation · Statistics 2007-11-02 Ajay Jasra , David A. Stephens , Chris C. Holmes