English
Related papers

Related papers: A Bayesian Multiscale Deep Learning Framework for …

200 papers

Solving partial differential equations (PDEs) by numerical methods meet computational cost challenge for getting the accurate solution since fine grids and small time steps are required. Machine learning can accelerate this process, but…

Numerical Analysis · Mathematics 2025-01-28 Qi Wang , Yuan Mi , Haoyun Wang , Yi Zhang , Ruizhi Chengze , Hongsheng Liu , Ji-Rong Wen , Hao Sun

We introduce implicit Bayesian neural networks, a simple and scalable approach for uncertainty representation in deep learning. Standard Bayesian approach to deep learning requires the impractical inference of the posterior distribution…

Machine Learning · Statistics 2020-10-27 Trung Trinh , Samuel Kaski , Markus Heinonen

We develop a novel deep learning method for uncertainty quantification in stochastic partial differential equations based on Bayesian neural network (BNN) and Hamiltonian Monte Carlo (HMC). A BNN efficiently learns the posterior…

Machine Learning · Statistics 2022-10-24 Jeahan Jung , Minseok Choi

Machine learning for scientific applications faces the challenge of limited data. We propose a framework that leverages a priori known physics to reduce overfitting when training on relatively small datasets. A deep neural network is…

Machine Learning · Computer Science 2019-11-22 Jonathan B. Freund , Jonathan F. MacArt , Justin Sirignano

We develop a new computational framework to solve the partial differential equations (PDEs) governing the flow of the joint probability density functions (PDFs) in continuous-time stochastic nonlinear systems. The need for computing the…

Optimization and Control · Mathematics 2019-08-08 Kenneth F. Caluya , Abhishek Halder

In this thesis, we introduce Bayesian filtering as a principled framework for tackling diverse sequential machine learning problems, including online (continual) learning, prequential (one-step-ahead) forecasting, and contextual bandits. To…

Machine Learning · Statistics 2025-05-13 Gerardo Duran-Martin

One of the most popular recent areas of machine learning predicates the use of neural networks augmented by information about the underlying process in the form of Partial Differential Equations (PDEs). These physics-informed neural…

Fluid Dynamics · Physics 2025-06-17 Luca Menicali , David H. Richter , Stefano Castruccio

A novel multi-level method for partial differential equations with uncertain parameters is proposed. The principle behind the method is that the error between grid levels in multi-level methods has a spatial structure that is by good…

Numerical Analysis · Mathematics 2020-04-29 Yous van Halder , Benjamin Sanderse , Barry Koren

Many systems in physics, engineering, and biology exhibit multiscale stochastic dynamics, where low-dimensional slow variables evolve under the influence of high-dimensional fast processes. In practice, observations are often limited to a…

Machine Learning · Statistics 2026-05-12 Anan Saha , Arnab Ganguly

This article addresses reaction networks in which spatial and stochastic effects are of crucial importance. For such systems, particle-based models allow us to describe all microscopic details with high accuracy. However, they suffer from…

While deep neural networks have become the go-to approach in computer vision, the vast majority of these models fail to properly capture the uncertainty inherent in their predictions. Estimating this predictive uncertainty can be crucial,…

Machine Learning · Computer Science 2020-04-08 Fredrik K. Gustafsson , Martin Danelljan , Thomas B. Schön

Many large scale problems in computational fluid dynamics such as uncertainty quantification, Bayesian inversion, data assimilation and PDE constrained optimization are considered very challenging computationally as they require a large…

Computational Physics · Physics 2020-04-22 Kjetil O. Lye , Siddhartha Mishra , Deep Ray

Recent advances in reconstruction methods for inverse problems leverage powerful data-driven models, e.g., deep neural networks. These techniques have demonstrated state-of-the-art performances for several imaging tasks, but they often do…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Riccardo Barbano , Chen Zhang , Simon Arridge , Bangti Jin

We propose new machine learning schemes for solving high dimensional nonlinear partial differential equations (PDEs). Relying on the classical backward stochastic differential equation (BSDE) representation of PDEs, our algorithms estimate…

Probability · Mathematics 2020-06-08 Côme Huré , Huyên Pham , Xavier Warin

Modeling effective transport properties of 3D porous media, such as permeability, at multiple scales is challenging as a result of the combined complexity of the pore structures and fluid physics - in particular, confinement effects which…

Deriving governing equations of complex physical systems based on first principles can be quite challenging when there are certain unknown terms and hidden physical mechanisms in the systems. In this work, we apply a deep learning…

Plasma Physics · Physics 2022-12-06 Wenjie Cheng , Haiyang Fu , Liang Wang , Chuanfei Dong , Yaqiu Jin , Mingle Jiang , Jiayu Ma , Yilan Qin , Kexin Liu

Equations governing physico-chemical processes are usually known at microscopic spatial scales, yet one suspects that there exist equations, e.g. in the form of Partial Differential Equations (PDEs), that can explain the system evolution at…

Machine Learning · Statistics 2021-03-31 Hassan Arbabi , Ioannis Kevrekidis

While perception tasks such as visual object recognition and text understanding play an important role in human intelligence, the subsequent tasks that involve inference, reasoning and planning require an even higher level of intelligence.…

Machine Learning · Statistics 2016-09-06 Hao Wang , Dit-Yan Yeung

The numerical solution of high dimensional partial differential equations (PDEs) is severely constrained by the curse of dimensionality (CoD), rendering classical grid--based methods impractical beyond a few dimensions. In recent years,…

Numerical Analysis · Mathematics 2026-01-27 Wenzhong Zhang , Zheyuan Hu , Wei Cai , George EM Karniadakis

Although deep-learning has been successfully applied in a variety of science and engineering problems owing to its strong high-dimensional nonlinear mapping capability, it is of limited use in scientific knowledge discovery. In this work,…

Computational Physics · Physics 2021-11-19 Junsheng Zeng , Hao Xu , Yuntian Chen , Dongxiao Zhang