English
Related papers

Related papers: Bayesian Deep Learning for Partial Differential Eq…

200 papers

There have been growing interests in leveraging experimental measurements to discover the underlying partial differential equations (PDEs) that govern complex physical phenomena. Although past research attempts have achieved great success…

Machine Learning · Computer Science 2023-05-23 Chengping Rao , Pu Ren , Yang Liu , Hao Sun

Robust physics (e.g., governing equations and laws) discovery is of great interest for many engineering fields and explainable machine learning. A critical challenge compared with general training is that the term and format of governing…

Numerical Analysis · Mathematics 2021-02-15 Zhiming Zhang , Yongming Liu

This paper presents a machine learning framework for Bayesian systems identification from noisy, sparse and irregular observations of nonlinear dynamical systems. The proposed method takes advantage of recent developments in differentiable…

Machine Learning · Computer Science 2020-04-21 Yibo Yang , Mohamed Aziz Bhouri , Paris Perdikaris

In processing and manufacturing industries, there has been a large push to produce higher quality products and ensure maximum efficiency of processes. This requires approaches to effectively detect and resolve disturbances to ensure optimal…

Machine Learning · Statistics 2021-02-05 Weike Sun , Antonio R. C. Paiva , Peng Xu , Anantha Sundaram , Richard D. Braatz

The study presents a general framework for discovering underlying Partial Differential Equations (PDEs) using measured spatiotemporal data. The method, called Sparse Spatiotemporal System Discovery ($\text{S}^3\text{d}$), decides which…

We investigate methods for learning partial differential equation (PDE) models from spatiotemporal data under biologically realistic levels and forms of noise. Recent progress in learning PDEs from data have used sparse regression to select…

Dynamical Systems · Mathematics 2021-04-28 John Lagergren , John T. Nardini , G. Michael Lavigne , Erica M. Rutter , Kevin B. Flores

Physics-informed neural networks (PINNs) were recently proposed in [1] as an alternative way to solve partial differential equations (PDEs). A neural network (NN) represents the solution while a PDE-induced NN is coupled to the solution NN,…

Computational Physics · Physics 2019-10-22 Xiaoli Chen , Jinqiao Duan , George Em Karniadakis

Bayesian neural networks (BNNs) have been long considered an ideal, yet unscalable solution for improving the robustness and the predictive uncertainty of deep neural networks. While they could capture more accurately the posterior…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Gianni Franchi , Andrei Bursuc , Emanuel Aldea , Severine Dubuisson , Isabelle Bloch

Sparse deep learning aims to address the challenge of huge storage consumption by deep neural networks, and to recover the sparse structure of target functions. Although tremendous empirical successes have been achieved, most sparse deep…

Machine Learning · Statistics 2020-11-17 Jincheng Bai , Qifan Song , Guang Cheng

Time-delayed differential equations (TDDEs) are widely used to model complex dynamic systems where future states depend on past states with a delay. However, inferring the underlying TDDEs from observed data remains a challenging problem…

Machine Learning · Statistics 2025-01-07 Debangshu Chowdhury , Souvik Chakraborty

Harnessing data to discover the underlying governing laws or equations that describe the behavior of complex physical systems can significantly advance our modeling, simulation and understanding of such systems in various science and…

Machine Learning · Computer Science 2021-11-17 Zhao Chen , Yang Liu , Hao Sun

We develop a novel deep learning method for uncertainty quantification in stochastic partial differential equations based on Bayesian neural network (BNN) and Hamiltonian Monte Carlo (HMC). A BNN efficiently learns the posterior…

Machine Learning · Statistics 2022-10-24 Jeahan Jung , Minseok Choi

This work is concerned with discovering the governing partial differential equation (PDE) of a physical system. Existing methods have demonstrated the PDE identification from finite observations but failed to maintain satisfying results…

Numerical Analysis · Mathematics 2023-02-09 Pongpisit Thanasutives , Takashi Morita , Masayuki Numao , Ken-ichi Fukui

Data-driven discovery of partial differential equations (PDEs) offers a promising paradigm for uncovering governing physical laws from observational data. However, in practical scenarios, measurements are often contaminated by noise and…

Machine Learning · Computer Science 2026-03-25 Xingyu Chen , Junxiu An , Jun Guo , Yuqian Zhou

Neural networks (NN) have achieved state-of-the-art performance in various applications. Unfortunately in applications where training data is insufficient, they are often prone to overfitting. One effective way to alleviate this problem is…

Machine Learning · Computer Science 2016-11-03 Hao Wang , Xingjian Shi , Dit-Yan Yeung

Physics-informed extreme learning machine (PIELM) has recently received significant attention as a rapid version of physics-informed neural network (PINN) for solving partial differential equations (PDEs). The key characteristic is to fix…

Machine Learning · Computer Science 2024-09-30 Xu Liu , Wen Yao , Wei Peng , Weien Zhou

Bayesian neural networks (BNNs) have recently regained a significant amount of attention in the deep learning community due to the development of scalable approximate Bayesian inference techniques. There are several advantages of using a…

Machine Learning · Statistics 2023-05-02 Aliaksandr Hubin , Geir Storvik

Deep learning has been the engine powering many successes of data science. However, the deep neural network (DNN), as the basic model of deep learning, is often excessively over-parameterized, causing many difficulties in training,…

Machine Learning · Statistics 2021-03-09 Yan Sun , Qifan Song , Faming Liang

PDE discovery shows promise for uncovering predictive models of complex physical systems but has difficulty when measurements are sparse and noisy. We introduce a new approach for PDE discovery that uses two Rational Neural Networks and a…

Machine Learning · Computer Science 2022-06-20 Robert Stephany , Christopher Earls

Bayesian flow networks (BFNs) iteratively refine the parameters, instead of the samples in diffusion models (DMs), of distributions at various noise levels through Bayesian inference. Owing to its differentiable nature, BFNs are promising…

Machine Learning · Computer Science 2024-06-04 Kaiwen Xue , Yuhao Zhou , Shen Nie , Xu Min , Xiaolu Zhang , Jun Zhou , Chongxuan Li