English
Related papers

Related papers: Bayesian neural networks for weak solution of PDEs…

200 papers

We provide simple schemes to build Bayesian Neural Networks (BNNs), block by block, inspired by a recent idea of computation skeletons. We show how by adjusting the types of blocks that are used within the computation skeleton, we can…

Machine Learning · Statistics 2018-06-12 Hao Henry Zhou , Yunyang Xiong , Vikas Singh

Bayesian neural networks (BNNs) allow rigorous uncertainty quantification in deep learning, but often come at a prohibitive computational cost. We propose three different innovative architectures of partial trace-class Bayesian neural…

Machine Learning · Statistics 2025-11-04 Arran Carter , Torben Sell

In this article a novel approach for training deep neural networks using Bayesian techniques is presented. The Bayesian methodology allows for an easy evaluation of model uncertainty and additionally is robust to overfitting. These are…

Machine Learning · Computer Science 2019-04-03 Konstantin Posch , Jürgen Pilz

As data size and computing power increase, the architectures of deep neural networks (DNNs) have been getting more complex and huge, and thus there is a growing need to simplify such complex and huge DNNs. In this paper, we propose a novel…

Machine Learning · Statistics 2023-05-24 Insung Kong , Dongyoon Yang , Jongjin Lee , Ilsang Ohn , Yongdai Kim

Approximating solutions to partial differential equations (PDEs) is fundamental for the modeling of dynamical systems in science and engineering. Physics-informed neural networks (PINNs) are a recent machine learning-based approach, for…

In this paper, we introduce BNN-DP, an efficient algorithmic framework for analysis of adversarial robustness of Bayesian Neural Networks (BNNs). Given a compact set of input points $T\subset \mathbb{R}^n$, BNN-DP computes lower and upper…

Machine Learning · Computer Science 2023-06-21 Steven Adams , Andrea Patane , Morteza Lahijanian , Luca Laurenti

In this paper, we propose a novel Physics-Informed Neural Network (PINN) framework based on the Cord\`{e}s condition for solving both linear and fully nonlinear partial differential equations (PDEs) in non-divergence form, together with…

Numerical Analysis · Mathematics 2026-04-29 Bingcheng Hu , Lixiang Jin , Zhaoxiang Li

Machine learning methods for solving nonlinear partial differential equations (PDEs) are hot topical issues, and different algorithms proposed in the literature show efficient numerical approximation in high dimension. In this paper, we…

Optimization and Control · Mathematics 2022-01-05 Maximilien Germain , Mathieu Laurière , Huyên Pham , Xavier Warin

Solving partial differential equations (PDE) is an indispensable part of many branches of science as many processes can be modelled in terms of PDEs. However, recent numerical solvers require manual discretization of the underlying equation…

Neural networks (NNs) are often used as surrogates or emulators of partial differential equations (PDEs) that describe the dynamics of complex systems. A virtually negligible computational cost of such surrogates renders them an attractive…

Numerical Analysis · Mathematics 2021-05-04 Dong H. Song , Daniel M. Tartakovsky

We investigate the high-precision training of Physics-Informed Neural Networks (PINNs) in unbounded domains, with a special focus on applications to singularity formulation in PDEs. We propose a modularized approach and study the choices of…

Machine Learning · Computer Science 2025-06-25 Yixuan Wang , Ziming Liu , Zongyi Li , Anima Anandkumar , Thomas Y. Hou

Deep neural networks (DNNs) have made a revolution in numerous fields during the last decade. However, in tasks with high safety requirements, such as medical or autonomous driving applications, providing an assessment of the models…

Machine Learning · Computer Science 2020-11-20 Omer Achrack , Raizy Kellerman , Ouriel Barzilay

Intensive research has been conducted on the verification and validation of deep neural networks (DNNs), aiming to understand if, and how, DNNs can be applied to safety critical applications. However, existing verification and validation…

Machine Learning · Computer Science 2021-03-08 Nicolas Berthier , Amany Alshareef , James Sharp , Sven Schewe , Xiaowei Huang

Recent research works for solving partial differential equations (PDEs) with deep neural networks (DNNs) have demonstrated that spatiotemporal function approximators defined by auto-differentiation are effective for approximating nonlinear…

Numerical Analysis · Mathematics 2021-09-21 Haoxiang Huang , Yingjie Liu , Vigor Yang

Neural networks have achieved remarkable performance across various problem domains, but their widespread applicability is hindered by inherent limitations such as overconfidence in predictions, lack of interpretability, and vulnerability…

Machine Learning · Statistics 2023-09-29 Julyan Arbel , Konstantinos Pitas , Mariia Vladimirova , Vincent Fortuin

Motivated by recent research on Physics-Informed Neural Networks (PINNs), we make the first attempt to introduce the PINNs for numerical simulation of the elliptic Partial Differential Equations (PDEs) on 3D manifolds. PINNs are one of the…

Numerical Analysis · Mathematics 2021-03-05 Zhuochao Tang , Zhuojia Fu

Modern neural networks have proven to be powerful function approximators, providing state-of-the-art performance in a multitude of applications. They however fall short in their ability to quantify confidence in their predictions - this is…

Machine Learning · Statistics 2020-06-29 Alex J. Chan , Ahmed M. Alaa , Zhaozhi Qian , Mihaela van der Schaar

There have been extensive studies on solving differential equations using physics-informed neural networks. While this method has proven advantageous in many cases, a major criticism lies in its lack of analytical error bounds. Therefore,…

Neural and Evolutionary Computing · Computer Science 2022-07-05 Shuheng Liu , Xiyue Huang , Pavlos Protopapas

Physics-informed neural networks (PINNs) have been demonstrated to be efficient in solving partial differential equations (PDEs) from a variety of experimental perspectives. Some recent studies have also proposed PINN algorithms for PDEs on…

Numerical Analysis · Mathematics 2024-08-06 Guanhang Lei , Zhen Lei , Lei Shi , Chenyu Zeng , Ding-Xuan Zhou

Deep Neural Networks (DNNs) have aroused great attention in Compressed Sensing (CS) restoration. However, the working mechanism of DNNs is not explainable, thereby it is unclear that how to design an optimal DNNs for CS restoration. In this…

Signal Processing · Electrical Eng. & Systems 2019-02-26 Xinjie Lan , Xin Guo , Kenneth E. Barner