English
Related papers

Related papers: DPG loss functions for learning parameter-to-solut…

200 papers

Solving inverse and optimization problems over solutions of nonlinear partial differential equations (PDEs) on complex spatial domains is a long-standing challenge. Here we introduce a method that parameterizes the solution using spectral…

Numerical Analysis · Mathematics 2025-10-30 James V. Roggeveen , Michael P. Brenner

We propose an abstract discontinuous Galerkin neural network (DGNN) framework for analyzing the convergence of least-squares methods based on the residual minimization when feasible solutions are neural networks. Within this framework, we…

Numerical Analysis · Mathematics 2025-11-11 Long Yuan , Hongxing Rui

We present a dual weighted residual-based a posteriori error estimate for a discontinuous Galerkin (DG) approximation of a linear second-order elliptic problem on compact smooth connected and oriented surfaces in $\mathbb{R}^{3}$ which are…

Numerical Analysis · Mathematics 2014-02-11 Andreas Dedner , Pravin Madhavan

A feedforward neural network, including hidden layers, motivated by nonlinear functions (such as Tanh, ReLU, and Sigmoid functions), exhibits uniform approximation properties in Sobolev space, and discontinuous neural networks can reduce…

Numerical Analysis · Mathematics 2025-05-16 Xiaoyu Wang , Long Yuan , Yao Yu

Partial Differential Equations (PDE) are fundamental to model different phenomena in science and engineering mathematically. Solving them is a crucial step towards a precise knowledge of the behaviour of natural and engineered systems. In…

In a world blessed with a great diversity of loss functions, we argue that that choice between them is not a matter of taste or pragmatics, but of model. Probabilistic depencency graphs (PDGs) are probabilistic models that come equipped…

Machine Learning · Computer Science 2022-02-25 Oliver E Richardson

We consider a mesh-based approach for training a neural network to produce field predictions of solutions to parametric partial differential equations (PDEs). This approach contrasts current approaches for "neural PDE solvers" that employ…

Recent years have witnessed a growth in mathematics for deep learning--which seeks a deeper understanding of the concepts of deep learning with mathematics and explores how to make it more robust--and deep learning for mathematics, where…

Machine Learning · Computer Science 2023-10-31 Derick Nganyu Tanyu , Jianfeng Ning , Tom Freudenberg , Nick Heilenkötter , Andreas Rademacher , Uwe Iben , Peter Maass

We present a computational method for empirically characterizing the training loss level-sets of deep neural networks. Our method numerically constructs a path in parameter space that is constrained to a set with a fixed near-zero training…

Machine Learning · Computer Science 2021-04-27 Naveed Tahir , Garrett E. Katz

In this work we apply the Deep Galerkin Method (DGM) described in Sirignano and Spiliopoulos (2018) to solve a number of partial differential equations that arise in quantitative finance applications including option pricing, optimal…

Computational Finance · Quantitative Finance 2018-11-22 Ali Al-Aradi , Adolfo Correia , Danilo Naiff , Gabriel Jardim , Yuri Saporito

The solution to partial differential equations using deep learning approaches has shown promising results for several classes of initial and boundary-value problems. However, their ability to surpass, particularly in terms of accuracy,…

Numerical Analysis · Mathematics 2023-08-23 Ziad Aldirany , Régis Cottereau , Marc Laforest , Serge Prudhomme

Solving partial differential equations (PDEs) is the canonical approach for understanding the behavior of physical systems. However, large scale solutions of PDEs using state of the art discretization techniques remains an expensive…

Computational Engineering, Finance, and Science · Computer Science 2021-01-14 Xiaoxuan Zhang , Krishna Garikipati

Deep Gaussian Processes (DGPs) were proposed as an expressive Bayesian model capable of a mathematically grounded estimation of uncertainty. The expressivity of DPGs results from not only the compositional character but the distribution…

Machine Learning · Computer Science 2021-11-23 Chi-Ken Lu , Patrick Shafto

While deep learning has achieved remarkable success in solving partial differential equations (PDEs), it still faces significant challenges, particularly when the PDE solutions have low regularity or singularities. To address these issues,…

Numerical Analysis · Mathematics 2025-06-19 Zhihang Xu , Min Wang , Zhu Wang

Solving high-dimensional partial differential equations is a recurrent challenge in economics, science and engineering. In recent years, a great number of computational approaches have been developed, most of them relying on a combination…

Numerical Analysis · Mathematics 2023-01-31 Nikolas Nüsken , Lorenz Richter

We study in this paper a multilayer discretization of second order elliptic problems, aimed at providing reliable multilayer discretizations of shallow fluid flow problems with diffusive effects. This discretization is based upon the…

Numerical Analysis · Mathematics 2018-07-17 Toms Chacón Rebollo , Daniel Franco Coronil , Frédéric Hecht

Machine learning based partial differential equations (PDEs) solvers have received great attention in recent years. Most progress in this area has been driven by deep neural networks such as physics-informed neural networks (PINNs) and…

Numerical Analysis · Mathematics 2025-09-23 Chunyang Liao

Fully convolutional deep neural networks carry out excellent potential for fast and accurate image segmentation. One of the main challenges in training these networks is data imbalance, which is particularly problematic in medical imaging…

Computer Vision and Pattern Recognition · Computer Science 2017-06-20 Seyed Sadegh Mohseni Salehi , Deniz Erdogmus , Ali Gholipour

Recent advances in deep learning have pushed the performances of visual saliency models way further than it has ever been. Numerous models in the literature present new ways to design neural networks, to arrange gaze pattern data, or to…

Computer Vision and Pattern Recognition · Computer Science 2019-07-05 Alexandre Bruckert , Hamed R. Tavakoli , Zhi Liu , Marc Christie , Olivier Le Meur

Partitioned neural network functions are used to approximate the solution of partial differential equations. The problem domain is partitioned into non-overlapping subdomains and the partitioned neural network functions are defined on the…

Numerical Analysis · Mathematics 2023-12-25 Deok-Kyu Jang , Kyungsoo Kim , Hyea Hyun Kim