English
Related papers

Related papers: Residual-based error correction for neural operato…

200 papers

We consider the discretization of elliptic boundary-value problems by variational physics-informed neural networks (VPINNs), in which test functions are continuous, piecewise linear functions on a triangulation of the domain. We define an a…

Numerical Analysis · Mathematics 2022-10-19 Stefano Berrone , Claudio Canuto , Moreno Pintore

The problem of learning the structure of Bayesian networks from complete discrete data with a limit on parent set size is considered. Learning is cast explicitly as an optimisation problem where the goal is to find a BN structure which…

Artificial Intelligence · Computer Science 2012-02-20 James Cussens

In this work we deal with parametric inverse problems, which consist in recovering a finite number of parameters describing the structure of an unknown object, from indirect measurements. State-of-the-art methods for approximating a…

Numerical Analysis · Mathematics 2021-12-22 Paolo Massa , Sara Garbarino , Federico Benvenuto

In this study, we investigate how the updating of weights during forward operation and the computation of gradients during backpropagation impact the optimization process, training procedure, and overall performance of the neural network,…

Machine Learning · Computer Science 2024-07-10 Amir Noorizadegan , D. L. Young , Y. C. Hon , C. S. Chen

A primary challenge in using neural networks to approximate nonlinear dynamical systems governed by partial differential equations (PDEs) lies in recasting these systems into a tractable representation particularly when the dynamics are…

Machine Learning · Computer Science 2026-02-10 Pengyu Lai , Yixiao Chen , Dewu Yang , Rui Wang , Feng Wang , Hui Xu

Neural operator (NO) architectures learn nonlinear maps between infinite-dimensional function spaces and are widely used to accelerate simulation and enable data-driven model discovery. While universality results ensure expressivity, they…

Optimization and Control · Mathematics 2026-03-02 Takashi Furuya , Anastasis Kratsios

Physics informed neural networks (PINNs) have recently been widely used for robust and accurate approximation of PDEs. We provide rigorous upper bounds on the generalization error of PINNs approximating solutions of the forward problem for…

Numerical Analysis · Mathematics 2023-12-07 Siddhartha Mishra , Roberto Molinaro

Normalizing flows are a powerful tool for generative modelling, density estimation and posterior reconstruction in Bayesian inverse problems. In this paper, we introduce proximal residual flows, a new architecture of normalizing flows.…

Machine Learning · Computer Science 2023-05-19 Johannes Hertrich

DeepONets have recently been proposed as a framework for learning nonlinear operators mapping between infinite dimensional Banach spaces. We analyze DeepONets and prove estimates on the resulting approximation and generalization errors. In…

Numerical Analysis · Mathematics 2022-01-14 Samuel Lanthaler , Siddhartha Mishra , George Em Karniadakis

Solving high dimensional partial differential equations (PDEs) has historically posed a considerable challenge when utilizing conventional numerical methods, such as those involving domain meshes. Recent advancements in the field have seen…

Numerical Analysis · Mathematics 2024-02-05 Xiaokai Huo , Hailiang Liu

Identifying parameters in partial differential equations (PDEs) represents a very broad class of applied inverse problems. In recent years, several unsupervised learning approaches using (deep) neural networks have been developed to solve…

Numerical Analysis · Mathematics 2025-08-22 Siyu Cen , Bangti Jin , Qimeng Quan , Zhi Zhou

Developing neural operators that accurately predict the behavior of systems governed by partial differential equations (PDEs) across unseen parameter regimes is crucial for robust generalization in scientific and engineering applications.…

Machine Learning · Computer Science 2026-04-21 Eva van Tegelen , Taniya Kapoor , George A. K. van Voorn , Peter van Heijster , Ioannis N. Athanasiadis

Many-query problems, arising from uncertainty quantification, Bayesian inversion, Bayesian optimal experimental design, and optimization under uncertainty-require numerous evaluations of a parameter-to-output map. These evaluations become…

Numerical Analysis · Mathematics 2021-03-18 Thomas O'Leary-Roseberry , Umberto Villa , Peng Chen , Omar Ghattas

Physics-informed neural networks (PINNs) are able to solve partial differential equations (PDEs) by incorporating the residuals of the PDEs into their loss functions. Variational Physics-Informed Neural Networks (VPINNs) and hp-VPINNs use…

Determining whether multiple instructions can access the same memory location is a critical task in binary analysis. It is challenging as statically computing precise alias information is undecidable in theory. The problem aggravates at the…

Cryptography and Security · Computer Science 2022-10-07 Kexin Pei , Dongdong She , Michael Wang , Scott Geng , Zhou Xuan , Yaniv David , Junfeng Yang , Suman Jana , Baishakhi Ray

Deep neural networks are powerful tools for solving nonlinear problems in science and engineering, but training highly accurate models becomes challenging as problem complexity increases. Non-convex optimization and sensitivity to…

Machine Learning · Computer Science 2026-04-20 Ethan Mulle , Wei Kang , Qi Gong

In this paper, we introduce an innovative approach for addressing Bayesian inverse problems through the utilization of physics-informed invertible neural networks (PI-INN). The PI-INN framework encompasses two sub-networks: an invertible…

Numerical Analysis · Mathematics 2023-10-04 Xiaofei Guan , Xintong Wang , Hao Wu , Zihao Yang , Peng Yu

Many engineering and scientific fields have recently become interested in modeling terms in partial differential equations (PDEs) with neural networks, which requires solving the inverse problem of learning neural network terms from…

Machine Learning · Computer Science 2026-03-30 Konstantin Riedl , Justin Sirignano , Konstantinos Spiliopoulos

Inverse problems are pervasive mathematical methods in inferring knowledge from observational and experimental data by leveraging simulations and models. Unlike direct inference methods, inverse problem approaches typically require many…

Computational Physics · Physics 2019-12-20 Sheroze Sheriffdeen , Jean C. Ragusa , Jim E. Morel , Marvin L. Adams , Tan Bui-Thanh

To quantify uncertainties in inverse problems of partial differential equations (PDEs), we formulate them into statistical inference problems using Bayes' formula. Recently, well-justified infinite-dimensional Bayesian analysis methods have…

Numerical Analysis · Mathematics 2026-02-09 Junxiong Jia , Yanni Wu , Peijun Li , Deyu Meng