English
Related papers

Related papers: Reliable extrapolation of deep neural operators in…

200 papers

This focused review explores a range of neural operator architectures for approximating solutions to parametric partial differential equations (PDEs), emphasizing high-level concepts and practical implementation strategies. The study covers…

Computational Engineering, Finance, and Science · Computer Science 2025-03-10 Prashant K. Jha

Neural operators have achieved strong performance in learning solution operators of partial differential equations (PDEs), but their inherently continuous representations struggle to capture discontinuities and sharp transitions. Existing…

Machine Learning · Computer Science 2026-05-20 Ha Dang , Sebastian Schmidt , Juergen Hesser

A wide range of scientific problems, such as those described by continuous-time dynamical systems and partial differential equations (PDEs), are naturally formulated on function spaces. While function spaces are typically…

When using recurrent neural networks (RNNs) it is common practice to apply trained models to sequences longer than those seen in training. This "extrapolating" usage deviates from the traditional statistical learning setup where guarantees…

Machine Learning · Computer Science 2022-03-25 Edo Cohen-Karlik , Avichai Ben David , Nadav Cohen , Amir Globerson

Neural networks have shown significant potential in solving partial differential equations (PDEs). While deep networks are capable of approximating complex functions, direct one-shot training often faces limitations in both accuracy and…

Numerical Analysis · Mathematics 2025-03-10 Mingxing Weng , Zhiping Mao , Jie Shen

The computational overhead of traditional numerical solvers for partial differential equations (PDEs) remains a critical bottleneck for large-scale parametric studies and design optimization. We introduce a Minimal-Data Parametric Neural…

Machine Learning · Computer Science 2026-05-15 Qiyun Cheng , Md Hossain Sahadath , Huihua Yang , Shaowu Pan , Wei Ji

This paper addresses the problem of accurately estimating a function on one domain when only its discrete samples are available on another domain. To answer this challenge, we utilize a neural network, which we train to incorporate prior…

Machine Learning · Computer Science 2024-05-20 Guy Hay , Nir Sharon

Energy-Dissipative Evolutionary Deep Operator Neural Network is an operator learning neural network. It is designed to seed numerical solutions for a class of partial differential equations instead of a single partial differential equation,…

Machine Learning · Statistics 2023-06-13 Jiahao Zhang , Shiheng Zhang , Jie Shen , Guang Lin

Neural Operators offer a powerful, data-driven tool for solving parametric PDEs as they can represent maps between infinite-dimensional function spaces. In this work, we employ physics-informed Neural Operators in the context of…

Machine Learning · Statistics 2023-03-08 Sebastian Kaltenbach , Paris Perdikaris , Phaedon-Stelios Koutsourelakis

The traditional limitations of neural networks in reliably generalizing beyond the convex hulls of their training data present a significant problem for computational physics, in which one often wishes to solve PDEs in regimes far beyond…

Machine Learning · Computer Science 2026-02-17 Jonathan Gorard , Ammar Hakim , James Juno

A new data-driven method for operator learning of stochastic differential equations(SDE) is proposed in this paper. The central goal is to solve forward and inverse stochastic problems more effectively using limited data. Deep operator…

Machine Learning · Statistics 2022-04-08 Jiahao Zhang , Shiqi Zhang , Guang Lin

The solution of partial differential equations (PDEs) plays a central role in numerous applications in science and engineering, particularly those involving multiphase flow in porous media. Complex, nonlinear systems govern these problems…

Standard neural networks can approximate general nonlinear operators, represented either explicitly by a combination of mathematical operators, e.g., in an advection-diffusion-reaction partial differential equation, or simply as a black…

Machine Learning · Computer Science 2022-07-19 Somdatta Goswami , Aniruddha Bora , Yue Yu , George Em Karniadakis

The deep operator network (DeepONet) is a popular neural operator architecture that has shown promise in solving partial differential equations (PDEs) by using deep neural networks to map between infinite-dimensional function spaces. In the…

Machine Learning · Computer Science 2025-02-25 Luis Mandl , Somdatta Goswami , Lena Lambers , Tim Ricken

Deep neural operators can learn operators mapping between infinite-dimensional function spaces via deep neural networks and have become an emerging paradigm of scientific machine learning. However, training neural operators usually requires…

Computational Physics · Physics 2022-07-20 Lu Lu , Raphael Pestourie , Steven G. Johnson , Giuseppe Romano

A recent paradigm views deep neural networks as discretizations of certain controlled ordinary differential equations, sometimes called neural ordinary differential equations. We make use of this perspective to link expressiveness of deep…

Optimization and Control · Mathematics 2020-07-20 Christa Cuchiero , Martin Larsson , Josef Teichmann

In this paper, we evaluate the effectiveness of deep operator networks (DeepONets) in solving both forward and inverse problems of partial differential equations (PDEs) on unknown manifolds. By unknown manifolds, we identify the manifold by…

Numerical Analysis · Mathematics 2024-07-09 Anran Jiao , Qile Yan , Jhn Harlim , Lu Lu

Scientific computing using deep learning has seen significant advancements in recent years. There has been growing interest in models that learn the operator from the parameters of a partial differential equation (PDE) to the corresponding…

Machine Learning · Computer Science 2024-02-14 Sung Woong Cho , Jae Yong Lee , Hyung Ju Hwang

Poroelasticity -- coupled fluid flow and elastic deformation in porous media -- often involves spatially variable permeability, especially in subsurface systems. In such cases, simulations with random permeability fields are widely used for…

Machine Learning · Computer Science 2025-09-16 Sangjoon Park , Yeonjong Shin , Jinhyun Choo

Empirical interpolation method (EIM) is a well-known technique to efficiently approximate parameterized functions. This paper proposes to use EIM algorithm to efficiently reduce the dimension of the training data within supervised machine…

Machine Learning · Computer Science 2023-05-18 Harbir Antil , Madhu Gupta , Randy Price