English
Related papers

Related papers: Dimension reduction for derivative-informed operat…

200 papers

Mechanical systems are often characterized only by their response to certain loads known from experiments or simulations. The obtained data can be used for various purposes: system analysis, design of mathematical models, or construction of…

Dynamical Systems · Mathematics 2026-01-05 Yevgeniya Filanova , Igor Pontes Duff , Pawan Goyal , Peter Benner

There have been extensive studies on solving differential equations using physics-informed neural networks. While this method has proven advantageous in many cases, a major criticism lies in its lack of analytical error bounds. Therefore,…

Neural and Evolutionary Computing · Computer Science 2022-07-05 Shuheng Liu , Xiyue Huang , Pavlos Protopapas

Reliability analysis is a formidable task, particularly in systems with a large number of stochastic parameters. Conventional methods for quantifying reliability often rely on extensive simulations or experimental data, which can be costly…

Numerical Analysis · Mathematics 2024-09-10 N Navaneeth , Tushar , Souvik Chakraborty

Deep Operator Networks are an increasingly popular paradigm for solving regression in infinite dimensions and hence solve families of PDEs in one shot. In this work, we aim to establish a first-of-its-kind data-dependent lowerbound on the…

Machine Learning · Computer Science 2024-02-26 Anirbit Mukherjee , Amartya Roy

Predictive learning for spatio-temporal processes (PL-STP) on complex spatial domains plays a critical role in various scientific and engineering fields, with its essence being the construction of operators between infinite-dimensional…

Machine Learning · Computer Science 2024-09-10 Qinglu Meng , Yingguang Li , Zhiliang Deng , Xu Liu , Gengxiang Chen , Qiutong Wu , Changqing Liu , Xiaozhong Hao

DeepONet has recently been proposed as a representative framework for learning nonlinear mappings between function spaces. However, when it comes to approximating solution operators of partial differential equations (PDEs) with…

Numerical Analysis · Mathematics 2024-08-09 Yameng Zhu , Jingrun Chen , Weibing Deng

To speed-up the solution to parametrized differential problems, reduced order models (ROMs) have been developed over the years, including projection-based ROMs such as the reduced-basis (RB) method, deep learning-based ROMs, as well as…

Numerical Analysis · Mathematics 2022-02-08 Ludovica Cicci , Stefania Fresca , Andrea Manzoni

Identifying parameters in partial differential equations (PDEs) represents a very broad class of applied inverse problems. In recent years, several unsupervised learning approaches using (deep) neural networks have been developed to solve…

Numerical Analysis · Mathematics 2025-08-22 Siyu Cen , Bangti Jin , Qimeng Quan , Zhi Zhou

Solving high dimensional partial differential equations (PDEs) has historically posed a considerable challenge when utilizing conventional numerical methods, such as those involving domain meshes. Recent advancements in the field have seen…

Numerical Analysis · Mathematics 2024-02-05 Xiaokai Huo , Hailiang Liu

This study investigates the impact of Sobolev Training on operator learning frameworks for improving model performance. Our research reveals that integrating derivative information into the loss function enhances the training process, and…

Machine Learning · Computer Science 2024-02-15 Namkyeong Cho , Junseung Ryu , Hyung Ju Hwang

Neural operators have shown great potential in surrogate modeling. However, training a well-performing neural operator typically requires a substantial amount of data, which can pose a major challenge in complex applications. In such…

Machine Learning · Computer Science 2026-02-05 Keyan Chen , Yile Li , Da Long , Zhitong Xu , Wei Xing , Jacob Hochhalter , Shandian Zhe

Deep neural networks (DNNs) have recently emerged as effective tools for approximating solution operators of partial differential equations (PDEs) including evolutionary problems. Classical numerical solvers for such PDEs often face…

Numerical Analysis · Mathematics 2025-09-05 Ke Chen , Meenakshi Krishnan , Haizhao Yang

Optimal control problems with nonsmooth objectives and nonlinear partial differential equation (PDE) constraints are challenging, mainly because of the underlying nonsmooth and nonconvex structures and the demanding computational cost for…

Optimization and Control · Mathematics 2025-04-25 Yongcun Song , Xiaoming Yuan , Hangrui Yue , Tianyou Zeng

Neural Operators that directly learn mappings between function spaces, such as Deep Operator Networks (DONs) and Fourier Neural Operators (FNOs), have received considerable attention. Despite the universal approximation guarantees for DONs…

Machine Learning · Computer Science 2025-02-04 Pedro Cisneros-Velarde , Bhavesh Shrimali , Arindam Banerjee

We present statistical convergence results for the learning of (possibly) non-linear mappings in infinite-dimensional spaces. Specifically, given a map $G_0:\mathcal X\to\mathcal Y$ between two separable Hilbert spaces, we analyze the…

Statistics Theory · Mathematics 2024-12-24 Niklas Reinhardt , Sven Wang , Jakob Zech

This paper addresses the problem of nearly optimal Vapnik--Chervonenkis dimension (VC-dimension) and pseudo-dimension estimations of the derivative functions of deep neural networks (DNNs). Two important applications of these estimations…

Machine Learning · Computer Science 2023-05-16 Yahong Yang , Haizhao Yang , Yang Xiang

Physics informed neural networks approximate solutions of PDEs by minimizing pointwise residuals. We derive rigorous bounds on the error, incurred by PINNs in approximating the solutions of a large class of linear parabolic PDEs, namely…

Numerical Analysis · Mathematics 2021-07-13 Tim De Ryck , Siddhartha Mishra

A large class of hyperbolic and advection-dominated PDEs can have solutions with discontinuities. This paper investigates, both theoretically and empirically, the operator learning of PDEs with discontinuous solutions. We rigorously prove,…

Machine Learning · Computer Science 2022-10-04 Samuel Lanthaler , Roberto Molinaro , Patrik Hadorn , Siddhartha Mishra

We develop a new and general encode-approximate-reconstruct operator learning model that leverages learned neural representations of bases for input and output function distributions. We introduce the concepts of \textit{numerical operator…

Machine Learning · Computer Science 2025-07-11 Jacob Hauck , Yanzhi Zhang

Operator learning has emerged as a new paradigm for the data-driven approximation of nonlinear operators. Despite its empirical success, the theoretical underpinnings governing the conditions for efficient operator learning remain…

Machine Learning · Computer Science 2024-10-21 Nikola B. Kovachki , Samuel Lanthaler , Hrushikesh Mhaskar