English
Related papers

Related papers: Generalization Error Bounds for Picard-Type Operat…

200 papers

Optimal control problems with nonsmooth objectives and nonlinear partial differential equation (PDE) constraints are challenging, mainly because of the underlying nonsmooth and nonconvex structures and the demanding computational cost for…

Optimization and Control · Mathematics 2025-04-25 Yongcun Song , Xiaoming Yuan , Hangrui Yue , Tianyou Zeng

Fast and accurate solution of time-dependent partial differential equations (PDEs) is of key interest in many research fields including physics, engineering, and biology. Generally, implicit schemes are preferred over the explicit ones for…

Numerical Analysis · Mathematics 2019-11-28 Suprosanna Shit , Abinav Ravi Venkatakrishnan , Ivan Ezhov , Jana Lipkova , Marie Piraud , Bjoern Menze

We present a framework for recovering/approximating unknown time-dependent partial differential equation (PDE) using its solution data. Instead of identifying the terms in the underlying PDE, we seek to approximate the evolution operator of…

Numerical Analysis · Mathematics 2020-05-05 Kailiang Wu , Dongbin Xiu

Deep operator network (DeepONet) has shown significant promise as surrogate models for systems governed by partial differential equations (PDEs), enabling accurate mappings between infinite-dimensional function spaces. However, when applied…

Machine Learning · Computer Science 2025-10-29 Sharmila Karumuri , Lori Graham-Brady , Somdatta Goswami

Physics informed neural networks (PINNs) have recently been widely used for robust and accurate approximation of PDEs. We provide rigorous upper bounds on the generalization error of PINNs approximating solutions of the forward problem for…

Numerical Analysis · Mathematics 2023-12-07 Siddhartha Mishra , Roberto Molinaro

A primary challenge of physics-informed machine learning (PIML) is its generalization beyond the training domain, especially when dealing with complex physical problems represented by partial differential equations (PDEs). This paper aims…

Machine Learning · Computer Science 2023-12-19 Taniya Kapoor , Abhishek Chandra , Daniel M. Tartakovsky , Hongrui Wang , Alfredo Nunez , Rolf Dollevoet

Operator learning has emerged as a promising paradigm for developing efficient surrogate models to solve partial differential equations (PDEs). However, existing approaches often overlook the domain knowledge inherent in the underlying PDEs…

Machine Learning · Computer Science 2025-10-20 Ziqian Li , Kang Liu , Yongcun Song , Hangrui Yue , Enrique Zuazua

Neural ordinary differential equations (neural ODEs) are a popular type of deep learning model that operate with continuous-depth architectures. To assess how well such models perform on unseen data, it is crucial to understand their…

Machine Learning · Computer Science 2025-08-27 Madhusudan Verma , Manoj Kumar

Operator learning has emerged as a new paradigm for the data-driven approximation of nonlinear operators. Despite its empirical success, the theoretical underpinnings governing the conditions for efficient operator learning remain…

Machine Learning · Computer Science 2024-10-21 Nikola B. Kovachki , Samuel Lanthaler , Hrushikesh Mhaskar

We present a new framework for computing fine-scale solutions of multiscale Partial Differential Equations (PDEs) using operator learning tools. Obtaining fine-scale solutions of multiscale PDEs can be challenging, but there are many…

Numerical Analysis · Mathematics 2023-08-29 Zecheng Zhang , Christian Moya , Wing Tat Leung , Guang Lin , Hayden Schaeffer

This paper explores the generalization characteristics of iterative learning algorithms with bounded updates for non-convex loss functions, employing information-theoretic techniques. Our key contribution is a novel bound for the…

Machine Learning · Computer Science 2023-10-17 Jingwen Fu , Nanning Zheng

We propose a framework for solving nonlinear partial differential equations (PDEs) by combining perturbation theory with one-shot transfer learning in Physics-Informed Neural Networks (PINNs). Nonlinear PDEs with polynomial terms are…

Numerical Analysis · Mathematics 2025-11-17 Samuel Auroy , Pavlos Protopapas

In this paper, we propose a systematic approach for accelerating finite element-type methods by machine learning for the numerical solution of partial differential equations (PDEs). The main idea is to use a neural network to learn the…

Numerical Analysis · Mathematics 2024-10-11 Shukai Du , Samuel N. Stechmann

In scientific and engineering applications, solving partial differential equations (PDEs) across various parameters and domains normally relies on resource-intensive numerical methods. Neural operators based on deep learning offered a…

Numerical Analysis · Mathematics 2024-06-21 Zhiwei Zhao , Changqing Liu , Yingguang Li , Zhibin Chen , Xu Liu

Modeling sequential patterns from data is at the core of various time series forecasting tasks. Deep learning models have greatly outperformed many traditional models, but these black-box models generally lack explainability in prediction…

Machine Learning · Computer Science 2023-05-23 Yingtao Luo , Chang Xu , Yang Liu , Weiqing Liu , Shun Zheng , Jiang Bian

Modeling and controlling complex spatiotemporal dynamical systems driven by partial differential equations (PDEs) often necessitate dimensionality reduction techniques to construct lower-order models for computational efficiency. This paper…

Systems and Control · Electrical Eng. & Systems 2024-09-12 Priyabrata Saha , Saibal Mukhopadhyay

A wide range of scientific problems, such as those described by continuous-time dynamical systems and partial differential equations (PDEs), are naturally formulated on function spaces. While function spaces are typically…

In this work, we propose a method to learn the solution operators of PDEs defined on varying domains via MIONet, and theoretically justify this method. We first extend the approximation theory of MIONet to further deal with metric spaces,…

Machine Learning · Computer Science 2024-03-19 Shanshan Xiao , Pengzhan Jin , Yifa Tang

Neural operator learning models have emerged as very effective surrogates in data-driven methods for partial differential equations (PDEs) across different applications from computational science and engineering. Such operator learning…

Machine Learning · Computer Science 2024-05-30 Benjamin Shih , Ahmad Peyvan , Zhongqiang Zhang , George Em Karniadakis

We study learning-theoretic foundations of operator learning, using the linear layer of the Fourier Neural Operator architecture as a model problem. First, we identify three main errors that occur during the learning process: statistical…

Machine Learning · Statistics 2025-02-10 Unique Subedi , Ambuj Tewari