English
Related papers

Related papers: Quantitative Sobolev Approximation Bounds for Neur…

200 papers

Neural operators have achieved significant success in modern scientific computing due to their flexibility and strong generalization capabilities. Existing models, however, primarily rely on first-order kernel integral approximations, which…

Machine Learning · Computer Science 2026-05-22 Pengyuan Zhu , Ivor W. Tsang , Yueming Lyu

The celebrated universal approximation theorems for neural networks roughly state that any reasonable function can be arbitrarily well-approximated by a network whose parameters are appropriately chosen real numbers. This paper examines the…

Machine Learning · Computer Science 2023-03-17 C. Sinan Güntürk , Weilin Li

We study Neural Optimal Transport in infinite-dimensional Hilbert spaces. In non-regular settings, Semi-dual Neural OT often generates spurious solutions that fail to accurately capture target distributions. We analytically characterize…

Machine Learning · Computer Science 2026-02-17 Jae-Hwan Choi , Jiwoo Yoon , Dohyun Kwon , Jaewoong Choi

Learning solution operators of partial differential equations (PDEs) from data has emerged as a promising route to fast surrogate models in multi-query scientific workflows. However, for geometric PDEs whose inputs and outputs transform…

Artificial Intelligence · Computer Science 2026-03-17 Pengcheng Cheng

Unlike ODEs, whose models involve system matrices and whose controllers involve vector or matrix gains, PDE models involve functions in those roles functional coefficients, dependent on the spatial variables, and gain functions dependent on…

Systems and Control · Electrical Eng. & Systems 2023-03-21 Miroslav Krstic , Luke Bhan , Yuanyuan Shi

Stochastic partial differential equations (SPDEs) are significant tools for modeling dynamics in many areas including atmospheric sciences and physics. Neural Operators, generations of neural networks with capability of learning maps…

Machine Learning · Computer Science 2022-07-19 Peiyan Hu , Qi Meng , Bingguang Chen , Shiqi Gong , Yue Wang , Wei Chen , Rongchan Zhu , Zhi-Ming Ma , Tie-Yan Liu

Operator learning has been highly successful for continuous mappings between infinite-dimensional spaces, such as PDE solution operators. However, many operators of interest-including differential operators-are discontinuous or set-valued,…

Machine Learning · Computer Science 2026-05-13 Takashi Furuya , Yury Korolev , Takaharu Yaguchi

Learning rates for least-squares regression are typically expressed in terms of $L_2$-norms. In this paper we extend these rates to norms stronger than the $L_2$-norm without requiring the regression function to be contained in the…

Machine Learning · Statistics 2020-10-27 Simon Fischer , Ingo Steinwart

Deep operator networks (DeepONet) and neural operators have gained significant attention for their ability to map infinite-dimensional function spaces and perform zero-shot super-resolution. However, these models often require large…

Machine Learning · Computer Science 2024-09-17 Milad Ramezankhani , Rishi Yash Parekh , Anirudh Deodhar , Dagnachew Birru

Partial differential equations (PDEs) govern complex systems, yet neural operators often struggle to efficiently capture the long-range, nonlocal interactions inherent in their solution maps. We introduce Spectral Filtering Operator (SFO),…

Machine Learning · Computer Science 2026-01-27 Noam Koren , Rafael Moschopoulos , Kira Radinsky , Elad Hazan

In this paper, we study the error in first order Sobolev norm in the approximation of solutions to linear parabolic PDEs. We use a Monte Carlo Euler scheme obtained from combining the Feynman--Kac representation with a Euler discretization…

Numerical Analysis · Mathematics 2023-06-30 Patrick Cheridito , Florian Rossmannek

We construct the first rigorously justified probabilistic algorithm for recovering the solution operator of a hyperbolic partial differential equation (PDE) in two variables from input-output training pairs. The primary challenge of…

Numerical Analysis · Mathematics 2026-02-03 Christopher Wang , Alex Townsend

We develop a deep autoencoder architecture that can be used to find a coordinate transformation which turns a nonlinear PDE into a linear PDE. Our architecture is motivated by the linearizing transformations provided by the Cole-Hopf…

Dynamical Systems · Mathematics 2020-09-30 Craig Gin , Bethany Lusch , Steven L. Brunton , J. Nathan Kutz

Operator learning has emerged as a promising paradigm for approximating solution operators of partial differential equations (PDEs). However, conventional approaches typically rely on pointwise function discretizations, which often suffer…

Numerical Analysis · Mathematics 2026-02-03 Chuqi Chen , Yang Xiang , Weihong Zhang

Nonlocal periodic operators in partial differential equations (PDEs) pose challenges in constructing neural network solutions, which typically lack periodic boundary conditions. In this paper, we introduce a novel PDE perspective on…

Numerical Analysis · Mathematics 2024-11-20 Elie Abdo , Ruimeng Hu , Quyuan Lin

The aim of the paper is to develop a general theory of solvability of linear inhomogeneous boundary-value problems for systems of ordinary differential equations of arbitrary order in Sobolev spaces. Boundary conditions are allowed to be…

Classical Analysis and ODEs · Mathematics 2023-10-12 Vladimir Mikhailets , Olena Atlasiuk

We investigate properties of neural networks that use both ReLU and $x^2$ as activation functions and build upon previous results to show that both analytic functions and functions in Sobolev spaces can be approximated by such networks of…

Machine Learning · Computer Science 2023-01-31 Vincent P. H. Goverse , Jad Hamdan , Jared Tanner

Neural operators learn to map initial conditions to the terminal solution of partial differential equations (PDEs), providing a surrogate for the full operator mapping. This enables rapid prediction across different input configurations.…

Machine Learning · Computer Science 2026-05-14 Runlong Xie , An Luo

We prove uniform boundedness of certain boundary representations on appropriate fractional Sobolev spaces $W^{s,p}$ with $p>1$ for arbitrary Gromov hyperbolic groups. These are closed subspaces of $L^p$ and in particular Hilbert spaces in…

Group Theory · Mathematics 2023-06-19 Kevin Boucher , Jan Spakula

Neural Operators (NOs) are machine learning models designed to solve partial differential equations (PDEs) by learning to map between function spaces. Neural Operators such as the Deep Operator Network (DeepONet) and the Fourier Neural…

Machine Learning · Computer Science 2025-04-30 W. Diab , M. Al-Kobaisi