English
Related papers

Related papers: Quantitative Sobolev Approximation Bounds for Neur…

200 papers

Neural operators have become increasingly popular in solving \textit{partial differential equations} (PDEs) due to their superior capability to capture intricate mappings between function spaces over complex domains. However, the…

Machine Learning · Computer Science 2026-03-02 Jianing Huang , Kaixuan Zhang , Youjia Wu , Ze Cheng

In this work, we describe a novel approach to building a neural PDE solver leveraging recent advances in transformer based neural network architectures. Our model can provide solutions for different values of PDE parameters without any need…

Machine Learning · Computer Science 2024-07-10 Varun Madhavan , Amal S Sebastian , Bharath Ramsundar , Venkatasubramanian Viswanathan

In this paper, we introduce semi-autonomous neural ordinary differential equations (SA-NODEs), a variation of the vanilla NODEs, employing fewer parameters. We investigate the universal approximation properties of SA-NODEs for dynamical…

Numerical Analysis · Mathematics 2026-01-13 Ziqian Li , Kang Liu , Lorenzo Liverani , Enrique Zuazua

Neural operators (NOs) provide a new paradigm for efficiently solving partial differential equations (PDEs), but their training depends on costly high-fidelity data from numerical solvers, limiting applications in complex systems. We…

Computational Physics · Physics 2026-05-18 Wen You , Shaoqian Zhou , Xuhui Meng

An approximation Ansatz for the operator solution, $U(z',z)$, of a hyperbolic first-order pseudodifferential equation, $\d_z + a(z,x,D_x)$ with $\Re (a) \geq 0$, is constructed as the composition of global Fourier integral operators with…

Analysis of PDEs · Mathematics 2007-05-23 Jerome Le Rousseau

The approximate degree of a Boolean function $f(x_{1},x_{2},\ldots,x_{n})$ is the minimum degree of a real polynomial that approximates $f$ pointwise within $1/3$. Upper bounds on approximate degree have a variety of applications in…

Computational Complexity · Computer Science 2018-01-16 Alexander A. Sherstov

The numerical approximation of the Boltzmann collision operator presents significant challenges arising from its high dimensionality, nonlinear structure, and nonlocal integral form. In this work, we propose a Fourier Neural Operator (FNO)…

Numerical Analysis · Mathematics 2025-10-16 Boyun Hu , Kunlun Qi

We introduce the Sumudu Neural Operator (SNO), a neural operator rooted in the properties of the Sumudu Transform. We leverage the relationship between the polynomial expansions of transform pairs to decompose the input space as…

Machine Learning · Computer Science 2025-11-18 Ben Zelenskiy , Saibilila Abudukelimu , George Flint , Kevin Zhu , Sunishchal Dev

In this paper, we study the statistical limits in terms of Sobolev norms of gradient descent for solving inverse problem from randomly sampled noisy observations using a general class of objective functions. Our class of objective functions…

Numerical Analysis · Mathematics 2022-09-20 Yiping Lu , Jose Blanchet , Lexing Ying

Neural operators have emerged as a promising paradigm for learning solution operators of partial differential equa- tions (PDEs) directly from data. Existing methods, such as those based on Fourier or graph techniques, make strong as-…

Machine Learning · Computer Science 2025-11-14 Noam Koren , Ralf J. J. Mackenbach , Ruud J. G. van Sloun , Kira Radinsky , Daniel Freedman

This paper is devoted to a qualitative analysis of the Poincar\'e--Sobolev level associated with the fractional GJMS operators \(\mathcal{P}_s\) \(\bigl(s\in(0,\tfrac n2)\setminus\mathbb N\bigr)\) on the hyperbolic space \(\mathbb H^n\). In…

Analysis of PDEs · Mathematics 2026-02-25 Huyuan Chen , Rui Chen

We develop a general framework for data-driven approximation of input-output maps between infinite-dimensional spaces. The proposed approach is motivated by the recent successes of neural networks and deep learning, in combination with…

Numerical Analysis · Mathematics 2021-06-21 Kaushik Bhattacharya , Bamdad Hosseini , Nikola B. Kovachki , Andrew M. Stuart

PDEs arise ubiquitously in science and engineering, where solutions depend on parameters (physical properties, boundary conditions, geometry). Traditional numerical methods require re-solving the PDE for each parameter, making parameter…

Machine Learning · Statistics 2026-02-02 Zhuo Zhang , Xiong Xiong , Sen Zhang , Yuan Zhao , Xi Yang

Fourier Neural Operators are deep learning models that learn mappings between function spaces and can be used to learn and solve partial differential equations (PDEs), in some cases significantly faster than traditional PDE solvers. Within…

Machine Learning · Computer Science 2026-05-05 Michael F. Staddon

In this work, we consider the approximation capabilities of shallow neural networks in weighted Sobolev spaces for functions in the spectral Barron space. The existing literature already covers several cases, in which the spectral Barron…

Machine Learning · Computer Science 2024-11-07 Ahmed Abdeljawad , Thomas Dittrich

Neural operators are neural network-based surrogate models for approximating solution operators of parametric partial differential equations, enabling efficient many-query computations in science and engineering. Many applications,…

Numerical Analysis · Mathematics 2026-02-03 Mingyu Han , Daniel Zhengyu Huang , Yuhan Wang , Yanshu Zhang , Jiayi Zhou

Let $\Omega\subset \mathbb{R}^d$ be a bounded domain. We consider the problem of how efficiently shallow neural networks with the ReLU$^k$ activation function can approximate functions from Sobolev spaces $W^s(L_p(\Omega))$ with error…

Machine Learning · Statistics 2025-10-17 Tong Mao , Jonathan W. Siegel , Jinchao Xu

We analyze approximation rates of deep ReLU neural networks for Sobolev-regular functions with respect to weaker Sobolev norms. First, we construct, based on a calculus of ReLU networks, artificial neural networks with ReLU activation…

Functional Analysis · Mathematics 2019-02-22 Ingo Gühring , Gitta Kutyniok , Philipp Petersen

Neural operators (NO) are discretization invariant deep learning methods with functional output and can approximate any continuous operator. NO have demonstrated the superiority of solving partial differential equations (PDEs) over other…

Numerical Analysis · Mathematics 2024-02-02 Jianguo Huang , Yue Qiu

Neural operators extend data-driven models to map between infinite-dimensional functional spaces. While these operators perform effectively in either the time or frequency domain, their performance may be limited when applied to…

Machine Learning · Computer Science 2024-06-06 Karn Tiwari , N M Anoop Krishnan , A P Prathosh