English
Related papers

Related papers: Quantitative Sobolev Approximation Bounds for Neur…

200 papers

Recent advances in machine learning have inspired a surge of research into reconstructing specific quantities of interest from measurements that comply with certain physical laws. These efforts focus on inverse problems that are governed by…

Machine Learning · Statistics 2025-04-23 Honam Wong , Wendao Wu , Fanghui Liu , Yiping Lu

Existing neural operator architectures face challenges when solving multiphysics problems with coupled partial differential equations (PDEs) due to complex geometries, interactions between physical variables, and the limited amounts of…

Neural operators approximate PDE solution maps, but they need not respect the symmetries of the governing equation. In out-of-distribution (OOD) regimes, a standard neural operator must often learn coordinate alignment and physical…

Machine Learning · Computer Science 2026-05-19 Jiaxiao Xu , Changhong Mou , Yeyu Zhang , Fengxiang He

Fourier Neural Operators (FNO) offer a principled approach to solving challenging partial differential equations (PDE) such as turbulent flows. At the core of FNO is a spectral layer that leverages a discretization-convergent representation…

Machine Learning · Computer Science 2024-03-06 Robert Joseph George , Jiawei Zhao , Jean Kossaifi , Zongyi Li , Anima Anandkumar

We design a quasi-interpolation operator from the Sobolev space $H^1_0(\Omega)$ to its finite-dimensional finite element subspace formed by piecewise polynomials on a simplicial mesh with a computable approximation constant. The operator 1)…

Numerical Analysis · Mathematics 2025-07-17 T. Chaumont-Frelet , M. Vohralik

The classical development of neural networks has primarily focused on learning mappings between finite-dimensional Euclidean spaces. Recently, this has been generalized to neural operators that learn mappings between function spaces. For…

Learning mappings between infinite-dimensional function spaces has achieved empirical success in many disciplines of machine learning, including generative modeling, functional data analysis, causal inference, and multi-agent reinforcement…

Machine Learning · Computer Science 2023-07-25 Jikai Jin , Yiping Lu , Jose Blanchet , Lexing Ying

This paper studies approximation by shallow ReLU$^s$ networks, $\sigma_s(t)=\max\{0,t\}^s$, together with their generalization behavior under $\ell_1$ path-norm control. For the $L^p$-type integral spaces…

Machine Learning · Statistics 2026-05-27 Weizhao Li , Fanghui Liu , Lei Shi

Areas of computational mechanics such as uncertainty quantification and optimization usually involve repeated evaluation of numerical models that represent the behavior of engineering systems. In the case of complex nonlinear systems…

Machine Learning · Computer Science 2024-10-03 A. O. M. Kilicsoy , J. Liedmann , M. A. Valdebenito , F. -J. Barthold , M. G. R. Faes

Neural operators, as an efficient surrogate model for learning the solutions of PDEs, have received extensive attention in the field of scientific machine learning. Among them, attention-based neural operators have become one of the…

Machine Learning · Computer Science 2024-12-30 Zipeng Xiao , Zhongkai Hao , Bokai Lin , Zhijie Deng , Hang Su

This paper introduces an operator-based neural network, the mirror-padded Fourier neural operator (MFNO), designed to learn the dynamics of stochastic systems. MFNO extends the standard Fourier neural operator (FNO) by incorporating mirror…

Machine Learning · Computer Science 2025-07-25 Wonjae Lee , Taeyoung Kim , Hyungbin Park

In this article, we fully characterize the measurable Gaussian processes $(U(x))_{x\in\mathcal{D}}$ whose sample paths lie in the Sobolev space of integer order $W^{m,p}(\mathcal{D}),\ m\in\mathbb{N}_0,\ 1 <p<+\infty$, where $\mathcal{D}$…

Functional Analysis · Mathematics 2022-09-08 Iain Henderson

This paper studies function approximation in Gaussian Sobolev spaces over the real line and measures the error in a Gaussian-weighted $L^p$-norm. We construct two linear approximation algorithms using $n$ function evaluations that achieve…

Numerical Analysis · Mathematics 2026-03-20 Yuya Suzuki , Toni Karvonen

Motivated by recent work on benign overfitting in overparameterized machine learning, we study the generalization behavior of functions in Sobolev spaces $W^{k, p}(\mathbb{R}^d)$ that perfectly fit a noisy training data set. Under…

Machine Learning · Statistics 2026-02-03 Kedar Karhadkar , Alexander Sietsema , Deanna Needell , Guido Montufar

Recent advances in scientific machine learning (SciML) have enabled neural operators (NOs) to serve as powerful surrogates for modeling the dynamic evolution of physical systems governed by partial differential equations (PDEs). While…

Machine Learning · Computer Science 2026-02-18 Siying Ma , Mehrdad M. Zadeh , Mauricio Soroco , Wuyang Chen , Jiguo Cao , Vijay Ganesh

To stabilize PDEs, feedback controllers require gain kernel functions, which are themselves governed by PDEs. Furthermore, these gain-kernel PDEs depend on the PDE plants' functional coefficients. The functional coefficients in PDE plants…

Systems and Control · Electrical Eng. & Systems 2024-01-17 Maxence Lamarque , Luke Bhan , Yuanyuan Shi , Miroslav Krstic

This paper investigates the numerical approximation of integrals for functions in fractional Gaussian Sobolev spaces $W^s_{p}(\mathbb{R}^d,\gamma)$ with dominating mixed smoothness defined via kernel related to the fractional…

Numerical Analysis · Mathematics 2026-04-21 Van Kien Nguyen

In this paper, we prove the uniform estimates for the resolvent $(\Delta - \alpha)^{-1}$ as a map from $L^q$ to $L^{q'}$ on real hyperbolic space $\mathbb{H}^n$ where $\alpha \in \mathbb{C}\setminus [(n - 1)^2/4, \infty)$ and $2n/(n + 2)…

Analysis of PDEs · Mathematics 2023-02-15 Xi Chen

Neural Operators (NOs) have emerged as powerful tools for learning mappings between function spaces. Among them, the kernel integral operator has been widely used in universally approximating architectures. Following the original…

Machine Learning · Computer Science 2026-01-30 Haoze Song , Zhihao Li , Xiaobo Zhang , Zecheng Gan , Zhilu Lai , Wei Wang

We develop fast and memory efficient numerical methods for learning functions of many variables that admit sparse representations in terms of general bounded orthonormal tensor product bases. Such functions appear in many applications…

Numerical Analysis · Mathematics 2020-05-11 Bosu Choi , Mark Iwen , Felix Krahmer