English
Related papers

Related papers: The Parametric Complexity of Operator Learning

200 papers

We develop a minimax theory for operator learning, where the goal is to estimate an unknown operator between separable Hilbert spaces from finitely many noisy input-output samples. For uniformly bounded Lipschitz operators, we prove…

Statistics Theory · Mathematics 2026-03-06 Ben Adcock , Gregor Maier , Rahul Parhi

In Artificial Intelligence (AI) and computational science, learning the mappings between functions (called operators) defined on complex computational domains is a common theoretical challenge. Recently, Neural Operator emerged as a…

Numerical Analysis · Mathematics 2023-12-13 Gengxiang Chen , Xu Liu , Qinglu Meng , Lu Chen , Changqing Liu , Yingguang Li

The classical development of neural networks has primarily focused on learning mappings between finite dimensional Euclidean spaces or finite sets. We propose a generalization of neural networks to learn operators, termed neural operators,…

Recent studies show that a reproducing kernel Hilbert space (RKHS) is not a suitable space to model functions by neural networks as the curse of dimensionality (CoD) cannot be evaded when trying to approximate even a single ReLU neuron…

Machine Learning · Statistics 2024-06-27 Fanghui Liu , Leello Dadi , Volkan Cevher

As an emerging paradigm in scientific machine learning, neural operators aim to learn operators, via neural networks, that map between infinite-dimensional function spaces. Several neural operators have been recently developed. However, all…

Machine Learning · Computer Science 2022-02-15 Pengzhan Jin , Shuai Meng , Lu Lu

We study the approximation properties and optimization dynamics of recurrent neural networks (RNNs) when applied to learn input-output relationships in temporal data. We consider the simple but representative setting of using…

Machine Learning · Computer Science 2024-09-02 Zhong Li , Jiequn Han , Weinan E , Qianxiao Li

Operator learning problems arise in many key areas of scientific computing where Partial Differential Equations (PDEs) are used to model physical systems. In such scenarios, the operators map between Banach or Hilbert spaces. In this work,…

Machine Learning · Computer Science 2024-10-31 Ben Adcock , Nick Dexter , Sebastian Moraga

Neural operators are neural network-based surrogate models for approximating solution operators of parametric partial differential equations, enabling efficient many-query computations in science and engineering. Many applications,…

Numerical Analysis · Mathematics 2026-02-03 Mingyu Han , Daniel Zhengyu Huang , Yuhan Wang , Yanshu Zhang , Jiayi Zhou

Neural operator methods have emerged as powerful tools for learning mappings between infinite-dimensional function spaces, yet their potential in optimal control remains largely unexplored. We focus on multi-task control problems, whose…

Machine Learning · Computer Science 2026-04-07 David Sewell , Xingjian Li , Stepan Tretiakov , Krishna Kumar , David Fridovich-Keil

Operator learning techniques have recently emerged as a powerful tool for learning maps between infinite-dimensional Banach spaces. Trained under appropriate constraints, they can also be effective in learning the solution operator of…

Machine Learning · Computer Science 2021-10-13 Sifan Wang , Hanwen Wang , Paris Perdikaris

While machine learning can accurately model process systems, models for decision making should also be structurally simple and physically interpretable. In process control, for example, (nearly) linear models are favored than nonlinear…

Systems and Control · Electrical Eng. & Systems 2026-05-25 Wentao Tang

We study the derivative-informed learning of nonlinear operators between infinite-dimensional separable Hilbert spaces by neural networks. Such operators can arise from the solution of partial differential equations (PDEs), and are used in…

Numerical Analysis · Mathematics 2025-04-14 Dingcheng Luo , Thomas O'Leary-Roseberry , Peng Chen , Omar Ghattas

Solving Partial Differential Equation (PDE) interface problems on varying domains is a critical task in design and optimization, yet it remains computationally prohibitive for traditional solvers. Although operator learning has shown…

Numerical Analysis · Mathematics 2026-04-07 Shanshan Xiao , Ye Li , Zhongyi Huang , Hao Wu

Much recent work has addressed the solution of a family of partial differential equations by computing the inverse operator map between the input and solution space. Toward this end, we incorporate function-valued reproducing kernel Hilbert…

Numerical Analysis · Mathematics 2022-04-05 Kaijun Bao , Xu Qian , Ziyuan Liu , Songhe Song

Inverse problems are important mathematical problems that seek to recover model parameters from noisy data. Since inverse problems are often ill-posed, they require regularization or incorporation of prior information about the underlying…

Numerical Analysis · Mathematics 2026-02-09 Oluwatosin Akande , Gabriel P. Langlois , Akwum Onwunta

Despite the many challenges in exploratory data analysis, artificial neural networks have motivated strong interests in scientists and researchers both in theoretical as well as practical applications. Among sources of such popularity of…

Machine Learning · Computer Science 2025-03-31 Z. Zarezadeh , N. Zarezadeh

Operator learning has emerged as a promising paradigm for approximating solution operators of partial differential equations (PDEs). However, conventional approaches typically rely on pointwise function discretizations, which often suffer…

Numerical Analysis · Mathematics 2026-02-03 Chuqi Chen , Yang Xiang , Weihong Zhang

Logic-based problems such as planning, theorem proving, or puzzles, typically involve combinatoric search and structured knowledge representation. Artificial neural networks are very successful statistical learners, however, for many years,…

Machine Learning · Computer Science 2017-12-11 Gadi Pinkas , Shimon Cohen

A wide range of scientific problems, such as those described by continuous-time dynamical systems and partial differential equations (PDEs), are naturally formulated on function spaces. While function spaces are typically…

Computationally efficient surrogates for parametrized physical models play a crucial role in science and engineering. Operator learning provides data-driven surrogates that map between function spaces. However, instead of full-field…

Machine Learning · Computer Science 2024-12-31 Daniel Zhengyu Huang , Nicholas H. Nelsen , Margaret Trautner