Related papers: Projection Methods for Operator Learning and Unive…
This paper proposes a specific type of Local Linear Model, the Shuffled Linear Model (SLM), that can be used as a universal approximator. Local operating points are chosen randomly and linear models are used to approximate a function or…
In this paper we explore the properties of a bounded linear operator defined on a Banach space, in light of operator norm attainment. Using Birkhoff-James orthogonality techniques, we give a necessary condition for a bounded linear operator…
We develop a general, functional calculus approach to approximation of $C_0$-semigroups on Banach spaces by bounded completely monotone functions of their generators. The approach comprises most of well-known approximation formulas, yields…
We study a notion analogous to the $p$-Approximation Property ($p$-AP) for Banach spaces, within the noncommutative context of operator spaces. Referred to as the $p$-Operator Approximation Property ($p$-OAP), this concept is linked to the…
It is well known that iterates of quasi-compact operators converge towards a spectral projection, whereas the explicit construction of the limiting operator is in general hard to obtain. Here, we show a simple method to explicitly construct…
Computationally efficient surrogates for parametrized physical models play a crucial role in science and engineering. Operator learning provides data-driven surrogates that map between function spaces. However, instead of full-field…
In \cite{Os} a general spectral approximation theory was developed for compact operators on a Banach space which does not require that the operators be self-adjoint and also provides a first order correction term. Here we extend some of the…
We show that there are sampling projections on arbitrary $n$-dimensional subspaces of $B(D)$ with at most $2n$ samples and norm of order $\sqrt{n}$, where $B(D)$ is the space of complex-valued bounded functions on a set $D$. This gives a…
Supervised learning in function spaces is an emerging area of machine learning research with applications to the prediction of complex physical systems such as fluid flows, solid mechanics, and climate modeling. By directly learning maps…
Given an operator ideal I, a Banach space E has the I-approximation property if operators on E can be uniformly approximated on compact subsets of E by operators belonging to I. In this paper the I- approximation property is studied in…
The Koopman operator approach provides a powerful linear description of nonlinear dynamical systems in terms of the evolution of observables. While the operator is typically infinite-dimensional, it is crucial to develop finite-dimensional…
We define a neural network in infinite dimensional spaces for which we can show the universal approximation property. Indeed, we derive approximation results for continuous functions from a Fr\'echet space $\X$ into a Banach space $\Y$. The…
Deep learning employs multi-layer neural networks trained via the backpropagation algorithm. This approach has achieved success across many domains and relies on adaptive gradient methods such as the Adam optimizer. Sequence modeling…
The Universal Approximation Theorem (UAT) guarantees universal function approximation but does not explain how residual models distribute approximation across layers. We reframe residual networks as a layer-wise approximation process that…
We build on the dynamical systems approach to deep learning, where deep residual networks are idealized as continuous-time dynamical systems, from the approximation perspective. In particular, we establish general sufficient conditions for…
Operator regression provides a powerful means of constructing discretization-invariant emulators for partial-differential equations (PDEs) describing physical systems. Neural operators specifically employ deep neural networks to approximate…
We use the notion of $\A$-compact sets, which are determined by a Banach operator ideal $\A$, to show that most classic results of certain approximation properties and several Banach operator ideals can be systematically studied under this…
Universal approximation theory offers a foundational framework to verify neural network expressiveness, enabling principled utilization in real-world applications. However, most existing theoretical constructions are established by…
For Banach spaces $X,Y,$ we consider a distance problem in the space of bounded linear operators $\mathcal{L}(X,Y).$ Motivated by a recent paper \cite{RAO21}, we obtain sufficient conditions so that for a compact operator…
Transfer and Koopman operator methods offer a framework for representing complex, nonlinear dynamical systems via linear transformations, enabling a deeper understanding of the underlying dynamics. The spectra of these operators provide…