English
Related papers

Related papers: Universal Approximation of Nonlinear Operators and…

200 papers

For linear partial differential equations with known fundamental solutions, this work introduces a novel operator learning framework that relies exclusively on domain boundary data, including solution values and normal derivatives, rather…

Machine Learning · Computer Science 2026-01-19 Haochen Wu , Heng Wu , Benzhuo Lu

We present an approach for solving optimal Dirichlet boundary control problems of nonlinear optics by using deep learning. For computing high resolution approximations of the solution to the nonlinear wave model, we propose higher order…

Numerical Analysis · Mathematics 2023-12-27 Nils Margenberg , Franz X. Kärtner , Markus Bause

The universal approximation theorem is generalised to uniform convergence on the (noncompact) input space $\mathbb{R}^n$. All continuous functions that vanish at infinity can be uniformly approximated by neural networks with one hidden…

Machine Learning · Computer Science 2024-03-05 Teun D. H. van Nuland

Modifications to a neural network's input and output layers are often required to accommodate the specificities of most practical learning tasks. However, the impact of such changes on architecture's approximation capabilities is largely…

Machine Learning · Computer Science 2020-11-10 Anastasis Kratsios , Eugene Bilokopytov

Neural Operators (NOs) provide a powerful framework for computations involving physical laws that can be modelled by (integro-) partial differential equations (PDEs), directly learning maps between infinite-dimensional function spaces that…

Machine Learning · Computer Science 2025-09-18 Gianluca Fabiani , Hannes Vandecasteele , Somdatta Goswami , Constantinos Siettos , Ioannis G. Kevrekidis

We present a completely new structure theoretic approach to the dilation theory of linear operators. Our main result is the following theorem: if $X$ is a super-reflexive Banach space and $T$ is contained in the weakly closed convex hull of…

Functional Analysis · Mathematics 2018-10-10 Stephan Fackler , Jochen Glück

Infinite-dimensional differential algebraic equations (short DAEs) with input and output are studied. The concepts of operator nodes and system nodes are extended to systems which additionally may include algebraic constraints.…

Analysis of PDEs · Mathematics 2025-11-24 Mehmet Erbay , Birgit Jacob , Timo Reis

We introduce a new functional space U designed to contain all classical arithmetic functions (Mobius, von Mangoldt, Euler phi, divisor functions, Dirichlet characters, etc.). The norm of U combines a Hilbert-type component, based on square…

General Mathematics · Mathematics 2025-10-02 Es-said En-naoui

A linear operator $U$ acting boundedly on an infinite-dimensional separable complex Hilbert space $H$ is universal if every linear bounded operator acting on $H$ is similar to a scalar multiple of a restriction of $U$ to one of its…

Functional Analysis · Mathematics 2024-06-05 Luciano Abadías , F. Javier González-Doña , Jesús Oliva-Maza

The inability of deep learning models to handle data drawn from unseen distributions has sparked much interest in unsupervised out-of-distribution (U-OOD) detection, as it is crucial for reliable deep learning models. Despite considerable…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Lars Doorenbos , Raphael Sznitman , Pablo Márquez-Neila

This article studies unbalanced optimal transport (UOT) and its dynamical extension, unbalanced density control (UDC), for a class of constrained discrete-time linear systems. UOT compares measures with unequal total mass by balancing…

Optimization and Control · Mathematics 2026-05-08 Haruto Nakashima , Siddhartha Ganguly , Kenji Kashima

We develop Banach spaces for ReLU neural networks of finite depth $L$ and infinite width. The spaces contain all finite fully connected $L$-layer networks and their $L^2$-limiting objects under bounds on the natural path-norm. Under this…

Machine Learning · Statistics 2020-07-31 Weinan E , Stephan Wojtowytsch

Differential algebraic equations (DAEs) describe the temporal evolution of systems that obey both differential and algebraic constraints. Of particular interest are systems that contain implicit relationships between their components, such…

Machine Learning · Computer Science 2025-07-23 James Koch , Madelyn Shapiro , Himanshu Sharma , Draguna Vrabie , Jan Drgona

We characterize preduals and K\"othe duals to a class of Sobolev multiplier type spaces. Our results fit in well with the modern theory of function spaces of harmonic analysis and are also applicable to nonlinear partial differential…

Analysis of PDEs · Mathematics 2020-05-12 Keng Hao Ooi , Nguyen Cong Phuc

The classical Universal Approximation Theorem holds for neural networks of arbitrary width and bounded depth. Here we consider the natural `dual' scenario for networks of bounded width and arbitrary depth. Precisely, let $n$ be the number…

Machine Learning · Computer Science 2020-06-09 Patrick Kidger , Terry Lyons

Estimating statistical uncertainties allows autonomous agents to communicate their confidence during task execution and is important for applications in safety-critical domains such as autonomous driving. In this work, we present the…

Machine Learning · Computer Science 2019-05-09 Yuchen Cui , David Isele , Scott Niekum , Kikuo Fujimura

We prove that a general class of nonlinear, non-autonomous ODEs in Fr\'echet spaces are close to ODEs in a specific normal form, where closeness means that solutions of the normal form ODE satisfy the original ODE up to a residual that…

Analysis of PDEs · Mathematics 2019-06-12 Peter Hochs , A. J. Roberts

Domain shift poses a significant challenge in cross-domain spoken language recognition (SLR) by reducing its effectiveness. Unsupervised domain adaptation (UDA) algorithms have been explored to address domain shifts in SLR without relying…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-23 Xugang Lu , Peng Shen , Yu Tsao , Hisashi Kawai

We study non-autonomous observation systems \begin{align*} \dot{x}(t) = A(t) x(t),\quad y(t) = C(t) x(t),\quad x(0) = x_0\in X, \end{align*} where $(A(t))$ is a strongly measurable family of closed operators on a Banach space $X$ and…

Functional Analysis · Mathematics 2023-02-28 Clemens Bombach , Fabian Gabel , Christian Seifert , Martin Tautenhahn

While many problems in machine learning focus on learning mappings between finite-dimensional spaces, scientific applications require approximating mappings between function spaces, i.e., operators. We study the problem of learning…

Machine Learning · Computer Science 2025-10-30 Adrien Weihs , Jingmin Sun , Zecheng Zhang , Hayden Schaeffer