English
Related papers

Related papers: Universal Approximation of Nonlinear Operators and…

200 papers

Learning operators between infinitely dimensional spaces is an important learning task arising in wide applications in machine learning, imaging science, mathematical modeling and simulations, etc. This paper studies the nonparametric…

Machine Learning · Statistics 2022-01-04 Hao Liu , Haizhao Yang , Minshuo Chen , Tuo Zhao , Wenjing Liao

Deep learning (DL) has driven broad advances across scientific and engineering domains. Despite its success, DL models often exhibit limited interpretability and generalization, which can undermine trust, especially in safety-critical…

Machine Learning · Computer Science 2026-01-14 Atefeh Termehchi , Ekram Hossain , Isaac Woungang

Neural operator learning accelerates PDE solution by approximating operators as mappings between continuous function spaces. Yet in many engineering settings, varying geometry induces discrete structural changes, including topological…

Machine Learning · Computer Science 2026-03-04 Jinshuai Bai , Haolin Li , Zahra Sharif Khodaei , M. H. Aliabadi , YuanTong Gu , Xi-Qiao Feng

Neural Ordinary Differential Equations replace the right-hand side of a conventional ODE with a neural net, which by virtue of the universal approximation theorem, can be trained to the representation of any function. When we do not know…

Neurons and Cognition · Quantitative Biology 2020-08-25 Robert Strauss

Neural ordinary differential equations (Neural ODEs) propose the idea that a sequence of layers in a neural network is just a discretisation of an ODE, and thus can instead be directly modelled by a parameterised ODE. This idea has had…

Machine Learning · Computer Science 2024-05-07 Christina Runkel , Ander Biguri , Carola-Bibiane Schönlieb

Machine learning has opened new frontiers in purely data-driven algorithms for data assimilation in, and for forecasting of, dynamical systems; the resulting methods are showing some promise. However, in contrast to model-driven algorithms,…

Machine Learning · Statistics 2026-04-03 Edoardo Calvello , Elizabeth Carlson , Nikola Kovachki , Michael N. Manta , Andrew M. Stuart

Neural operators have emerged as powerful tools for learning nonlinear mappings between function spaces, enabling real-time prediction of complex dynamics in diverse scientific and engineering applications. With their growing adoption in…

Computational Engineering, Finance, and Science · Computer Science 2025-10-14 Weiheng Zhong , Qibang Liu , Diab Abueidda , Seid Koric , Hadi Meidani

An important consequence of the Hahn-Banach Theorem says that on any locally convex Hausdorff topological space $X$, there are sufficiently many continuous linear functionals to separate points of $X$. In the paper, we establish a `local'…

Functional Analysis · Mathematics 2018-09-07 Niushan Gao , Denny H. Leung , Foivos Xanthos

Regularization plays a pivotal role in integrating prior information into inverse problems. While many deep learning methods have been proposed to solve inverse problems, determining where to apply regularization remains a crucial…

Numerical Analysis · Mathematics 2024-03-22 Ke Chen , Chunmei Wang , Haizhao Yang

We develop a variational framework to understand the properties of functions learned by fitting deep neural networks with rectified linear unit activations to data. We propose a new function space, which is reminiscent of classical bounded…

Machine Learning · Statistics 2022-04-18 Rahul Parhi , Robert D. Nowak

We give conditions for local diagonalization of analytic operator families acting between real or complex Banach spaces. The transformations are constructed from an operator Toeplitz matrix obtained from Jordan chains of increasing length.…

Algebraic Geometry · Mathematics 2023-05-24 Matthias Stiefenhofer

The Double Operator Integral (DOI) framework provides a powerful tool for analyzing perturbations and interactions between self-adjoint operators in functional analysis and spectral theory. However, most existing DOI formulations rely on…

Functional Analysis · Mathematics 2025-03-21 Shih-Yu Chang

Neural ordinary differential equations (ODEs) provide expressive representations of invertible transport maps that can be used to approximate complex probability distributions, e.g., for generative modeling, density estimation, and Bayesian…

Machine Learning · Computer Science 2025-02-07 Youssef Marzouk , Zhi Ren , Jakob Zech

Deep neural networks have been successful in diverse discriminative classification tasks, although, they are poorly calibrated often assigning high probability to misclassified predictions. Potential consequences could lead to…

Machine Learning · Statistics 2020-10-06 John Mitros , Arjun Pakrashi , Brian Mac Namee

We propose a deep neural-operator framework for a general class of probability models. Under global Lipschitz conditions on the operator over the entire Euclidean space-and for a broad class of probabilistic models-we establish a universal…

Machine Learning · Computer Science 2025-11-11 Erhan Bayraktar , Qi Feng , Zecheng Zhang , Zhaoyu Zhang

The aim of this note is to prove various general properties of a generalization of the full module of first order differential operators on a commutative ring - a $\operatorname{D}$-Lie algebra. A $\operatorname{D}$-Lie algebra $\tilde{L}$…

Algebraic Geometry · Mathematics 2022-11-17 Helge Øystein Maakestad

Neural ordinary differential equations (NODEs) is an invertible neural network architecture promising for its free-form Jacobian and the availability of a tractable Jacobian determinant estimator. Recently, the representation power of NODEs…

Machine Learning · Computer Science 2020-12-07 Takeshi Teshima , Koichi Tojo , Masahiro Ikeda , Isao Ishikawa , Kenta Oono

We present approximation theories and efficient training methods for derivative-informed Fourier neural operators (DIFNOs) with applications to PDE-constrained optimization. A DIFNO is an FNO trained by minimizing its prediction error…

Machine Learning · Computer Science 2026-03-17 Boyuan Yao , Dingcheng Luo , Lianghao Cao , Nikola Kovachki , Thomas O'Leary-Roseberry , Omar Ghattas

Fourier neural operators (FNOs) can learn highly nonlinear mappings between function spaces, and have recently become a popular tool for learning responses of complex physical systems. However, to achieve good accuracy and efficiency, FNOs…

Machine Learning · Computer Science 2023-10-31 Ning Liu , Siavash Jafarzadeh , Yue Yu

In this work, we consider the non-invasive medical imaging modality of Electrical Impedance Tomography (EIT), where the goal is to recover the conductivity in a medium from boundary current-to-voltage measurements, i.e., the…

Machine Learning · Computer Science 2026-04-15 Anuj Abhishek , Thilo Strauss