English
Related papers

Related papers: Operator Learning of Lipschitz Operators: An Infor…

200 papers

Deep Neural Networks (DNNs) are vulnerable to adversarial attacks. Existing methods are devoted to developing various robust training strategies or regularizations to update the weights of the neural network. But beyond the weights, the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Minjing Dong , Yanxi Li , Yunhe Wang , Chang Xu

We investigate dynamical properties of linear operators that are obtained as the linearization of Lipschitz self-maps defined on a pointed metric space. These operators are known as Lipschitz operators. More concretely, for a Lipschitz…

Functional Analysis · Mathematics 2023-05-01 Sebastián Tapia-García

This article delves into the study of the theory of regularized learning in Banach spaces for linear-functional data. It encompasses discussions on representer theorems, pseudo-approximation theorems, and convergence theorems. Regularized…

Machine Learning · Computer Science 2025-03-05 Qi Ye

We study approximately orthogonality (in the sense of Dragomir) preserving and reversing operators. We show that for some orthogonality notations, an operator defined from a finite-dimensional Banach space to a normed linear space is…

Functional Analysis · Mathematics 2025-12-11 Divya Khurana

We develop an operator-theoretic framework for stability and statistical concentration in nonlinear inverse problems with block-structured parameters. Under a unified set of assumptions combining blockwise Lipschitz geometry, local…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Joe-Mei Feng , Hsin-Hsiung Kao

Standard neural network architectures employ fixed activation functions (ReLU, tanh, sigmoid) that are poorly suited for approximating functions with singular or fractional power behavior, a structure that arises ubiquitously in physics,…

Machine Learning · Computer Science 2026-01-21 Gnankan Landry Regis N'guessan

In this paper, the problem of the order of approximation for the multivariate sampling Kantorovich operators is studied. The cases of the uniform approximation for uniformly continuous and bounded functions/signals belonging to Lipschitz…

Functional Analysis · Mathematics 2014-11-11 Danilo Costarelli , Gianluca Vinti

Much recent work has addressed the solution of a family of partial differential equations by computing the inverse operator map between the input and solution space. Toward this end, we incorporate function-valued reproducing kernel Hilbert…

Numerical Analysis · Mathematics 2022-04-05 Kaijun Bao , Xu Qian , Ziyuan Liu , Songhe Song

Invertible neural networks (INNs) represent an important class of deep neural network architectures that have been widely used in several applications. The universal approximation properties of INNs have also been established recently.…

Numerical Analysis · Mathematics 2023-08-21 Bangti Jin , Zehui Zhou , Jun Zou

Recent advances in operator learning theory have improved our knowledge about learning maps between infinite dimensional spaces. However, for large-scale engineering problems such as concurrent multiscale simulation for mechanical…

Machine Learning · Computer Science 2022-12-05 Owen Huang , Sourav Saha , Jiachen Guo , Wing Kam Liu

An important application of neural networks to scientific computing has been the learning of non-linear operators. In this framework, a neural network is trained to fit a non-linear map between two infinite dimensional spaces, for example,…

Machine Learning · Computer Science 2026-02-03 Shao-Ting Chiu , Aditya Nambiar , Ali Syed , Jonathan W. Siegel , Ulisses Braga-Neto

Important research efforts have focused on the design and training of neural networks with a controlled Lipschitz constant. The goal is to increase and sometimes guarantee the robustness against adversarial attacks. Recent promising…

Machine Learning · Computer Science 2023-10-30 Alexandre Araujo , Aaron Havens , Blaise Delattre , Alexandre Allauzen , Bin Hu

We develop a stochastic approximation framework for learning nonlinear operators between infinite-dimensional spaces utilizing general Mercer operator-valued kernels. Our framework encompasses two key classes: (i) compact kernels, which…

Machine Learning · Statistics 2026-01-13 Jia-Qi Yang , Lei Shi

Fourier neural operators (FNOs) have recently been proposed as an effective framework for learning operators that map between infinite-dimensional spaces. We prove that FNOs are universal, in the sense that they can approximate any…

Numerical Analysis · Mathematics 2021-12-21 Nikola Kovachki , Samuel Lanthaler , Siddhartha Mishra

The ``differentiability gap'' presents a primary bottleneck in Earth system deep learning: since models cannot be trained directly on non-differentiable scientific metrics and must rely on smooth proxies (e.g., MSE), they often fail to…

Machine Learning · Computer Science 2026-04-14 Filippo Quarenghi , Ryan Cotsakis , Tom Beucler

In this paper we study the theory of the so-called Kantorovich max-product neural network operators in the setting of Orlicz spaces $L^{\varphi}$. The results here proved, extend those given by Costarelli and Vinti in Result Math., 2016, to…

Functional Analysis · Mathematics 2020-02-25 Danilo Costarelli , Anna Rita Sambucini

Learning maps between function spaces with a strong inductive bias is a central challenge in soft computing, especially when training data are scarce and standard deep architectures overfit. We introduce a \emph{neural integral operator}…

Machine Learning · Computer Science 2026-05-26 Emanuele Zappala , Alice Giola , Andreas Kramer , Saugat Acharya , Enrico Greco

We develop a rigorous framework for extending neural operators to handle out-of-distribution input functions. We leverage kernel approximation techniques and provide theory for characterizing the input-output function spaces in terms of…

Machine Learning · Computer Science 2026-03-05 Blaine Quackenbush , Paul J. Atzberger

Deep learning has achieved remarkable success across a wide range of domains, significantly expanding the frontiers of what is achievable in artificial intelligence. Yet, despite these advances, critical challenges remain -- most notably,…

Machine Learning · Computer Science 2026-02-05 Róisín Luo

We consider a class of operator-induced norms, acting as finite-dimensional surrogates to the L2 norm, and study their approximation properties over Hilbert subspaces of L2 . The class includes, as a special case, the usual empirical norm…

Statistics Theory · Mathematics 2011-06-01 Arash A. Amini , Martin J. Wainwright