English
Related papers

Related papers: A universal reproducing kernel Hilbert space for l…

200 papers

We study a reproducing kernel Hilbert space of functions defined on the positive integers and associated to the binomial coefficients. We introduce two transforms, which allow us to develop a related harmonic analysis in this Hilbert space.…

Complex Variables · Mathematics 2014-12-19 Daniel Alpay , Palle Jorgensen

This paper develops a nonlinear operator dynamic that progressively removes the influence of a prescribed feature subspace while retaining maximal structure elsewhere. The induced sequence of positive operators is monotone, admits an exact…

Functional Analysis · Mathematics 2025-12-05 James Tian

In this paper, by mapping datasets to a set of non-linear coherent states, the process of encoding inputs in quantum states as a non-linear feature map is re-interpreted. As a result of this fact that the Radial Basis Function is recovered…

Quantum Physics · Physics 2020-07-17 Prayag Tiwari , Shahram Dehdashti , Abdul Karim Obeid , Massimo Melucci , Peter Bruza

We present a general kernel-based framework for learning operators between Banach spaces along with a priori error analysis and comprehensive numerical comparisons with popular neural net (NN) approaches such as Deep Operator Net (DeepONet)…

Machine Learning · Statistics 2023-10-10 Pau Batlle , Matthieu Darcy , Bamdad Hosseini , Houman Owhadi

Learning models of dynamical systems characterized by specific stability properties is of crucial importance in applications. Existing results mainly focus on linear systems or some limited classes of nonlinear systems and stability…

Systems and Control · Electrical Eng. & Systems 2025-03-18 Matteo Scandella , Michelangelo Bin , Thomas Parisini

Substring kernels are classical tools for representing biological sequences or text. However, when large amounts of annotated data are available, models that allow end-to-end training such as neural networks are often preferred. Links…

Machine Learning · Statistics 2019-10-18 Dexiong Chen , Laurent Jacob , Julien Mairal

We consider the problem of learning a linear operator $\theta$ between two Hilbert spaces from empirical observations, which we interpret as least squares regression in infinite dimensions. We show that this goal can be reformulated as an…

Statistics Theory · Mathematics 2024-07-11 Mattes Mollenhauer , Nicole Mücke , T. J. Sullivan

We study infinite products of reproducing kernels with view to their use in dynamics (of iterated function systems), in harmonic analysis, and in stochastic processes. On the way, we construct a new family of representations of the Cuntz…

Functional Analysis · Mathematics 2013-01-22 D. Alpay , P. Jorgensen , I. Lewkowicz , I. Martziano

This paper introduces the Kernel Neural Operator (KNO), a provably convergent operator-learning architecture that utilizes compositions of deep kernel-based integral operators for function-space approximation of operators (maps from…

Machine Learning · Computer Science 2026-05-06 Matthew Lowery , John Turnage , Zachary Morrow , John D. Jakeman , Akil Narayan , Shandian Zhe , Varun Shankar

This manuscript presents a novel approach to nonlinear system identification leveraging densely defined Liouville operators and a new "kernel" function that represents an integration functional over a reproducing kernel Hilbert space (RKHS)…

Optimization and Control · Mathematics 2021-07-07 Joel A. Rosenfeld , Benjamin Russo , Rushikesh Kamalapurkar , Taylor T. Johnson

Estimating the dissipativity of nonlinear systems from empirical data is useful for the analysis and control of nonlinear systems, especially when an accurate model is unavailable. Based on a Koopman operator model of the nonlinear system…

Systems and Control · Electrical Eng. & Systems 2026-04-03 Xiuzhen Ye , Wentao Tang

Consider the problem: given the data pair $(\mathbf{x}, \mathbf{y})$ drawn from a population with $f_*(x) = \mathbf{E}[\mathbf{y} | \mathbf{x} = x]$, specify a neural network model and run gradient flow on the weights over time until…

Machine Learning · Statistics 2020-07-27 Xialiang Dou , Tengyuan Liang

We consider conditions on a given system $\mathcal{F}$ of vectors in Hilbert space $\mathcal{H}$, forming a frame, which turn $\mathcal{H}$ into a reproducing kernel Hilbert space. It is assumed that the vectors in $\mathcal{F}$ are…

Functional Analysis · Mathematics 2016-06-16 Palle E. T. Jorgensen , Myung-Sin Song

We propose a nonlinear function-on-function regression model where both the covariate and the response are random functions. The nonlinear regression is carried out in two steps: we first construct Hilbert spaces to accommodate the…

Methodology · Statistics 2022-07-19 Peijun Sang , Bing Li

We provide the first mathematically complete derivation of the Nystr\"om method for low-rank approximation of indefinite kernels and propose an efficient method for finding an approximate eigendecomposition of such kernel matrices. Building…

Machine Learning · Statistics 2019-06-03 Dino Oglic , Thomas Gärtner

In this paper we introduce reproducing kernel Hilbert spaces of polyanalytic functions of infinite order. First we study in details the counterpart of the Fock space and related results in this framework. In this case the kernel function is…

Complex Variables · Mathematics 2021-12-30 Daniel Alpay , Fabrizio Colombo , Kamal Diki , Irene Sabadini

Residual deep neural networks are formulated as interacting particle systems leading to a description through neural differential equations, and, in the case of large input data, through mean-field neural networks. The mean-field…

Optimization and Control · Mathematics 2024-03-14 Michael Herty , Chiara Segala , Giuseppe Visconti

This paper proposes that Lipschitz continuity is a natural outcome of regularized least squares in kernel-based learning. Lipschitz continuity is an important proxy for robustness of input-output operators. It is also instrumental for…

Optimization and Control · Mathematics 2021-12-08 Henk J. van Waarde , Rodolphe Sepulchre

Machine learning models can represent climate processes that are nonlocal in horizontal space, height, and time, often by combining information across these dimensions in highly nonlinear ways. While this can improve predictive skill, it…

Machine Learning · Computer Science 2026-05-14 Savannah L. Ferretti , Jerry Lin , Sara Shamekh , Jane W. Baldwin , Michael S. Pritchard , Tom Beucler

Learning mappings between infinite-dimensional function spaces has achieved empirical success in many disciplines of machine learning, including generative modeling, functional data analysis, causal inference, and multi-agent reinforcement…

Machine Learning · Computer Science 2023-07-25 Jikai Jin , Yiping Lu , Jose Blanchet , Lexing Ying