English
Related papers

Related papers: Operator-Based Machine Intelligence: A Hilbert Spa…

200 papers

We consider an operator-based latent Markov representation of a stochastic nonlinear dynamical system, where the stochastic evolution of the latent state embedded in a reproducing kernel Hilbert space is described with the corresponding…

Machine Learning · Computer Science 2026-05-08 Naichang Ke , Ryogo Tanaka , Yoshinobu Kawahara

Many recent theoretical works on \emph{meta-learning} aim to achieve guarantees in leveraging similar representational structures from related tasks towards simplifying a target task. The main aim of theoretical guarantees on the subject is…

Machine Learning · Statistics 2025-05-21 Dimitri Meunier , Zhu Li , Arthur Gretton , Samory Kpotufe

Supervised learning in reproducing kernel Hilbert space (RKHS) and vector-valued RKHS (vvRKHS) has been investigated for more than 30 years. In this paper, we provide a new twist to this rich literature by generalizing supervised learning…

Machine Learning · Statistics 2024-06-27 Yuka Hashimoto , Masahiro Ikeda , Hachem Kadri

Koopman operator theory provides a framework for nonlinear dynamical system analysis and time-series forecasting by mapping dynamics to a space of real-valued measurement functions, enabling a linear operator representation. Despite the…

Machine Learning · Computer Science 2025-06-18 Yitian Zhang , Liheng Ma , Antonios Valkanas , Boris N. Oreshkin , Mark Coates

Machine Learning techniques can be used to represent high-dimensional potential energy surfaces for reactive chemical systems. Two such methods are based on a reproducing kernel Hilbert space representation or on deep neural networks. They…

Chemical Physics · Physics 2019-09-19 Oliver T. Unke , Markus Meuwly

Operator learning offers a robust framework for approximating mappings between infinite-dimensional function spaces. It has also become a powerful tool for solving inverse problems in the computational sciences. This chapter surveys…

Numerical Analysis · Mathematics 2025-12-08 Nicholas H. Nelsen , Yunan Yang

We provide a detailed description of the model Hilbert space $L^2(\bbR; d\Sigma; \cK)$, were $\cK$ represents a complex, separable Hilbert space, and $\Sigma$ denotes a bounded operator-valued measure. In particular, we show that several…

Spectral Theory · Mathematics 2011-11-04 Fritz Gesztesy , Rudi Weikard , Maxim Zinchenko

The mathematical properties and data-driven learning of the Koopman operator, which represents nonlinear dynamics as a linear mapping on a properly defined functional spaces, have become key problems in nonlinear system identification and…

Systems and Control · Electrical Eng. & Systems 2024-10-02 Wentao Tang

We consider the data-driven approximation of the Koopman operator for stochastic differential equations on reproducing kernel Hilbert spaces (RKHS). Our focus is on the estimation error if the data are collected from long-term ergodic…

Dynamical Systems · Mathematics 2023-12-20 Friedrich Philipp , Manuel Schaller , Karl Worthmann , Sebastian Peitz , Feliks Nüske

This paper studies sequence modeling for prediction tasks with long range dependencies. We propose a new formulation for state space models (SSMs) based on learning linear dynamical systems with the spectral filtering algorithm (Hazan et…

Machine Learning · Computer Science 2024-07-12 Naman Agarwal , Daniel Suo , Xinyi Chen , Elad Hazan

Reproducing kernel Hilbert spaces (RKHSs) are special Hilbert spaces where all the evaluation functionals are linear and bounded. They are in one-to-one correspondence with positive definite maps called kernels. Stable RKHSs enjoy the…

Systems and Control · Electrical Eng. & Systems 2023-05-04 Mauro Bisiacco , Gianluigi Pillonetto

Reproducing Kernel Hilbert Space (RKHS) is the common mathematical platform for various kernel methods in machine learning. The purpose of kernel learning is to learn an appropriate RKHS according to different machine learning scenarios and…

Machine Learning · Computer Science 2021-02-19 Xinlong Lu , Zhengming Ma , Yuanping Lin

Learning nonparametric systems of Ordinary Differential Equations (ODEs) dot x = f(t,x) from noisy data is an emerging machine learning topic. We use the well-developed theory of Reproducing Kernel Hilbert Spaces (RKHS) to define candidates…

Machine Learning · Statistics 2023-11-14 Kamel Lahouel , Michael Wells , Victor Rielly , Ethan Lew , David Lovitz , Bruno M. Jedynak

Neural integral equations are deep learning models based on the theory of integral equations, where the model consists of an integral operator and the corresponding equation (of the second kind) which is learned through an optimization…

Numerical Analysis · Mathematics 2025-11-14 Emanuele Zappala

This paper explores the Invariant Subspace Problem in operator theory and functional analysis, examining its applications in various branches of mathematics and physics. The problem addresses the existence of invariant subspaces for bounded…

Quantum Physics · Physics 2023-06-30 Mostafa Behtouei

In many applications of machine learning, a large number of variables are considered. Motivated by machine learning of interacting particle systems, we consider the situation when the number of input variables goes to infinity. First, we…

Machine Learning · Computer Science 2023-10-30 Christian Fiedler , Michael Herty , Sebastian Trimpe

Reduced modeling of a computationally demanding dynamical system aims at approximating its trajectories, while optimizing the trade-off between accuracy and computational complexity. In this work, we propose to achieve such an approximation…

Machine Learning · Statistics 2025-02-20 Patrick Héas , Cédric Herzet , Benoit Combès

We propose a novel online learning paradigm for nonlinear-function estimation tasks based on the iterative projections in the L2 space with probability measure reflecting the stochastic property of input signals. The proposed learning…

Signal Processing · Electrical Eng. & Systems 2018-09-13 Motoya Ohnishi , Masahiro Yukawa

We present a general kernel-based framework for learning operators between Banach spaces along with a priori error analysis and comprehensive numerical comparisons with popular neural net (NN) approaches such as Deep Operator Net (DeepONet)…

Machine Learning · Statistics 2023-10-10 Pau Batlle , Matthieu Darcy , Bamdad Hosseini , Houman Owhadi

A novel kernel-based support vector machine (SVM) for graph classification is proposed. The SVM feature space mapping consists of a sequence of graph convolutional layers, which generates a vector space representation for each vertex,…

Machine Learning · Computer Science 2020-08-05 Padraig Corcoran