English
Related papers

Related papers: Spatio-Temporal Prediction via Operator-Valued RKH…

200 papers

Motivated by the abundance of functional data such as time series and images, there has been a growing interest in integrating such data into neural networks and learning maps from function spaces to R (i.e., functionals). In this paper, we…

Machine Learning · Statistics 2024-03-20 Tian-Yi Zhou , Namjoon Suh , Guang Cheng , Xiaoming Huo

Bayesian optimization (BO) is an efficient framework for optimizing expensive black-box functions. However, it is typically formulated as learning an end-to-end mapping from inputs to scalar objectives, thereby discarding the potentially…

Machine Learning · Computer Science 2026-05-12 Wenbin Wang , Colin N. Jones

In the context of kernel optimization, we prove a result that yields new factorizations and realizations. Our initial context is that of general positive operator-valued kernels. We further present implications for Hilbert space-valued…

Operator Algebras · Mathematics 2024-10-14 Palle E. T. Jorgensen , James Tian

The theory of Koopman operators allows to deploy non-parametric machine learning algorithms to predict and analyze complex dynamical systems. Estimators such as principal component regression (PCR) or reduced rank regression (RRR) in kernel…

We propose a novel approach for pixel classification in hyperspectral images, leveraging on both the spatial and spectral information in the data. The introduced method relies on a recently proposed framework for learning on distributions…

Computer Vision and Pattern Recognition · Computer Science 2016-05-31 Gianni Franchi , Jesus Angulo , Dino Sejdinovic

The study of Koopman and Liouville operators over reproducing kernel Hilbert spaces (RKHSs) has been gaining considerable interest over the past decade. In particular, these operators represent nonlinear dynamical systems, and through the…

Functional Analysis · Mathematics 2025-11-06 Sushant Pokhriyal , Joel A Rosenfeld

Inverse Optimization (IO) is a framework for learning the unknown objective function of an expert decision-maker from a past dataset. In this paper, we extend the hypothesis class of IO objective functions to a reproducing kernel Hilbert…

Machine Learning · Computer Science 2024-11-01 Youyuan Long , Tolga Ok , Pedro Zattoni Scroccaro , Peyman Mohajerin Esfahani

A novel kernel-based support vector machine (SVM) for graph classification is proposed. The SVM feature space mapping consists of a sequence of graph convolutional layers, which generates a vector space representation for each vertex,…

Machine Learning · Computer Science 2020-08-05 Padraig Corcoran

Representing and predicting high-dimensional and spatiotemporally chaotic dynamical systems remains a fundamental challenge in dynamical systems and machine learning. Although data-driven models can achieve accurate short-term forecasts,…

Machine Learning · Computer Science 2026-02-17 Liangyu Su , Jun Shu , Rui Liu , Deyu Meng , Zongben Xu

We study recursive regularized learning algorithms in the reproducing kernel Hilbert space (RKHS) with non-stationary online data streams. We introduce the concept of random Tikhonov regularization path and decompose the tracking error of…

Machine Learning · Computer Science 2025-10-24 Xiwei Zhang , Yan Chen , Tao Li

Kernel methods approximate nonlinear maps in a data-driven manner by projecting the target map onto a finite-dimensional Hilbert space called the solution space. Traditionally, this space is a subspace of a fixed ambient reproducing kernel…

Numerical Analysis · Mathematics 2026-01-30 Tamás Dózsa , Andrea Angino , Zoltán Szabó , József Bokor , Matthias Voigt

Nonlinear dynamical systems are ubiquitous in science and engineering, yet analysis and prediction of these systems remains a challenge. Koopman operator theory circumvents some of these issues by considering the dynamics in the space of…

Numerical Analysis · Mathematics 2020-02-17 Mason Kamb , Eurika Kaiser , Steven L. Brunton , J. Nathan Kutz

Kernel methods are one of the cornerstones of learning-based control, modern system identification, surrogate modelling, and related fields. A key advantage of this class of learning and function approximation methods is the availability of…

Numerical Analysis · Mathematics 2026-05-20 Tizian Wenzel , Abdullah Tokmak , Christian Fiedler

Koopman operators and transfer operators represent dynamical systems through their induced linear action on vector spaces of observables, enabling the use of operator-theoretic techniques to analyze nonlinear dynamics in state space. The…

Dynamical Systems · Mathematics 2024-06-10 Claire Valva , Dimitrios Giannakis

Continuous-time stochastic processes underlie many natural and engineered systems. In healthcare, autonomous driving, and industrial control, direct interaction with the environment is often unsafe or impractical, motivating offline…

Machine Learning · Statistics 2025-11-14 Nicolas Hoischen , Petar Bevanda , Max Beier , Stefan Sosnowski , Boris Houska , Sandra Hirche

In this effort, a novel operator theoretic framework is developed for data-driven solution of optimal control problems. The developed methods focus on the use of trajectories (i.e., time-series) as the fundamental unit of data for the…

Optimization and Control · Mathematics 2021-06-02 Rushikesh Kamalapurkar , Joel A. Rosenfeld

We derive novel deterministic bounds on the approximation error of data-based bilinear surrogate models for unknown nonlinear systems. The surrogate models are constructed using kernel-based extended dynamic mode decomposition to…

Systems and Control · Electrical Eng. & Systems 2025-07-24 Robin Strässer , Manuel Schaller , Julian Berberich , Karl Worthmann , Frank Allgöwer

To infer eigenvalues of the infinite-dimensional Koopman operator, we study the leading eigenvalues of the autocovariance matrix associated with a given observable of a dynamical system. For any observable $f$ for which all the time-delayed…

Optimization and Control · Mathematics 2022-04-06 Yicun Zhen , Bertrand Chapron , Etienne Memin , Lin Peng

This work presents a nonparametric framework for dissipativity learning in reproducing kernel Hilbert spaces, which enables data-driven certification of stability and performance properties for unknown nonlinear systems without requiring an…

Systems and Control · Electrical Eng. & Systems 2025-11-03 Xiuzhen Ye , Wentao Tang

Kernel transfer operators, which can be regarded as approximations of transfer operators such as the Perron-Frobenius or Koopman operator in reproducing kernel Hilbert spaces, are defined in terms of covariance and cross-covariance…

Machine Learning · Statistics 2018-05-28 Stefan Klus , Sebastian Peitz , Ingmar Schuster