English
Related papers

Related papers: Error bounds for kernel-based approximations of th…

200 papers

In this paper, we consider the coefficient-based regularized distribution regression which aims to regress from probability measures to real-valued responses over a reproducing kernel Hilbert space (RKHS), where the regularization is put on…

Machine Learning · Statistics 2022-08-29 Yuan Mao , Lei Shi , Zheng-Chu Guo

This work establishes a rigorous bridge between infinite-dimensional delay dynamics and finite-dimensional Koopman learning, with explicit and interpretable error guarantees. While Koopman analysis is well-developed for ordinary…

Systems and Control · Electrical Eng. & Systems 2026-04-06 Santosh Mohan Rajkumar , Dibyasri Barman , Kumar Vikram Singh , Debdipta Goswami

We develop a rigorous framework for extending neural operators to handle out-of-distribution input functions. We leverage kernel approximation techniques and provide theory for characterizing the input-output function spaces in terms of…

Machine Learning · Computer Science 2026-03-05 Blaine Quackenbush , Paul J. Atzberger

The theory of Koopman operators allows to deploy non-parametric machine learning algorithms to predict and analyze complex dynamical systems. Estimators such as principal component regression (PCR) or reduced rank regression (RRR) in kernel…

This paper addresses the covariate shift problem in the context of nonparametric regression within reproducing kernel Hilbert spaces (RKHSs). Covariate shift arises in supervised learning when the input distributions of the training and…

Machine Learning · Statistics 2025-05-21 Andrea Della Vecchia , Arnaud Mavakala Watusadisi , Ernesto De Vito , Lorenzo Rosasco

Under the reproducing kernel Hilbert spaces (RKHS), we consider the penalized least-squares of the partially functional linear models (PFLM), whose predictor contains both functional and traditional multivariate parts, and the multivariate…

Statistics Theory · Mathematics 2022-10-03 Huiming Zhang , Xiaoyu Lei

This paper presents a novel approach for estimating the Koopman operator defined on a reproducing kernel Hilbert space (RKHS) and its spectra. We propose an estimation method, what we call Jet Extended Dynamic Mode Decomposition (JetEDMD),…

Dynamical Systems · Mathematics 2025-12-02 Isao Ishikawa , Yuka Hashimoto , Masahiro Ikeda , Yoshinobu Kawahara

Data-driven approximations of the infinite-dimensional Koopman operator rely on finite-dimensional projections, where the predictive accuracy of the resulting models hinges heavily on the invariance of the chosen subspace. Subspace pruning…

Systems and Control · Electrical Eng. & Systems 2026-04-03 Dhruv Shah , Jorge Cortes

Koopman and Perron-Frobenius operators for dynamical systems have been getting popular in a number of fields in science these days. Properties of the Koopman operator essentially depend on the choice of function spaces where it acts.…

Dynamical Systems · Mathematics 2024-01-29 Masahiro Ikeda , Isao Ishikawa , Corbinian Schlosser

We study approaches for compressing the empirical measure in the context of finite dimensional reproducing kernel Hilbert spaces (RKHSs). In this context, the empirical measure is contained within a natural convex set and can be…

Machine Learning · Statistics 2024-08-29 Steffen Grünewälder

The performance of adaptive estimators that employ embedding in reproducing kernel Hilbert spaces (RKHS) depends on the choice of the location of basis kernel centers. Parameter convergence and error approximation rates depend on where and…

Systems and Control · Electrical Eng. & Systems 2020-09-08 Sai Tej Paruchuri , Jia Guo , Andrew Kurdila

Traditional machine learning models, particularly neural networks, are rooted in finite-dimensional parameter spaces and nonlinear function approximations. This report explores an alternative formulation where learning tasks are expressed…

Machine Learning · Computer Science 2025-07-30 Andrew Kiruluta , Andreas Lemos , Priscilla Burity

Modeling dynamical systems with ordinary differential equations implies a mechanistic view of the process underlying the dynamics. However in many cases, this knowledge is not available. To overcome this issue, we introduce a general…

Machine Learning · Computer Science 2014-11-20 Markus Heinonen , Florence d'Alché-Buc

We introduce a unified framework for learning the spatio-temporal dynamics of vector valued functions by combining operator valued reproducing kernel Hilbert spaces (OV-RKHS) with kernel based Koopman operator methods. The approach enables…

Machine Learning · Computer Science 2025-08-27 Mahishanka Withanachchi

This paper proposes a method for constructing one-step prediction tubes for nonlinear systems using reproducing kernel Hilbert spaces. We approximate a bounded reproducing kernel Hilbert space (RKHS) hypothesis set by a finite-dimensional…

Systems and Control · Electrical Eng. & Systems 2026-04-08 Jannis Lübsen , Annika Eichler

We present simple, user-friendly bounds for the expected operator norm of a random kernel matrix under general conditions on the kernel function $k(\cdot,\cdot)$. Our approach uses decoupling results for U-statistics and the non-commutative…

Machine Learning · Statistics 2025-11-07 Chiraag Kaushik , Justin Romberg , Vidya Muthukumar

Kernel mean embeddings, a widely used technique in machine learning, map probability distributions to elements of a reproducing kernel Hilbert space (RKHS). For supervised learning problems, where input-output pairs are observed, the…

Machine Learning · Statistics 2024-10-24 Ambrus Tamás , Balázs Csanád Csáji

Optimal experimental design seeks to determine the most informative allocation of experiments to infer an unknown statistical quantity. In this work, we investigate the optimal design of experiments for {\em estimation of linear functionals…

Artificial Intelligence · Computer Science 2023-01-18 Mojmír Mutný , Andreas Krause

The kernel-based method has been successfully applied in linear system identification using stable kernel designs. From a Gaussian process perspective, it automatically provides probabilistic error bounds for the identified models from the…

Systems and Control · Electrical Eng. & Systems 2023-03-20 Mingzhou Yin , Roy S. Smith

We consider a class of statistical inverse problems involving the estimation of a regression operator from a Polish space to a separable Hilbert space, where the target lies in a vector-valued reproducing kernel Hilbert space induced by an…

Machine Learning · Statistics 2026-04-28 Jia-Qi Yang , Lei Shi