English
Related papers

Related papers: Operator-Valued Kernels, Machine Learning, and Dyn…

200 papers

This monograph studies the relations between two approaches using positive definite kernels: probabilistic methods using Gaussian processes, and non-probabilistic methods using reproducing kernel Hilbert spaces (RKHS). They are widely…

Machine Learning · Statistics 2025-06-24 Motonobu Kanagawa , Philipp Hennig , Dino Sejdinovic , Bharath K. Sriperumbudur

This paper investigates a general regularization framework for unsupervised domain adaptation in vector-valued regression under the covariate shift assumption, utilizing vector-valued reproducing kernel Hilbert spaces (vRKHS). Covariate…

Statistics Theory · Mathematics 2026-01-30 Markus Holzleitner , Sergiy Pereverzyev , Sergei V. Pereverzyev , Vaibhav Silmana , S. Sivananthan

Kernel ridge regression (KRR) is widely used for nonparametric regression over reproducing kernel Hilbert spaces. It offers powerful modeling capabilities at the cost of significant computational costs, which typically require $O(n^3)$…

Methodology · Statistics 2024-03-18 Xiaowu Dai , Huiying Zhong

We suppose that $G$ is a locally compact abelian group, $Y$ is a measure space, and $H$ is a reproducing kernel Hilbert space on $G\times Y$ such that $H$ is naturally embedded into $L^2(G\times Y)$ and it is invariant under the…

Operator Algebras · Mathematics 2025-04-29 Shubham R. Bais , Egor A. Maximenko , D. Venku Naidu

After carrying out an overview on the non Euclidean geometrical setting suitable for the study of Kolmogorov operators with rough coefficients, we list some properties of the functional space $\mathcal{W}$, mirroring the classical $H^1$…

Analysis of PDEs · Mathematics 2023-04-04 Francesca Anceschi , Mirco Piccinini , Annalaura Rebucci

Modern datasets across many disciplines increasingly consist of time-evolving, potentially infinite-dimensional random objects, such as dynamic functional data, which are naturally modeled in Hilbert spaces. In these settings,…

Machine Learning · Statistics 2026-05-08 Daniel López-Montero , Antonio Álvarez-López , Marcos Matabuena

This is a tutorial and survey paper on kernels, kernel methods, and related fields. We start with reviewing the history of kernels in functional analysis and machine learning. Then, Mercer kernel, Hilbert and Banach spaces, Reproducing…

Machine Learning · Statistics 2021-06-17 Benyamin Ghojogh , Ali Ghodsi , Fakhri Karray , Mark Crowley

In supervised learning with distributional inputs in the two-stage sampling setup, relevant to applications like learning-based medical screening or causal learning, the inputs (which are probability distributions) are not accessible in the…

Machine Learning · Computer Science 2026-01-22 Christian Fiedler

We present a novel kernel-based machine learning algorithm for identifying the low-dimensional geometry of the effective dynamics of high-dimensional multiscale stochastic systems. Recently, the authors developed a mathematical framework…

Dynamical Systems · Mathematics 2020-02-04 Andreas Bittracher , Stefan Klus , Boumediene Hamzi , Péter Koltai , Christof Schütte

We discuss the problem of estimating Radon-Nikodym derivatives. This problem appears in various applications, such as covariate shift adaptation, likelihood-ratio testing, mutual information estimation, and conditional probability…

Statistics Theory · Mathematics 2023-08-16 Duc Hoan Nguyen , Werner Zellinger , Sergei V. Pereverzyev

Additive models play an important role in semiparametric statistics. This paper gives learning rates for regularized kernel based methods for additive models. These learning rates compare favourably in particular in high dimensions to…

Machine Learning · Statistics 2014-05-15 Andreas Christmann , Ding-Xuan Zhou

We study classes of reproducing kernels $K$ on general domains; these are kernels which arise commonly in machine learning models; models based on certain families of reproducing kernel Hilbert spaces. They are the positive definite kernels…

Functional Analysis · Mathematics 2017-08-22 Palle Jorgensen , Feng Tian

Development of metrics for structural data-generating mechanisms is fundamental in machine learning and the related fields. In this paper, we give a general framework to construct metrics on random nonlinear dynamical systems, defined with…

Machine Learning · Statistics 2019-10-29 Isao Ishikawa , Akinori Tanaka , Masahiro Ikeda , Yoshinobu Kawahara

Many dimensionality and model reduction techniques rely on estimating dominant eigenfunctions of associated dynamical operators from data. Important examples include the Koopman operator and its generator, but also the Schr\"odinger…

Dynamical Systems · Mathematics 2021-04-06 Stefan Klus , Feliks Nüske , Boumediene Hamzi

We consider weakly positive semidefinite kernels valued in ordered $*$-spaces with or without certain topological properties, and investigate their linearisations (Kolmogorov decompositions) as well as their reproducing kernel spaces. The…

Functional Analysis · Mathematics 2025-11-04 Serdar Ay , Aurelian Gheondea

Let $G$ be a locally compact abelian group with a Haar measure, and $Y$ be a measure space. Suppose that $H$ is a reproducing kernel Hilbert space of functions on $G\times Y$, such that $H$ is naturally embedded into $L^2(G\times Y)$ and is…

Functional Analysis · Mathematics 2025-04-28 Crispin Herrera-Yañez , Egor A. Maximenko , Gerardo Ramos-Vazquez

We consider a kernel based harmonic analysis of "boundary," and boundary representations. Our setting is general: certain classes of positive definite kernels. Our theorems extend (and are motivated by) results and notions from classical…

Functional Analysis · Mathematics 2016-11-15 Palle Jorgensen , Feng Tian

Learning from non-independent and non-identically distributed data poses a persistent challenge in statistical learning. In this study, we introduce data-dependent Bernstein inequalities tailored for vector-valued processes in Hilbert…

Machine Learning · Computer Science 2025-07-11 Erfan Mirzaei , Andreas Maurer , Vladimir R. Kostic , Massimiliano Pontil

Kernel Estimation provides an unbinned and non-parametric estimate of the probability density function from which a set of data is drawn. In the first section, after a brief discussion on parametric and non-parametric methods, the theory of…

High Energy Physics - Experiment · Physics 2009-10-31 Kyle S. Cranmer

Given a positive definite, bounded linear operator $A$ on the Hilbert space $\mathcal{H}_0:=l^2(E)$, we consider a reproducing kernel Hilbert space $\mathcal{H}_+$ with a reproducing kernel $A(x,y)$. Here $E$ is any countable set and…

Probability · Mathematics 2007-05-23 Hyun Jae Yoo