English
Related papers

Related papers: Singular Value Decomposition of Operators on Repro…

200 papers

We propose a new point of view for regularizing deep neural networks by using the norm of a reproducing kernel Hilbert space (RKHS). Even though this norm cannot be computed, it admits upper and lower approximations leading to various…

Machine Learning · Statistics 2019-05-15 Alberto Bietti , Grégoire Mialon , Dexiong Chen , Julien Mairal

These notes provide a self-contained introduction to kernel methods and their geometric foundations in machine learning. Starting from the construction of Hilbert spaces, we develop the theory of positive definite kernels, reproducing…

Koopman operator provides a general linear description of nonlinear systems, whose estimation from data (via extended dynamic mode decomposition) has been extensively studied. However, the elusiveness between the Koopman spectrum and the…

Systems and Control · Electrical Eng. & Systems 2026-03-03 Wentao Tang , Xiuzhen Ye

Learning convolution kernels in operators from data arises in numerous applications and represents an ill-posed inverse problem of broad interest. With scant prior information, kernel methods offer a natural nonparametric approach with…

Numerical Analysis · Mathematics 2025-07-17 Haibo Li , Fei Lu

Operator-Valued Kernels (OVKs) and associated vector-valued Reproducing Kernel Hilbert Spaces provide an elegant way to extend scalar kernel methods when the output space is a Hilbert space. Although primarily used in finite dimension for…

Machine Learning · Statistics 2020-08-24 Pierre Laforgue , Alex Lambert , Luc Brogat-Motte , Florence d'Alché-Buc

Usually, complex-valued RKHS are presented as an straightforward application of the real-valued case. In this paper we prove that this procedure yields a limited solution for regression. We show that another kernel, here denoted as pseudo…

Reproducing kernel Hilbert spaces (RKHSs) are key spaces for machine learning that are becoming popular also for linear system identification. In particular, the so-called stable RKHSs can be used to model absolutely summable impulse…

Machine Learning · Computer Science 2020-05-07 Mauro Bisiacco , Gianluigi Pillonetto

We present a general framework to learn functions in tensor product reproducing kernel Hilbert spaces (TP-RKHSs). The methodology is based on a novel representer theorem suitable for existing as well as new spectral penalties for tensors.…

Machine Learning · Computer Science 2013-10-21 Marco Signoretto , Lieven De Lathauwer , Johan A. K. Suykens

Since its introduction, the Discrete Variable Representation (DVR) basis set has become an invaluable representation of state vectors and Hermitian operators in non-relativistic quantum dynamics and spectroscopy calculations. On the other…

Computational Physics · Physics 2014-05-30 Hamse Mussa

In this paper, we consider the coefficient-based regularized distribution regression which aims to regress from probability measures to real-valued responses over a reproducing kernel Hilbert space (RKHS), where the regularization is put on…

Machine Learning · Statistics 2022-08-29 Yuan Mao , Lei Shi , Zheng-Chu Guo

In this paper, we give some results concerning atomic decompositions for operators on reproducing kernel Hilbert spaces, using frame theory techniques. We provide also generalizations for atomic decompositions of some theorems for…

Functional Analysis · Mathematics 2014-02-03 Laura Gavruta

In this article, we consider convergence rates in functional linear regression with functional responses, where the linear coefficient lies in a reproducing kernel Hilbert space (RKHS). Without assuming that the reproducing kernel and the…

Methodology · Statistics 2012-11-20 Heng Lian

This paper addresses the covariate shift problem in the context of nonparametric regression within reproducing kernel Hilbert spaces (RKHSs). Covariate shift arises in supervised learning when the input distributions of the training and…

Machine Learning · Statistics 2025-05-21 Andrea Della Vecchia , Arnaud Mavakala Watusadisi , Ernesto De Vito , Lorenzo Rosasco

In this paper, we develop a generalized theory of convolutional signal processing and neural networks for Reproducing Kernel Hilbert Spaces (RKHS). Leveraging the theory of algebraic signal processing (ASP), we show that any RKHS allows the…

Machine Learning · Computer Science 2025-06-03 Alejandro Parada-Mayorga , Leopoldo Agorio , Alejandro Ribeiro , Juan Bazerque

We propose a novel test procedure for comparing mean functions across two groups within the reproducing kernel Hilbert space (RKHS) framework. Our proposed method is adept at handling sparsely and irregularly sampled functional data when…

Methodology · Statistics 2025-01-29 Chi Zhang , Peijun Sang , Yingli Qin

In this work we consider the problem of numerical integration, i.e., approximating integrals with respect to a target probability measure using only pointwise evaluations of the integrand. We focus on the setting in which the target…

Machine Learning · Statistics 2025-06-17 Antoine Chatalic , Nicolas Schreuder , Ernesto De Vito , Lorenzo Rosasco

Reproducing kernel Hilbert $C^*$-module (RKHM) is a generalization of reproducing kernel Hilbert space (RKHS) by means of $C^*$-algebra, and the Perron-Frobenius operator is a linear operator related to the composition of functions.…

Machine Learning · Statistics 2023-11-07 Yuka Hashimoto , Masahiro Ikeda , Hachem Kadri

We introduce a complex-valued counterpart of the representer theorem in machine learning. We study several learning and minimization problems in reproducing kernel Hilbert spaces (RKHSs), with the aim of identifying appropriate input-output…

Functional Analysis · Mathematics 2026-04-28 Natanael Alpay , Antonino De Martino , Kamal Diki

We study distributed learning with the least squares regularization scheme in a reproducing kernel Hilbert space (RKHS). By a divide-and-conquer approach, the algorithm partitions a data set into disjoint data subsets, applies the least…

Machine Learning · Computer Science 2017-03-14 Shao-Bo Lin , Xin Guo , Ding-Xuan Zhou

We review machine learning methods employing positive definite kernels. These methods formulate learning and estimation problems in a reproducing kernel Hilbert space (RKHS) of functions defined on the data domain, expanded in terms of a…

Statistics Theory · Mathematics 2009-09-29 Thomas Hofmann , Bernhard Schölkopf , Alexander J. Smola
‹ Prev 1 3 4 5 6 7 10 Next ›