English
Related papers

Related papers: Kernel absolute summability is only sufficient for…

200 papers

An extension of reproducing kernel Hilbert space (RKHS) theory provides a new framework for modeling functional regression models with functional responses. The approach only presumes a general nonlinear regression structure as opposed to…

Statistics Theory · Mathematics 2008-12-17 Heng Lian

Kernel methods are one of the cornerstones of learning-based control, modern system identification, surrogate modelling, and related fields. A key advantage of this class of learning and function approximation methods is the availability of…

Numerical Analysis · Mathematics 2026-05-20 Tizian Wenzel , Abdullah Tokmak , Christian Fiedler

We study classes of reproducing kernels $K$ on general domains; these are kernels which arise commonly in machine learning models; models based on certain families of reproducing kernel Hilbert spaces. They are the positive definite kernels…

Functional Analysis · Mathematics 2017-08-22 Palle Jorgensen , Feng Tian

We propose a new point of view for regularizing deep neural networks by using the norm of a reproducing kernel Hilbert space (RKHS). Even though this norm cannot be computed, it admits upper and lower approximations leading to various…

Machine Learning · Statistics 2019-05-15 Alberto Bietti , Grégoire Mialon , Dexiong Chen , Julien Mairal

The reproducing kernel Hilbert space (RKHS) embedding method is a recently introduced estimation approach that seeks to identify the unknown or uncertain function in the governing equations of a nonlinear set of ordinary differential…

Optimization and Control · Mathematics 2020-07-14 Jia Guo , Sai Tej Paruchuri , Andrew J. Kurdila

Kernel-based quadrature rules are becoming important in machine learning and statistics, as they achieve super-$\sqrt{n}$ convergence rates in numerical integration, and thus provide alternatives to Monte Carlo integration in challenging…

Machine Learning · Statistics 2016-10-31 Motonobu Kanagawa , Bharath K. Sriperumbudur , Kenji Fukumizu

We present estimates for the covering numbers of the unit ball of Reproducing Kernel Hilbert Spaces (RKHSs) of functions on $M^d$ a d-dimensional compact two-point homogeneous space. The RKHS is generated by a continuous zonal/isotropic…

Functional Analysis · Mathematics 2026-03-12 Karina Gonzalez , Thaís Jordão

Reproducing kernel Hilbert spaces (RKHSs) are Hilbert spaces of functions where pointwise evaluation is continuous. There are known examples of RKHSs that are Banach algebras under pointwise multiplication. These examples are built from…

Functional Analysis · Mathematics 2024-02-09 Dimitrios Giannakis , Michael Montgomery

Substring kernels are classical tools for representing biological sequences or text. However, when large amounts of annotated data are available, models that allow end-to-end training such as neural networks are often preferred. Links…

Machine Learning · Statistics 2019-10-18 Dexiong Chen , Laurent Jacob , Julien Mairal

Kernel methods are powerful tools in machine learning. Classical kernel methods are based on positive-definite kernels, which map data spaces into reproducing kernel Hilbert spaces (RKHS). For non-Euclidean data spaces, positive-definite…

Machine Learning · Computer Science 2024-07-31 Nathael Da Costa , Cyrus Mostajeran , Juan-Pablo Ortega , Salem Said

This paper studies the relationship between the positive limit sets of continuous semiflows and the newly introduced definition of persistently excited (PE) sets and associated subspaces of reproducing kernel Hilbert (RKH) spaces. It is…

Optimization and Control · Mathematics 2019-09-27 Andrew J. Kurdila , Jia Guo , Sai Tej Paruchuri , Parag Bobade

In this paper, we consider the coefficient-based regularized distribution regression which aims to regress from probability measures to real-valued responses over a reproducing kernel Hilbert space (RKHS), where the regularization is put on…

Machine Learning · Statistics 2022-08-29 Yuan Mao , Lei Shi , Zheng-Chu Guo

A framework for estimation and hypothesis testing of functional restrictions against general alternatives is proposed. The parameter space is a reproducing kernel Hilbert space (RKHS). The null hypothesis does not necessarily define a…

Methodology · Statistics 2018-08-21 Alessio Sancetta

We review machine learning methods employing positive definite kernels. These methods formulate learning and estimation problems in a reproducing kernel Hilbert space (RKHS) of functions defined on the data domain, expanded in terms of a…

Statistics Theory · Mathematics 2009-09-29 Thomas Hofmann , Bernhard Schölkopf , Alexander J. Smola

Error estimates for kernel interpolation in Reproducing Kernel Hilbert Spaces (RKHS) usually assume quite restrictive properties on the shape of the domain, especially in the case of infinitely smooth kernels like the popular Gaussian…

Numerical Analysis · Mathematics 2025-01-09 Tizian Wenzel , Gabriele Santin , Bernard Haasdonk

In this paper, an adaptive non-parametric method is proposed to estimate the scalar-valued nonlinear function that appears in uncertain systems governed by ordinary differential equations (ODEs). By employing an infinite-dimensional…

Optimization and Control · Mathematics 2021-03-15 Jia Guo , Sai Tej Paruchuri , Andrew J. Kurdila

We study recursive regularized learning algorithms in the reproducing kernel Hilbert space (RKHS) with non-stationary online data streams. We introduce the concept of random Tikhonov regularization path and decompose the tracking error of…

Machine Learning · Computer Science 2025-10-24 Xiwei Zhang , Yan Chen , Tao Li

The success of deep convolutional architectures is often attributed in part to their ability to learn multiscale and invariant representations of natural signals. However, a precise study of these properties and how they affect learning…

Machine Learning · Statistics 2019-02-14 Alberto Bietti , Julien Mairal

We investigate for which Gaussian processes there do or do not exist reproducing kernel Hilbert spaces (RKHSs) that contain almost all of their paths. In particular, we establish a new result that makes it possible to exclude the existence…

Probability · Mathematics 2026-02-12 Ingo Steinwart

Using the smallest eigenvalues of Hankel forms associated with a multidimensional moment problem, we establish a condition equivalent to the existence of a reproducing kernel. This result is a multivariate analogue of Berg, Chen,and…

Functional Analysis · Mathematics 2007-05-23 Roger A. Roybal