English
Related papers

Related papers: Product kernels are efficient and flexible tools f…

200 papers

In this work, we consider the problem of learning nonlinear operators that correspond to discrete-time nonlinear dynamical systems with inputs. Given an initial state and a finite input trajectory, such operators yield a finite output…

Optimization and Control · Mathematics 2024-12-25 Mircea Lazar

We study a reproducing kernel Hilbert space of functions defined on the positive integers and associated to the binomial coefficients. We introduce two transforms, which allow us to develop a related harmonic analysis in this Hilbert space.…

Complex Variables · Mathematics 2014-12-19 Daniel Alpay , Palle Jorgensen

These notes provide a self-contained introduction to kernel methods and their geometric foundations in machine learning. Starting from the construction of Hilbert spaces, we develop the theory of positive definite kernels, reproducing…

We propose a kernel method to identify finite mixtures of nonparametric product distributions. It is based on a Hilbert space embedding of the joint distribution. The rank of the constructed tensor is equal to the number of mixture…

Machine Learning · Computer Science 2013-09-27 Eleni Sgouritsa , Dominik Janzing , Jonas Peters , Bernhard Schoelkopf

The universality properties of kernels characterize the class of functions that can be approximated in the associated reproducing kernel Hilbert space and are of fundamental importance in the theoretical underpinning of kernel methods in…

Machine Learning · Computer Science 2025-06-25 Franziskus Steinert , Salem Said , Cyrus Mostajeran

We revisit tensor algebras of subproduct systems with Hilbert space fibers, resolving some open questions in the case of infinite dimensional fibers. We characterize when a tensor algebra can be identified as the algebra of uniformly…

Operator Algebras · Mathematics 2025-04-16 Michael Hartz , Orr Shalit

We review machine learning methods employing positive definite kernels. These methods formulate learning and estimation problems in a reproducing kernel Hilbert space (RKHS) of functions defined on the data domain, expanded in terms of a…

Statistics Theory · Mathematics 2009-09-29 Thomas Hofmann , Bernhard Schölkopf , Alexander J. Smola

We consider a kernel based harmonic analysis of "boundary," and boundary representations. Our setting is general: certain classes of positive definite kernels. Our theorems extend (and are motivated by) results and notions from classical…

Functional Analysis · Mathematics 2016-11-15 Palle Jorgensen , Feng Tian

The polynomial kernels are widely used in machine learning and they are one of the default choices to develop kernel-based classification and regression models. However, they are rarely used and considered in numerical analysis due to their…

We study classes of reproducing kernels $K$ on general domains; these are kernels which arise commonly in machine learning models; models based on certain families of reproducing kernel Hilbert spaces. They are the positive definite kernels…

Functional Analysis · Mathematics 2017-08-22 Palle Jorgensen , Feng Tian

The tensor-tensor product (t-product) [M. E. Kilmer and C. D. Martin, 2011] is a natural generalization of matrix multiplication. Based on t-product, many operations on matrix can be extended to tensor cases, including tensor SVD, tensor…

Machine Learning · Statistics 2018-06-21 Canyi Lu

Let $\kappa : \mathbb D \times \mathbb D \to \mathbb C$ be a diagonal positive definite kernel and let $\mathscr H_{\kappa}$ denote the associated reproducing kernel Hilbert space of holomorphic functions on the open unit disc $\mathbb D$.…

Functional Analysis · Mathematics 2016-08-30 Akash Anand , Sameer Chavan

Rapidly decaying kernels and frames (needlets) in the context of tensor product Jacobi polynomials are developed based on several constructions of multivariate $C^\infty$ cutoff functions. These tools are further employed to the development…

Classical Analysis and ODEs · Mathematics 2009-02-17 Kamen Ivanov , Pencho Petrushev , Yuan Xu

It is well known that the cohomology of a tensor product is essentially the tensor product of the cohomologies. We look at twisted tensor products, and investigate to which extend this is still true. We give an explicit description of the…

K-Theory and Homology · Mathematics 2008-03-27 Petter Andreas Bergh , Steffen Oppermann

We prove that every positive semidefinite matrix over the natural numbers that is eventually 0 in each row and column can be factored as the product of an upper triangular matrix times a lower triangular matrix. We also extend some known…

Functional Analysis · Mathematics 2017-04-17 Vern I. Paulsen , Hugo J. Woerdeman

Kernels are often developed and used as implicit mapping functions that show impressive predictive power due to their high-dimensional feature space representations. In this study, we gradually construct a series of simple feature maps that…

Machine Learning · Computer Science 2020-07-20 Gurhan Ceylan , S. Ilker Birbil

Recent work shows that inference for Gaussian processes can be performed efficiently using iterative methods that rely only on matrix-vector multiplications (MVMs). Structured Kernel Interpolation (SKI) exploits these techniques by deriving…

Machine Learning · Computer Science 2018-02-27 Jacob R. Gardner , Geoff Pleiss , Ruihan Wu , Kilian Q. Weinberger , Andrew Gordon Wilson

Kernel methods, being supported by a well-developed theory and coming with efficient algorithms, are among the most popular and successful machine learning techniques. From a mathematical point of view, these methods rest on the concept of…

Machine Learning · Statistics 2023-03-20 Christian Fiedler , Michael Herty , Michael Rom , Chiara Segala , Sebastian Trimpe

The paper studies strictly positive definite kernels on compact Riemannian manifolds. We state new conditions to ensure strict positive definiteness for general kernels and kernels with certain convolutional structure. We also state…

Numerical Analysis · Mathematics 2023-01-20 Jean Carlo Guella , Janin Jäger

Given a reproducing kernel Hilbert space H of real-valued functions and a suitable measure mu over the source space D (subset of R), we decompose H as the sum of a subspace of centered functions for mu and its orthogonal in H. This…

Machine Learning · Statistics 2012-12-10 Nicolas Durrande , David Ginsbourger , Olivier Roustant , Laurent Carraro