English
Related papers

Related papers: New boundaries for positive definite functions

200 papers

We consider the problem of reconstructing a function from a finite set of noise-corrupted samples. Two kernel algorithms are analyzed, namely kernel ridge regression and $\varepsilon$-support vector regression. By assuming the ground-truth…

Systems and Control · Electrical Eng. & Systems 2021-08-03 Emilio T. Maddalena , Paul Scharnhorst , Colin N. Jones

The Gaussian kernel plays a central role in machine learning, uncertainty quantification and scattered data approximation, but has received relatively little attention from a numerical analysis standpoint. The basic problem of finding an…

Numerical Analysis · Mathematics 2021-04-02 Toni Karvonen , Chris J. Oates , Mark Girolami

In this paper we investigate and compare different gradient algorithms designed for the domain expression of the shape derivative. Our main focus is to examine the usefulness of kernel reproducing Hilbert spaces for PDE constrained shape…

Optimization and Control · Mathematics 2016-04-20 Martin Eigel , Kevin Sturm

A new notion of stochastic germs for quantum processes is introduced and a characterisation of the stochastic differentials for positive definite (PD) processes is found in terms of their germs for arbitrary Ito algebra. A representation…

Probability · Mathematics 2007-05-23 V. P. Belavkin

We propose a framework for 2D shape analysis using positive definite kernels defined on Kendall's shape manifold. Different representations of 2D shapes are known to generate different nonlinear spaces. Due to the nonlinearity of these…

Computer Vision and Pattern Recognition · Computer Science 2014-12-16 Sadeep Jayasumana , Mathieu Salzmann , Hongdong Li , Mehrtash Harandi

With view to applications, we establish a correspondence between two problems: (i) the problem of finding continuous positive definite extensions of functions $F$ which are defined on open bounded domains $\Omega$ in $\mathbb{R}$, on the…

Functional Analysis · Mathematics 2015-06-19 Palle Jorgensen , Feng Tian

We introduce, for any set $S$, the concept of $\mathfrak{K}$-family between two Hilbert $C^*$-modules over two $C^*$-algebras, for a given completely positive definite (CPD-) kernel $\mathfrak{K}$ over $S$ between those $C^*$-algebras and…

Operator Algebras · Mathematics 2018-06-12 Santanu Dey , Harsh Trivedi

This paper presents a framework for computing random operator-valued feature maps for operator-valued positive definite kernels. This is a generalization of the random Fourier features for scalar-valued kernels to the operator-valued case.…

Machine Learning · Computer Science 2016-08-22 Ha Quang Minh

We investigate a recently proposed family of positive-definite kernels that mimic the computation in large neural networks. We examine the properties of these kernels using tools from differential geometry; specifically, we analyze the…

Machine Learning · Computer Science 2011-12-19 Youngmin Cho , Lawrence K. Saul

We prove a factorization theorem for reproducing kernel Hilbert spaces whose kernel has a normalized complete Nevanlinna-Pick factor. This result relates the functions in the original space to pointwise multipliers determined by the…

Functional Analysis · Mathematics 2018-07-19 Alexandru Aleman , Michael Hartz , John E. McCarthy , Stefan Richter

There exists a plethora of parametric models for positive definite kernels, and their use is ubiquitous in disciplines as diverse as statistics, machine learning, numerical analysis, and approximation theory. Usually, the kernel parameters…

Machine Learning · Statistics 2025-01-06 Xavier Emery , Emilio Porcu , Moreno Bevilacqua

In this paper, we develop an approach to exploiting kernel methods with manifold-valued data. In many computer vision problems, the data can be naturally represented as points on a Riemannian manifold. Due to the non-Euclidean geometry of…

Computer Vision and Pattern Recognition · Computer Science 2015-03-18 Sadeep Jayasumana , Richard Hartley , Mathieu Salzmann , Hongdong Li , Mehrtash Harandi

We discuss the structure of positive definite kernels in terms of operator models. In particular, we introduce two models, one of Hessenberg type and another one that we call near triangular. These models produce parametrizations of the…

Functional Analysis · Mathematics 2007-05-23 T. Constantinescu , Nermine El-Sissi

Given a positive definite, bounded linear operator $A$ on the Hilbert space $\mathcal{H}_0:=l^2(E)$, we consider a reproducing kernel Hilbert space $\mathcal{H}_+$ with a reproducing kernel $A(x,y)$. Here $E$ is any countable set and…

Probability · Mathematics 2007-05-23 Hyun Jae Yoo

We study infinite products of reproducing kernels with view to their use in dynamics (of iterated function systems), in harmonic analysis, and in stochastic processes. On the way, we construct a new family of representations of the Cuntz…

Functional Analysis · Mathematics 2013-01-22 D. Alpay , P. Jorgensen , I. Lewkowicz , I. Martziano

This work concerns the construction and characterization of product kernels for multivariate approximation from a finite set of discrete samples. To this end, we consider composing different component kernels, each acting on a…

Numerical Analysis · Mathematics 2024-11-27 Kristof Albrecht , Juliane Entzian , Armin Iske

Suppose $A$ is a positive real linear transformation on a finite dimensional complex inner product space $V$. The reproducing kernel for the Fock space of square integrable holomorphic functions on $V$ relative to the Gaussian measure…

Functional Analysis · Mathematics 2007-05-23 R. Fabec , G. Olafsson , A. Sengupta

We define an extension of operator-valued positive definite functions from the real or complex setting to topological algebras, and describe their associated reproducing kernel spaces. The case of entire functions is of special interest,…

Functional Analysis · Mathematics 2024-01-05 Daniel Alpay , Ismael L. Paiva

Gaussian processes are flexible function approximators, with inductive biases controlled by a covariance kernel. Learning the kernel is the key to representation learning and strong predictive performance. In this paper, we develop…

Machine Learning · Computer Science 2019-10-31 Gregory W. Benton , Wesley J. Maddox , Jayson P. Salkey , Julio Albinati , Andrew Gordon Wilson

Kernel expansions are a topic of considerable interest in machine learning, also because of their relation to the so-called feature maps introduced in machine learning. Properties of the associated basis functions and weights (corresponding…

Machine Learning · Computer Science 2024-10-03 Mauro Bisiacco , Gianluigi Pillonetto