English
Related papers

Related papers: A Kernel for Hierarchical Parameter Spaces

200 papers

The paper introduces a new characterisation of strictly positive definiteness for kernels on the 2-sphere without assuming the kernel to be radially (isotropic) or axially symmetric. The results use the series expansion of the kernel in…

Numerical Analysis · Mathematics 2022-05-06 Janin Jäger

The paper studies strictly positive definite kernels on compact Riemannian manifolds. We state new conditions to ensure strict positive definiteness for general kernels and kernels with certain convolutional structure. We also state…

Numerical Analysis · Mathematics 2023-01-20 Jean Carlo Guella , Janin Jäger

We prove that the optimal assignment kernel, proposed recently as an attempt to embed labeled graphs and more generally tuples of basic data to a Hilbert space, is in fact not always positive definite.

Machine Learning · Computer Science 2008-01-29 Jean-Philippe Vert

We supply a Fourier characterization for the real, continuous, isotropic and strictly positive definite kernels on a product of circles.

Classical Analysis and ODEs · Mathematics 2018-09-25 J. C. Guella , V. A. Menegatto , A. P. Peron

Motivated by applications to the study of stochastic processes, we introduce a new analysis of positive definite kernels $K$, their reproducing kernel Hilbert spaces (RKHS), and an associated family of feature spaces that may be chosen in…

Functional Analysis · Mathematics 2017-07-27 Palle Jorgensen , Feng Tian

We propose a framework for 2D shape analysis using positive definite kernels defined on Kendall's shape manifold. Different representations of 2D shapes are known to generate different nonlinear spaces. Due to the nonlinearity of these…

Computer Vision and Pattern Recognition · Computer Science 2014-12-16 Sadeep Jayasumana , Mathieu Salzmann , Hongdong Li , Mehrtash Harandi

We investigate a recently proposed family of positive-definite kernels that mimic the computation in large neural networks. We examine the properties of these kernels using tools from differential geometry; specifically, we analyze the…

Machine Learning · Computer Science 2011-12-19 Youngmin Cho , Lawrence K. Saul

This work explores new classes of nonstationary stochastic sequences associated with polynomial hypergroups. Their covariance structures are analyzed through positive definite kernels and corresponding Hilbert spaces. Novel consistent…

Functional Analysis · Mathematics 2024-11-27 Volker Hösel

In many applications data is naturally presented in terms of orderings of some basic elements or symbols. Reasoning about such data requires a notion of similarity capable of handling sequences of different lengths. In this paper we…

Machine Learning · Computer Science 2015-01-27 Andrea Baisero , Florian T. Pokorny , Carl Henrik Ek

Highly localized kernels based on orthogonal polynomials have been studied and utilized over several regular domains. Much of the results deduced via these kernels can be treated uniformly in the framework of localizable spaces of…

Classical Analysis and ODEs · Mathematics 2024-06-25 Yuan Xu

For the real, continuous, isotropic and positive definite kernels on a product of spheres, one may consider not only its usual strict positive definiteness but also strict positive definiteness restrict to the points of the product that…

Classical Analysis and ODEs · Mathematics 2015-05-15 Jean C. Guella , Valdir A. Menegatto

Kernel matrices are ubiquitous in computational mathematics, often arising from applications in machine learning and scientific computing. In two or three spatial or feature dimensions, such problems can be approximated efficiently by a…

Numerical Analysis · Mathematics 2025-11-07 Abraham Khan , Chao Chen , Vishwas Rao , Arvind K. Saibaba

In this note we refine the notion of conditionally negative definite kernels to the notion of conditionally strictly negative definite kernels and study its properties. We show that the class of these kernels carries some surprising…

Functional Analysis · Mathematics 2016-11-17 Paweł Józiak

A spectrahedron is the positivity region of a linear matrix pencil and thus the feasible set of a semidefinite program. We propose and study a hierarchy of sufficient semidefinite conditions to certify the containment of a spectrahedron in…

Optimization and Control · Mathematics 2015-03-23 Kai Kellner , Thorsten Theobald , Christian Trabandt

Interpolation and approximation of functionals with conditionally positive definite kernels is considered on sets of centers that are not determining for polynomials. It is shown that polynomial consistency is sufficient in order to define…

Numerical Analysis · Mathematics 2025-08-26 Oleg Davydov

We propose a novel class of kernels to alleviate the high computational cost of large-scale nonparametric learning with kernel methods. The proposed kernel is defined based on a hierarchical partitioning of the underlying data domain, where…

Machine Learning · Computer Science 2017-08-15 Jie Chen , Haim Avron , Vikas Sindhwani

Tree kernels have demonstrated their ability to deal with hierarchical data, as the intrinsic tree structure often plays a discriminative role. While such kernels have been successfully applied to various domains such as nature language…

Computer Vision and Pattern Recognition · Computer Science 2016-04-08 Yanwei Cui , Laetitia Chapel , Sébastien Lefèvre

A nonparametric family of conditional distributions is introduced, which generalizes conditional exponential families using functional parameters in a suitable RKHS. An algorithm is provided for learning the generalized natural parameter,…

Machine Learning · Statistics 2018-04-10 Michael Arbel , Arthur Gretton

The paper introduces new sufficient conditions of strict positive definiteness for kernels on d-dimensional spheres which are not radially symmetric but possess specific coefficient structures. The results use the series expansion of the…

Numerical Analysis · Mathematics 2021-05-07 Martin Buhmann , Janin Jäger

In practical Bayesian optimization, we must often search over structures with differing numbers of parameters. For instance, we may wish to search over neural network architectures with an unknown number of layers. To relate performance…

Machine Learning · Statistics 2014-09-16 Kevin Swersky , David Duvenaud , Jasper Snoek , Frank Hutter , Michael A. Osborne