English
Related papers

Related papers: New boundaries for positive definite functions

200 papers

The success of kernel methods has initiated the design of novel positive semidefinite functions, in particular for structured data. A leading design paradigm for this is the convolution kernel, which decomposes structured objects into their…

Machine Learning · Computer Science 2017-02-01 Nils M. Kriege , Pierre-Louis Giscard , Richard C. Wilson

The use of kernel functions is a common technique to extract important features from data sets. A quantum computer can be used to estimate kernel entries as transition amplitudes of unitary circuits. Quantum kernels exist that, subject to…

The paper discusses a series of results concerning reproducing kernel Hilbert spaces, related to the factorization of their kernels. In particular, it is proved that for a large class of spaces isometric multipliers are trivial. One also…

Functional Analysis · Mathematics 2016-05-10 Rani Kumari , Jaydeb Sarkar , Srijan Sarkar , Dan Timotin

We introduce a real-parameter refinement of the classical integer hierarchies underlying Schmidt number, block-positivity, and $k$-positivity for maps between matrix algebras. Starting from a compact family of $\alpha$-admissible unit…

Functional Analysis · Mathematics 2026-02-16 Mohsen Kian

We introduce a novel framework for constructing scalable and flexible covariance kernels for Gaussian processes (GPs) by directly learning the covariance structure under a regression-type parameterization induced by Vecchia approximations,…

Machine Learning · Statistics 2026-05-08 Jian Cao , Nian Liu , Ying Lin

In this paper, we present the general theory of embedding independence tests on Hilbert spaces that generalizes the concepts of distance covariance, distance multivariance and HSIC. This is done by defining new types of kernel on an $n$…

Functional Analysis · Mathematics 2024-11-14 Jean Carlo Guella

Modern datasets across many disciplines increasingly consist of time-evolving, potentially infinite-dimensional random objects, such as dynamic functional data, which are naturally modeled in Hilbert spaces. In these settings,…

Machine Learning · Statistics 2026-05-08 Daniel López-Montero , Antonio Álvarez-López , Marcos Matabuena

We describe a method to perform functional operations on probability distributions of random variables. The method uses reproducing kernel Hilbert space representations of probability distributions, and it is applicable to all operations…

Machine Learning · Statistics 2016-09-14 Bernhard Schölkopf , Krikamol Muandet , Kenji Fukumizu , Jonas Peters

Kernel based methods including Gaussian process regression (GPR) and generally kernel ridge regression (KRR) have been finding increasing use in computational chemistry, including the fitting of potential energy surfaces and density…

Machine Learning · Statistics 2023-01-27 Sergei Manzhos , Manabu Ihara

Stochastic models share many characteristics with generic parametric models. In some ways they can be regarded as a special case. But for stochastic models there is a notion of weak distribution or generalised random variable, and the same…

Numerical Analysis · Mathematics 2018-09-05 Hermann G. Matthies

We review definitions and properties of reproducing kernel Hilbert spaces attached to Gaussian variables and processes, with a view to applications in nonparametric Bayesian statistics using Gaussian priors. The rate of contraction of…

Functional Analysis · Mathematics 2008-12-18 A. W. van der Vaart , J. H. van Zanten

The composition operators preserving total non-negativity and total positivity for various classes of kernels are classified, following three themes. Letting a function act by post composition on kernels with arbitrary domains, it is shown…

Functional Analysis · Mathematics 2023-09-27 Alexander Belton , Dominique Guillot , Apoorva Khare , Mihai Putinar

The notion of a (polynomial) kernelization from parameterized complexity is a well-studied model for efficient preprocessing for hard computational problems. By now, it is quite well understood which parameterized problems do or…

Data Structures and Algorithms · Computer Science 2025-04-28 Leonid Antipov , Stefan Kratsch

Data-driven discovery of "hidden physics" -- i.e., machine learning of differential equation models underlying observed data -- has recently been approached by embedding the discovery problem into a Gaussian Process regression of spatial…

Machine Learning · Computer Science 2019-08-05 Mamikon Gulian , Maziar Raissi , Paris Perdikaris , George Karniadakis

A family of log-correlated Gaussian processes indexed by metric spaces is introduced, when the metric is conditionally negative definite. These processes arise as the limit of bi-fractional Brownian motions indexed by $(H,K)$ scaled by…

Probability · Mathematics 2025-09-30 Yizao Wang

We introduce a new scalable variational Gaussian process approximation which provides a high fidelity approximation while retaining general applicability. We propose the harmonic kernel decomposition (HKD), which uses Fourier series to…

Machine Learning · Computer Science 2021-06-14 Shengyang Sun , Jiaxin Shi , Andrew Gordon Wilson , Roger Grosse

We study two classes of extension problems, and their interconnections: (i) Extension of positive definite (p.d.) continuous functions defined on subsets in locally compact groups $G$; (ii) In case of Lie groups, representations of the…

Functional Analysis · Mathematics 2015-07-10 Palle Jorgensen , Steen Pedersen , Feng Tian

We develop a stochastic approximation framework for learning nonlinear operators between infinite-dimensional spaces utilizing general Mercer operator-valued kernels. Our framework encompasses two key classes: (i) compact kernels, which…

Machine Learning · Statistics 2026-01-13 Jia-Qi Yang , Lei Shi

Choosing the most adequate kernel is crucial in many Machine Learning applications. Gaussian Process is a state-of-the-art technique for regression and classification that heavily relies on a kernel function. However, in the Gaussian…

Machine Learning · Computer Science 2019-10-15 Ibai Roman , Roberto Santana , Alexander Mendiburu , Jose A. Lozano

Given a set of points $P\subset \mathbb{R}^{d}$ and a kernel $k$, the Kernel Density Estimate at a point $x\in\mathbb{R}^{d}$ is defined as $\mathrm{KDE}_{P}(x)=\frac{1}{|P|}\sum_{y\in P} k(x,y)$. We study the problem of designing a data…

Data Structures and Algorithms · Computer Science 2018-09-03 Moses Charikar , Paris Siminelakis