English
Related papers

Related papers: Positive Definite Kernels and Random Sequences Con…

200 papers

Dynamic graphs are rife with higher-order interactions, such as co-authorship relationships and protein-protein interactions in biological networks, that naturally arise between more than two nodes at once. In spite of the ubiquitous…

Machine Learning · Computer Science 2021-02-09 Manohar Kaul , Masaaki Imaizumi

Positive-definite kernel functions are fundamental elements of kernel methods and Gaussian processes. A well-known construction of such functions comes from Bochner's characterization, which connects a positive-definite function with a…

Machine Learning · Statistics 2016-10-28 Jie Chen , Dehua Cheng , Yan Liu

This paper introduces a novel approach to probabilistic deep learning, kernel density matrices, which provide a simpler yet effective mechanism for representing joint probability distributions of both continuous and discrete random…

Machine Learning · Computer Science 2024-05-01 Fabio A. González , Raúl Ramos-Pollán , Joseph A. Gallego-Mejia

Modern Bayesian optimization and adaptive sampling methods increasingly rely on nonlinear parametric models, yet theoretical guarantees for such models under adaptive data collection remain limited. Existing analyses largely focus on…

Machine Learning · Statistics 2026-05-14 Rafael Oliveira

We propose a new method for input variable selection in nonlinear regression. The method is embedded into a kernel regression machine that can model general nonlinear functions, not being a priori limited to additive models. This is the…

Machine Learning · Computer Science 2018-09-05 Magda Gregorová , Jason Ramapuram , Alexandros Kalousis , Stéphane Marchand-Maillet

We consider the problem of learning a set from random samples. We show how relevant geometric and topological properties of a set can be studied analytically using concepts from the theory of reproducing kernel Hilbert spaces. A new kind of…

Machine Learning · Statistics 2014-11-26 Ernesto De Vito , Lorenzo Rosasco , Alessandro Toigo

The paper studies strictly positive definite kernels on compact Riemannian manifolds. We state new conditions to ensure strict positive definiteness for general kernels and kernels with certain convolutional structure. We also state…

Numerical Analysis · Mathematics 2023-01-20 Jean Carlo Guella , Janin Jäger

The problem of establishing out-of-sample bounds for the values of an unkonwn ground-truth function is considered. Kernels and their associated Hilbert spaces are the main formalism employed herein along with an observational model where…

Machine Learning · Computer Science 2022-09-13 Paul Scharnhorst , Emilio T. Maddalena , Yuning Jiang , Colin N. Jones

We study a reproducing kernel Hilbert space of functions defined on the positive integers and associated to the binomial coefficients. We introduce two transforms, which allow us to develop a related harmonic analysis in this Hilbert space.…

Complex Variables · Mathematics 2014-12-19 Daniel Alpay , Palle Jorgensen

The main purpose of our paper is a new approach to design of algorithms of Kaczmarz type in the framework of operators in Hilbert space. Our applications include a diverse list of optimization problems, new Karhunen-Lo\`eve transforms, and…

Functional Analysis · Mathematics 2021-04-27 Palle E. T. Jorgensen , Myung-Sin Song , James Tian

The use of covariance kernels is ubiquitous in the field of spatial statistics. Kernels allow data to be mapped into high-dimensional feature spaces and can thus extend simple linear additive methods to nonlinear methods with higher order…

Machine Learning · Statistics 2017-11-16 Jean-Francois Ton , Seth Flaxman , Dino Sejdinovic , Samir Bhatt

The paper introduces a new characterisation of strictly positive definiteness for kernels on the 2-sphere without assuming the kernel to be radially (isotropic) or axially symmetric. The results use the series expansion of the kernel in…

Numerical Analysis · Mathematics 2022-05-06 Janin Jäger

This paper examines the problem of learning with a finite and possibly large set of p base kernels. It presents a theoretical and empirical analysis of an approach addressing this problem based on ensembles of kernel predictors. This…

Machine Learning · Computer Science 2012-02-20 Corinna Cortes , Mehryar Mohri , Afshin Rostamizadeh

We show that, for positive definite kernels, if specific forms of regularity (continuity, Sn-differentiability or holomorphy) hold locally on the diagonal, then they must hold globally on the whole domain of positive-definiteness. This…

Complex Variables · Mathematics 2018-02-21 Jorge Buescu , António Paixão , Claudemir Oliveira

Stochastic configuration networks (SCNs), as a class of randomized learner models, are featured by its way of random parameters assignment in the light of a supervisory mechanism, resulting in the universal approximation property at…

Machine Learning · Computer Science 2024-12-17 Yongxuan Chen , Dianhui Wang

In this paper, we present the general theory of embedding independence tests on Hilbert spaces that generalizes the concepts of distance covariance, distance multivariance and HSIC. This is done by defining new types of kernel on an $n$…

Functional Analysis · Mathematics 2024-11-14 Jean Carlo Guella

This paper presents new methodology for computationally efficient kernel density estimation. It is shown that a large class of kernels allows for exact evaluation of the density estimates using simple recursions. The same methodology can be…

Computation · Statistics 2019-11-12 David P. Hofmeyr

It is often said that control and estimation problems are in duality. Recently, in (Aubin-Frankowski,2021), we found new reproducing kernels in Linear-Quadratic optimal control by focusing on the Hilbert space of controlled trajectories,…

Optimization and Control · Mathematics 2022-10-14 Pierre-Cyril Aubin-Frankowski , Alain Bensoussan

We develop a framework for function classes generated by parametric ridge kernels: one-dimensional kernels composed with affine projections and averaged over a parameter measure. The induced kernels are positive definite, and the resulting…

Functional Analysis · Mathematics 2025-08-26 James Tian

A number of machine learning tasks entail a high degree of invariance: the data distribution does not change if we act on the data with a certain group of transformations. For instance, labels of images are invariant under translations of…

Machine Learning · Statistics 2021-03-01 Song Mei , Theodor Misiakiewicz , Andrea Montanari