English
Related papers

Related papers: Remarks on kernel Bayes' rule

200 papers

This paper introduces a novel statistical regression framework that allows the incorporation of consistency constraints. A linear and nonlinear (kernel-based) formulation are introduced, and both imply closed-form analytical solutions. The…

Methodology · Statistics 2020-12-10 Emiliano Díaz , Adrián Pérez-Suay , Valero Laparra , Gustau Camps-Valls

Quantum kernel methods leverage a kernel function computed by embedding input information into the Hilbert space of a quantum system. However, large Hilbert spaces can hinder generalization capability, and the scalability of quantum kernels…

Quantum Physics · Physics 2024-04-16 Rodrigo Martínez-Peña , Miguel C. Soriano , Roberta Zambrini

Marginalising over families of Gaussian Process kernels produces flexible model classes with well-calibrated uncertainty estimates. Existing approaches require likelihood evaluations of many kernels, rendering them prohibitively expensive…

Machine Learning · Statistics 2023-03-16 Saad Hamid , Sebastian Schulze , Michael A. Osborne , Stephen J. Roberts

In this paper, we consider a partial deconvolution kernel estimator for nonparametric regression when some covariates are measured with error while others are observed without error. We focus on a general and realistic setting in which the…

Statistics Theory · Mathematics 2026-01-29 Baba Thiam

This paper introduces a new type of probabilistic semiparametric model that takes advantage of data binning to reduce the computational cost of kernel density estimation in nonparametric distributions. Two new conditional probability…

Machine Learning · Computer Science 2026-04-02 Rafael Sojo , Javier Díaz-Rozo , Concha Bielza , Pedro Larrañaga

This paper introduces an approach for detecting differences in the first-order structures of spatial point patterns. The proposed approach leverages the kernel mean embedding in a novel way by introducing its approximate version tailored to…

Methodology · Statistics 2020-06-15 Raif M. Rustamov , James T. Klosowski

We propose a novel calibration method for computer simulators, dealing with the problem of covariate shift. Covariate shift is the situation where input distributions for training and test are different, and ubiquitous in applications of…

Machine Learning · Statistics 2020-03-20 Keiichi Kisamori , Motonobu Kanagawa , Keisuke Yamazaki

Kernel methods are a cornerstone of classical machine learning. The idea of using quantum computers to compute kernels has recently attracted attention. Quantum embedding kernels (QEKs) constructed by embedding data into the Hilbert space…

A mean function in reproducing kernel Hilbert space, or a kernel mean, is an important part of many applications ranging from kernel principal component analysis to Hilbert-space embedding of distributions. Given finite samples, an…

Machine Learning · Statistics 2013-06-07 Krikamol Muandet , Kenji Fukumizu , Bharath Sriperumbudur , Arthur Gretton , Bernhard Schölkopf

Here we develop a method for performing nonparametric Bayesian inference on quantiles. Relying on geometric measure theory and employing a Hausdorff base measure, we are able to specify meaningful priors for the quantile while treating the…

Methodology · Statistics 2016-05-12 Luke Bornn , Neil Shephard , Reza Solgi

Conditional kernel mean embeddings are nonparametric models that encode conditional expectations in a reproducing kernel Hilbert space. While they provide a flexible and powerful framework for probabilistic inference, their performance is…

Machine Learning · Statistics 2018-11-09 Kelvin Hsu , Richard Nock , Fabio Ramos

Models like support vector machines or Gaussian process regression often require positive semi-definite kernels. These kernels may be based on distance functions. While definiteness is proven for common distances and kernels, a proof for a…

Machine Learning · Computer Science 2018-07-11 Martin Zaefferer , Thomas Bartz-Beielstein , Günter Rudolph

In recent times, neural networks have become a powerful tool for the analysis of complex and abstract data models. However, their introduction intrinsically increases our uncertainty about which features of the analysis are model-related…

Machine Learning · Statistics 2020-11-09 Tom Charnock , Laurence Perreault-Levasseur , François Lanusse

We describe a method for fitting distributions to data which only requires knowledge of the parametric form of either the signal or the background but not both. The unknown distribution is fit using a non-parametric kernel density…

Data Analysis, Statistics and Probability · Physics 2015-06-03 Wolfgang A. Rolke , Angel M. López

Quantum kernel method is one of the key approaches to quantum machine learning, which has the advantages that it does not require optimization and has theoretical simplicity. By virtue of these properties, several experimental…

Quantum Physics · Physics 2022-11-28 Norihito Shirai , Kenji Kubo , Kosuke Mitarai , Keisuke Fujii

The aim of this article is to establish basic results in a conditional measure theory. The results are applied to prove that arbitrary kernels and conditional distributions are represented by measures in a conditional set theory. In…

Probability · Mathematics 2018-03-21 Asgar Jamneshan , Michael Kupper , Martin Streckfuß

We propose a novel Bayesian methodology for inference in functional linear and logistic regression models based on the theory of reproducing kernel Hilbert spaces (RKHS's). We introduce general models that build upon the RKHS generated by…

Methodology · Statistics 2025-09-09 José R. Berrendero , Antonio Coín , Antonio Cuevas

The Bayesian learning rule is a natural-gradient variational inference method, which not only contains many existing learning algorithms as special cases but also enables the design of new algorithms. Unfortunately, when variational…

Machine Learning · Statistics 2020-10-27 Wu Lin , Mark Schmidt , Mohammad Emtiyaz Khan

Kernel ridge regression is an important nonparametric method for estimating smooth functions. We introduce a new set of conditions, under which the actual rates of convergence of the kernel ridge regression estimator under both the L_2 norm…

Statistics Theory · Mathematics 2020-01-03 Rui Tuo , Yan Wang , C. F. Jeff Wu

The problem of sequentially maximizing the expectation of a function seeks to maximize the expected value of a function of interest without having direct control on its features. Instead, the distribution of such features depends on a given…

Machine Learning · Statistics 2022-10-26 Diego Martinez-Taboada , Dino Sejdinovic