English
Related papers

Related papers: Tractable Computation of Expected Kernels

200 papers

Kernel herding belongs to a family of deterministic quadratures that seek to minimize the worst-case integration error over a reproducing kernel Hilbert space (RKHS). These quadrature rules come with strong experimental evidence that this…

Machine Learning · Computer Science 2025-08-12 Martin Rouault , Rémi Bardenet , Mylène Maïda

Kernel methods are used extensively in classical machine learning, especially in the field of pattern analysis. In this paper, we propose a kernel-based quantum machine learning algorithm that can be implemented on a near-term, intermediate…

Quantum Physics · Physics 2019-06-11 Roohollah Ghobadi , Jaspreet S. Oberoi , Ehsan Zahedinejhad

It has been hypothesized that quantum computers may lend themselves well to applications in machine learning. In the present work, we analyze function classes defined via quantum kernels. Quantum computers offer the possibility to…

Quantum Physics · Physics 2021-11-10 Jonas M. Kübler , Simon Buchholz , Bernhard Schölkopf

Kernel means are frequently used to represent probability distributions in machine learning problems. In particular, the well known kernel density estimator and the kernel mean embedding both have the form of a kernel mean. Unfortunately,…

Machine Learning · Statistics 2015-03-03 E. Cruz Cortés , C. Scott

The polynomial kernels are widely used in machine learning and they are one of the default choices to develop kernel-based classification and regression models. However, they are rarely used and considered in numerical analysis due to their…

We consider the problem of improving kernel approximation via randomized feature maps. These maps arise as Monte Carlo approximation to integral representations of kernel functions and scale up kernel methods for larger datasets. Based on…

Machine Learning · Computer Science 2018-10-31 Marina Munkhoeva , Yermek Kapushev , Evgeny Burnaev , Ivan Oseledets

We review machine learning methods employing positive definite kernels. These methods formulate learning and estimation problems in a reproducing kernel Hilbert space (RKHS) of functions defined on the data domain, expanded in terms of a…

Statistics Theory · Mathematics 2009-09-29 Thomas Hofmann , Bernhard Schölkopf , Alexander J. Smola

We introduce scalable deep kernels, which combine the structural properties of deep learning architectures with the non-parametric flexibility of kernel methods. Specifically, we transform the inputs of a spectral mixture base kernel with a…

Machine Learning · Computer Science 2015-11-09 Andrew Gordon Wilson , Zhiting Hu , Ruslan Salakhutdinov , Eric P. Xing

This paper presents an algorithm, Voted Kernel Regularization , that provides the flexibility of using potentially very complex kernel functions such as predictors based on much higher-degree polynomial kernels, while benefitting from…

Machine Learning · Computer Science 2015-09-16 Corinna Cortes , Prasoon Goyal , Vitaly Kuznetsov , Mehryar Mohri

Approximate Bayesian computation has emerged as a standard computational tool when dealing with the increasingly common scenario of completely intractable likelihood functions in Bayesian inference. We show that many common Markov chain…

Methodology · Statistics 2014-08-12 Anthony Lee , Krzysztof Latuszynski

High-dimensional data in the form of tensors are challenging for kernel classification methods. To both reduce the computational complexity and extract informative features, kernels based on low-rank tensor decompositions have been…

Machine Learning · Statistics 2023-02-17 Kirandeep Kour , Sergey Dolgov , Peter Benner , Martin Stoll , Max Pfeffer

Most machine learning algorithms, such as classification or regression, treat the individual data point as the object of interest. Here we consider extending machine learning algorithms to operate on groups of data points. We suggest…

Machine Learning · Computer Science 2021-01-15 Danica J. Sutherland , Liang Xiong , Barnabás Póczos , Jeff Schneider

The accuracy and complexity of machine learning algorithms based on kernel optimization are limited by the set of kernels over which they are able to optimize. An ideal set of kernels should: admit a linear parameterization (for…

Machine Learning · Computer Science 2020-06-16 Brendon K. Colbert , Matthew M. Peet

An important issue when using Machine Learning algorithms in recent research is the lack of interpretability. Although these algorithms provide accurate point predictions for various learning problems, uncertainty estimates connected with…

Machine Learning · Statistics 2021-03-11 Burim Ramosaj

Kernel methods provide a theoretically grounded framework for non-linear and non-parametric learning, with strong analytic foundations and statistical guarantees. Yet, their scalability has long been limited by prohibitive time and memory…

Machine Learning · Computer Science 2025-10-01 Maedeh Zarvandi , Michael Timothy , Theresa Wasserer , Debarghya Ghoshdastidar

Probabilistic representations, such as Bayesian and Markov networks, are fundamental to much of statistical machine learning. Thus, learning probabilistic representations directly from data is a deep challenge, the main computational…

Machine Learning · Computer Science 2020-06-16 Amelie Levray , Vaishak Belle

In this paper we consider the problem of approximating vector-valued functions over a domain $\Omega$. For this purpose, we use matrix-valued reproducing kernels, which can be related to Reproducing kernel Hilbert spaces of vectorial…

Numerical Analysis · Mathematics 2019-01-11 Dominik Wittwar , Gabriele Santin , Bernard Haasdonk

Conformal prediction constructs a confidence set for an unobserved response of a feature vector based on previous identically distributed and exchangeable observations of responses and features. It has a coverage guarantee at any nominal…

Machine Learning · Statistics 2022-12-08 Eugene Ndiaye , Ichiro Takeuchi

Kernel techniques are among the most popular and flexible approaches in data science allowing to represent probability measures without loss of information under mild conditions. The resulting mapping called mean embedding gives rise to a…

Machine Learning · Statistics 2024-11-27 Linda Chamakh , Zoltan Szabo

This work proposed kernel selection approaches for probabilistic classifiers based on features produced by the convolutional encoder of a variational autoencoder. Particularly, the developed methodologies allow the selection of the most…

Machine Learning · Computer Science 2025-08-05 Fábio Mendonça , Sheikh Shanawaz Mostafa , Fernando Morgado-Dias , Antonio G. Ravelo-García