English
Related papers

Related papers: The Minecraft Kernel: Modelling correlated Gaussia…

200 papers

The general perception is that kernel methods are not scalable, and neural nets are the methods of choice for nonlinear learning problems. Or have we simply not tried hard enough for kernel methods? Here we propose an approach that scales…

Machine Learning · Computer Science 2015-09-11 Bo Dai , Bo Xie , Niao He , Yingyu Liang , Anant Raj , Maria-Florina Balcan , Le Song

Kernels are a fundamental technical primitive in machine learning. In recent years, kernel-based methods such as Gaussian processes are becoming increasingly important in applications where quantifying uncertainty is of key interest. In…

Gaussian process regression is a classical kernel method for function estimation and data interpolation. In large data applications, computational costs can be reduced using low-rank or sparse approximations of the kernel. This paper…

Numerical Analysis · Mathematics 2024-10-04 Daniel Sanz-Alonso , Ruiyi Yang

This paper introduces a kernel discrepancy-based framework for rerandomization to enhance the precision of causal inference in controlled experiments. We demonstrate that the kernel discrepancy is the key part of the variance upper bound…

Methodology · Statistics 2025-11-05 Yiou Li , Lulu Kang

We develop an exact and scalable algorithm for one-dimensional Gaussian process regression with Mat\'ern correlations whose smoothness parameter $\nu$ is a half-integer. The proposed algorithm only requires $\mathcal{O}(\nu^3 n)$ operations…

Machine Learning · Statistics 2022-03-11 Haoyuan Chen , Liang Ding , Rui Tuo

Kernel-based methods have been recently introduced for linear system identification as an alternative to parametric prediction error methods. Adopting the Bayesian perspective, the impulse response is modeled as a non-stationary Gaussian…

Optimization and Control · Mathematics 2017-03-16 Mattia Zorzi , Alessandro Chiuso

Gaussian processes are arguably the most important class of spatiotemporal models within machine learning. They encode prior information about the modeled function and can be used for exact or approximate Bayesian learning. In many…

The popular qubit framework has dominated recent work on quantum kernel machine learning, with results characterising expressivity, learnability and generalisation. As yet, there is no comparative framework to understand these concepts for…

Quantum Physics · Physics 2024-12-18 Laura J. Henderson , Rishi Goel , Sally Shrapnel

One of the fundamental problems in network analysis is detecting community structure in multi-layer networks, of which each layer represents one type of edge information among the nodes. We propose integrative spectral clustering approaches…

Machine Learning · Statistics 2022-10-07 Sihan Huang , Haolei Weng , Yang Feng

Symmetry, where certain features remain invariant under geometric transformations, can often serve as a powerful prior in designing convolutional neural networks (CNNs). While conventional CNNs inherently support translational equivariance,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Yuexi Du , Jiazhen Zhang , Nicha C. Dvornek , John A. Onofrey

We propose a unifying setting that combines existing restricted kernel machine methods into a single primal-dual multi-view framework for kernel principal component analysis in both supervised and unsupervised settings. We derive the primal…

Machine Learning · Computer Science 2023-07-07 Sonny Achten , Arun Pandey , Hannes De Meulemeester , Bart De Moor , Johan A. K. Suykens

Recently, machine learning had a remarkable impact, from scientific to everyday-life applications. However, complex tasks often imply unfeasible energy and computational power consumption. Quantum computation might lower such requirements,…

We consider the problem of inferring the interaction kernel of stochastic interacting particle systems from observations of a single particle. We adopt a semi-parametric approach and represent the interaction kernel in terms of a…

Statistics Theory · Mathematics 2025-10-31 Grigorios A. Pavliotis , Andrea Zanoni

Nowadays, hyperspectral image classification widely copes with spatial information to improve accuracy. One of the most popular way to integrate such information is to extract hierarchical features from a multiscale segmentation. In the…

Computer Vision and Pattern Recognition · Computer Science 2016-06-17 Yanwei Cui , Laetitia Chapel , Sébastien Lefèvre

There is growing interest in accelerating irregular data-parallel algorithms on GPUs. These algorithms are typically blocking, so they require fair scheduling. But GPU programming models (e.g.\ OpenCL) do not mandate fair scheduling, and…

Programming Languages · Computer Science 2017-07-10 Tyler Sorensen , Hugues Evrard , Alastair F. Donaldson

Selecting an appropriate kernel is a central challenge in kernel-based spectral methods. In \emph{Kernelized Diffusion Maps} (KDM), the kernel determines the accuracy of the RKHS estimator of a diffusion-type operator and hence the quality…

Machine Learning · Statistics 2026-04-21 Othmane Aboussaad , Adam Miraoui , Boumediene Hamzi , Houman Owhadi

The density function of the limiting spectral distribution of general sample covariance matrices is usually unknown. We propose to use kernel estimators which are proved to be consistent. A simulation study is also conducted to show the…

Statistics Theory · Mathematics 2012-11-15 Bing-Yi Jing , Guangming Pan , Qi-Man Shao , Wang Zhou

Generative Modeling via Drifting has recently achieved state-of-the-art one-step image generation through a kernel-based drift operator, yet the success is largely empirical and its theoretical foundations remain poorly understood. In this…

Machine Learning · Computer Science 2026-03-11 Erkan Turan , Maks Ovsjanikov

Non-conservative uncertainty bounds are essential for making reliable predictions about latent functions from noisy data, and thus, a key enabler for safe learning-based control. In this domain, kernel methods such as Gaussian process…

Machine Learning · Computer Science 2026-05-26 Amon Lahr , Anna Scampicchio , Johannes Köhler , Melanie N. Zeilinger

In this chapter we review the main literature related to kernel spectral clustering (KSC), an approach to clustering cast within a kernel-based optimization setting. KSC represents a least-squares support vector machine based formulation of…

Machine Learning · Computer Science 2015-05-05 Rocco Langone , Raghvendra Mall , Carlos Alzate , Johan A. K. Suykens