English
Related papers

Related papers: Interpretable Machine Learning for Spatial Science…

200 papers

We consider learning on graphs, guided by kernels that encode similarity between vertices. Our focus is on random walk kernels, the analogues of squared exponential kernels in Euclidean spaces. We show that on large, locally treelike,…

Machine Learning · Statistics 2013-10-01 Matthew Urry , Peter Sollich

Gaussian process (GP) regression is a fundamental tool in Bayesian statistics. It is also known as kriging and is the Bayesian counterpart to the frequentist kernel ridge regression. Most of the theoretical work on GP regression has focused…

Statistics Theory · Mathematics 2023-10-27 Simon Barthelmé , Pierre-Olivier Amblard , Nicolas Tremblay , Konstantin Usevich

Gaussian processes (GPs) are a class of Kernel methods that have shown to be very useful in geoscience and remote sensing applications for parameter retrieval, model inversion, and emulation. They are widely used because they are simple,…

Machine Learning · Computer Science 2020-05-21 J. Emmanuel Johnson , Valero Laparra , Gustau Camps-Valls

Gaussian processes (GPs) provide a principled and direct approach for inference and learning on graphs. However, the lack of justified graph kernels for spatio-temporal modelling has held back their use in graph problems. We leverage an…

Machine Learning · Computer Science 2024-12-30 Alexander Nikitin , ST John , Arno Solin , Samuel Kaski

Kernel ridge regression (KRR) and Gaussian processes (GPs) are fundamental tools in statistics and machine learning, with recent applications to highly over-parameterized deep neural networks. The ability of these tools to learn a target…

Machine Learning · Statistics 2025-02-18 Itay Lavie , Zohar Ringel

Data-driven modeling is playing an increasing role in robotics and control, yet standard learning methods typically ignore the geometric structure of nonholonomic systems. As a consequence, the learned dynamics may violate the nonholonomic…

Systems and Control · Electrical Eng. & Systems 2026-03-31 Thomas Beckers , Anthony Bloch , Leonardo Colombo

Gaussian processes are flexible function approximators, with inductive biases controlled by a covariance kernel. Learning the kernel is the key to representation learning and strong predictive performance. In this paper, we develop…

Machine Learning · Computer Science 2019-10-31 Gregory W. Benton , Wesley J. Maddox , Jayson P. Salkey , Julio Albinati , Andrew Gordon Wilson

Training and inference in Gaussian processes (GPs) require solving linear systems with $n\times n$ kernel matrices. To address the prohibitive $\mathcal{O}(n^3)$ time complexity, recent work has employed fast iterative methods, like…

Machine Learning · Computer Science 2024-03-12 Kaiwen Wu , Jonathan Wenger , Haydn Jones , Geoff Pleiss , Jacob R. Gardner

Sparse grids are popular tools for high-dimensional function approximation. In this work, we study the use of sparse grids for interpolation using separable Mat\'ern kernels…

Numerical Analysis · Mathematics 2026-04-14 Elliot J. Addy , Aretha L. Teckentrup

This paper introduces Generalized Nonnegative Structured Kruskal Tensor Regression (NS-KTR), a novel tensor regression framework that enhances interpretability and performance through mode-specific hybrid regularization and nonnegativity…

Signal Processing · Electrical Eng. & Systems 2025-09-25 Xinjue Wang , Esa Ollila , Sergiy A. Vorobyov , Ammar Mian

Large kernel convolutions offer a scalable alternative to vision transformers for high-resolution 3D volumetric analysis, yet naively increasing kernel size often leads to optimization instability. Motivated by the spatial bias inherent in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Ho Hin Lee , Quan Liu , Shunxing Bao , Yuankai Huo , Bennett A. Landman

Anisotropic patchy particles have become an archetypical statistical model system for associating fluids. Here we formulate an approach to the Kern-Frenkel model via classical density functional theory to describe the positionally and…

Statistical Mechanics · Physics 2024-06-12 Alessandro Simon , Jens Weimar , Georg Martius , Martin Oettel

Dimensionality reduction techniques are fundamental for analyzing and visualizing high-dimensional data. With established methods like t-SNE and PCA presenting a trade-off between representational power and interpretability. This paper…

Machine Learning · Computer Science 2025-04-25 Erik Bergh

Gaussian process regression (GPR) or kernel ridge regression is a widely used and powerful tool for nonlinear prediction. Therefore, active learning (AL) for GPR, which actively collects data labels to achieve an accurate prediction with…

Quantum methods are increasingly proposed for healthcare, but translational biomarker studies demand transparent benchmarking and robust small-dataset evaluation. We analysed a preclinical COPD cohort of 213 animals with blood and…

Machine Learning · Computer Science 2026-04-21 Azadeh Alavi , Hamidreza Khalili , Stanley H. Chan , Fatemeh Kouchmeshki , Muhammad Usman , Ross Vlahos

This article studies the recovery of graphons when they are convolution kernels on compact (symmetric) metric spaces. This case is of particular interest since it covers the situation where the probability of an edge depends only on some…

Statistics Theory · Mathematics 2020-04-08 Yohann De Castro , Claire Lacour , Thanh Mai Pham Ngoc

In this article, we propose a general nonlinear sufficient dimension reduction (SDR) framework when both the predictor and response lie in some general metric spaces. We construct reproducing kernel Hilbert spaces whose kernels are fully…

Statistics Theory · Mathematics 2022-06-24 Joni Virta , Kuang-Yao Lee , Lexin Li

3D action recognition was shown to benefit from a covariance representation of the input data (joint 3D positions). A kernel machine feed with such feature is an effective paradigm for 3D action recognition, yielding state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2017-10-05 Jacopo Cavazza , Pietro Morerio , Vittorio Murino

We consider estimation of the parameters of a Gaussian Stochastic Process (GaSP), in the context of emulation (approximation) of computer models for which the outcomes are real-valued scalars. The main focus is on estimation of the GaSP…

Statistics Theory · Mathematics 2017-08-17 Mengyang Gu , Xiaojing Wang , James O. Berger

We obtain upper bounds for the estimation error of Kernel Ridge Regression (KRR) for all non-negative regularization parameters, offering a geometric perspective on various phenomena in KRR. As applications: 1. We address the multiple…

Statistics Theory · Mathematics 2024-10-10 Georgios Gavrilopoulos , Guillaume Lecué , Zong Shang