English
Related papers

Related papers: Extrinsic Kernel Ridge Regression Classifier for P…

200 papers

We introduce a novel concept of coarse extrinsic curvature for Riemannian submanifolds, inspired by Ollivier's notion of coarse Ricci curvature. This curvature is derived from the Wasserstein 1-distance between probability measures…

Differential Geometry · Mathematics 2025-04-11 Marc Arnaudon , Xue-Mei Li , Benedikt Petko

Many machine learning problems can be formulated as predicting labels for a pair of objects. Problems of that kind are often referred to as pairwise learning, dyadic prediction or network inference problems. During the last decade kernel…

Machine Learning · Statistics 2018-03-06 Michiel Stock , Tapio Pahikkala , Antti Airola , Bernard De Baets , Willem Waegeman

This work presents a family of parsimonious Gaussian process models which allow to build, from a finite sample, a model-based classifier in an infinite dimensional space. The proposed parsimonious models are obtained by constraining the…

Methodology · Statistics 2012-06-18 Charles Bouveyron , Stéphane Girard , Mathieu Fauvel

This paper develops a novel mathematical framework for collaborative learning by means of geometrically inspired kernel machines which includes statements on the bounds of generalisation and approximation errors, and sample complexity. For…

We consider kernel methods on general geodesic metric spaces and provide both negative and positive results. First we show that the common Gaussian kernel can only be generalized to a positive definite kernel on a geodesic metric space if…

Machine Learning · Computer Science 2014-11-18 Aasa Feragen , Francois Lauze , Søren Hauberg

In this work, we propose a simple kernel ridge regression (KRR) framework with a dynamic-aware validation strategy for long-term prediction of complex dynamical systems. By employing a data-driven kernel derived from diffusion maps, the…

Machine Learning · Computer Science 2025-12-30 Jiwoo Song , Daning Huang , John Harlim

Quantum kernel methods are a promising branch of quantum machine learning, yet their effectiveness on diverse, high-dimensional, real-world data remains unverified. Current research has largely been limited to low-dimensional or synthetic…

Machine Learning · Computer Science 2026-02-19 Jiang Yuhan , Matthew Otten

Scaling analysis, in which one infers scaling exponents and a scaling function in a scaling law from given data, is a powerful tool for determining universal properties of critical phenomena in many fields of science. However, there are…

Statistical Mechanics · Physics 2015-07-08 Kenji Harada

Kernel methods are an incredibly popular technique for extending linear models to non-linear problems via a mapping to an implicit, high-dimensional feature space. While kernel methods are computationally cheaper than an explicit feature…

Machine Learning · Statistics 2019-02-26 Philip Milton , Emanuele Giorgi , Samir Bhatt

Many of the tools available for robot learning were designed for Euclidean data. However, many applications in robotics involve manifold-valued data. A common example is orientation; this can be represented as a 3-by-3 rotation matrix or a…

Robotics · Computer Science 2024-05-15 P. C. Lopez-Custodio , K. Bharath , A. Kucukyilmaz , S. P. Preston

This paper presents a method for building a preconditioner for a kernel ridge regression problem, where the preconditioner is not only effective in its ability to reduce the condition number substantially, but also efficient in its…

Numerical Analysis · Mathematics 2021-04-07 Gil Shabat , Era Choshen , Dvir Ben Or , Nadav Carmel

In this work, we investigate high-dimensional kernel ridge regression (KRR) on i.i.d. Gaussian data with anisotropic power-law covariance. This setting differs fundamentally from the classical source & capacity conditions for KRR, where…

Machine Learning · Statistics 2025-10-07 Arie Wortsman , Bruno Loureiro

In this article a surprising result is demonstrated using the neural tangent kernel. This kernel is defined as the inner product of the vector of the gradient of an underlying model evaluated at training points. This kernel is used to…

Artificial Intelligence · Computer Science 2021-04-14 Matt Calder

Kernel ridge regression, KRR, is a generalization of linear ridge regression that is non-linear in the data, but linear in the model parameters. Here, we introduce an equivalent formulation of the objective function of KRR, which opens up…

Machine Learning · Statistics 2025-03-10 Oskar Allerbo

We propose a new method for input variable selection in nonlinear regression. The method is embedded into a kernel regression machine that can model general nonlinear functions, not being a priori limited to additive models. This is the…

Machine Learning · Computer Science 2018-09-05 Magda Gregorová , Jason Ramapuram , Alexandros Kalousis , Stéphane Marchand-Maillet

This paper investigates the formulation and implementation of Bayesian inverse problems to learn input parameters of partial differential equations (PDEs) defined on manifolds. Specifically, we study the inverse problem of determining the…

Numerical Analysis · Mathematics 2019-10-24 John Harlim , Daniel Sanz-Alonso , Ruiyi Yang

A brain can detect outlier just by using only normal samples. Similarly, one-class classification (OCC) also uses only normal samples to train the model and trained model can be used for outlier detection. In this paper, a multi-layer…

Machine Learning · Computer Science 2019-04-16 Chandan Gautam , Aruna Tiwari , M. Tanveer

This paper is an attempt to bridge the conceptual gaps between researchers working on the two widely used approaches based on positive definite kernels: Bayesian learning or inference using Gaussian processes on the one side, and…

Machine Learning · Statistics 2018-07-10 Motonobu Kanagawa , Philipp Hennig , Dino Sejdinovic , Bharath K Sriperumbudur

This paper introduces Kernel-based Information Criterion (KIC) for model selection in regression analysis. The novel kernel-based complexity measure in KIC efficiently computes the interdependency between parameters of the model using a…

Machine Learning · Statistics 2014-12-16 Somayeh Danafar , Kenji Fukumizu , Faustino Gomez

Due to its promising classification performance, sparse representation based classification(SRC) algorithm has attracted great attention in the past few years. However, the existing SRC type methods apply only to vector data in Euclidean…

Computer Vision and Pattern Recognition · Computer Science 2016-01-28 Ming Yin , Shengli Xie , Yi Guo , Junbin Gao , Yun Zhang