English
Related papers

Related papers: Extrinsic Kernel Ridge Regression Classifier for P…

200 papers

We derive improved regression and classification rates for support vector machines using Gaussian kernels under the assumption that the data has some low-dimensional intrinsic structure that is described by the box-counting dimension. Under…

Statistics Theory · Mathematics 2021-04-08 Thomas Hamm , Ingo Steinwart

This paper shows that gradient boosting based on symmetric decision trees can be equivalently reformulated as a kernel method that converges to the solution of a certain Kernel Ridge Regression problem. Thus, we obtain the convergence to a…

Machine Learning · Computer Science 2023-03-14 Aleksei Ustimenko , Artem Beliakov , Liudmila Prokhorenkova

We implement an all-optical setup demonstrating kernel-based quantum machine learning for two-dimensional classification problems. In this hybrid approach, kernel evaluations are outsourced to projective measurements on suitably designed…

Kernel methods have been extensively utilized in machine learning for classification and prediction tasks due to their ability to capture complex non-linear data patterns. However, single kernel approaches are inherently limited, as they…

Machine Learning · Computer Science 2026-02-12 Qiyuan Shi , Jian Kang , Yi Li

Topological data analysis (TDA) is an emerging mathematical concept for characterizing shapes in complex data. In TDA, persistence diagrams are widely recognized as a useful descriptor of data, and can distinguish robust and noisy…

Algebraic Topology · Mathematics 2016-04-27 Genki Kusano , Kenji Fukumizu , Yasuaki Hiraoka

The kernel matrix used in kernel methods encodes all the information required for solving complex nonlinear problems defined on data representations in the input space using simple, but implicitly defined, solutions. Spectral analysis on…

Machine Learning · Computer Science 2020-10-26 Alexandros Iosifidis

We propose estimators based on kernel ridge regression for nonparametric causal functions such as dose, heterogeneous, and incremental response curves. Treatment and covariates may be discrete or continuous in general spaces. Due to a…

Econometrics · Economics 2022-10-25 Rahul Singh , Liyuan Xu , Arthur Gretton

In nonparametric regression, it is common for the inputs to fall in a restricted subset of Euclidean space. Typical kernel-based methods that do not take into account the intrinsic geometry of the domain across which observations are…

Methodology · Statistics 2021-11-04 David B Dunson , Hau-Tieng Wu , Nan Wu

Graph kernels methods are based on an implicit embedding of graphs within a vector space of large dimension. This implicit embedding allows to apply to graphs methods which where until recently solely reserved to numerical data. Within the…

Computer Vision and Pattern Recognition · Computer Science 2008-10-21 François-Xavier Dupé , Luc Brun

Learning with kernels is an important concept in machine learning. Standard approaches for kernel methods often use predefined kernels that require careful selection of hyperparameters. To mitigate this burden, we propose in this paper a…

Machine Learning · Computer Science 2020-06-26 Yufan Zhou , Changyou Chen , Jinhui Xu

We address the problem of fitting parametric curves on the Grassmann manifold for the purpose of intrinsic parametric regression. As customary in the literature, we start from the energy minimization formulation of linear least-squares in…

Computer Vision and Pattern Recognition · Computer Science 2015-05-15 Yi Hong , Nikhil Singh , Roland Kwitt , Nuno Vasconcelos , Marc Niethammer

This paper proposes an extension of Random Projection Depth (RPD) to cope with multiple modalities and non-convexity on data clouds. In the framework of the proposed method, the RPD is computed in a reproducing kernel Hilbert space. With…

Machine Learning · Statistics 2023-09-07 Akira Tamamori

Existing statistical learning guarantees for general kernel regressors often yield loose bounds when used with finite-rank kernels. Yet, finite-rank kernels naturally appear in several machine learning problems, e.g.\ when fine-tuning a…

Machine Learning · Computer Science 2023-10-04 Tin Sum Cheng , Aurelien Lucchi , Ivan Dokmanić , Anastasis Kratsios , David Belius

Kernel methods are fundamental tools in machine learning that allow detection of non-linear dependencies between data without explicitly constructing feature vectors in high dimensional spaces. A major disadvantage of kernel methods is…

Data Structures and Algorithms · Computer Science 2020-12-23 Thomas D. Ahle , Michael Kapralov , Jakob B. T. Knudsen , Rasmus Pagh , Ameya Velingker , David Woodruff , Amir Zandieh

Topological data analysis offers a rich source of valuable information to study vision problems. Yet, so far we lack a theoretically sound connection to popular kernel-based learning techniques, such as kernel SVMs or kernel PCA. In this…

Machine Learning · Statistics 2014-12-24 Jan Reininghaus , Stefan Huber , Ulrich Bauer , Roland Kwitt

This paper establishes a kernel-based framework for reconstructing data on manifolds, tailored to fit the dynamic-(d)MRI-data recovery problem. The proposed methodology exploits simple tangent-space geometries of manifolds in reproducing…

Machine Learning · Computer Science 2020-02-28 Gaurav N. Shetty , Konstantinos Slavakis , Ukash Nakarmi , Gesualdo Scutari , Leslie Ying

We develop methods for constructing and computing conformal invariants of submanifolds, with a particular emphasis on conformal submanifold scalars and conformally invariant integrals of natural submanifold scalars. These methods include a…

Differential Geometry · Mathematics 2026-04-10 Jeffrey S. Case , Ayush Khaitan , Yueh-Ju Lin , Aaron J. Tyrrell , Wei Yuan

A fundamental task in data exploration is to extract simplified low dimensional representations that capture intrinsic geometry in data, especially for faithfully visualizing data in two or three dimensions. Common approaches to this task…

Machine Learning · Statistics 2021-07-30 Andrés F. Duque , Sacha Morin , Guy Wolf , Kevin R. Moon

This paper presents a parametric family of compactly-supported positive semidefinite kernels aimed to model the covariance structure of second-order stationary isotropic random fields defined in the $d$-dimensional Euclidean space. Both the…

Statistics Theory · Mathematics 2021-01-26 Xavier Emery , Alfredo Alegría

We consider a Gaussian process formulation of the multiple kernel learning problem. The goal is to select the convex combination of kernel matrices that best explains the data and by doing so improve the generalisation on unseen data.…

Machine Learning · Statistics 2011-10-25 Cedric Archambeau , Francis Bach