English
Related papers

Related papers: Comparing Distributions and Shapes using the Kerne…

200 papers

This work builds a unified framework for the study of quadratic form distance measures as they are used in assessing the goodness of fit of models. Many important procedures have this structure, but the theory for these methods is dispersed…

Statistics Theory · Mathematics 2008-12-18 Bruce G. Lindsay , Marianthi Markatou , Surajit Ray , Ke Yang , Shu-Chuan Chen

We prove that kernel covariance embeddings lead to information-theoretically perfect separation of distinct continuous probability distributions. In statistical terms, we establish that testing for the \emph{equality} of two non-atomic…

Machine Learning · Statistics 2026-05-14 Leonardo V. Santoro , Kartik G. Waghmare , Victor M. Panaretos

We obtain upper bounds for the estimation error of Kernel Ridge Regression (KRR) for all non-negative regularization parameters, offering a geometric perspective on various phenomena in KRR. As applications: 1. We address the multiple…

Statistics Theory · Mathematics 2024-10-10 Georgios Gavrilopoulos , Guillaume Lecué , Zong Shang

Kernel methods, being supported by a well-developed theory and coming with efficient algorithms, are among the most popular and successful machine learning techniques. From a mathematical point of view, these methods rest on the concept of…

Machine Learning · Statistics 2023-03-20 Christian Fiedler , Michael Herty , Michael Rom , Chiara Segala , Sebastian Trimpe

This paper develops a novel mathematical framework for collaborative learning by means of geometrically inspired kernel machines which includes statements on the bounds of generalisation and approximation errors, and sample complexity. For…

Much recent work in bioinformatics has focused on the inference of various types of biological networks, representing gene regulation, metabolic processes, protein-protein interactions, etc. A common setting involves inferring network edges…

Quantitative Methods · Quantitative Biology 2007-05-23 Jean-Philippe Vert , Jian Qiu , William Stafford Noble

Object segmentation is a key component in the visual system of a robot that performs tasks like grasping and object manipulation, especially in presence of occlusions. Like many other computer vision tasks, the adoption of deep…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Federico Ceola , Elisa Maiettini , Giulia Pasquale , Lorenzo Rosasco , Lorenzo Natale

Most graph kernels are an instance of the class of $\mathcal{R}$-Convolution kernels, which measure the similarity of objects by comparing their substructures. Despite their empirical success, most graph kernels use a naive aggregation of…

Machine Learning · Computer Science 2019-10-31 Matteo Togninalli , Elisabetta Ghisu , Felipe Llinares-López , Bastian Rieck , Karsten Borgwardt

We present in this work a new methodology to design kernels on data which is structured with smaller components, such as text, images or sequences. This methodology is a template procedure which can be applied on most kernels on measures…

Machine Learning · Computer Science 2007-05-23 Marco Cuturi , Kenji Fukumizu

The relative similarity testing aims to determine which of the distributions, P or Q, is closer to an anchor distribution U. Existing kernel-based approaches often test the relative similarity with a fixed kernel in a manually specified…

Machine Learning · Computer Science 2025-10-14 Zhijian Zhou , Liuhua Peng , Xunye Tian , Feng Liu

Most machine learning algorithms, such as classification or regression, treat the individual data point as the object of interest. Here we consider extending machine learning algorithms to operate on groups of data points. We suggest…

Machine Learning · Computer Science 2021-01-15 Danica J. Sutherland , Liang Xiong , Barnabás Póczos , Jeff Schneider

The rate of convergence of weighted kernel herding (WKH) and sequential Bayesian quadrature (SBQ), two kernel-based sampling algorithms for estimating integrals with respect to some target probability measure, is investigated. Under…

Machine Learning · Statistics 2021-11-02 Rajiv Khanna , Liam Hodgkinson , Michael W. Mahoney

Testing the equality of two conditional distributions is crucial in various modern applications, including transfer learning and causal inference. Despite its importance, this fundamental problem has received surprisingly little attention…

Methodology · Statistics 2025-09-04 Jian Yan , Zhuoxi Li , Xianyang Zhang

A corpus of vector-embedded text documents has some empirical distribution. Given two corpora, we want to calculate a single metric of distance (e.g., Mauve, Frechet Inception) between them. We describe an abstract quality, called…

Computation and Language · Computer Science 2023-10-24 Samuel Ackerman , George Kour , Eitan Farchi

Depth measures are powerful tools for defining level sets in emerging, non--standard, and complex random objects such as high-dimensional multivariate data, functional data, and random graphs. Despite their favorable theoretical properties,…

Computing a consensus object from a set of given objects is a core problem in machine learning and pattern recognition. One popular approach is to formulate it as an optimization problem using the generalized median. Previous methods like…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Andreas Nienkötter , Xiaoyi Jiang

We give a dimensionality reduction procedure to approximate the sum of distances of a given set of $n$ points in $R^d$ to any "shape" that lies in a $k$-dimensional subspace. Here, by "shape" we mean any set of points in $R^d$. Our…

Data Structures and Algorithms · Computer Science 2021-06-25 Zhili Feng , Praneeth Kacham , David P. Woodruff

We describe new approaches for distances between pairs of 2-dimensional surfaces (embedded in 3-dimensional space) that use local structures and global information contained in inter-structure geometric relationships. We present algorithms…

Numerical Analysis · Mathematics 2015-05-30 D. Boyer , Y. Lipman , E. St. Clair , J. Puente , T. Funkhouser , B. Patel , J. Jernvall , I. Daubechies

The measures of distances between points in a Hilbert space are one of the basic theoretical concepts used to characterize properties of a quantum system with respect to some etalon state. These are not only used in studying fidelity of…

Quantum Physics · Physics 2019-04-03 Karol Bartkiewicz , Vojtěch Trávníček , Karel Lemr

Several important algorithms for machine learning and data analysis use pairwise distances as input. On Riemannian manifolds these distances may be prohibitively costly to compute, in particular for large datasets. To tackle this problem,…

Differential Geometry · Mathematics 2019-04-29 Philipp Harms , Elodie Maignant , Stefan Schlager