English
Related papers

Related papers: Spectral alignment of kernel matrices and applicat…

200 papers

In this paper we show how specific families of positive definite kernels serve as powerful tools in analyses of iteration algorithms for multiple layer feedforward Neural Network models. Our focus is on particular kernels that adapt well to…

Machine Learning · Computer Science 2023-01-09 Palle E. T. Jorgensen , Myung-Sin Song , James Tian

We study the hermitian one matrix model with semi-classical potential. This is a general unitary invariant random matrix ensemble in which the potential has a derivative that is a rational function and the measure is supported on some…

Mathematical Physics · Physics 2015-04-20 Max R. Atkin

A spectral mixture (SM) kernel is a flexible kernel used to model any stationary covariance function. Although it is useful in modeling data, the learning of the SM kernel is generally difficult because optimizing a large number of…

Machine Learning · Statistics 2020-06-15 Yohan Jung , Kyungwoo Song , Jinkyoo Park

We study fast algorithms for computing fundamental properties of a positive semidefinite kernel matrix $K \in \mathbb{R}^{n \times n}$ corresponding to $n$ points $x_1,\ldots,x_n \in \mathbb{R}^d$. In particular, we consider estimating the…

Data Structures and Algorithms · Computer Science 2021-06-21 Arturs Backurs , Piotr Indyk , Cameron Musco , Tal Wagner

Spectral risk measures (SRMs) belong to the family of coherent risk measures. A natural estimator for the class of SRMs has the form of L-statistics. Various authors have studied and derived the asymptotic properties of the empirical…

Statistical Finance · Quantitative Finance 2023-12-11 Suparna Biswas , Rituparna Sen

Spectral kernel methods are techniques for transforming data into a coordinate system that efficiently reveals the geometric structure - in particular, the "connectivity" - of the data. These methods depend on certain tuning parameters. We…

Methodology · Statistics 2008-11-04 Ann B. Lee , Larry Wasserman

A kernel based procedure for correcting experimental data for distortions due to the finite resolution and limited detector acceptance is presented. The unfolding problem is known to be an ill-posed problem that can not be solved without…

Data Analysis, Statistics and Probability · Physics 2012-09-19 N. D. Gagunashvili , M. Schmelling

We introduce a kernel method for manifold alignment (KEMA) and domain adaptation that can match an arbitrary number of data sources without needing corresponding pairs, just few labeled examples in all domains. KEMA has interesting…

Machine Learning · Statistics 2016-04-04 Devis Tuia , Gustau Camps-Valls

Kernel methods are a cornerstone of classical machine learning. The idea of using quantum computers to compute kernels has recently attracted attention. Quantum embedding kernels (QEKs) constructed by embedding data into the Hilbert space…

Robust stability problem of integral delay systems with uncertain kernel matrix functions is addressed in this paper. On the basis of characteristic equation and the argument principle, an algorithm is generated which is shown to outperform…

Systems and Control · Electrical Eng. & Systems 2020-08-25 Hamed Taghavian

Kernel smoothers are considered near the boundary of the interval. Kernels which minimize the expected mean square error are derived. These kernels are equivalent to using a linear weighting function in the local polynomial regression. It…

Methodology · Statistics 2019-12-03 Alexander Sidorenko , Kurt S. Riedel

Kernel methods are a popular class of nonlinear predictive models in machine learning. Scalable algorithms for learning kernel models need to be iterative in nature, but convergence can be slow due to poor conditioning. Spectral…

Machine Learning · Statistics 2024-01-26 Amirhesam Abedsoltan , Parthe Pandit , Luis Rademacher , Mikhail Belkin

The family of Mat\'ern kernels are often used in spatial statistics, function approximation and Gaussian process methods in machine learning. One reason for their popularity is the presence of a smoothness parameter that controls, for…

Statistics Theory · Mathematics 2025-06-06 Moritz Korte-Stapff , Toni Karvonen , Eric Moulines

Domain specific (dis-)similarity or proximity measures used e.g. in alignment algorithms of sequence data, are popular to analyze complex data objects and to cover domain specific data properties. Without an underlying vector space these…

Data Structures and Algorithms · Computer Science 2014-11-07 Andrej Gisbrecht , Frank-Michael Schleif

This article establishes sharp inverse and saturation statements for kernel-based approximation using finitely smooth Sobolev kernels on bounded Lipschitz regions. The analysis focuses on the superconvergence regime, for which direct…

Numerical Analysis · Mathematics 2026-01-06 Tizian Wenzel

Applying kernel methods to matchings is challenging due to their discrete, non-Euclidean nature. In this paper, we develop a principled framework for constructing geometric kernels that respect the natural geometry of the space of…

Machine Learning · Computer Science 2026-04-17 Dmitry Eremeev , Salem Said , Viacheslav Borovitskiy

We consider the problem of improving kernel approximation via randomized feature maps. These maps arise as Monte Carlo approximation to integral representations of kernel functions and scale up kernel methods for larger datasets. Based on…

Machine Learning · Computer Science 2018-10-31 Marina Munkhoeva , Yermek Kapushev , Evgeny Burnaev , Ivan Oseledets

Computing the eigenvectors and eigenvalues of a perturbed matrix can be remarkably difficult when the unperturbed matrix has repeated eigenvalues. In this work we show how the limiting eigenvectors and eigenvalues of a symmetric matrix…

Numerical Analysis · Mathematics 2025-07-08 Konstantin Usevich , Simon Barthelme

Kernel methods are an extremely popular set of techniques used for many important machine learning and data analysis applications. In addition to having good practical performances, these methods are supported by a well-developed theory.…

Machine Learning · Statistics 2015-04-23 Shiva Prasad Kasiviswanathan , Mark Rudelson

In recent years, quantum computers have emerged as promising candidates for implementing kernels. Quantum Embedding Kernels embed data points into quantum states and calculate their inner product in a high-dimensional Hilbert Space by…

Quantum Physics · Physics 2025-02-13 Rodrigo Coelho , Georg Kruse , Andreas Rosskopf