English
Related papers

Related papers: Analysis and Extension of Arc-Cosine Kernels for L…

200 papers

For supervised and unsupervised learning, positive definite kernels allow to use large and potentially infinite dimensional feature spaces with a computational cost that only depends on the number of observations. This is usually done…

Machine Learning · Computer Science 2008-09-10 Francis Bach

In this paper we show the similarities and differences of two deep neural networks by comparing the manifolds composed of activation vectors in each fully connected layer of them. The main contribution of this paper includes 1) a new data…

Machine Learning · Computer Science 2018-01-23 Tao Yu , Huan Long , John E. Hopcroft

Recent research in the theory of overparametrized learning has sought to establish generalization guarantees in the interpolating regime. Such results have been established for a few common classes of methods, but so far not for ensemble…

Machine Learning · Statistics 2022-05-20 Yutong Wang , Clayton D. Scott

The success of kernel-based learning methods depend on the choice of kernel. Recently, kernel learning methods have been proposed that use data to select the most appropriate kernel, usually by combining a set of base kernels. We introduce…

Machine Learning · Computer Science 2011-12-21 Arash Afkanpour , Csaba Szepesvari , Michael Bowling

Gaussian Radial Basis Function (RBF) Kernels are the most-often-employed kernels in artificial intelligence and machine learning routines for providing optimally-best results in contrast to their respective counter-parts. However, a little…

Machine Learning · Computer Science 2023-12-19 Himanshu Singh

Group equivariant convolutional neural networks (G-CNNs) have been successfully applied in geometric deep learning. Typically, G-CNNs have the advantage over CNNs that they do not waste network capacity on training symmetries that should…

Machine Learning · Computer Science 2023-04-04 Gijs Bellaard , Daan L. J. Bon , Gautam Pai , Bart M. N. Smets , Remco Duits

Learning the kernel functions used in kernel methods has been a vastly explored area in machine learning. It is now widely accepted that to obtain 'good' performance, learning a kernel function is the key challenge. In this work we focus on…

Machine Learning · Computer Science 2016-01-08 Chetan Tonde , Ahmed Elgammal

We study some properties of smoothing kernels and their local expression as they appear in the construction of Colombeau-type generalized function algebras which are diffeomorphism invariant.

Functional Analysis · Mathematics 2016-04-12 Eduard A. Nigsch

Indefinite inner product spaces of entire functions and functions analytic inside a disk are considered and their completeness studied. Spaces induced by the rotation invariant reproducing kernels in the form of the generalized…

Complex Variables · Mathematics 2007-05-23 Dmitry B. Karp

Kernel methods approximate nonlinear maps in a data-driven manner by projecting the target map onto a finite-dimensional Hilbert space called the solution space. Traditionally, this space is a subspace of a fixed ambient reproducing kernel…

Numerical Analysis · Mathematics 2026-01-30 Tamás Dózsa , Andrea Angino , Zoltán Szabó , József Bokor , Matthias Voigt

Quantum kernel methods have emerged as a promising approach for leveraging high-dimensional feature spaces in machine learning, particularly in domains where classical kernel methods face scalability limitations. In this work, we present…

Quantum Physics · Physics 2026-05-19 A. Delilbasic , A. Miroszewski , A. Wijata , J. Nalepa , J. Mielczarek , M. Riedel , G. Cavallaro

We consider frames F in a given Hilbert space, and we show that every F may be obtained in a constructive way from a reproducing kernel and an orthonormal basis in an ambient Hilbert space. The construction is operator-theoretic, building…

Classical Analysis and ODEs · Mathematics 2007-05-23 Palle E. T. Jorgensen

Kernel-based methods in Numerical Analysis have the advantage of yielding optimal recovery processes in the "native" Hilbert space $\calh$ in which they are reproducing. Continuous kernels on compact domains have an expansion into…

Numerical Analysis · Mathematics 2018-10-09 Gabriele Santin , Robert Schaback

Starting with a similarity function between objects, it is possible to define a distance metric on pairs of objects, and more generally on probability distributions over them. These distance metrics have a deep basis in functional analysis,…

Computational Geometry · Computer Science 2011-03-15 Sarang Joshi , Raj Varma Kommaraju , Jeff M. Phillips , Suresh Venkatasubramanian

Generalizing previous work of Iwaniec, Luo, and Sarnak (2000), we use information from one-level density theorems to estimate the proportion of non-vanishing of $L$-functions in a family at a low-lying height on the critical line (measured…

Number Theory · Mathematics 2022-10-17 Emanuel Carneiro , Andrés Chirre , Micah B. Milinovich

This work is concerned with the kernel-based approximation of a complex-valued function from data, where the frequency response function of a partial differential equation in the frequency domain is of particular interest. In this setting,…

Computational Engineering, Finance, and Science · Computer Science 2024-11-26 Julien Bect , Niklas Georg , Ulrich Römer , Sebastian Schöps

Spectral clustering and diffusion maps are celebrated dimensionality reduction algorithms built on eigen-elements related to the diffusive structure of the data. The core of these procedures is the approximation of a Laplacian through a…

Machine Learning · Statistics 2023-02-15 Loucas Pillaud-Vivien , Francis Bach

We investigate the question of studying spectral clustering in a Hilbert space where the set of points to cluster are drawn i.i.d. according to an unknown probability distribution whose support is a union of compact connected components. We…

Statistics Theory · Mathematics 2016-06-22 Ilaria Giulini

Representations of probability measures in reproducing kernel Hilbert spaces provide a flexible framework for fully nonparametric hypothesis tests of independence, which can capture any type of departure from independence, including…

Computation · Statistics 2018-06-11 Qinyi Zhang , Sarah Filippi , Arthur Gretton , Dino Sejdinovic

We introduce the loss kernel, an interpretability method for measuring similarity between data points according to a trained neural network. The kernel is the covariance matrix of per-sample losses computed under a distribution of…

Machine Learning · Computer Science 2025-10-01 Maxwell Adam , Zach Furman , Jesse Hoogland