English
Related papers

Related papers: A Spectral Analysis of Dot-product Kernels

200 papers

We utilize a connection between compositional kernels and branching processes via Mehler's formula to study deep neural networks. This new probabilistic insight provides us a novel perspective on the mathematical role of activation…

Machine Learning · Statistics 2021-01-20 Tengyuan Liang , Hai Tran-Bach

Approximating non-linear kernels using feature maps has gained a lot of interest in recent years due to applications in reducing training and testing times of SVM classifiers and other kernel based learning algorithms. We extend this line…

Machine Learning · Computer Science 2015-03-20 Purushottam Kar , Harish Karnick

This work is concerned with the kernel-based approximation of a complex-valued function from data, where the frequency response function of a partial differential equation in the frequency domain is of particular interest. In this setting,…

Computational Engineering, Finance, and Science · Computer Science 2024-11-26 Julien Bect , Niklas Georg , Ulrich Römer , Sebastian Schöps

Recent studies have reported $\textit{saturation effects}$ and $\textit{multiple descent behavior}$ in large dimensional kernel ridge regression (KRR). However, these findings are predominantly derived under restrictive settings, such as…

Machine Learning · Statistics 2026-05-15 Yang Zhou , Yicheng Li , Yuqian Cheng , Qian Lin

We consider autocovariance operators of a stationary stochastic process on a Polish space that is embedded into a reproducing kernel Hilbert space. We investigate how empirical estimates of these operators converge along realizations of the…

Probability · Mathematics 2023-08-08 Mattes Mollenhauer , Stefan Klus , Christof Schütte , Péter Koltai

In this paper, we give some results concerning atomic decompositions for operators on reproducing kernel Hilbert spaces, using frame theory techniques. We provide also generalizations for atomic decompositions of some theorems for…

Functional Analysis · Mathematics 2014-02-03 Laura Gavruta

Based on direct integrals, a framework allowing to integrate a parametrised family of reproducing kernels with respect to some measure on the parameter space is developed. By pointwise integration, one obtains again a reproducing kernel…

Functional Analysis · Mathematics 2012-02-21 Thomas Hotz , Fabian J. E. Telschow

The discrete kernel method was developed to estimate count data distributions, distinguishing discrete associated kernels based on their asymptotic behaviour. This study investigates the class of discrete asymmetric kernels and their…

Methodology · Statistics 2017-02-07 Tristan Senga Kiessé

Reproducing kernel Hilbert spaces (RKHSs) play an important role in many statistics and machine learning applications ranging from support vector machines to Gaussian processes and kernel embeddings of distributions. Operators acting on…

Functional Analysis · Mathematics 2021-04-06 Mattes Mollenhauer , Ingmar Schuster , Stefan Klus , Christof Schütte

We study a reproducing kernel Hilbert space of functions defined on the positive integers and associated to the binomial coefficients. We introduce two transforms, which allow us to develop a related harmonic analysis in this Hilbert space.…

Complex Variables · Mathematics 2014-12-19 Daniel Alpay , Palle Jorgensen

We study infinite products of reproducing kernels with view to their use in dynamics (of iterated function systems), in harmonic analysis, and in stochastic processes. On the way, we construct a new family of representations of the Cuntz…

Functional Analysis · Mathematics 2013-01-22 D. Alpay , P. Jorgensen , I. Lewkowicz , I. Martziano

In this paper, we will derive the first and 2nd order Wiener chaos decomposition for the multivariate linear statistics of the determinantal point processes associated with the spectral projection kernels on the unit spheres $S^d$. We will…

Probability · Mathematics 2023-01-24 Renjie Feng , Friedrich Götze , Dong Yao

In this paper, we study composition operators on Hilbert space of complex-valued harmonic functions. In particular, we explore isometries, the type of self-map that generate bounded composition operator, and characterize the boundedness of…

Functional Analysis · Mathematics 2025-03-14 Tseganesh Getachew Gebrehana , Hunduma Legesse Geleta

We give analytical expressions for the eigenvalues and generalized eigenfunctions of $\hat{T}_3$, the $z$-axis projection of the toroidal dipole operator, in a system consisting of a particle confined in a thin film bent into a torus shape.…

Quantum Physics · Physics 2023-01-04 Dragos-Victor Anghel , Mircea Dolineanu

We study kernel functions of L-functions and products of L-functions of Hilbert cusp forms over real quadratic fields. This extends the results on elliptic modualr forms by Diamantis and C. O'Sullivan. .

Number Theory · Mathematics 2019-05-08 Y. Choie , Y. Zhang

In this paper, we discuss the convergence analysis of the conjugate gradient-based algorithm for the functional linear model in the reproducing kernel Hilbert space framework, utilizing early stopping results in regularization against…

Statistics Theory · Mathematics 2023-10-05 Naveen Gupta , S. Sivananthan , Bharath K. Sriperumbudur

We consider the analysis of probability distributions through their associated covariance operators from reproducing kernel Hilbert spaces. We show that the von Neumann entropy and relative entropy of these operators are intimately related…

Information Theory · Computer Science 2022-08-29 Francis Bach

Our basic structure is a finite-dimensional complex Hilbert space $H$. We point out that the set of effects on $H$ form a convex effect algebra. Although the set of operators on $H$ also form a convex effect algebra, they have a more…

Quantum Physics · Physics 2021-08-19 Stan Gudder

Dot product kernels, such as polynomial and exponential (softmax) kernels, are among the most widely used kernels in machine learning, as they enable modeling the interactions between input features, which is crucial in applications like…

Machine Learning · Statistics 2024-08-14 Jonas Wacker , Motonobu Kanagawa , Maurizio Filippone

We introduce a vector differential operator $\mathbf{P}$ and a vector boundary operator $\mathbf{B}$ to derive a reproducing kernel along with its associated Hilbert space which is shown to be embedded in a classical Sobolev space. This…

Numerical Analysis · Mathematics 2011-09-28 Gregory E. Fasshauer , Qi Ye