English
Related papers

Related papers: Inner-product Kernels are Asymptotically Equivalen…

200 papers

Domain specific (dis-)similarity or proximity measures used e.g. in alignment algorithms of sequence data, are popular to analyze complex data objects and to cover domain specific data properties. Without an underlying vector space these…

Data Structures and Algorithms · Computer Science 2014-11-07 Andrej Gisbrecht , Frank-Michael Schleif

The kernel trick concept, formulated as an inner product in a feature space, facilitates powerful extensions to many well-known algorithms. While the kernel matrix involves inner products in the feature space, the sample covariance matrix…

Computation · Statistics 2017-07-20 Tomer Lancewicki

This paper proposes a new nonlinear approach for additive functional regression with functional response based on kernel methods along with some slight reformulation and implementation of the linear regression and the spectral additive…

Kernel methods form a theoretically-grounded, powerful and versatile framework to solve nonlinear problems in signal processing and machine learning. The standard approach relies on the \emph{kernel trick} to perform pairwise evaluations of…

Machine Learning · Computer Science 2020-01-03 Kan Li , Jose C. Principe

Many recent works have studied the eigenvalue spectrum of the Conjugate Kernel (CK) defined by the nonlinear feature map of a feedforward neural network. However, existing results only establish weak convergence of the empirical eigenvalue…

Machine Learning · Statistics 2024-02-16 Zhichao Wang , Denny Wu , Zhou Fan

Let $f$ be the $\mathbb{F}_q$-linear map over $\mathbb{F}_{q^{2n}}$ defined by $x\mapsto x+ax^{q^s}+bx^{q^{n+s}}$ with $\gcd(n,s)=1$. It is known that the kernel of $f$ has dimension at most $2$, as proved by Csajb\'ok et al. in "A new…

Combinatorics · Mathematics 2020-04-23 Olga Polverino , Giovanni Zini , Ferdinando Zullo

The kernel trick is a widely applicable technique in machine learning domains that maps datasets that are difficult to classify into a computationally friendly feature space. As the dimension of the dataset scales, these kernel calculations…

Quantum Physics · Physics 2025-12-15 Collin C. D. Frink , Chaoyang Ti , Stephen K. Gray , Xu Han , Matthew Otten

In this paper, we present a kernel subspace clustering method that can handle non-linear models. In contrast to recent kernel subspace clustering methods which use predefined kernels, we propose to learn a low-rank kernel matrix, with which…

Computer Vision and Pattern Recognition · Computer Science 2019-01-28 Pan Ji , Ian Reid , Ravi Garg , Hongdong Li , Mathieu Salzmann

Kernels are often developed and used as implicit mapping functions that show impressive predictive power due to their high-dimensional feature space representations. In this study, we gradually construct a series of simple feature maps that…

Machine Learning · Computer Science 2020-07-20 Gurhan Ceylan , S. Ilker Birbil

In this paper we study the asymptotic behaviour of the spectral function corresponding to the lower part of the spectrum of the Kodaira Laplacian on high tensor powers of a holomorphic line bundle. This implies a full asymptotic expansion…

Complex Variables · Mathematics 2014-04-18 Chin-Yu Hsiao , George Marinescu

In this article, we prove that k-dimensional spherical integrals are asymptotically equivalent to the product of 1-dimensional spherical integrals. This allows us to generalize several large deviations principles in random matrix theory…

Probability · Mathematics 2023-04-12 Alice Guionnet , Jonathan Husson

Kernel methods in machine learning use a kernel function that takes two data points as input and returns their inner product after mapping them to a Hilbert space, implicitly and without actually computing the mapping. For many kernel…

Machine Learning · Computer Science 2024-10-17 Kamaledin Ghiasi-Shirazi , Mohammadreza Qaraei

A symmetric pseudo-Boolean function is a map from Boolean tuples to real numbers which is invariant under input variable interchange. We prove that any such function can be equivalently expressed as a power series or factorized. The kernel…

Combinatorics · Mathematics 2023-08-23 Richik Sengupta , Jacob Biamonte

Sample correlation matrices are employed ubiquitously in statistics. However, quite surprisingly, little is known about their asymptotic spectral properties for high-dimensional data, particularly beyond the case of "null models" for which…

Statistics Theory · Mathematics 2019-03-13 David Morales-Jimenez , Iain M. Johnstone , Matthew R. McKay , Jeha Yang

Any sequence of uniformly bounded $N\times N$ Hermitian Toeplitz matrices $\{\boldsymbol{H}_N\}$ is asymptotically equivalent to a certain sequence of $N\times N$ circulant matrices $\{\boldsymbol{C}_N\}$ derived from the Toeplitz matrices…

Information Theory · Computer Science 2017-02-24 Zhihui Zhu , Michael B. Wakin

We use the steepest descents method to study the integral kernel of a family of normal random matrix ensembles with eigenvalue distribution P_{N}(z_{1},...,z_{N}) = Z_{N}^{-1} e^{-N\Sigma_{i=1}^{N}V_{\alpha}(z_{i})}…

Mathematical Physics · Physics 2015-05-28 Alexei M. Veneziani , Tiago Pereira , Domingos H. U. Marchetti

Let $\xi_1,\xi_2,...$ be independent identically distributed random variables and $F:\bbR^\ell\to SL_d(\bbR)$ be a Borel measurable matrix-valued function. Set $X_n=F(\xi_{q_1(n)},\xi_{q_2(n)},...,\xi_{q_\ell(n)})$ where $0\leq…

Probability · Mathematics 2018-12-18 Yuri Kifer , Sasha Sodin

We show that kernel-based quadrature rules for computing integrals can be seen as a special case of random feature expansions for positive definite kernels, for a particular decomposition that always exists for such kernels. We provide a…

Machine Learning · Computer Science 2015-11-10 Francis Bach

We present a novel attention-based model for discrete event data to capture complex non-linear temporal dependence structures. We borrow the idea from the attention mechanism and incorporate it into the point processes' conditional…

Machine Learning · Statistics 2021-02-23 Shixiang Zhu , Minghe Zhang , Ruyi Ding , Yao Xie

Functional regression is very crucial in functional data analysis and a linear relationship between scalar response and functional predictor is often assumed. However, the linear assumption may not hold in practice, which makes the methods…

Methodology · Statistics 2023-01-18 Rou Zhong , Dongxue Wang , Jingxiao Zhang