English
Related papers

Related papers: Adaptive Hyperbolic Kernels: Modulated Embedding i…

200 papers

This paper introduces a diagonal adaptive kernel model that dynamically learns kernel eigenvalues and output coefficients simultaneously during training. Unlike fixed-kernel methods tied to the neural tangent kernel theory, the diagonal…

Machine Learning · Computer Science 2025-01-16 Yicheng Li , Qian Lin

We study the relationships between a subvariety of the open unit ball in the complex $d$-dimensional space $\mathbb{C}^{d}$, the reproducing kernel Hilbert space (RKHS) obtained by restricting the Drury-Arveson space to the variety, and its…

Functional Analysis · Mathematics 2025-09-23 Yasin Watted

In this note, we describe the backward shift invariant subspaces for a large class of reproducing kernel Hilbert spaces. This class includes in particular de Branges-Rovnyak spaces (the non-extreme case) and the range space of co-analytic…

Functional Analysis · Mathematics 2019-04-08 Emmanuel Fricain , Javad Mashreghi , Rishika Rupam

We present several generative and predictive algorithms based on the RKHS (reproducing kernel Hilbert spaces) methodology, which, most importantly, are scale up efficiently with large datasets or high-dimensional data. It is well recognized…

Numerical Analysis · Mathematics 2024-12-12 Philippe G. LeFloch , Jean-Marc Mercier , Shohruh Miryusupov

Substring kernels are classical tools for representing biological sequences or text. However, when large amounts of annotated data are available, models that allow end-to-end training such as neural networks are often preferred. Links…

Machine Learning · Statistics 2019-10-18 Dexiong Chen , Laurent Jacob , Julien Mairal

Given a function $b$, holomorphic on the disc and bounded by 1, one can construct an associated reproducing kernel Hilbert space called the de Branges--Rovnyak space $H(b)$. We explore representations of such spaces via descriptions of the…

Complex Variables · Mathematics 2026-03-04 Eugenio Dellepiane , Daniel Seco

Reproducing kernel Hilbert spaces are elucidated without assuming prior familiarity with Hilbert spaces. Compared with extant pedagogic material, greater care is placed on motivating the definition of reproducing kernel Hilbert spaces and…

History and Overview · Mathematics 2015-11-06 Jonathan H. Manton , Pierre-Olivier Amblard

Many high-dimensional practical data sets have hierarchical structures induced by graphs or time series. Such data sets are hard to process in Euclidean spaces and one often seeks low-dimensional embeddings in other space forms to perform…

Machine Learning · Computer Science 2022-04-13 Chao Pan , Eli Chien , Puoya Tabaghi , Jianhao Peng , Olgica Milenkovic

This is a tutorial and survey paper on kernels, kernel methods, and related fields. We start with reviewing the history of kernels in functional analysis and machine learning. Then, Mercer kernel, Hilbert and Banach spaces, Reproducing…

Machine Learning · Statistics 2021-06-17 Benyamin Ghojogh , Ali Ghodsi , Fakhri Karray , Mark Crowley

Nonlocal operators with integral kernels have become a popular tool for designing solution maps between function spaces, due to their efficiency in representing long-range dependence and the attractive feature of being resolution-invariant.…

Machine Learning · Statistics 2022-05-24 Fei Lu , Qingci An , Yue Yu

Hyperbolic representation learning is well known for its ability to capture hierarchical information. However, the distance between samples from different levels of hierarchical classes can be required large. We reveal that the hyperbolic…

Machine Learning · Computer Science 2024-10-30 Kun Song , Ruben Solozabal , Li hao , Lu Ren , Moloud Abdar , Qing Li , Fakhri Karray , Martin Takac

Learning embeddings of entities and relations existing in knowledge bases allows the discovery of hidden patterns in data. In this work, we examine the geometrical space's contribution to the task of knowledge base completion. We focus on…

Computation and Language · Computer Science 2019-08-20 Prodromos Kolyvakis , Alexandros Kalousis , Dimitris Kiritsis

A method for learning Hamiltonian dynamics from a limited and noisy dataset is proposed. The method learns a Hamiltonian vector field on a reproducing kernel Hilbert space (RKHS) of inherently Hamiltonian vector fields, and in particular,…

Machine Learning · Computer Science 2024-11-05 Torbjørn Smith , Olav Egeland

Multiscale Models are known to be successful in uncovering and analyzing the structures in data at different resolutions. In the current work we propose a feature driven Reproducing Kernel Hilbert space (RKHS), for which the associated…

Machine Learning · Computer Science 2022-08-24 Prashant Shekhar , Abani Patra

Asymptotic expansions as well as necessary and sufficient conditions are provided for the pointwise convergence of the spherical partial integrals of the associated Fourier transforms on the real hyperbolic space. The proposed method…

Mathematical Physics · Physics 2020-05-25 Agapitos N. Hatzinikitas

This monograph develops a unified, application-driven framework for kernel methods grounded in reproducing kernel Hilbert spaces (RKHS) and optimal transport (OT). Part I lays the theoretical and numerical foundations on positive-definite…

Numerical Analysis · Mathematics 2025-10-07 Philippe G. LeFloch , Jean-Marc Mercier , Shohruh Miryusupov

We develop novel learning rates for conditional mean embeddings by applying the theory of interpolation for reproducing kernel Hilbert spaces (RKHS). We derive explicit, adaptive convergence rates for the sample estimator under the…

Machine Learning · Statistics 2026-04-09 Prem Talwai , Ali Shameli , David Simchi-Levi

Deep Learning is mostly responsible for the surge of interest in Artificial Intelligence in the last decade. So far, deep learning researchers have been particularly successful in the domain of image processing, where Convolutional Neural…

Machine Learning · Computer Science 2023-08-31 Andrii Skliar , Maurice Weiler

Hyperbolic spaces have recently gained momentum in the context of machine learning due to their high capacity and tree-likeliness properties. However, the representational power of hyperbolic geometry is not yet on par with Euclidean…

Machine Learning · Computer Science 2018-06-29 Octavian-Eugen Ganea , Gary Bécigneul , Thomas Hofmann

We analyse the convergence of sampling algorithms for functions in reproducing kernel Hilbert spaces (RKHS). To this end, we discuss approximation properties of kernel regression under minimalistic assumptions on both the kernel and the…

Machine Learning · Statistics 2025-04-21 Armin Iske