English
Related papers

Related papers: Neurally-plausible radial basis kernels using dist…

200 papers

We study the constructions of piecewise rational interpolation kernels that are supported on the interval $[-2,2]$, and present one novel rational cubic/linear and five quartic/linear interpolation kernels. All proposed kernels are…

Numerical Analysis · Mathematics 2025-11-24 Bing Guo , Wanfeng Qi

Universal kernels, whose Reproducing Kernel Hilbert Space is dense in the space of continuous functions are of great practical and theoretical interest. In this paper, we introduce an explicit construction of universal kernels on compact…

Functional Analysis · Mathematics 2025-10-09 Eloi Tanguy

Steerable convolutional neural networks (CNNs) provide a general framework for building neural networks equivariant to translations and transformations of an origin-preserving group $G$, such as reflections and rotations. They rely on…

Machine Learning · Computer Science 2023-10-30 Maksim Zhdanov , Nico Hoffmann , Gabriele Cesa

Positive semi-definite kernels are used to induce pseudo-metrics, or ``distances'', between measures. We write these as an expected quadratic variation of, or expected inner product between, a random field and the difference of measures.…

Probability · Mathematics 2025-05-30 Ian Langmore

A universal kernel is constructed whose sections approximate any causal and time-invariant filter in the fading memory category with inputs and outputs in a finite-dimensional Euclidean space. This kernel is built using the reservoir…

Machine Learning · Computer Science 2025-09-05 Lukas Gonon , Lyudmila Grigoryeva , Juan-Pablo Ortega

We address three key challenges in learning continuous kernel representations: computational efficiency, parameter efficiency, and spectral bias. Continuous kernels have shown significant potential, but their practical adoption is often…

Machine Learning · Computer Science 2024-09-17 Clayton Harper , Luke Wood , Peter Gerstoft , Eric C. Larson

Approaches to signal representation and coding theory have traditionally focused on how to best represent signals using parsimonious representations that incur the lowest possible distortion. Classical examples include linear and non-linear…

Information Theory · Computer Science 2015-12-25 Petros T Boufounos , Shantanu Rane , Hassan Mansour

We study representations of positive definite kernels $K$ in a general setting, but with view to applications to harmonic analysis, to metric geometry, and to realizations of certain stochastic processes. Our initial results are stated for…

Functional Analysis · Mathematics 2017-06-30 Palle Jorgensen , Feng Tian

Approximation/interpolation from spaces of positive definite or conditionally positive definite kernels is an increasingly popular tool for the analysis and synthesis of scattered data, and is central to many meshless methods. For a set of…

Numerical Analysis · Mathematics 2013-09-11 E. Fuselier , T. Hangelbroek , F. J. Narcowich , J. D. Ward , G. B. Wright

The expressive power of Gaussian processes depends heavily on the choice of kernel. In this work we propose the novel harmonizable mixture kernel (HMK), a family of expressive, interpretable, non-stationary kernels derived from mixture…

Machine Learning · Statistics 2019-10-15 Zheyang Shen , Markus Heinonen , Samuel Kaski

Reproducing kernel Hilbert spaces are elucidated without assuming prior familiarity with Hilbert spaces. Compared with extant pedagogic material, greater care is placed on motivating the definition of reproducing kernel Hilbert spaces and…

History and Overview · Mathematics 2015-11-06 Jonathan H. Manton , Pierre-Olivier Amblard

We introduce a framework for learning continuous neural representations of formal specifications by distilling the geometry of their semantics into a latent space. Existing approaches rely either on symbolic kernels -- which preserve…

Computation and Language · Computer Science 2026-03-06 Sara Candussio , Gabriele Sarti , Gaia Saveri , Luca Bortolussi

Tree kernels have demonstrated their ability to deal with hierarchical data, as the intrinsic tree structure often plays a discriminative role. While such kernels have been successfully applied to various domains such as nature language…

Computer Vision and Pattern Recognition · Computer Science 2016-04-08 Yanwei Cui , Laetitia Chapel , Sébastien Lefèvre

Approximations based on random Fourier features have recently emerged as an efficient and formally consistent methodology to design large-scale kernel machines. By expressing the kernel as a Fourier expansion, features are generated based…

Computer Vision and Pattern Recognition · Computer Science 2012-03-08 Eduard Gabriel Băzăvan , Fuxin Li , Cristian Sminchisescu

In this paper we propose a family of tractable kernels that is dense in the family of bounded positive semi-definite functions (i.e. can approximate any bounded kernel with arbitrary precision). We start by discussing the case of stationary…

Machine Learning · Statistics 2015-10-13 Yves-Laurent Kom Samo , Stephen Roberts

Kernel methods, being supported by a well-developed theory and coming with efficient algorithms, are among the most popular and successful machine learning techniques. From a mathematical point of view, these methods rest on the concept of…

Machine Learning · Statistics 2023-03-20 Christian Fiedler , Michael Herty , Michael Rom , Chiara Segala , Sebastian Trimpe

We propose to use the family of Mat\'ern kernels for implicit surface reconstruction, building upon the recent success of kernel methods for 3D reconstruction of oriented point clouds. As we show from a theoretical and practical…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Maximilian Weiherer , Bernhard Egger

We present a data-driven method for computing approximate forward reachable sets using separating kernels in a reproducing kernel Hilbert space. We frame the problem as a support estimation problem, and learn a classifier of the support as…

Optimization and Control · Mathematics 2020-11-20 Adam J. Thorpe , Kendric R. Ortiz , Meeko M. K. Oishi

The paper discusses a series of results concerning reproducing kernel Hilbert spaces, related to the factorization of their kernels. In particular, it is proved that for a large class of spaces isometric multipliers are trivial. One also…

Functional Analysis · Mathematics 2016-05-10 Rani Kumari , Jaydeb Sarkar , Srijan Sarkar , Dan Timotin

Gaussian processes are flexible function approximators, with inductive biases controlled by a covariance kernel. Learning the kernel is the key to representation learning and strong predictive performance. In this paper, we develop…

Machine Learning · Computer Science 2019-10-31 Gregory W. Benton , Wesley J. Maddox , Jayson P. Salkey , Julio Albinati , Andrew Gordon Wilson