English
Related papers

Related papers: Matrix-valued Kernels for Shape Deformation Analys…

200 papers

We propose a new point of view for regularizing deep neural networks by using the norm of a reproducing kernel Hilbert space (RKHS). Even though this norm cannot be computed, it admits upper and lower approximations leading to various…

Machine Learning · Statistics 2019-05-15 Alberto Bietti , Grégoire Mialon , Dexiong Chen , Julien Mairal

In this paper, by mapping datasets to a set of non-linear coherent states, the process of encoding inputs in quantum states as a non-linear feature map is re-interpreted. As a result of this fact that the Radial Basis Function is recovered…

Quantum Physics · Physics 2020-07-17 Prayag Tiwari , Shahram Dehdashti , Abdul Karim Obeid , Massimo Melucci , Peter Bruza

Permutation-valued features arise in a variety of applications, either in a direct way when preferences are elicited over a collection of items, or an indirect way in which numerical ratings are converted to a ranking. To date, there has…

Machine Learning · Statistics 2017-07-24 Horia Mania , Aaditya Ramdas , Martin J. Wainwright , Michael I. Jordan , Benjamin Recht

We implement an all-optical setup demonstrating kernel-based quantum machine learning for two-dimensional classification problems. In this hybrid approach, kernel evaluations are outsourced to projective measurements on suitably designed…

We generalize Jan Willems' behavioral approach to a class of discrete-time nonlinear systems in a vector-valued reproducing kernel Hilbert space (RKHS). Apart from linear time-invariant systems, this class covers nonlinear systems modeled…

Systems and Control · Electrical Eng. & Systems 2026-05-11 Boya Hou , Maxim Raginsky

An extension of reproducing kernel Hilbert space (RKHS) theory provides a new framework for modeling functional regression models with functional responses. The approach only presumes a general nonlinear regression structure as opposed to…

Statistics Theory · Mathematics 2008-12-17 Heng Lian

A Hilbert space embedding of a distribution---in short, a kernel mean embedding---has recently emerged as a powerful tool for machine learning and inference. The basic idea behind this framework is to map distributions into a reproducing…

Machine Learning · Statistics 2020-12-15 Krikamol Muandet , Kenji Fukumizu , Bharath Sriperumbudur , Bernhard Schölkopf

There exists a plethora of parametric models for positive definite kernels, and their use is ubiquitous in disciplines as diverse as statistics, machine learning, numerical analysis, and approximation theory. Usually, the kernel parameters…

Machine Learning · Statistics 2025-01-06 Xavier Emery , Emilio Porcu , Moreno Bevilacqua

This paper presents a framework for computing random operator-valued feature maps for operator-valued positive definite kernels. This is a generalization of the random Fourier features for scalar-valued kernels to the operator-valued case.…

Machine Learning · Computer Science 2016-08-22 Ha Quang Minh

This paper is devoted to the study of vector valued reproducing kernel Hilbert spaces. We focus on reproducing kernels in vector-valued reproducing kernel Hilbert spaces. In particular we extend reproducing kernels to relative reproducing…

Functional Analysis · Mathematics 2016-01-07 Ali Ebadian , Saeed Hashemi Sababe

Reproducing kernel Hilbert spaces (RKHSs) are key elements of many non-parametric tools successfully used in signal processing, statistics, and machine learning. In this work, we aim to address three issues of the classical RKHS based…

Signal Processing · Electrical Eng. & Systems 2019-05-09 Maria Peifer , Luiz. F. O. Chamon , Santiago Paternain , Alejandro Ribeiro

The study presents a vector-valued extension of the classical Mercer theorem within the framework of reproducing kernel Hilbert spaces defined over Kaplansky-Hilbert modules associated with the algebra of essentially bounded measurable…

Functional Analysis · Mathematics 2025-11-24 A. Arziev , K. Kudaybergenov. P. Orinbaev

Convolutional networks are not aware of an object's geometric variations, which leads to inefficient utilization of model and data capacity. To overcome this issue, recent works on deformation modeling seek to spatially reconfigure the data…

Computer Vision and Pattern Recognition · Computer Science 2020-02-13 Hang Gao , Xizhou Zhu , Steve Lin , Jifeng Dai

Approximating non-linear kernels using feature maps has gained a lot of interest in recent years due to applications in reducing training and testing times of SVM classifiers and other kernel based learning algorithms. We extend this line…

Machine Learning · Computer Science 2015-03-20 Purushottam Kar , Harish Karnick

Reproducing kernel Hilbert spaces are elucidated without assuming prior familiarity with Hilbert spaces. Compared with extant pedagogic material, greater care is placed on motivating the definition of reproducing kernel Hilbert spaces and…

History and Overview · Mathematics 2015-11-06 Jonathan H. Manton , Pierre-Olivier Amblard

Kernel-based methods offer a powerful and flexible mathematical framework for addressing histopolation problems. In histopolation, the available input data does not consist of pointwise function samples but of averages taken over intervals…

Numerical Analysis · Mathematics 2026-01-14 Ludovico Bruni Bruno , Giacomo Cappellazzo , Wolfgang Erb , Mohammad Karimnejad Esfahani

In this paper, we develop a generalized theory of convolutional signal processing and neural networks for Reproducing Kernel Hilbert Spaces (RKHS). Leveraging the theory of algebraic signal processing (ASP), we show that any RKHS allows the…

Machine Learning · Computer Science 2025-06-03 Alejandro Parada-Mayorga , Leopoldo Agorio , Alejandro Ribeiro , Juan Bazerque

In this paper, we study the asymptotic properties of regularized least squares with indefinite kernels in reproducing kernel Krein spaces (RKKS). By introducing a bounded hyper-sphere constraint to such non-convex regularized risk…

Machine Learning · Statistics 2020-11-26 Fanghui Liu , Lei Shi , Xiaolin Huang , Jie Yang , Johan A. K. Suykens

We give two new global and algorithmic constructions of the reproducing kernel Hilbert space associated to a positive definite kernel. We further present ageneral positive definite kernel setting using bilinear forms, and we provide new…

Functional Analysis · Mathematics 2020-11-20 Daniel Alpay , Palle Jorgensen

The success of deep convolutional architectures is often attributed in part to their ability to learn multiscale and invariant representations of natural signals. However, a precise study of these properties and how they affect learning…

Machine Learning · Statistics 2019-02-14 Alberto Bietti , Julien Mairal