English
Related papers

Related papers: Operator-Valued Bochner Theorem, Fourier Feature M…

200 papers

We present a novel diffusion scheme for online kernel-based learning over networks. So far, a major drawback of any online learning algorithm, operating in a reproducing kernel Hilbert space (RKHS), is the need for updating a growing number…

Machine Learning · Computer Science 2018-03-14 Pantelis Bouboulis , Symeon Chouvardas , Sergios Theodoridis

Encoding classical data into quantum states is considered a quantum feature map to map classical data into a quantum Hilbert space. This feature map provides opportunities to incorporate quantum advantages into machine learning algorithms…

Quantum Physics · Physics 2021-08-31 Takahiro Goto , Quoc Hoan Tran , Kohei Nakajima

Kernel function plays a crucial role in machine learning algorithms such as classifiers. In this paper, we aim to improve the classification performance and reduce the reading out burden of quantum classifiers. We devise a universally…

Quantum Physics · Physics 2025-05-08 Li Xu , Xiao-yu Zhang , Ming Li , Shu-qian Shen

Random feature approximation is arguably one of the most popular techniques to speed up kernel methods in large scale algorithms and provides a theoretical approach to the analysis of deep neural networks. We analyze generalization…

Machine Learning · Computer Science 2023-08-30 Mike Nguyen , Nicole Mücke

Kernel methods provide a flexible and theoretically grounded approach to nonlinear and nonparametric learning. While memory and run-time requirements hinder their applicability to large datasets, many low-rank kernel approximations, such as…

Machine Learning · Statistics 2024-04-15 Mateus P. Otto , Rafael Izbicki

The popular qubit framework has dominated recent work on quantum kernel machine learning, with results characterising expressivity, learnability and generalisation. As yet, there is no comparative framework to understand these concepts for…

Quantum Physics · Physics 2024-12-18 Laura J. Henderson , Rishi Goel , Sally Shrapnel

Since its introduction, the Discrete Variable Representation (DVR) basis set has become an invaluable representation of state vectors and Hermitian operators in non-relativistic quantum dynamics and spectroscopy calculations. On the other…

Computational Physics · Physics 2014-05-30 Hamse Mussa

Kernel learning methods are among the most effective learning methods and have been vigorously studied in the past decades. However, when tackling with complicated tasks, classical kernel methods are not flexible or "rich" enough to…

Machine Learning · Computer Science 2019-10-08 Jiaxuan Xie , Fanghui Liu , Kaijie Wang , Xiaolin Huang

Quantum kernel methods (QKMs) have emerged as a prominent framework for supervised quantum machine learning. Unlike variational quantum algorithms, which rely on gradient-based optimisation and may suffer from issues such as barren…

Quantum Physics · Physics 2026-04-10 John Tanner , Chon-Fai Kam , Jingbo Wang

We present a general kernel-based framework for learning operators between Banach spaces along with a priori error analysis and comprehensive numerical comparisons with popular neural net (NN) approaches such as Deep Operator Net (DeepONet)…

Machine Learning · Statistics 2023-10-10 Pau Batlle , Matthieu Darcy , Bamdad Hosseini , Houman Owhadi

We present a characterization for a positive definite operator valued kernel to be universal or $C_{0}$-universal, and apply these characterizations to a family of operator valued kernels that are shown to be well behaved. Later, we obtain…

Functional Analysis · Mathematics 2020-03-26 Jean Carlo Guella

Approximating kernel functions with random features (RFs)has been a successful application of random projections for nonparametric estimation. However, performing random projections presents computational challenges for large-scale…

Emerging Technologies · Computer Science 2020-06-23 Ruben Ohana , Jonas Wacker , Jonathan Dong , Sébastien Marmin , Florent Krzakala , Maurizio Filippone , Laurent Daudet

This paper presents a novel framework for visual object recognition using infinite-dimensional covariance operators of input features in the paradigm of kernel methods on infinite-dimensional Riemannian manifolds. Our formulation provides…

Computer Vision and Pattern Recognition · Computer Science 2016-09-30 Hà Quang Minh , Marco San Biagio , Loris Bazzani , Vittorio Murino

It has been hypothesized that quantum computers may lend themselves well to applications in machine learning. In the present work, we analyze function classes defined via quantum kernels. Quantum computers offer the possibility to…

Quantum Physics · Physics 2021-11-10 Jonas M. Kübler , Simon Buchholz , Bernhard Schölkopf

Operator-valued frames are natural generalization of frames that have been used in quantum computing, packets encoding, etc. In this paper, we focus on developing the theory about operator-valued frames for finite Hilbert spaces. Some…

Functional Analysis · Mathematics 2010-09-28 Bin Meng

Random Fourier features is one of the most popular techniques for scaling up kernel methods, such as kernel ridge regression. However, despite impressive empirical results, the statistical properties of random Fourier features are still not…

Machine Learning · Computer Science 2018-05-22 Haim Avron , Michael Kapralov , Cameron Musco , Christopher Musco , Ameya Velingker , Amir Zandieh

We study the problem of extending a positive-definite operator-valued kernel, defined on words of a fixed finite length from a free semigroup, to a global kernel defined on all words. We show that if the initial kernel satisfies a natural…

Functional Analysis · Mathematics 2025-10-14 James Tian

Motivated by the abundance of functional data such as time series and images, there has been a growing interest in integrating such data into neural networks and learning maps from function spaces to R (i.e., functionals). In this paper, we…

Machine Learning · Statistics 2024-03-20 Tian-Yi Zhou , Namjoon Suh , Guang Cheng , Xiaoming Huo

Nonparametric feature selection in high-dimensional data is an important and challenging problem in statistics and machine learning fields. Most of the existing methods for feature selection focus on parametric or additive models which may…

Methodology · Statistics 2021-03-31 Hang Yu , Yuanjia Wang , Donglin Zeng

This paper reviews the functional aspects of statistical learning theory. The main point under consideration is the nature of the hypothesis set when no prior information is available but data. Within this framework we first discuss about…

Machine Learning · Statistics 2016-11-25 Stephane Canu , Xavier Mary , Alain Rakotomamonjy