English
Related papers

Related papers: A Dual Formulation for Probabilistic Principal Com…

200 papers

Binary classification is a fundamental problem in machine learning. Recent development of quantum similarity-based binary classifiers and kernel method that exploit quantum interference and feature quantum Hilbert space opened up tremendous…

Quantum Physics · Physics 2020-04-08 Daniel K. Park , Carsten Blank , Francesco Petruccione

Solving a decision theory problem usually involves finding the actions, among a set of possible ones, which optimize the expected reward, possibly accounting for the uncertainty of the environment. In this paper, we introduce the…

Artificial Intelligence · Computer Science 2025-02-19 Damiano Azzolini , Elena Bellodi , Rafael Kiesel , Fabrizio Riguzzi

The kernel mean embedding of probability distributions is commonly used in machine learning as an injective mapping from distributions to functions in an infinite dimensional Hilbert space. It allows us, for example, to define a distance…

Quantum Physics · Physics 2019-12-24 Jonas M. Kübler , Krikamol Muandet , Bernhard Schölkopf

Probabilistic principal component analysis (PPCA) is a probabilistic reformulation of principal component analysis (PCA), under the framework of a Gaussian latent variable model. To improve the robustness of PPCA, it has been proposed to…

Methodology · Statistics 2023-11-28 Yiping Guo , Howard D. Bondell

In this paper, a modified formulation of generalized probabilistic theories that will always give rise to the structure of Hilbert space of quantum mechanics, in any finite outcome space, is presented and the guidelines to how to extend…

General Physics · Physics 2022-09-19 Raed M. Shaiia

Based on direct integrals, a framework allowing to integrate a parametrised family of reproducing kernels with respect to some measure on the parameter space is developed. By pointwise integration, one obtains again a reproducing kernel…

Functional Analysis · Mathematics 2012-02-21 Thomas Hotz , Fabian J. E. Telschow

Permutation-valued features arise in a variety of applications, either in a direct way when preferences are elicited over a collection of items, or an indirect way in which numerical ratings are converted to a ranking. To date, there has…

Machine Learning · Statistics 2017-07-24 Horia Mania , Aaditya Ramdas , Martin J. Wainwright , Michael I. Jordan , Benjamin Recht

The kernel matrix used in kernel methods encodes all the information required for solving complex nonlinear problems defined on data representations in the input space using simple, but implicitly defined, solutions. Spectral analysis on…

Machine Learning · Computer Science 2020-10-26 Alexandros Iosifidis

The universality properties of kernels characterize the class of functions that can be approximated in the associated reproducing kernel Hilbert space and are of fundamental importance in the theoretical underpinning of kernel methods in…

Machine Learning · Computer Science 2025-06-25 Franziskus Steinert , Salem Said , Cyrus Mostajeran

We develop a theory of Valuation Hilbert Modules and prove a version of Beurling's theorem for these. Then we apply our version of Beurling's theorem to obtain complete descriptions of the closed invariant subspaces of a number of Hilbert…

Complex Variables · Mathematics 2023-06-23 Charles W. Neville

Conventional principal component analysis (PCA) finds a principal vector that maximizes the sum of second powers of principal components. We consider a generalized PCA that aims at maximizing the sum of an arbitrary convex function of…

Machine Learning · Computer Science 2019-11-19 Samuele Battaglino , Erdem Koyuncu

We present two diagnostic methods based on ideas of Principal Component Analysis and demonstrate their efficiency for sophisticated processing of multicolour photometric observations of variable objects.

Astrophysics · Physics 2015-06-24 Zdenek Mikulasek

Traditional functional linear regression usually takes a one-dimensional functional predictor as input and estimates the continuous coefficient function. Modern applications often generate two-dimensional covariates, which become matrices…

Methodology · Statistics 2024-11-26 Dan Yang , Jianlong Shao , Haipeng Shen , Hongtu Zhu

This work is concerned with the kernel-based approximation of a complex-valued function from data, where the frequency response function of a partial differential equation in the frequency domain is of particular interest. In this setting,…

Computational Engineering, Finance, and Science · Computer Science 2024-11-26 Julien Bect , Niklas Georg , Ulrich Römer , Sebastian Schöps

The basic idea of quantum computing is surprisingly similar to that of kernel methods in machine learning, namely to efficiently perform computations in an intractably large Hilbert space. In this paper we explore some theoretical…

Quantum Physics · Physics 2019-02-06 Maria Schuld , Nathan Killoran

The popular cubic smoothing spline estimate of a regression function arises as the minimizer of the penalized sum of squares $\sum_j(Y_j - {\mu}(t_j))^2 + {\lambda}\int_a^b [{\mu}"(t)]^2 dt$, where the data are $t_j,Y_j$, $j=1,..., n$. The…

Machine Learning · Statistics 2011-11-09 Nancy Heckman

Principal Component Analysis (PCA) is a powerful tool in statistics and machine learning. While existing study of PCA focuses on the recovery of principal components and their associated eigenvalues, there are few precise characterizations…

Statistics Theory · Mathematics 2022-04-12 Emmanuel Abbe , Jianqing Fan , Kaizheng Wang

We propose a novel kernel-based two-sample test that leverages the spectral decomposition of the maximum mean discrepancy (MMD) statistic to identify and utilize well-estimated directional components in reproducing kernel Hilbert space…

Methodology · Statistics 2025-08-21 Rui Cui , Yuhao Li , Xiaojun Song

In this article, the reproducing kernel Hilbert space [0, 1] is employed for solving a class of third-order periodic boundary value problem by using fitted reproducing kernel algorithm. The reproducing kernel function is built to get fast…

Numerical Analysis · Mathematics 2017-04-18 Asad Freihat , Radwan Abu-Gdairi , Hammad Khalil , Eman Abuteen , Mohammed Al-Smadi , Rahmat Ali Khan

The role of kernels is central to machine learning. Motivated by the importance of power-law distributions in statistical modeling, in this paper, we propose the notion of power-law kernels to investigate power-laws in learning problem. We…

Machine Learning · Computer Science 2013-04-02 Debarghya Ghoshdastidar , Ambedkar Dukkipati