English
Related papers

Related papers: Probabilistic classifiers with low rank indefinite…

200 papers

Despite the success of the popular kernelized support vector machines, they have two major limitations: they are restricted to Positive Semi-Definite (PSD) kernels, and their training complexity scales at least quadratically with the size…

Machine Learning · Computer Science 2014-05-28 Omid Aghazadeh , Stefan Carlsson

Support vector machines (SVM) and other kernel techniques represent a family of powerful statistical classification methods with high accuracy and broad applicability. Because they use all or a significant portion of the training data,…

Machine Learning · Statistics 2023-01-31 Peter Mills

The recent discovery of the equivalence between infinitely wide neural networks (NNs) in the lazy training regime and Neural Tangent Kernels (NTKs) (Jacot et al., 2018) has revived interest in kernel methods. However, conventional wisdom…

Machine Learning · Computer Science 2023-01-31 Teng Andrea Xu , Bryan Kelly , Semyon Malamud

Sparse Bayesian learning is a state-of-the-art supervised learning algorithm that can choose a subset of relevant samples from the input data and make reliable probabilistic predictions. However, in the presence of high-dimensional data…

Machine Learning · Computer Science 2020-01-10 Bingbing Jiang , Chang Li , Maarten de Rijke , Xin Yao , Huanhuan Chen

Random Fourier Features (RFF) demonstrate wellappreciated performance in kernel approximation for largescale situations but restrict kernels to be stationary and positive definite. And for non-stationary kernels, the corresponding RFF could…

Machine Learning · Statistics 2021-04-15 Qin Luo , Kun Fang , Jie Yang , Xiaolin Huang

Among various quantum machine learning (QML) algorithms, the quantum kernel method has especially attracted attention due to its compatibility with noisy intermediate-scale quantum devices and its potential to achieve quantum advantage.…

Quantum Physics · Physics 2024-08-07 Keitaro Anai , Shion Ikehara , Yoshichika Yano , Daichi Okuno , Shuntaro Takeda

Quantum kernel methods are a promising branch of quantum machine learning, yet their effectiveness on diverse, high-dimensional, real-world data remains unverified. Current research has largely been limited to low-dimensional or synthetic…

Machine Learning · Computer Science 2026-02-19 Jiang Yuhan , Matthew Otten

Kernel methods are used frequently in various applications of machine learning. For large-scale high dimensional applications, the success of kernel methods hinges on the ability to operate certain large dense kernel matrix K. An enormous…

Numerical Analysis · Mathematics 2021-12-30 Difeng Cai , James Nagy , Yuanzhe Xi

Kernel methods offer the flexibility to learn complex relationships in modern, large data sets while enjoying strong theoretical guarantees on quality. Unfortunately, these methods typically require cubic running time in the data set size,…

Machine Learning · Statistics 2019-03-01 Raj Agrawal , Trevor Campbell , Jonathan H. Huggins , Tamara Broderick

Kernel methods are powerful and flexible approach to solve many problems in machine learning. Due to the pairwise evaluations in kernel methods, the complexity of kernel computation grows as the data size increases; thus the applicability…

Machine Learning · Computer Science 2017-11-28 Bharath Bhushan Damodaran , Nicolas Courty , Philippe-Henri Gosselin

Approximating non-linear kernels using feature maps has gained a lot of interest in recent years due to applications in reducing training and testing times of SVM classifiers and other kernel based learning algorithms. We extend this line…

Machine Learning · Computer Science 2015-03-20 Purushottam Kar , Harish Karnick

We propose a method for the approximation of high- or even infinite-dimensional feature vectors, which play an important role in supervised learning. The goal is to reduce the size of the training data, resulting in lower storage…

Machine Learning · Statistics 2021-04-06 Patrick Gelß , Stefan Klus , Ingmar Schuster , Christof Schütte

Decision forests are widely used for classification and regression tasks. A lesser known property of tree-based methods is that one can construct a proximity matrix from the tree(s), and these proximity matrices are induced kernels. While…

Machine Learning · Statistics 2024-10-14 Sambit Panda , Cencheng Shen , Joshua T. Vogelstein

This article presents a quantum computing approach to designing of similarity measures and kernels for classification of stochastic symbolic time series. In the area of machine learning, kernels are important components of various…

Quantum Physics · Physics 2025-06-10 Vanio Markov , Vladimir Rastunkov , Daniel Fry

We propose a method for support vector machine classification using indefinite kernels. Instead of directly minimizing or stabilizing a nonconvex loss function, our algorithm simultaneously computes support vectors and a proxy kernel matrix…

Machine Learning · Computer Science 2009-08-04 Ronny Luss , Alexandre d'Aspremont

Non-negative Matrix Factorization(NMF) algorithm can only be used to find low rank approximation of original non-negative data while Concept Factorization(CF) algorithm extends matrix factorization to single non-linear kernel space,…

Machine Learning · Computer Science 2024-10-29 Fei Li , Liang Du , Chaohong Ren

Machine learning and quantum computing are two technologies each with the potential for altering how computation is performed to address previously untenable problems. Kernel methods for machine learning are ubiquitous for pattern…

We investigate how to train kernel approximation methods that generalize well under a memory budget. Building on recent theoretical work, we define a measure of kernel approximation error which we find to be more predictive of the empirical…

Machine Learning · Computer Science 2019-03-21 Jian Zhang , Avner May , Tri Dao , Christopher Ré

Kernel approximation using randomized feature maps has recently gained a lot of interest. In this work, we identify that previous approaches for polynomial kernel approximation create maps that are rank deficient, and therefore do not…

Machine Learning · Statistics 2013-12-18 Raffay Hamid , Ying Xiao , Alex Gittens , Dennis DeCoste

Particle filtering methods can be applied to estimation problems in discrete spaces on bounded domains, to sample from and marginalise over unknown hidden states. As in continuous settings, problems such as particle degradation can arise:…

‹ Prev 1 2 3 10 Next ›