English
Related papers

Related papers: Radial basis function kernel optimization for Supp…

200 papers

This paper presents a kernel-based discriminative learning framework on probability measures. Rather than relying on large collections of vectorial training examples, our framework learns using a collection of probability distributions that…

Machine Learning · Statistics 2013-01-15 Krikamol Muandet , Kenji Fukumizu , Francesco Dinuzzo , Bernhard Schölkopf

The support vector machine (SVM) is a widely used machine learning tool for classification based on statistical learning theory. Given a set of training data, the SVM finds a hyperplane that separates two different classes of data points by…

Machine Learning · Computer Science 2017-10-31 Daniel Lopez-Martinez

We propose a Gradient Boosting algorithm for learning an ensemble of kernel functions adapted to the task at hand. Unlike state-of-the-art Multiple Kernel Learning techniques that make use of a pre-computed dictionary of kernel functions to…

Machine Learning · Statistics 2019-06-17 Léo Gautheron , Pascal Germain , Amaury Habrard , Emilie Morvant , Marc Sebban , Valentina Zantedeschi

We propose a novel approach for pixel classification in hyperspectral images, leveraging on both the spatial and spectral information in the data. The introduced method relies on a recently proposed framework for learning on distributions…

Computer Vision and Pattern Recognition · Computer Science 2016-05-31 Gianni Franchi , Jesus Angulo , Dino Sejdinovic

This study combines two different learning paradigms, k-nearest neighbor (k-NN) rule, as memory-based learning paradigm and relevance vector machines (RVM), as statistical learning paradigm. This combination is performed in kernel space and…

Machine Learning · Computer Science 2021-03-09 Sara Hosseinzadeh Kassani , Farhood Rismanchian , Peyman Hosseinzadeh Kassani

This paper aims at refined error analysis for binary classification using support vector machine (SVM) with Gaussian kernel and convex loss. Our first result shows that for some loss functions such as the truncated quadratic loss and…

Machine Learning · Computer Science 2017-10-06 Shao-Bo Lin , Jinshan Zeng , Xiangyu Chang

The radial basis function (RBF) method is used for the numerical solution of the Poisson problem in high dimension. The approximate solution can be found by solving a large system of linear equations. Here we investigate the extent to which…

Quantum Physics · Physics 2023-01-18 Lingxia Cui , Zongming Wu , Hua Xiang

Kernel methods represent one of the most powerful tools in machine learning to tackle problems expressed in terms of function values and derivatives due to their capability to represent and model complex relations. While these methods show…

Statistics Theory · Mathematics 2015-11-06 Bharath K. Sriperumbudur , Zoltan Szabo

Quantum machine learning (QML) has emerged as an important area for Quantum applications, although useful QML applications would require many qubits. Therefore our paper is aimed at exploring the successful application of the Quantum…

Quantum Physics · Physics 2020-12-15 Jae-Eun Park , Brian Quanz , Steve Wood , Heather Higgins , Ray Harishankar

We study post-training interpretability for Support Vector Machines (SVMs) built from truncated orthogonal polynomial kernels. Since the associated reproducing kernel Hilbert space is finite-dimensional and admits an explicit tensor-product…

Machine Learning · Statistics 2026-04-17 Víctor Soto-Larrosa , Nuria Torrado , Edmundo J. Huertas

We investigate two training-set methods: support vector machines (SVMs) and Kernel Regression (KR) for photometric redshift estimation with the data from the Sloan Digital Sky Survey Data Release 5 and Two Micron All Sky Survey databases.…

Astrophysics · Physics 2009-11-13 Dan Wang , Yan-Xia Zhang , Chao Liu , Yong-Heng Zhao

Rank-based metrics are some of the most widely used criteria for performance evaluation of computer vision models. Despite years of effort, direct optimization for these metrics remains a challenge due to their non-differentiable and…

Machine Learning · Computer Science 2024-12-16 Michal Rolínek , Vít Musil , Anselm Paulus , Marin Vlastelica , Claudio Michaelis , Georg Martius

This study introduces a novel formulation to enhance Support Vector Machines (SVMs) in handling class imbalance and noise. Unlike the conventional Soft Margin SVM, which penalizes the magnitude of constraint violations, the proposed model…

Machine Learning · Computer Science 2025-03-20 Seyed Mojtaba Mohasel , Hamidreza Koosha

Deep kernel learning combines the non-parametric flexibility of kernel methods with the inductive biases of deep learning architectures. We propose a novel deep kernel learning model and stochastic variational inference procedure which…

Machine Learning · Statistics 2016-11-03 Andrew Gordon Wilson , Zhiting Hu , Ruslan Salakhutdinov , Eric P. Xing

Support vector machines (SVMs) are a well-established classifier effectively deployed in an array of classification tasks. In this work, we consider extending classical SVMs with quantum kernels and applying them to satellite data analysis.…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Artur Miroszewski , Jakub Mielczarek , Grzegorz Czelusta , Filip Szczepanek , Bartosz Grabowski , Bertrand Le Saux , Jakub Nalepa

Asymmetric data naturally exist in real life, such as directed graphs. Different from the common kernel methods requiring Mercer kernels, this paper tackles the asymmetric kernel-based learning problem. We describe a nonlinear extension of…

Machine Learning · Computer Science 2023-06-13 Qinghua Tao , Francesco Tonin , Panagiotis Patrinos , Johan A. K. Suykens

Relevance Vector Machine (RVM) is a supervised learning algorithm extended from Support Vector Machine (SVM) based on the Bayesian sparsity model. Compared with the regression problem, RVM classification is difficult to be conducted because…

Machine Learning · Statistics 2022-10-28 Wenyang Wang , Dongchu Sun , Zhuoqiong He

The problem of development of the SVM classifier based on the modified particle swarm optimization has been considered. This algorithm carries out the simultaneous search of the kernel function type, values of the kernel function parameters…

Machine Learning · Computer Science 2016-03-29 L. Demidova , E. Nikulchev , Yu. Sokolova

In deep learning models, learning more with less data is becoming more important. This paper explores how neural networks with normalized Radial Basis Function (RBF) kernels can be trained to achieve better sample efficiency. Moreover, we…

This paper investigates the asymptotic behavior of the soft-margin and hard-margin support vector machine (SVM) classifiers for simultaneously high-dimensional and numerous data (large $n$ and large $p$ with $n/p\to\delta$) drawn from a…

Information Theory · Computer Science 2020-03-31 Abla Kammoun , Mohamed-Slim Alouini