English
Related papers

Related papers: Radial basis function kernel optimization for Supp…

200 papers

In this paper we measured the stability of stochastic gradient method (SGM) for learning an approximated Fourier primal support vector machine. The stability of an algorithm is considered by measuring the generalization error in terms of…

Signal Processing · Electrical Eng. & Systems 2018-04-24 Aven Samareh , Mahshid Salemi Parizi

With the continuous expansion of the scale of air transport, the demand for aviation meteorological support also continues to grow. The impact of hazardous weather on flight safety is critical. How to effectively use meteorological data to…

Artificial Intelligence · Computer Science 2024-06-19 Haoxing Liu , Renjie Xie , Haoshen Qin , Yizhou Li

We consider gradient descent like algorithms for Support Vector Machine (SVM) training when the data is in relational form. The gradient of the SVM objective can not be efficiently computed by known techniques as it suffers from the…

Data Structures and Algorithms · Computer Science 2020-05-13 Mahmoud Abo-Khamis , Sungjin Im , Benjamin Moseley , Kirk Pruhs , Alireza Samadian

This paper presents an algorithm, Voted Kernel Regularization , that provides the flexibility of using potentially very complex kernel functions such as predictors based on much higher-degree polynomial kernels, while benefitting from…

Machine Learning · Computer Science 2015-09-16 Corinna Cortes , Prasoon Goyal , Vitaly Kuznetsov , Mehryar Mohri

The computational complexity of solving nonlinear support vector machine (SVM) is prohibitive on large-scale data. In particular, this issue becomes very sensitive when the data represents additional difficulties such as highly imbalanced…

Machine Learning · Computer Science 2019-04-09 E. Sadrfaridpour , T. Razzaghi , I. Safro

Support Vector Machines (SVMs) can solve structured multi-output learning problems such as multi-label classification, multiclass classification and vector regression. SVM training is expensive especially for large and high dimensional…

Machine Learning · Computer Science 2019-11-11 Qinbin Li , Zeyi Wen , Bingsheng He

We introduce a functional gradient descent trajectory optimization algorithm for robot motion planning in Reproducing Kernel Hilbert Spaces (RKHSs). Functional gradient algorithms are a popular choice for motion planning in complex…

Robotics · Computer Science 2016-01-15 Zita Marinho , Anca Dragan , Arun Byravan , Byron Boots , Siddhartha Srinivasa , Geoffrey Gordon

Kernel method has been developed as one of the standard approaches for nonlinear learning, which however, does not scale to large data set due to its quadratic complexity in the number of samples. A number of kernel approximation methods…

Machine Learning · Computer Science 2018-09-20 Lingfei Wu , Ian E. H. Yen , Jie Chen , Rui Yan

An adaptive kernel method in the Bayesian framework together with a new simulation program for Rutherford backscattering spectroscopy (RBS) have been applied to the analysis of RBS data. Even in the case of strongly overlapping RBS peaks a…

Data Analysis, Statistics and Probability · Physics 2007-05-23 U. V. Toussaint , K. Krieger , R. Fischer , V. Dose

Quantum support vector machines employ quantum circuits to define the kernel function. It has been shown that this approach offers a provable exponential speedup compared to any known classical algorithm for certain data sets. The training…

Quantum Physics · Physics 2024-01-17 Gian Gentinetta , Arne Thomsen , David Sutter , Stefan Woerner

Training a Support Vector Machine (SVM) requires the solution of a quadratic programming problem (QP) whose computational complexity becomes prohibitively expensive for large scale datasets. Traditional optimization methods cannot be…

Machine Learning · Computer Science 2014-01-29 Emanuele Frandi , Ricardo Nanculef , Maria Grazia Gasparo , Stefano Lodi , Claudio Sartori

This paper proposes a hybrid basis function construction method (GP-RVM) for Symbolic Regression problem, which combines an extended version of Genetic Programming called Kaizen Programming and Relevance Vector Machine to evolve an optimal…

Neural and Evolutionary Computing · Computer Science 2018-08-28 Hossein Izadi Rad , Ji Feng , Hitoshi Iba

Recent advances in healthcare technologies have led to the availability of large amounts of biological samples across several techniques and applications. In particular, in the last few years, Raman spectroscopy analysis of biological…

Quantitative Methods · Quantitative Biology 2025-06-24 Marco Piazza , Andrea Spinelli , Francesca Maggioni , Marzia Bedoni , Enza Messina

We propose a novel approach for designing kernels for support vector machines (SVMs) when the class label is linked to the observation through a latent state and the likelihood function of the observation given the state (the sensing model)…

Machine Learning · Computer Science 2014-03-14 Weicong Ding , Prakash Ishwar , Venkatesh Saligrama , W. Clem Karl

This work proposes a novel support vector machine (SVM) based robust automatic speech recognition (ASR) front-end that operates on an ensemble of the subband components of high-dimensional acoustic waveforms. The key issues of selecting the…

Computation and Language · Computer Science 2014-01-15 Jibran Yousafzai , Zoran Cvetkovic , Peter Sollich , Matthew Ager

Semi-implicit variational inference (SIVI) extends traditional variational families with semi-implicit distributions defined in a hierarchical manner. Due to the intractable densities of semi-implicit distributions, classical SIVI often…

Machine Learning · Statistics 2024-05-30 Ziheng Cheng , Longlin Yu , Tianyu Xie , Shiyue Zhang , Cheng Zhang

This paper studies an intriguing phenomenon related to the good generalization performance of estimators obtained by using large learning rates within gradient descent algorithms. First observed in the deep learning literature, we show that…

Machine Learning · Statistics 2022-06-06 Gaspard Beugnot , Julien Mairal , Alessandro Rudi

Conditional expectiles are becoming an increasingly important tool in finance as well as in other areas of applications. We analyse a support vector machine type approach for estimating conditional expectiles and establish learning rates…

Machine Learning · Statistics 2017-02-28 Muhammad Farooq , Ingo Steinwart

SVD (singular value decomposition) is one of the basic tools of machine learning, allowing to optimize basis for a given matrix. However, sometimes we have a set of matrices $\{A_k\}_k$ instead, and would like to optimize a single common…

Machine Learning · Computer Science 2022-04-19 Jarek Duda

We present DCSVM, an efficient algorithm for multi-class classification using Support Vector Machines. DCSVM is a divide and conquer algorithm which relies on data sparsity in high dimensional space and performs a smart partitioning of the…

Machine Learning · Computer Science 2018-10-24 Duleep Rathgamage Don , Ionut E. Iacob