English

A quantum extension of SVM-perf for training nonlinear SVMs in almost linear time

Quantum Physics 2020-10-21 v3 Machine Learning

Abstract

We propose a quantum algorithm for training nonlinear support vector machines (SVM) for feature space learning where classical input data is encoded in the amplitudes of quantum states. Based on the classical SVM-perf algorithm of Joachims, our algorithm has a running time which scales linearly in the number of training examples mm (up to polylogarithmic factors) and applies to the standard soft-margin 1\ell_1-SVM model. In contrast, while classical SVM-perf has demonstrated impressive performance on both linear and nonlinear SVMs, its efficiency is guaranteed only in certain cases: it achieves linear mm scaling only for linear SVMs, where classification is performed in the original input data space, or for the special cases of low-rank or shift-invariant kernels. Similarly, previously proposed quantum algorithms either have super-linear scaling in mm, or else apply to different SVM models such as the hard-margin or least squares 2\ell_2-SVM which lack certain desirable properties of the soft-margin 1\ell_1-SVM model. We classically simulate our algorithm and give evidence that it can perform well in practice, and not only for asymptotically large data sets.

Keywords

Cite

@article{arxiv.2006.10299,
  title  = {A quantum extension of SVM-perf for training nonlinear SVMs in almost linear time},
  author = {Jonathan Allcock and Chang-Yu Hsieh},
  journal= {arXiv preprint arXiv:2006.10299},
  year   = {2020}
}

Comments

21 pages, 1 Figure, 2 Tables