English
Related papers

Related papers: Accurate Streaming Support Vector Machines

200 papers

In large-scale applications including medical imaging, collocation differential equation solvers, and estimation with differential privacy, the underlying linear inverse problem can be reformulated as a streaming problem. In theory, the…

Numerical Analysis · Mathematics 2024-01-31 Nathaniel Pritchard , Vivak Patel

We give sublinear-time approximation algorithms for some optimization problems arising in machine learning, such as training linear classifiers and finding minimum enclosing balls. Our algorithms can be extended to some kernelized versions…

Machine Learning · Computer Science 2010-10-22 Kenneth L. Clarkson , Elad Hazan , David P. Woodruff

The support vector machine (SVM) is one of the most successful learning methods for solving classification problems. Despite its popularity, SVM has a serious drawback, that is sensitivity to outliers in training samples. The penalty on…

Machine Learning · Statistics 2014-09-04 Takafumi Kanamori , Shuhei Fujiwara , Akiko Takeda

We introduce semi-supervised data classification algorithms based on total variation (TV), Reproducing Kernel Hilbert Space (RKHS), support vector machine (SVM), Cheeger cut, labeled and unlabeled data points. We design binary and…

Machine Learning · Computer Science 2012-10-03 Xavier Bresson , Ruiliang Zhang

Transductive SVM (TSVM) is a well known semi-supervised large margin learning method for binary text classification. In this paper we extend this method to multi-class and hierarchical classification problems. We point out that the…

Machine Learning · Computer Science 2012-11-02 Sathiya Keerthi Selvaraj , Sundararajan Sellamanickam , Shirish Shevade

We propose the -- to the best of our knowledge -- first fully functional implementation of the ``Separation by a Convex Body'' (SCB) approach first outlined in Grzybowski et al. [1] for classification, separating two data sets using an…

Optimization and Control · Mathematics 2025-09-01 Antonio Frangioni , Enrico Gorgone , Benedetto Manca

This work presents a fully quantum approach to support vector machine (SVM) learning by integrating gate-based quantum kernel methods with quantum annealing-based optimization. We explore the construction of quantum kernels using various…

Quantum Physics · Physics 2025-09-08 Mario Bifulco , Luca Roversi

The classical hinge-loss support vector machines (SVMs) model is sensitive to outlier observations due to the unboundedness of its loss function. To circumvent this issue, recent studies have focused on non-convex loss functions, such as…

Machine Learning · Computer Science 2022-07-19 Ítalo Santana , Breno Serrano , Maximilian Schiffer , Thibaut Vidal

The support vector machine (SVM) is a powerful and widely used classification algorithm. This paper uses the Karush-Kuhn-Tucker conditions to provide rigorous mathematical proof for new insights into the behavior of SVM. These insights…

Machine Learning · Statistics 2018-10-11 Iain Carmichael , J. S. Marron

EnsembleSVM is a free software package containing efficient routines to perform ensemble learning with support vector machine (SVM) base models. It currently offers ensemble methods based on binary SVM models. Our implementation avoids…

Machine Learning · Statistics 2014-03-05 Marc Claesen , Frank De Smet , Johan Suykens , Bart De Moor

Support vector machines (SVMs) have been recognized as a potential tool for supervised classification analyses in different domains of research. In essence, SVM is a binary classifier. Therefore, in case of a multiclass problem, the problem…

Machine Learning · Computer Science 2016-12-06 Soumi Chaki , Aurobinda Routray , William K. Mohanty , Mamata Jenamani

In this paper, we consider asymptotic properties of the support vector machine (SVM) in high-dimension, low-sample-size (HDLSS) settings. We show that the hard-margin linear SVM holds a consistency property in which misclassification rates…

Machine Learning · Statistics 2017-02-28 Yugo Nakayama , Kazuyoshi Yata , Makoto Aoshima

Machine learning algorithms must be able to efficiently cope with massive data sets. Therefore, they have to scale well on any modern system and be able to exploit the computing power of accelerators independent of their vendor. In the…

Machine Learning · Computer Science 2022-09-07 Alexander Van Craen , Marcel Breyer , Dirk Pflüger

We propose several novel methods for enhancing the multi-class SVMs by applying the generalization performance of binary classifiers as the core idea. This concept will be applied on the existing algorithms, i.e., the Decision Directed…

Machine Learning · Computer Science 2013-09-12 Patoomsiri Songsiri , Thimaporn Phetkaew , Boonserm Kijsirikul

Machine-learning techniques are evolving into a subsidiary tool for studying phase transitions in many-body systems. However, most studies are tied to situations involving only one phase transition and one order parameter. Systems that…

Statistical Mechanics · Physics 2019-03-20 Ke Liu , Jonas Greitemann , Lode Pollet

This paper introduces Memory-limited Online Subspace Estimation Scheme (MOSES) for both estimating the principal components of streaming data and reducing its dimension. More specifically, in various applications such as sensor networks,…

Information Theory · Computer Science 2021-02-12 Armin Eftekhari , Raphael A. Hauser , Andreas Grammenos

This paper presents a novel framework for designing support vector machines (SVMs), which does not impose restriction on the SVM kernel to be positive-definite and allows the user to define memory constraint in terms of fixed template…

Neural and Evolutionary Computing · Computer Science 2020-01-07 P. Kumar , A. R. Nair , O. Chatterjee , T. Paul , A. Ghosh , S. Chakrabartty , C. S. Thakur

Support Vector Machine (SVM) is powerful classification technique based on the idea of structural risk minimization. Use of kernel function enables curse of dimensionality to be addressed. However, proper kernel function for certain problem…

Machine Learning · Computer Science 2014-03-04 Arindam Chaudhuri

We investigate the relation of two fundamental tools in machine learning and signal processing, that is the support vector machine (SVM) for classification, and the Lasso technique used in regression. We show that the resulting optimization…

Machine Learning · Computer Science 2014-04-28 Martin Jaggi

This paper proposes a frequent pattern data mining algorithm based on support vector machine (SVM), aiming to solve the performance bottleneck of traditional frequent pattern mining algorithms in high-dimensional and sparse data…

Machine Learning · Computer Science 2024-12-23 Pochun Li