English
Related papers

Related papers: Support Vector Machine Classifier with Rescaled Hu…

200 papers

An importance sampling and bagging approach to solving the support vector machine (SVM) problem in the context of large databases is presented and evaluated. Our algorithm builds on the nearest neighbors ideas presented in Camelo at al.…

Machine Learning · Statistics 2018-08-20 R. Bárcenas , M. D. Gónzalez--Lima , A. J. Quiroz

Due to the non-smoothness of the Hinge loss in SVM, it is difficult to obtain a faster convergence rate with modern optimization algorithms. In this paper, we introduce two smooth Hinge losses $\psi_G(\alpha;\sigma)$ and…

Machine Learning · Computer Science 2021-03-16 JunRu Luo , Hong Qiao , Bo Zhang

In this paper we develop a new Bayesian inference method for low rank matrix reconstruction. We call the new method the Relevance Singular Vector Machine (RSVM) where appropriate priors are defined on the singular vectors of the underlying…

Numerical Analysis · Computer Science 2014-07-02 Martin Sundin , Saikat Chatterjee , Magnus Jansson , Cristian R. Rojas

Support Vector Machines (SVMs) are one of the most popular supervised learning models to classify using a hyperplane in an Euclidean space. Similar to SVMs, tropical SVMs classify data points using a tropical hyperplane under the tropical…

Machine Learning · Computer Science 2022-10-05 Ruriko Yoshida , Misaki Takamori , Hideyuki Matsumoto , Keiji Miura

Twin support vector machine (TSVM), a variant of support vector machine (SVM), has garnered significant attention due to its $3/4$ times lower computational complexity compared to SVM. However, due to the utilization of the hinge loss…

Machine Learning · Computer Science 2024-10-01 Mushir Akhtar , M. Tanveer , Mohd. Arshad

High-dimensional classification problems often rely on the Lasso-penalized linear Support Vector Machines (SVMs). However, the double non-smoothness induced by the hinge loss and Lasso penalty in this model makes statistical inference…

Methodology · Statistics 2026-05-18 Shuya Zhou , Junwen Xia , Jingxiao Zhang

In this work, we develop efficient solvers for linear inverse problems based on randomized singular value decomposition (RSVD). This is achieved by combining RSVD with classical regularization methods, e.g., truncated singular value…

Numerical Analysis · Mathematics 2019-09-05 Kazufumi Ito , Bangti Jin

Sparse classifiers such as the support vector machines (SVM) are efficient in test-phases because the classifier is characterized only by a subset of the samples called support vectors (SVs), and the rest of the samples (non SVs) have no…

Machine Learning · Statistics 2014-01-28 Kohei Ogawa , Yoshiki Suzuki , Shinya Suzumura , Ichiro Takeuchi

The time complexity of support vector machines (SVMs) prohibits training on huge data sets with millions of data points. Recently, multilevel approaches to train SVMs have been developed to allow for time-efficient training on huge data…

Machine Learning · Computer Science 2020-01-29 Sebastian Schlag , Matthias Schmitt , Christian Schulz

The one-bit quantization is implemented by one single comparator that operates at low power and a high rate. Hence one-bit compressive sensing (1bit-CS) becomes attractive in signal processing. When measurements are corrupted by noise…

Information Theory · Computer Science 2018-03-20 Xiaolin Huang , Lei Shi , Ming Yan , Johan A. K. Suykens

A support vector machine (SVM) is an algorithm that finds a hyperplane which optimally separates labeled data points in $\mathbb{R}^n$ into positive and negative classes. The data points on the margin of this separating hyperplane are…

Machine Learning · Computer Science 2022-09-19 Henry Adams , Elin Farnell , Brittany Story

Dropout and other feature noising schemes have shown promising results in controlling over-fitting by artificially corrupting the training data. Though extensive theoretical and empirical studies have been performed for generalized linear…

Machine Learning · Computer Science 2014-04-17 Ning Chen , Jun Zhu , Jianfei Chen , Bo Zhang

Support vector machines represent a promising development in machine learning research that is not widely used within the remote sensing community. This paper reports the results of Multispectral(Landsat-7 ETM+) and Hyperspectral DAIS)data…

Neural and Evolutionary Computing · Computer Science 2009-11-13 Mahesh Pal , Paul M. Mather

We investigate the relation of two fundamental tools in machine learning and signal processing, that is the support vector machine (SVM) for classification, and the Lasso technique used in regression. We show that the resulting optimization…

Machine Learning · Computer Science 2014-04-28 Martin Jaggi

The generalization error bound of support vector machine (SVM) depends on the ratio of radius and margin, while standard SVM only considers the maximization of the margin but ignores the minimization of the radius. Several approaches have…

Machine Learning · Computer Science 2015-04-21 Xiaohe Wu , Wangmeng Zuo , Yuanyuan Zhu , Liang Lin

In this paper, we consider the binary classification problem via distributed Support-Vector-Machines (SVM), where the idea is to train a network of agents, with limited share of data, to cooperatively learn the SVM classifier for the global…

Systems and Control · Electrical Eng. & Systems 2021-04-02 Mohammadreza Doostmohammadian , Alireza Aghasi , Themistoklis Charalambous , Usman A. Khan

Support vector machine is an important and fundamental technique in machine learning. Soft-margin SVM models have stronger generalization performance compared with the hard-margin SVM. Most existing works use the hinge-loss function which…

Optimization and Control · Mathematics 2021-05-18 Lu Sitong , Li Qinana

In this paper, we have considered general k-piece-wise linear convex loss functions in SVM model for measuring the empirical risk. The resulting k-Piece-wise Linear loss Support Vector Machine (k-PL-SVM) model is an adaptive SVM model which…

Machine Learning · Computer Science 2021-02-10 Pritam Anand

Support vector machine (SVM) has proved to be a successful approach for machine learning. Two typical SVM models are the L1-loss model for support vector classification (SVC) and $\epsilon$-L1-loss model for support vector regression (SVR).…

Optimization and Control · Mathematics 2020-03-09 Yinqiao Yan , Qingna Li

Learning in the reproducing kernel Hilbert space (RKHS) such as the support vector machine has been recognized as a promising technique. It continues to be highly effective and competitive in numerous prediction tasks, particularly in…

Machine Learning · Computer Science 2025-01-15 Gakuto Obi , Ayato Saito , Yuto Sasaki , Tsuyoshi Kato