English
Related papers

Related papers: NESVM: a Fast Gradient Method for Support Vector M…

200 papers

Support vector machines are widely used in machine learning classification tasks, but traditional SVM models suffer from sensitivity to outliers and instability in resampling, which limits their performance in practical applications. To…

Machine Learning · Statistics 2025-12-01 Shibo Diao

In recent years, feature selection has become a challenging problem in several machine learning fields, such as classification problems. Support Vector Machine (SVM) is a well-known technique applied in classification tasks. Various…

Machine Learning · Computer Science 2021-01-18 Asunción Jiménez-Cordero , Juan Miguel Morales , Salvador Pineda

Quantum algorithms can enhance machine learning in different aspects. Here, we study quantum-enhanced least-square support vector machine (LS-SVM). Firstly, a novel quantum algorithm that uses continuous variable to assist matrix inversion…

Quantum Physics · Physics 2020-07-15 Jie Lin , Dan-Bo Zhang , Shuo Zhang , Xiang Wang , Tan Li , Wan-su Bao

Understanding the bottlenecks in implementing stochastic gradient descent (SGD)-based distributed support vector machines (SVM) algorithm is important in training larger data sets. The communication time to do the model synchronization…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-06 Vibhatha Abeykoon , Geoffrey Fox , Minje Kim

One-class support vector machine (OC-SVM) for a long time has been one of the most effective anomaly detection methods and extensively adopted in both research as well as industrial applications. The biggest issue for OC-SVM is yet the…

Machine Learning · Computer Science 2018-10-16 Minh-Nghia Nguyen , Ngo Anh Vien

The support vector machine (SVM) is an important class of learning machines for function approach, pattern recognition, and time-serious prediction, etc. It maps samples into the feature space by so-called support vectors of selected…

Machine Learning · Statistics 2016-02-15 Hong Zhao

We introduce an advanced, swift pattern recognition strategy for various multiple robotics during curve negotiation. This method, leveraging a sophisticated k-means clustering-enhanced Support Vector Machine algorithm, distinctly…

Robotics · Computer Science 2024-05-07 Rui Liu , Xuanzhen Xu , Yuwei Shen , Armando Zhu , Chang Yu , Tianjian Chen , Ye Zhang

We consider randomized block coordinate stochastic mirror descent (RBSMD) methods for solving high-dimensional stochastic optimization problems with strongly convex objective functions. Our goal is to develop RBSMD schemes that achieve a…

Optimization and Control · Mathematics 2019-02-15 Nahidsadat Majlesinasab , Farzad Yousefian , Arash Pourhabib

An importance sampling and bagging approach to solving the support vector machine (SVM) problem in the context of large databases is presented and evaluated. Our algorithm builds on the nearest neighbors ideas presented in Camelo at al.…

Machine Learning · Statistics 2018-08-20 R. Bárcenas , M. D. Gónzalez--Lima , A. J. Quiroz

Support Vector Machine (SVM) algorithm requires a high computational cost (both in memory and time) to solve a complex quadratic programming (QP) optimization problem during the training process. Consequently, SVM necessitates high…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-28 Islam Elgarhy

Considering the classification problem, we summarize the nonparallel support vector machines with the nonparallel hyperplanes to two types of frameworks. The first type constructs the hyperplanes separately. It solves a series of small…

Machine Learning · Computer Science 2021-06-28 Chun-Na Li , Yuan-Hai Shao , Huajun Wang , Yu-Ting Zhao , Ling-Wei Huang , Naihua Xiu , Nai-Yang Deng

A major problem of kernel-based methods (e.g., least squares support vector machines, LS-SVMs) for solving linear/nonlinear ordinary differential equations (ODEs) is the prohibitive $O(an^3)$ ($a=1$ for linear ODEs and 27 for nonlinear…

Computational Engineering, Finance, and Science · Computer Science 2025-10-07 Weikuo Wang , Yue Liao , Huan Luo

Support vector machines (SVMs) are widely used for solving classification and regression problems. Recently, various nonparallel hyperplanes classification algorithms (NHCAs) have been proposed, which are comparable in terms of…

Machine Learning · Computer Science 2020-04-17 Pooja Saigal , Reshma Khemchandani

The nonconvex and nonsmooth finite-sum optimization problem with linear constraint has attracted much attention in the fields of artificial intelligence, computer, and mathematics, due to its wide applications in machine learning and the…

Optimization and Control · Mathematics 2023-07-11 Yuxuan Zeng , Zhiguo Wang , Jianchao Bai , Xiaojing Shen

In this paper, we consider asymptotic properties of the support vector machine (SVM) in high-dimension, low-sample-size (HDLSS) settings. We show that the hard-margin linear SVM holds a consistency property in which misclassification rates…

Machine Learning · Statistics 2017-02-28 Yugo Nakayama , Kazuyoshi Yata , Makoto Aoshima

For solving pseudo-convex global optimization problems, we present a novel fully adaptive steepest descent method (or ASDM) without any hard-to-estimate parameters. For the step-size regulation in an $\varepsilon$-normalized direction, we…

Optimization and Control · Mathematics 2021-08-12 Z. R. Gabidullina

The Stochastic Gradient Descent method (SGD) and its stochastic variants have become methods of choice for solving finite-sum optimization problems arising from machine learning and data science thanks to their ability to handle large-scale…

Optimization and Control · Mathematics 2024-03-06 Trang H. Tran , Quoc Tran-Dinh , Lam M. Nguyen

In this paper, we introduce novel Twin Parametric Margin Support Vector Machine (TPMSVM) models designed to address multiclass classification tasks under feature uncertainty. To handle data perturbations, we construct bounded-by-norm…

Machine Learning · Computer Science 2026-04-29 Renato De Leone , Francesca Maggioni , Andrea Spinelli

In this paper, we propose Nesterov Accelerated Shuffling Gradient (NASG), a new algorithm for the convex finite-sum minimization problems. Our method integrates the traditional Nesterov's acceleration momentum with different shuffling…

Optimization and Control · Mathematics 2022-06-14 Trang H. Tran , Katya Scheinberg , Lam M. Nguyen

Training a Support Vector Machine (SVM) requires the solution of a quadratic programming problem (QP) whose computational complexity becomes prohibitively expensive for large scale datasets. Traditional optimization methods cannot be…

Machine Learning · Computer Science 2014-01-29 Emanuele Frandi , Ricardo Nanculef , Maria Grazia Gasparo , Stefano Lodi , Claudio Sartori