English
Related papers

Related papers: A Novel Loss Function-based Support Vector Machine…

200 papers

The support vector machine (SVM) algorithm is well known to the computer learning community for its very good practical results. The goal of the present paper is to study this algorithm from a statistical perspective, using tools of…

Statistics Theory · Mathematics 2008-12-18 Gilles Blanchard , Olivier Bousquet , Pascal Massart

Support vector machines (SVMs) are invaluable tools for many practical applications in artificial intelligence, e.g., classification and event recognition. However, popular SVM solvers are not sufficiently efficient for applications with a…

Machine Learning · Computer Science 2011-10-02 Tianyi Zhou , Dacheng Tao , Xindong Wu

The binomial deviance and the SVM hinge loss functions are two of the most widely used loss functions in machine learning. While there are many similarities between them, they also have their own strengths when dealing with different types…

Machine Learning · Statistics 2022-05-25 Man Huang , Luis Carvalho

Support vector machines (SVMs) appeared in the early nineties as optimal margin classifiers in the context of Vapnik's statistical learning theory. Since then SVMs have been successfully applied to real-world data analysis problems, often…

Statistics Theory · Mathematics 2016-08-16 Javier M. Moguerza , Alberto Muñoz

Support matrix machine (SMM) is an emerging classification framework that directly handles matrix-structured observations, thereby avoiding the spatial correlations destroyed by vectorization. However, most existing SMM variants rely on…

Machine Learning · Computer Science 2026-03-03 Xianchao Xiu , Shenghao Sun , Xinrong Li , Jiyuan Tao

The Support Vector Machine (SVM) has been used in a wide variety of classification problems. The original SVM uses the hinge loss function, which is non-differentiable and makes the problem difficult to solve in particular for regularized…

Machine Learning · Statistics 2015-12-01 Yangyang Xu , Ioannis Akrotirianakis , Amit Chakraborty

A widely-used tool for binary classification is the Support Vector Machine (SVM), a supervised learning technique that finds the "maximum margin" linear separator between the two classes. While SVMs have been well studied in the batch…

Machine Learning · Computer Science 2014-12-09 Vikram Nathan , Sharath Raghvendra

Support vector machines (SVMs) are well-studied supervised learning models for binary classification. In many applications, large amounts of samples can be cheaply and easily obtained. What is often a costly and error-prone process is to…

Optimization and Control · Mathematics 2024-12-20 Veronica Piccialli , Jan Schwiddessen , Antonio M. Sudoso

A novel linear classification method that possesses the merits of both the Support Vector Machine (SVM) and the Distance-weighted Discrimination (DWD) is proposed in this article. The proposed Distance-weighted Support Vector Machine method…

Machine Learning · Statistics 2015-10-09 Xingye Qiao , Lingsong Zhang

Several decades ago, Support Vector Machines (SVMs) were introduced for performing binary classification tasks, under a supervised framework. Nowadays, they often outperform other supervised methods and remain one of the most popular…

Support vector machines (SVMs) are special kernel based methods and belong to the most successful learning methods since more than a decade. SVMs can informally be described as a kind of regularized M-estimators for functions and have…

Machine Learning · Statistics 2010-07-26 Andreas Christmann , Robert Hable

This paper investigates the asymptotic behavior of the soft-margin and hard-margin support vector machine (SVM) classifiers for simultaneously high-dimensional and numerous data (large $n$ and large $p$ with $n/p\to\delta$) drawn from a…

Information Theory · Computer Science 2020-03-31 Abla Kammoun , Mohamed-Slim Alouini

A smoothing algorithm is presented for solving the soft-margin Support Vector Machine (SVM) optimization problem with an $\ell^{1}$ penalty. This algorithm is designed to require a modest number of passes over the data, which is an…

Optimization and Control · Mathematics 2024-01-19 Ibrahim Emirahmetoglu , Jeffrey Hajewski , Suely Oliveira , David E. Stewart

Recently, there have been several papers that discuss the extension of the Pinball loss Support Vector Machine (Pin-SVM) model, originally proposed by Huang et al.,[1][2]. Pin-SVM classifier deals with the pinball loss function, which has…

Machine Learning · Computer Science 2021-06-03 Pritam Anand , Reshma Rastogi , Suresh Chandra

The soft-margin support vector machine (SVM) is a ubiquitous tool for prediction of binary-response data. However, the SVM is characterized entirely via a numerical optimization problem, rather than a probability model, and thus does not…

Methodology · Statistics 2020-07-24 Hien D Nguyen , Daniel V Fryer

A new procedure for learning cost-sensitive SVM(CS-SVM) classifiers is proposed. The SVM hinge loss is extended to the cost sensitive setting, and the CS-SVM is derived as the minimizer of the associated risk. The extension of the hinge…

Machine Learning · Computer Science 2015-02-17 Hamed Masnadi-Shirazi , Nuno Vasconcelos , Arya Iranmehr

This paper addresses the problem of efficiently classifying high-dimensional data over decentralized networks. Penalized support vector machines (SVMs) are widely used for high-dimensional classification tasks. However, the double…

Machine Learning · Statistics 2025-03-11 Canyi Chen , Nan Qiao , Liping Zhu

Support vector machines (SVMs) are widely used and constitute one of the best examined and used machine learning models for two-class classification. Classification in SVM is based on a score procedure, yielding a deterministic…

Machine Learning · Statistics 2023-10-11 Sandra Benítez-Peña , Rafael Blanquero , Emilio Carrizosa , Pepa Ramírez-Cobo

We address the problem of model selection for Support Vector Machine (SVM) classification. For fixed functional form of the kernel, model selection amounts to tuning kernel parameters and the slack penalty coefficient $C$. We begin by…

Disordered Systems and Neural Networks · Physics 2007-05-23 Carl Gold , Peter Sollich

Support vector machine (SVM) has proved to be a successful approach for machine learning. Two typical SVM models are the L1-loss model for support vector classification (SVC) and $\epsilon$-L1-loss model for support vector regression (SVR).…

Optimization and Control · Mathematics 2020-03-09 Yinqiao Yan , Qingna Li