English
Related papers

Related papers: Proximal Operator and Optimality Conditions for Ra…

200 papers

Support vector machine (SVM) has proved to be a successful approach for machine learning. Two typical SVM models are the L1-loss model for support vector classification (SVC) and $\epsilon$-L1-loss model for support vector regression (SVR).…

Optimization and Control · Mathematics 2020-03-09 Yinqiao Yan , Qingna Li

Kernel-based regularized risk minimizers, also called support vector machines (SVMs), are known to possess many desirable properties but suffer from their super-linear computational requirements when dealing with large data sets. This…

Machine Learning · Statistics 2023-05-17 Hannes Köhler

This paper presents a Multiple Kernel Learning (abbreviated as MKL) framework for the Support Vector Machine (SVM) with the $(0, 1)$ loss function. Some KKT-like first-order optimality conditions are provided and then exploited to develop a…

Machine Learning · Statistics 2023-09-06 Bin Zhu , Yijie Shi

The Support Vector Machine (SVM) is one of the most widely used classification methods. In this paper, we consider the soft-margin SVM used on data points with independent features, where the sample size $n$ and the feature dimension $p$…

Machine Learning · Statistics 2019-08-02 Haoyang Liu

Stochastic proximal point methods have recently garnered renewed attention within the optimization community, primarily due to their desirable theoretical properties. Notably, these methods exhibit a convergence rate that is independent of…

Optimization and Control · Mathematics 2024-12-19 Elnur Gasanov , Peter Richtárik

Traditional Support Vector Machine (SVM) classification is carried out by finding the max-margin classifier for the training data that divides the margin space into two equal sub-spaces. This study demonstrates limitations of performing…

Machine Learning · Computer Science 2026-03-12 Satyajeet Sahoo , Jhareswar Maiti

Kernel-based methods for support vector machines (SVM) have shown highly advantageous performance in various applications. However, they may incur prohibitive computational costs for large-scale sample datasets. Therefore, data reduction…

Optimization and Control · Mathematics 2021-04-27 Shenglong Zhou

Support vector machines (SVMs) are special kernel based methods and belong to the most successful learning methods since more than a decade. SVMs can informally be described as a kind of regularized M-estimators for functions and have…

Machine Learning · Statistics 2010-07-26 Andreas Christmann , Robert Hable

Localized support vector machines solve SVMs on many spatially defined small chunks and one of their main characteristics besides the computational benefit compared to global SVMs is the freedom of choosing arbitrary kernel and…

Statistics Theory · Mathematics 2019-09-27 Ingrid Blaschzyk , Ingo Steinwart

The support vector machine (SVM) is a well-established classification method whose name refers to the particular training examples, called support vectors, that determine the maximum margin separating hyperplane. The SVM classifier is known…

Statistics Theory · Mathematics 2022-06-15 Daniel Hsu , Vidya Muthukumar , Ji Xu

Minimax optimization problems arises from both modern machine learning including generative adversarial networks, adversarial training and multi-agent reinforcement learning, as well as from tradition research areas such as saddle point…

Optimization and Control · Mathematics 2020-04-22 Yu-HOng Dai , Liwei Zhang

Support vector machine (SVM), is a popular kernel method for data classification that demonstrated its efficiency for a large range of practical applications. The method suffers, however, from some weaknesses including; time processing,…

Machine Learning · Computer Science 2023-08-23 Lakhdar Remaki

This paper considers distributed optimization algorithms, with application in binary classification via distributed support-vector-machines (D-SVM) over multi-agent networks subject to some link nonlinearities. The agents solve a…

Systems and Control · Electrical Eng. & Systems 2023-04-14 Mohammadreza Doostmohammadian , Alireza Aghasi , Houman Zarrabi

Support vector machine (SVM) has achieved many successes in machine learning, especially for a small sample problem. As a famous extension of the traditional SVM, the $\nu$ support vector machine ($\nu$-SVM) has shown outstanding…

Machine Learning · Computer Science 2024-03-05 Zhiji Yang , Wanyi Chen , Huan Zhang , Yitian Xu , Lei Shi , Jianhua Zhao

Most existing work focuses on the generalization of KKT for nonsmooth convex optimization problems, but this paper explores a generalized form of Karush-Kuhn-Tucker (KKT) conditions for real continuous optimization problems.

Optimization and Control · Mathematics 2020-04-09 Stanley Yang

This paper is devoted to study of optimality conditions at infinity in nonsmooth minimax programming problems and applications. By means of the limiting subdifferential and normal cone at infinity, we dirive necessary and sufficient…

Optimization and Control · Mathematics 2024-05-17 Nguyen Van Tuyen , Kwan Deok Bae , Do Sang Kim

The real-time solution of parametric optimization problems is critical for applications that demand high accuracy under tight real-time constraints, such as model predictive control. To this end, this work presents a learning-based…

Machine Learning · Computer Science 2025-11-17 Lukas Lüken , Sergio Lucia

We investigate the relation of two fundamental tools in machine learning and signal processing, that is the support vector machine (SVM) for classification, and the Lasso technique used in regression. We show that the resulting optimization…

Machine Learning · Computer Science 2014-04-28 Martin Jaggi

Support vector regression (SVR) is one of the most popular machine learning algorithms aiming to generate the optimal regression curve through maximizing the minimal margin of selected training samples, i.e., support vectors. Recent…

Machine Learning · Computer Science 2019-05-07 Gaoyang Li , Jinyu Yang , Chunguo Wu , Qin Ma

Support vector machine (SVM) has been one of the most popular learning algorithms, with the central idea of maximizing the minimum margin, i.e., the smallest distance from the instances to the classification boundary. Recent theoretical…

Machine Learning · Computer Science 2020-07-07 Teng Zhang , Zhi-Hua Zhou