English
Related papers

Related papers: Scaling Up ROC-Optimizing Support Vector Machines

200 papers

We present an evolutionary algorithm evo-SMC for the problem of Submodular Maximization under Cost constraints (SMC). Our algorithm achieves $1/2$-approximation with a high probability $1-1/n$ within $\mathcal{O}(n^2K_{\beta})$ iterations,…

Data Structures and Algorithms · Computer Science 2024-08-20 Yanhui Zhu , Samik Basu , A Pavan

For the binary classification problem, a novel nonlinear kernel-free quadratic hyper-surface support vector machine with 0-1 loss function (QSSVM$_{0/1}$) is proposed. Specifically, the task of QSSVM$_{0/1}$ is to seek a quadratic…

Optimization and Control · Mathematics 2024-04-17 Mingyang Wu , Zhixia Yang , Junyou Ye

We present an efficient method for training slack-rescaled structural SVM. Although finding the most violating label in a margin-rescaled formulation is often easy since the target function decomposes with respect to the structure, this is…

Machine Learning · Computer Science 2015-10-29 Heejin Choi , Ofer Meshi , Nathan Srebro

Regularized kernel methods such as support vector machines (SVM) and support vector regression (SVR) constitute a broad and flexible class of methods which are theoretically well investigated and commonly used in nonparametric…

Methodology · Statistics 2013-05-07 Robert Hable

Robust estimators for linear regression require non-convex objective functions to shield against adverse affects of outliers. This non-convexity brings challenges, particularly when combined with penalization in high-dimensional settings.…

Computation · Statistics 2025-08-08 David Kepplinger , Siqi Wei

Support vector machines (SVMs) are invaluable tools for many practical applications in artificial intelligence, e.g., classification and event recognition. However, popular SVM solvers are not sufficiently efficient for applications with a…

Machine Learning · Computer Science 2011-10-02 Tianyi Zhou , Dacheng Tao , Xindong Wu

Support vector machine (SVM) is a powerful classification method that has achieved great success in many fields. Since its performance can be seriously impaired by redundant covariates, model selection techniques are widely used for SVM…

Machine Learning · Statistics 2022-07-25 Chaoxia Yuan , Chao Ying , Zhou Yu , Fang Fang

The Receiver Operating Characteristic (ROC) curve is a useful tool that measures the discriminating power of a continuous variable or the accuracy of a pharmaceutical or medical test to distinguish between two conditions or classes. In…

Methodology · Statistics 2022-07-26 Ana M. Bianco , Graciela Boente , Wenceslao Gonzalez-Manteiga

We present the first optimal rates for infinite-dimensional vector-valued ridge regression on a continuous scale of norms that interpolate between $L_2$ and the hypothesis space, which we consider as a vector-valued reproducing kernel…

Machine Learning · Statistics 2024-08-07 Zhu Li , Dimitri Meunier , Mattes Mollenhauer , Arthur Gretton

The receiver operating characteristic (ROC) curve is a very useful tool for analyzing the diagnostic/classification power of instruments/classification schemes as long as a binary-scale gold standard is available. When the gold standard is…

Methodology · Statistics 2011-05-10 Zhanfeng Wang , Yuan-chin Ivan Chang

Support Vector Machines (SVMs) are popular tools for data mining tasks such as classification, regression, and density estimation. However, original SVM (C-SVM) only considers local information of data points on or over the margin.…

Artificial Intelligence · Computer Science 2010-09-28 Xin Liu , Ying Ding , Forrest Sheng Bao

A support vector machine (SVM) is an algorithm that finds a hyperplane which optimally separates labeled data points in $\mathbb{R}^n$ into positive and negative classes. The data points on the margin of this separating hyperplane are…

Machine Learning · Computer Science 2022-09-19 Henry Adams , Elin Farnell , Brittany Story

A wide variety of machine learning algorithms such as support vector machine (SVM), minimax probability machine (MPM), and Fisher discriminant analysis (FDA), exist for binary classification. The purpose of this paper is to provide a…

Machine Learning · Computer Science 2012-06-22 Akiko Takeda , Hiroyuki Mitsugi , Takafumi Kanamori

With data sizes constantly expanding, and with classical machine learning algorithms that analyze such data requiring larger and larger amounts of computation time and storage space, the need to distribute computation and memory…

Machine Learning · Computer Science 2015-12-08 Aruna Govada , Shree Ranjani , Aditi Viswanathan , S. K. Sahay

This paper deals with an extension of the Support Vector Machine (SVM) for classification problems where, in addition to maximize the margin, i.e., the width of strip defined by the two supporting hyperplanes, the minimum of the ordered…

Optimization and Control · Mathematics 2021-07-15 Alfredo Marín , Luisa I. Martínez-Merino , Justo Puerto , Antonio M. Rodríguez-Chía

Interest in bilevel optimization has grown in recent years, partially due to its applications to tackle challenging machine-learning problems. Several exciting recent works have been centered around developing efficient gradient-based…

Optimization and Control · Mathematics 2024-08-27 Liuyuan Jiang , Quan Xiao , Victor M. Tenorio , Fernando Real-Rojas , Antonio G. Marques , Tianyi Chen

Machine learning algorithms in high-dimensional settings are highly susceptible to the influence of even a small fraction of structured outliers, making robust optimization techniques essential. In particular, within the…

Machine Learning · Computer Science 2025-04-25 Changyu Gao , Andrew Lowy , Xingyu Zhou , Stephen J. Wright

Support vector machine (SVM) is one of the most popular classification algorithms in the machine learning literature. We demonstrate that SVM can be used to balance covariates and estimate average causal effects under the unconfoundedness…

Methodology · Statistics 2021-07-02 Alexander Tarr , Kosuke Imai

Robust optimization is a very popular means to address decision-making problems affected by uncertainty. Its success has been fueled by its attractive robustness and scalability properties, by ease of modeling, and by the limited…

Optimization and Control · Mathematics 2020-06-17 Phebe Vayanos , Qing Jin , George Elissaios

An approach to the construction of classifiers from imbalanced datasets is described. A dataset is imbalanced if the classification categories are not approximately equally represented. Often real-world data sets are predominately composed…

Artificial Intelligence · Computer Science 2011-11-25 N. V. Chawla , K. W. Bowyer , L. O. Hall , W. P. Kegelmeyer