English
Related papers

Related papers: Exact high-dimensional asymptotics for Support Vec…

200 papers

The Support Vector Machine (SVM) is a popular classification paradigm in machine learning and has achieved great success in real applications. However, the standard SVM can not select variables automatically and therefore its solution…

Methodology · Statistics 2008-12-18 Hao Helen Zhang , Yufeng Liu , Yichao Wu , Ji Zhu

The surroundings of a cancerous tumor impact how it grows and develops in humans. New data from early breast cancer patients contains information on the collagen fibers surrounding the tumorous tissue -- offering hope of finding additional…

Applications · Statistics 2022-06-30 Sean Kent , Menggang Yu

The computational complexity of solving nonlinear support vector machine (SVM) is prohibitive on large-scale data. In particular, this issue becomes very sensitive when the data represents additional difficulties such as highly imbalanced…

Machine Learning · Computer Science 2019-04-09 E. Sadrfaridpour , T. Razzaghi , I. Safro

Nonlinear regression methods, such as local optimization algorithms, are widely used in the extraction of nanostructure profile parameters in optical scatterometry. The success of local optimization algorithms heavily relies on the…

Optimization and Control · Mathematics 2019-05-17 Jinlong Zhu , Hao Jiang , Chuanwei Zhang , Xiuguo Chen , Shiyuan Liu

This paper presents a comprehensive analysis of a broad range of variations of the stochastic proximal point method (SPPM). Proximal point methods have attracted considerable interest owing to their numerical stability and robustness…

Optimization and Control · Mathematics 2024-05-28 Peter Richtárik , Abdurakhmon Sadiev , Yury Demidovich

Software defect prediction is an essential task during the software development Lifecycle as it can help managers to identify the most defect-proneness modules. Thus, it can reduce the test cost and assign testing resources efficiently.…

Software Engineering · Computer Science 2022-09-30 Haneen Abu Alhija , Mohammad Azzeh , Fadi Almasalha

In this work we study binary classification problems where we assume that our training data is subject to uncertainty, i.e. the precise data points are not known. To tackle this issue in the field of robust machine learning the aim is to…

Machine Learning · Computer Science 2022-03-04 Jannis Kurtz

Machine learning is widely used in developing computer-aided diagnosis (CAD) schemes of medical images. However, CAD usually computes large number of image features from the targeted regions, which creates a challenge of how to identify a…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Morteza Heidari , Sivaramakrishnan Lakshmivarahan , Seyedehnafiseh Mirniaharikandehei , Gopichandh Danala , Sai Kiran R. Maryada , Hong Liu , Bin Zheng

The Support Vector Machine (SVM) method has been widely used in numerous classification tasks. The main idea of this algorithm is based on the principle of the margin maximization to find an hyperplane which separates the data into two…

Computation and Language · Computer Science 2015-07-23 Rimah Amami , Dorra Ben Ayed , Nouerddine Ellouze

Dropout and other feature noising schemes have shown promising results in controlling over-fitting by artificially corrupting the training data. Though extensive theoretical and empirical studies have been performed for generalized linear…

Machine Learning · Computer Science 2015-08-11 Ning Chen , Jun Zhu , Jianfei Chen , Ting Chen

Support vector machines (SVMs) with sparsity-inducing nonconvex penalties have received considerable attentions for the characteristics of automatic classification and variable selection. However, it is quite challenging to solve the…

Machine Learning · Statistics 2018-09-12 Lei Guan , Linbo Qiao , Dongsheng Li , Tao Sun , Keshi Ge , Xicheng Lu

A key problem in deep learning and computational neuroscience is relating the geometrical properties of neural representations to task performance. Here, we consider this problem for continuous decoding tasks where neural variability may…

Disordered Systems and Neural Networks · Physics 2025-07-01 Abdulkadir Canatar , SueYeon Chung

The imminent advent of very large-scale optical sky surveys, such as Euclid and LSST, makes it important to find efficient ways of discovering rare objects such as strong gravitational lens systems, where a background object is multiply…

Instrumentation and Methods for Astrophysics · Physics 2017-08-23 P. Hartley , R. Flamary , N. Jackson , A. S. Tagore , R. B. Metcalf

For binary classification we establish learning rates up to the order of $n^{-1}$ for support vector machines (SVMs) with hinge loss and Gaussian RBF kernels. These rates are in terms of two assumptions on the considered distributions:…

Statistics Theory · Mathematics 2007-08-22 Ingo Steinwart , Clint Scovel

In the context of linear regression, we construct a data-driven convex loss function with respect to which empirical risk minimisation yields optimal asymptotic variance in the downstream estimation of the regression coefficients. At the…

Statistics Theory · Mathematics 2025-05-29 Oliver Y. Feng , Yu-Chun Kao , Min Xu , Richard J. Samworth

Motivated by the problem of identifying correlations between genes or features of two related biological systems, we propose a model of \emph{feature selection} in which only a subset of the predictors $X_t$ are dependent on the…

Applications · Statistics 2011-11-29 Charles Zheng , Scott Schwartz , Robert Chapkin , Raymond Carroll , Ivan Ivanov

Support Vector Data Description is a popular method for outlier detection. However, its usefulness largely depends on selecting good hyperparameter values -- a difficult problem that has received significant attention in literature.…

Machine Learning · Computer Science 2019-12-05 Holger Trittenbach , Klemens Böhm , Ira Assent

This paper analyzes a new regularized learning scheme for high dimensional partially linear support vector machine. The proposed approach consists of an empirical risk and the Lasso-type penalty for linear part, as well as the standard…

Statistics Theory · Mathematics 2020-06-08 Yifan Xia , Yongchao Hou , Shaogao Lv

We study the typical learning properties of the recently proposed Support Vectors Machines. The generalization error on linearly separable tasks, the capacity, the typical number of Support Vectors, the margin, and the robustness or noise…

Disordered Systems and Neural Networks · Physics 2007-05-23 A. Buhot , Mirta B. Gordon

We propose a novel non-parametric adaptive anomaly detection algorithm for high dimensional data based on rank-SVM. Data points are first ranked based on scores derived from nearest neighbor graphs on n-point nominal data. We then train a…

Machine Learning · Statistics 2014-05-06 Jing Qian , Jonathan Root , Venkatesh Saligrama , Yuting Chen