中文
相关论文

相关论文: Structured variable selection in support vector ma…

200 篇论文

In this paper, we consider asymptotic properties of the support vector machine (SVM) in high-dimension, low-sample-size (HDLSS) settings. We show that the hard-margin linear SVM holds a consistency property in which misclassification rates…

机器学习 · 统计学 2017-02-28 Yugo Nakayama , Kazuyoshi Yata , Makoto Aoshima

Conditional random field (CRF) and Structural Support Vector Machine (Structural SVM) are two state-of-the-art methods for structured prediction which captures the interdependencies among output variables. The success of these methods is…

机器学习 · 计算机科学 2015-03-19 Qi Mao , Ivor W. Tsang

For their ability to capture non-linearities in the data and to scale to large training sets, local Support Vector Machines (SVMs) have received a special attention during the past decade. In this paper, we introduce a new local SVM method,…

机器学习 · 统计学 2017-04-04 Valentina Zantedeschi , Rémi Emonet , Marc Sebban

Penalized regression models such as the Lasso have proved useful for variable selection in many fields - especially for situations with high-dimensional data where the numbers of predictors far exceeds the number of observations. These…

统计方法学 · 统计学 2014-03-19 Kasper Brink-Jensen , Claus Thorn Ekstrøm

Support vector machine (SVM) has attracted great attentions for the last two decades due to its extensive applications, and thus numerous optimization models have been proposed. To distinguish all of them, in this paper, we introduce a new…

最优化与控制 · 数学 2021-04-06 Huajun Wang , Yuanhai Shao , Shenglong Zhou , Ce Zhang , Naihua Xiu

Support Vector Machines (SVMs) based on hinge loss have been extensively discussed and applied to various binary classification tasks. These SVMs achieve a balance between margin maximization and the minimization of slack due to outliers.…

机器学习 · 计算机科学 2024-08-21 Haoxiang Sun

We propose a novel integrated formulation for multiclass and multilabel support vector machines (SVMs). A number of approaches have been proposed to extend the original binary SVM to an all-in-one multiclass SVM. However, its direct…

机器学习 · 计算机科学 2020-03-26 Hoda Shajari , Anand Rangarajan

Feature selection in learning to rank has recently emerged as a crucial issue. Whereas several preprocessing approaches have been proposed, only a few works have been focused on integrating the feature selection into the learning process.…

机器学习 · 计算机科学 2015-07-03 Léa Laporte , Rémi Flamary , Stephane Canu , Sébastien Déjean , Josiane Mothe

The Support Vector Machine (SVM) is one of the most widely used classification methods. In this paper, we consider the soft-margin SVM used on data points with independent features, where the sample size $n$ and the feature dimension $p$…

机器学习 · 统计学 2019-08-02 Haoyang Liu

This paper presents a novel framework for designing support vector machines (SVMs), which does not impose restriction on the SVM kernel to be positive-definite and allows the user to define memory constraint in terms of fixed template…

神经与进化计算 · 计算机科学 2020-01-07 P. Kumar , A. R. Nair , O. Chatterjee , T. Paul , A. Ghosh , S. Chakrabartty , C. S. Thakur

This paper presents approaches to compute sparse solutions of Generalized Singular Value Problem (GSVP). The GSVP is regularized by $\ell_1$-norm and $\ell_q$-penalty for $0<q<1$, resulting in the $\ell_1$-GSVP and $\ell_q$-GSVP…

机器学习 · 计算机科学 2024-10-08 Ugochukwu O. Ugwu , Michael Kirby

Support vector machine is an important and fundamental technique in machine learning. Soft-margin SVM models have stronger generalization performance compared with the hard-margin SVM. Most existing works use the hinge-loss function which…

最优化与控制 · 数学 2021-05-18 Lu Sitong , Li Qinana

This chapter describes componentwise Least Squares Support Vector Machines (LS-SVMs) for the estimation of additive models consisting of a sum of nonlinear components. The primal-dual derivations characterizing LS-SVMs for the estimation of…

机器学习 · 计算机科学 2007-05-23 Kristiaan Pelckmans , Ivan Goethals , Jos De Brabanter , Johan A. K. Suykens , Bart De Moor

Support vector machines (SVMs) are well-studied supervised learning models for binary classification. In many applications, large amounts of samples can be cheaply and easily obtained. What is often a costly and error-prone process is to…

最优化与控制 · 数学 2024-12-20 Veronica Piccialli , Jan Schwiddessen , Antonio M. Sudoso

In many scientific studies, it becomes increasingly important to delineate the causal pathways through a large number of mediators, such as genetic and brain mediators. Structural equation modeling (SEM) is a popular technique to estimate…

机器学习 · 统计学 2016-03-28 Yi Zhao , Xi Luo

We study a generalized framework for structured sparsity. It extends the well-known methods of Lasso and Group Lasso by incorporating additional constraints on the variables as part of a convex optimization problem. This framework provides…

机器学习 · 计算机科学 2011-06-28 Andreas Argyriou , Luca Baldassarre , Jean Morales , Massimiliano Pontil

We consider the empirical risk minimization problem for linear supervised learning, with regularization by structured sparsity-inducing norms. These are defined as sums of Euclidean norms on certain subsets of variables, extending the usual…

机器学习 · 统计学 2011-11-23 Rodolphe Jenatton , Jean-Yves Audibert , Francis Bach

As a popular tool for producing meaningful and interpretable models, large-scale sparse learning works efficiently when the underlying structures are indeed or close to sparse. However, naively applying the existing regularization methods…

统计方法学 · 统计学 2017-10-10 Zemin Zheng , Jinchi Lv , Wei Lin

In our today's information society more and more data emerges, e.g.~in social networks, technical applications, or business applications. Companies try to commercialize these data using data mining or machine learning methods. For this…

机器学习 · 统计学 2016-10-17 Tobias Reitmaier , Adrian Calma , Bernhard Sick

A new procedure for learning cost-sensitive SVM(CS-SVM) classifiers is proposed. The SVM hinge loss is extended to the cost sensitive setting, and the CS-SVM is derived as the minimizer of the associated risk. The extension of the hinge…

机器学习 · 计算机科学 2015-02-17 Hamed Masnadi-Shirazi , Nuno Vasconcelos , Arya Iranmehr