English
Related papers

Related papers: Efficient Decision Trees for Multi-class Support V…

200 papers

Classification algorithms face difficulties when one or more classes have limited training data. We are particularly interested in classification trees, due to their interpretability and flexibility. When data are limited in one or more of…

Methodology · Statistics 2021-06-15 Yichen Zhu , Cheng Li , David B. Dunson

This paper presents a computationally efficient variant of gradient boosting for multi-class classification and multi-output regression tasks. Standard gradient boosting uses a 1-vs-all strategy for classifications tasks with more than two…

Machine Learning · Computer Science 2024-07-25 Seyedsaman Emami , Gonzalo Martínez-Muñoz

A method based on one class support vector machine (OCSVM) is proposed for class incremental learning. Several OCSVM models divide the input space into several parts. Then, the 1VS1 classifiers are constructed for the confuse part by using…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Chengfei Yao , Jie Zou , Yanan Luo , Tao Li , Gang Bai

Several real-world classification problems are example-dependent cost-sensitive in nature, where the costs due to misclassification vary between examples and not only within classes. However, standard classification methods do not take…

Machine Learning · Computer Science 2015-05-19 Alejandro Correa Bahnsen , Djamila Aouada , Bjorn Ottersten

One-class Classification (OCC) is an area of machine learning which addresses prediction based on unbalanced datasets. Basically, OCC algorithms achieve training by means of a single class sample, with potentially some additional…

Machine Learning · Statistics 2020-03-27 Sarah Itani , Fabian Lecron , Philippe Fortemps

Classification models are very sensitive to data uncertainty, and finding robust classifiers that are less sensitive to data uncertainty has raised great interest in the machine learning literature. This paper aims to construct robust…

Machine Learning · Statistics 2022-03-01 Vali Asimit , Ioannis Kyriakou , Simone Santoni , Salvatore Scognamiglio , Rui Zhu

This paper presents a review on methods for class-imbalanced learning with the Support Vector Machine (SVM) and its variants. We first explain the structure of SVM and its variants and discuss their inefficiency in learning with…

Machine Learning · Computer Science 2024-07-23 Salim Rezvani , Farhad Pourpanah , Chee Peng Lim , Q. M. Jonathan Wu

Neural Networks and related Deep Learning methods are currently at the leading edge of technologies used for classifying objects. However, they generally demand large amounts of time and data for model training; and their learned models can…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Malcolm C. A. White , Kushal Sharma , Ang Li , T. K. Satish Kumar , Nori Nakata

With the rapid advancement of test-time compute search strategies to improve the mathematical problem-solving capabilities of large language models (LLMs), the need for building robust verifiers has become increasingly important. However,…

Computation and Language · Computer Science 2025-03-11 Jung Hyun Lee , June Yong Yang , Byeongho Heo , Dongyoon Han , Kyungsu Kim , Eunho Yang , Kang Min Yoo

We review the concept of support vector machines (SVMs) and discuss examples of their use. One of the benefits of SVM algorithms, compared with neural networks and decision trees is that they can be less susceptible to over fitting than…

Data Analysis, Statistics and Probability · Physics 2016-12-21 A. Bethani , A. J. Bevan , J. Hays , T. J. Stevenson

Support Vector Machines (SVM) have gathered significant acclaim as classifiers due to their successful implementation of Statistical Learning Theory. However, in the context of multiclass and multilabel settings, the reliance on…

Machine Learning · Computer Science 2023-07-19 Sambhav Jain Reshma Rastogi

Verifying the robustness of machine learning models against evasion attacks at test time is an important research problem. Unfortunately, prior work established that this problem is NP-hard for decision tree ensembles, hence bound to be…

Machine Learning · Computer Science 2023-11-14 Stefano Calzavara , Lorenzo Cazzaro , Giulio Ermanno Pibiri , Nicola Prezza

Automatic diagnosis of coronary heart disease helps the doctor to support in decision making a diagnosis. Coronary heart disease have some types or levels. Referring to the UCI Repository dataset, it divided into 4 types or levels that are…

Machine Learning · Computer Science 2015-11-17 Wiharto Wiharto , Hari Kusnanto , Herianto Herianto

We present a novel machine learning architecture for classification suggested by experiments on olfactory systems. The network separates input stimuli, represented as spatially distinct currents, via winnerless competition---a process based…

Biological Physics · Physics 2020-06-18 Jason A. Platt , Anna Miller , Lawson Fuller , Henry D. I. Abarbanel

We investigate the issue of model selection and the use of the nonconformity (strangeness) measure in batch learning. Using the nonconformity measure we propose a new training algorithm that helps avoid the need for Cross-Validation or…

Machine Learning · Statistics 2009-09-15 David R. Hardoon , Zakria Hussain , John Shawe-Taylor

Tree-based machine learning techniques, such as Decision Trees and Random Forests, are top performers in several domains as they do well with limited training datasets and offer improved interpretability compared to Deep Neural Networks…

Emerging Technologies · Computer Science 2021-10-27 Giacomo Pedretti , Catherine E. Graves , Can Li , Sergey Serebryakov , Xia Sheng , Martin Foltin , Ruibin Mao , John Paul Strachan

Decision trees are among the most popular machine learning models and are used routinely in applications ranging from revenue management and medicine to bioinformatics. In this paper, we consider the problem of learning optimal binary…

Machine Learning · Computer Science 2023-07-20 Sina Aghaei , Andrés Gómez , Phebe Vayanos

Support vector machine (SVM) is a powerful machine learning algorithm to handle classification tasks. However, the classical SVM is developed for binary problems with the assumption of balanced datasets. Obviously, the multi-class…

Machine Learning · Computer Science 2025-02-21 Zhong-Liang Zhang , Jie Yang , Jian-Ming Ru , Xiao-Xi Zhao , Xing-Gang Luo

Support vector machines (SVM) can classify data sets along highly non-linear decision boundaries because of the kernel-trick. This expressiveness comes at a price: During test-time, the SVM classifier needs to compute the kernel…

Machine Learning · Computer Science 2015-02-03 Zhixiang Xu , Jacob R. Gardner , Stephen Tyree , Kilian Q. Weinberger

Decision tree learning is a widely used approach in machine learning, favoured in applications that require concise and interpretable models. Heuristic methods are traditionally used to quickly produce models with reasonably high accuracy.…