English
Related papers

Related papers: BAdaCost: Multi-class Boosting with Costs

200 papers

We study a generalization of boosting to the multiclass setting. We introduce a weak learning condition for multiclass classification that captures the original notion of weak learnability as being "slightly better than random guessing". We…

Machine Learning · Computer Science 2023-07-04 Nataly Brukhim , Amit Daniely , Yishay Mansour , Shay Moran

Various algorithms have been proposed to address the challenges posed by class-imbalanced learning from real-world data with long-tailed distributions. While these algorithms reduce prediction bias through rebalancing techniques, they often…

Machine Learning · Computer Science 2026-05-29 Hyuck Lee , Taemin Park , Heeyoung Kim

Pattern recognition applications often suffer from skewed data distributions between classes, which may vary during operations w.r.t. the design data. Two-class classification systems designed using skewed data tend to recognize the…

Machine Learning · Computer Science 2019-12-02 Roghayeh Soleymani , Eric Granger , Giorgio Fumera

A large amount of research effort has been dedicated to adapting boosting for imbalanced classification. However, boosting methods are yet to be satisfactorily immune to class imbalance, especially for multi-class problems. This is because…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Shounak Datta , Sayak Nag , Swagatam Das

The problem of class imbalance along with class-overlapping has become a major issue in the domain of supervised learning. Most supervised learning algorithms assume equal cardinality of the classes under consideration while optimizing the…

AdaBoost is an important algorithm in machine learning and is being widely used in object detection. AdaBoost works by iteratively selecting the best amongst weak classifiers, and then combines several weak classifiers to obtain a strong…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-06-07 Munther Abualkibash , Ahmed ElSayed , Ausif Mahmood

In imbalanced multi-class classification problems, the misclassification rate as an error measure may not be a relevant choice. Several methods have been developed where the performance measure retained richer information than the mere…

Machine Learning · Computer Science 2013-11-05 Sokol Koço , Cécile Capponi

Machine learning based computational intelligence methods are widely used to analyze large scale data sets in this age of big data. Extracting useful predictive modeling from these types of data sets is a challenging problem due to their…

Machine Learning · Computer Science 2016-02-10 Ferhat Özgür Çatak

Many real-world data mining applications need varying cost for different types of classification errors and thus call for cost-sensitive classification algorithms. Existing algorithms for cost-sensitive classification are successful in…

Machine Learning · Computer Science 2017-10-27 Te-Kang Jan , Da-Wei Wang , Chi-Hung Lin , Hsuan-Tien Lin

Adaptive Boosting (AdaBoost) faces significant challenges posed by label noise, especially in multiclass classification tasks. Existing methods either lack mechanisms to handle label noise effectively or suffer from high computational costs…

Machine Learning · Computer Science 2025-06-18 Qin Xie , Qinghua Zhang , Shuyin Xia , Xinran Zhou , Guoyin Wang

Model-Agnostic Meta-Learning (MAML), a popular gradient-based meta-learning framework, assumes that the contribution of each task or instance to the meta-learner is equal. Hence, it fails to address the domain shift between base and novel…

Machine Learning · Computer Science 2021-12-02 Krishnateja Killamsetty , Changbin Li , Chen Zhao , Rishabh Iyer , Feng Chen

Machine learning methods based on AdaBoost have been widely applied to various classification problems across many mission-critical applications including healthcare, law and finance. However, there is a growing concern about the unfairness…

Machine Learning · Computer Science 2024-01-09 Xiaobin Song , Zeyuan Liu , Benben Jiang

Cascade classifiers are widely used in real-time object detection. Different from conventional classifiers that are designed for a low overall classification error rate, a classifier in each node of the cascade is required to achieve an…

Computer Vision and Pattern Recognition · Computer Science 2013-01-11 Chunhua Shen , Peng Wang , Sakrapee Paisitkriangkrai , Anton van den Hengel

In this paper, we propose an AdaBoost-assisted extreme learning machine for efficient online sequential classification (AOS-ELM). In order to achieve better accuracy in online sequential learning scenarios, we utilize the cost-sensitive…

Machine Learning · Computer Science 2019-09-17 Yi-Ta Chen , Yu-Chuan Chuang , An-Yeu , Wu

Boosting combines weak classifiers to form highly accurate predictors. Although the case of binary classification is well understood, in the multiclass setting, the "correct" requirements on the weak classifier, or the notion of the most…

Machine Learning · Statistics 2011-08-16 Indraneel Mukherjee , Robert E. Schapire

Advanced classification algorithms are being increasingly used in safety-critical applications like health-care, engineering, etc. In such applications, miss-classifications made by ML algorithms can result in substantial financial or…

Machine Learning · Computer Science 2024-12-06 Disha Ghandwani , Neeraj Sarna , Yuanyuan Li , Yang Lin

This paper introduces ICET, a new algorithm for cost-sensitive classification. ICET uses a genetic algorithm to evolve a population of biases for a decision tree induction algorithm. The fitness function of the genetic algorithm is the…

Artificial Intelligence · Computer Science 2009-09-25 P. D. Turney

In this paper, we propose a different insight to analyze AdaBoost. This analysis reveals that, beyond some preconceptions, AdaBoost can be directly used as an asymmetric learning algorithm, preserving all its theoretical properties. A novel…

Machine Learning · Computer Science 2015-07-15 Iago Landesa-Vázquez , José Luis Alba-Castro

Multimodal learning (MML) is significantly constrained by modality imbalance, leading to suboptimal performance in practice. While existing approaches primarily focus on balancing the learning of different modalities to address this issue,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 QingYuan Jiang , Longfei Huang , Yang Yang

The principle of boosting in supervised learning involves combining multiple weak classifiers to obtain a stronger classifier. AdaBoost has the reputation to be a perfect example of this approach. This study analyzes the (two classes)…

Machine Learning · Computer Science 2024-02-08 Jean-Marc Brossier , Olivier Lafitte , Lenny Réthoré