English
Related papers

Related papers: Dealing with Class Imbalance using Thresholding

200 papers

Medical diagnosis might fail due to bias. In this work, we identified class-feature bias, which refers to models' potential reliance on features that are strongly correlated with only a subset of classes, leading to biased performance and…

Machine Learning · Computer Science 2025-09-03 Lishi Zuo , Man-Wai Mak , Lu Yi , Youzhi Tu

In practice, machine learning experts are often confronted with imbalanced data. Without accounting for the imbalance, common classifiers perform poorly and standard evaluation metrics mislead the practitioners on the model's performance. A…

Machine Learning · Computer Science 2020-07-21 Ramiro Camino , Christian Hammerschmidt , Radu State

Resource-constrained classification tasks are common in real-world applications such as allocating tests for disease diagnosis, hiring decisions when filling a limited number of positions, and defect detection in manufacturing settings…

Machine Learning · Computer Science 2023-11-22 Danit Shifman Abukasis , Izack Cohen , Xiaochen Xian , Kejun Huang , Gonen Singer

While tasks could come with varying the number of instances and classes in realistic settings, the existing meta-learning approaches for few-shot classification assume that the number of instances per task and class is fixed. Due to such…

Machine Learning · Computer Science 2022-02-15 Hae Beom Lee , Hayeon Lee , Donghyun Na , Saehoon Kim , Minseop Park , Eunho Yang , Sung Ju Hwang

A set of introductory notes on the subject of data classification using a linear classifier and least-squares cost function, and the negative effect of the presence of outliers on the decision boundary of the linear discriminant. We also…

Data Analysis, Statistics and Probability · Physics 2022-01-10 Babatunde M. Ayeni

Classification models are expected to perform equally well for different classes, yet in practice, there are often large gaps in their performance. This issue of class bias is widely studied in cases of datasets with sample imbalance, but…

Machine Learning · Computer Science 2024-06-04 Chiraag Kaushik , Ran Liu , Chi-Heng Lin , Amrit Khera , Matthew Y Jin , Wenrui Ma , Vidya Muthukumar , Eva L Dyer

The problem of universal outlying sequence detection is studied, where the goal is to detect outlying sequences among $M$ sequences of samples. A sequence is considered as outlying if the observations therein are generated by a distribution…

Information Theory · Computer Science 2020-05-27 Yuheng Bu , Shaofeng Zou , Venugopal V. Veeravalli

This paper deals with the binary classification task when the target class has the lower probability of occurrence. In such situation, it is not possible to build a powerful classifier by using standard methods such as logistic regression,…

Machine Learning · Statistics 2015-02-26 Cheikh Ndour , Aliou Diop , Simplice Dossou-Gbété

Standard classification theory assumes that the distribution of images in the test and training sets are identical. Unfortunately, real-life scenarios typically feature unseen data (``out-of-distribution data") which is different from data…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Gianluca Barone , Aashrit Cunchala , Rudy Nunez

Probabilistic classifiers output a probability distribution on target classes rather than just a class prediction. Besides providing a clear separation of prediction and decision making, the main advantage of probabilistic models is their…

Machine Learning · Computer Science 2019-02-20 Juozas Vaicenavicius , David Widmann , Carl Andersson , Fredrik Lindsten , Jacob Roll , Thomas B. Schön

In an industrial context, the activity of sensors is recorded at a high frequency. A challenge is to automatically detect abnormal measurement behavior. Considering the sensor measures as functional data, the problem can be formulated as…

Statistics Theory · Mathematics 2022-03-09 Martial Amovin-Assagba , Irène Gannaz , Julien Jacques

Class-imbalance is a common problem in machine learning practice. Typical Imbalanced Learning (IL) methods balance the data via intuitive class-wise resampling or reweighting. However, previous studies suggest that beyond class-imbalance,…

Machine Learning · Computer Science 2022-11-24 Zhining Liu , Pengfei Wei , Zhepei Wei , Boyang Yu , Jing Jiang , Wei Cao , Jiang Bian , Yi Chang

Outlier is the term that indicates in statistics an anomalous observation, aberrant, clearly distant from others collected observations. The outliers are the subject to animated discussions in various contexts with regard to be or not to be…

Applications · Statistics 2014-03-24 Gianluca Rosso

Ensemble methods for classification and clustering have been effectively used for decades, while ensemble learning for outlier detection has only been studied recently. In this work, we design a new ensemble approach for outlier detection…

Machine Learning · Computer Science 2016-09-20 Shebuti Rayana , Wen Zhong , Leman Akoglu

This work describes an outlier detection procedure (named "OutlierTree") loosely based on the GritBot software developed by RuleQuest research, which works by evaluating and following supervised decision tree splits on variables, in whose…

Machine Learning · Statistics 2020-01-06 David Cortes

In imbalanced multi-class classification problems, the misclassification rate as an error measure may not be a relevant choice. Several methods have been developed where the performance measure retained richer information than the mere…

Machine Learning · Computer Science 2013-11-05 Sokol Koço , Cécile Capponi

We study the problem of estimating the means of well-separated mixtures when an adversary may add arbitrary outliers. While strong guarantees are available when the outlier fraction is significantly smaller than the minimum mixing weight,…

Recent studies showed that datasets used in fairness-aware machine learning for multiple protected attributes (referred to as multi-discrimination hereafter) are often imbalanced. The class-imbalance problem is more severe for the often…

Machine Learning · Computer Science 2022-06-22 Arjun Roy , Vasileios Iosifidis , Eirini Ntoutsi

Using hierarchies of classes is one of the standard methods to solve multi-class classification problems. In the literature, selecting the right hierarchy is considered to play a key role in improving classification performance. Although…

Machine Learning · Computer Science 2021-01-28 Pablo del Moral , Slawomir Nowaczyk , Anita Sant'Anna , Sepideh Pashami

This paper presents a new approach for detecting outliers by introducing the notion of object's proximity. The main idea is that normal point has similar characteristics with several neighbors. So the point in not an outlier if it has a…

Computer Vision and Pattern Recognition · Computer Science 2014-11-26 Amina Dik , Khalid Jebari , Abdelaziz Bouroumi , Aziz Ettouhami