English
Related papers

Related papers: Sharp error bounds for imbalanced classification: …

200 papers

In many application domains such as medicine, information retrieval, cybersecurity, social media, etc., datasets used for inducing classification models often have an unequal distribution of the instances of each class. This situation,…

Machine Learning · Computer Science 2022-01-21 Mohamed S. Kraiem , Fernando Sánchez-Hernández , María N. Moreno-García

The concept of a minimax classifier is well-established in statistical decision theory, but its implementation via neural networks remains challenging, particularly in scenarios with imbalanced training data having a limited number of…

Machine Learning · Computer Science 2026-01-07 Hansung Choi , Daewon Seo

We present a novel analysis of the expected risk of weighted majority vote in multiclass classification. The analysis takes correlation of predictions by ensemble members into account and provides a bound that is amenable to efficient…

Machine Learning · Computer Science 2020-12-18 Andrés R. Masegosa , Stephan S. Lorenzen , Christian Igel , Yevgeny Seldin

Improving the classification of multi-class imbalanced data is more difficult than its two-class counterpart. In this paper, we use deep neural networks to train new representations of tabular multi-class data. Unlike the typically…

Machine Learning · Computer Science 2023-12-19 Damian Horna , Lango Mateusz , Jerzy Stefanowski

Class imbalance in data presents significant challenges for classification tasks. It is fairly common and requires careful handling to obtain desirable performance. Traditional classification algorithms become biased toward the majority…

Machine Learning · Computer Science 2024-10-28 Asif Newaz , Asif Ur Rahman Adib , Taskeed Jabid

Internet services have led to the eruption of network traffic, and machine learning on these Internet data has become an indispensable tool, especially when the application is risk-sensitive. This paper focuses on network traffic…

Machine Learning · Statistics 2025-02-12 Wumei Du , Dong Liang , Yiqin Lv , Xingxing Liang , Guanlin Wu , Qi Wang , Zheng Xie

In many real-world binary classification tasks (e.g. detection of certain objects from images), an available dataset is imbalanced, i.e., it has much less representatives of a one class (a minor class), than of another. Generally, accurate…

Machine Learning · Statistics 2017-07-14 Evgeny Burnaev , Pavel Erofeev , Artem Papanov

The task of roof damage classification and segmentation from overhead imagery presents unique challenges. In this work we choose to address the challenge posed due to strong class imbalance. We propose four distinct techniques that aim at…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Jean-Baptiste Boin , Nat Roth , Jigar Doshi , Pablo Llueca , Nicolas Borensztein

Several variants of reweighted risk functionals, such as focal loss, inverse focal loss, and the Area Under the Risk Coverage Curve (AURC), have been proposed for improving model calibration; yet their theoretical connections to calibration…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Han Zhou , Sebastian G. Gruber , Teodora Popordanoska , Matthew B. Blaschko

In binary classification, imbalance refers to situations in which one class is heavily under-represented. This issue is due to either a data collection process or because one class is indeed rare in a population. Imbalanced classification…

Methodology · Statistics 2022-01-07 Arezou Mojiri , Abbas Khalili , Ali Zeinal Hamadani

Imbalanced datasets are commonplace in modern machine learning problems. The presence of under-represented classes or groups with sensitive attributes results in concerns about generalization and fairness. Such concerns are further…

Machine Learning · Computer Science 2022-01-05 Mingchen Li , Xuechen Zhang , Christos Thrampoulidis , Jiasi Chen , Samet Oymak

This study is about inducing classifiers using data that is imbalanced, with a minority class being under-represented in relation to the majority classes. The first section of this research focuses on the main characteristics of data that…

Machine Learning · Computer Science 2022-10-25 Shivaditya Shivganesh , Nitin Narayanan N , Pranav Murali , Ajaykumar M

We consider a general statistical learning problem where an unknown fraction of the training data is corrupted. We develop a robust learning method that only requires specifying an upper bound on the corrupted data fraction. The method…

Machine Learning · Statistics 2020-02-10 Muhammad Osama , Dave Zachariah , Peter Stoica

Real-world datasets exhibit imbalances of varying types and degrees. Several techniques based on re-weighting and margin adjustment of loss are often used to enhance the performance of neural networks, particularly on minority classes. In…

Machine Learning · Computer Science 2022-12-29 Harsh Rangwani , Sumukh K Aithal , Mayank Mishra , R. Venkatesh Babu

We develop minimax optimal risk bounds for the general learning task consisting in predicting as well as the best function in a reference set G up to the smallest possible additive term, called the convergence rate. When the reference set…

Statistics Theory · Mathematics 2008-03-04 Jean-Yves Audibert

In machine learning models, the estimation of errors is often complex due to distribution bias, particularly in spatial data such as those found in environmental studies. We introduce an approach based on the ideas of importance sampling to…

Machine Learning · Computer Science 2023-09-15 Boris Prokhorov , Diana Koldasbayeva , Alexey Zaytsev

In this study, we consider classification problems based on neural networks in data-imbalanced environment. Learning from an imbalanced data set is one of the most important and practical problems in the field of machine learning. A…

Machine Learning · Statistics 2019-12-02 Muneki Yasuda , Seishirou Ueno

Weighted empirical risk minimization is a common approach to prediction under distribution drift. This article studies its out-of-sample prediction error under nonstationarity. We provide a general decomposition of the excess risk into a…

Machine Learning · Statistics 2026-05-19 Tobias Brock , Thomas Nagler

The balanced loss is a widely adopted objective for multi-class classification under class imbalance. By assigning equal importance to all classes, regardless of their frequency, it promotes fairness and ensures that minority classes are…

Machine Learning · Computer Science 2026-01-01 Corinna Cortes , Mehryar Mohri , Yutao Zhong

In this paper we refine the process of computing calibration functions for a number of multiclass classification surrogate losses. Calibration functions are a powerful tool for easily converting bounds for the surrogate risk (which can be…

Machine Learning · Statistics 2016-09-22 Bernardo Ávila Pires , Csaba Szepesvári