English
Related papers

Related papers: Rethinking Class Imbalance in Machine Learning

200 papers

Intelligent diagnosis method based on data-driven and deep learning is an attractive and meaningful field in recent years. However, in practical application scenarios, the imbalance of time-series fault is an urgent problem to be solved.…

Machine Learning · Computer Science 2021-07-15 Xingtai Gui , Jiyang Zhang

Automated Machine Learning has grown very successful in automating the time-consuming, iterative tasks of machine learning model development. However, current methods struggle when the data is imbalanced. Since many real-world datasets are…

Machine Learning · Computer Science 2022-11-02 Prabhant Singh , Joaquin Vanschoren

Imbalanced problems can arise in different real-world situations, and to address this, certain strategies in the form of resampling or balancing algorithms are proposed. This issue has largely been studied in the context of classification,…

Machine Learning · Computer Science 2025-07-17 Juscimara G. Avelino , George D. C. Cavalcanti , Rafael M. O. Cruz

This study is about inducing classifiers using data that is imbalanced, with a minority class being under-represented in relation to the majority classes. The first section of this research focuses on the main characteristics of data that…

Machine Learning · Computer Science 2022-10-25 Shivaditya Shivganesh , Nitin Narayanan N , Pranav Murali , Ajaykumar M

Multi-task learning (MTL) aims to build general-purpose vision systems by training a single network to perform multiple tasks jointly. While promising, its potential is often hindered by "unbalanced optimization", where task interference…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yihang Guo , Tianyuan Yu , Liang Bai , Yanming Guo , Yirun Ruan , William Li , Weishi Zheng

Methods to correct class imbalance, i.e. imbalance between the frequency of outcome events and non-events, are receiving increasing interest for developing prediction models. We examined the effect of imbalance correction on the performance…

Methodology · Statistics 2022-02-21 Ruben van den Goorbergh , Maarten van Smeden , Dirk Timmerman , Ben Van Calster

For classification, the problem of class imbalance is well known and has been extensively studied. In this paper, we argue that imbalance in regression is an equally important problem which has so far been overlooked: Due to under- and…

Machine Learning · Computer Science 2024-02-20 Daniel Kowatsch , Nicolas M. Müller , Kilian Tscharke , Philip Sperl , Konstantin Bötinger

Medical diagnosis might fail due to bias. In this work, we identified class-feature bias, which refers to models' potential reliance on features that are strongly correlated with only a subset of classes, leading to biased performance and…

Machine Learning · Computer Science 2025-09-03 Lishi Zuo , Man-Wai Mak , Lu Yi , Youzhi Tu

Federated learning (FL) is a promising approach for training decentralized data located on local client devices while improving efficiency and privacy. However, the distribution and quantity of the training data on the clients' side may…

Machine Learning · Computer Science 2020-12-16 Lixu Wang , Shichao Xu , Xiao Wang , Qi Zhu

Class imbalance poses a significant challenge to supervised classification, particularly in critical domains like medical diagnostics and anomaly detection where minority class instances are rare. While numerous studies have explored…

Machine Learning · Computer Science 2025-09-10 Ali Nawaz , Amir Ahmad , Shehroz S. Khan

Class-wise characteristics of training examples affect the performance of deep classifiers. A well-studied example is when the number of training examples of classes follows a long-tailed distribution, a situation that is likely to yield…

Machine Learning · Computer Science 2025-05-02 Z. S. Baltaci , K. Oksuz , S. Kuzucu , K. Tezoren , B. K. Konar , A. Ozkan , E. Akbas , S. Kalkan

Machine learning (ML) is playing an increasingly important role in rendering decisions that affect a broad range of groups in society. ML models inform decisions in criminal justice, the extension of credit in banking, and the hiring…

Machine Learning · Computer Science 2022-07-14 Damien Dablain , Bartosz Krawczyk , Nitesh Chawla

In predictive tasks, real-world datasets often present different degrees of imbalanced (i.e., long-tailed or skewed) distributions. While the majority (the head) classes have sufficient samples, the minority (the tail) classes can be…

Machine Learning · Computer Science 2021-09-14 Chongsheng Zhang , Paolo Soda , Jingjun Bi , Gaojuan Fan , George Almpanidis , Salvador Garcia

Classification models are expected to perform equally well for different classes, yet in practice, there are often large gaps in their performance. This issue of class bias is widely studied in cases of datasets with sample imbalance, but…

Machine Learning · Computer Science 2024-06-04 Chiraag Kaushik , Ran Liu , Chi-Heng Lin , Amrit Khera , Matthew Y Jin , Wenrui Ma , Vidya Muthukumar , Eva L Dyer

Learning unbiased models on imbalanced datasets is a significant challenge. Rare classes tend to get a concentrated representation in the classification space which hampers the generalization of learned boundaries to new test examples. In…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Salman Khan , Munawar Hayat , Waqas Zamir , Jianbing Shen , Ling Shao

Training models on highly unbalanced data is admitted to be a challenging task for machine learning algorithms. Current studies on deep learning mainly focus on data sets with balanced class labels or unbalanced data, but with massive…

Machine Learning · Computer Science 2020-02-27 Louis Marceau , Lingling Qiu , Nick Vandewiele , Eric Charton

Deep learning algorithms can fare poorly when the training dataset suffers from heavy class-imbalance but the testing criterion requires good generalization on less frequent classes. We design two novel methods to improve performance in…

Machine Learning · Computer Science 2019-10-29 Kaidi Cao , Colin Wei , Adrien Gaidon , Nikos Arechiga , Tengyu Ma

Deep learning approaches are successful in a wide range of AI problems and in particular for visual recognition tasks. However, there are still open problems among which is the capacity to handle streams of visual information and the…

Machine Learning · Computer Science 2022-02-02 Umang Aggarwal , Adrian Popescu , Eden Belouadah , Céline Hudelot

Class imbalance (CI) is a longstanding problem in machine learning, slowing down training and reducing performances. Although empirical remedies exist, it is often unclear which ones work best and when, due to the lack of an overarching…

Machine Learning · Computer Science 2025-08-06 F. S. Pezzicoli , V. Ros , F. P. Landes , M. Baity-Jesi

The rapid advancement in data-driven research has increased the demand for effective graph data analysis. However, real-world data often exhibits class imbalance, leading to poor performance of machine learning models. To overcome this…

Machine Learning · Computer Science 2023-04-11 Yihong Ma , Yijun Tian , Nuno Moniz , Nitesh V. Chawla