English
Related papers

Related papers: Foundations of data imbalance and solutions for a …

200 papers

Time-series forecasting plays an important role in many domains. Boosted by the advances in Deep Learning algorithms, it has for instance been used to predict wind power for eolic energy production, stock market fluctuations, or motor…

Machine Learning · Computer Science 2021-07-23 Luis P. Silvestrin , Leonardos Pantiskas , Mark Hoogendoorn

Machine learning methods often fail when deployed in the real world. Worse still, they fail in high-stakes situations and across socially sensitive lines. These issues have a chilling effect on the adoption of machine learning methods in…

Machine Learning · Computer Science 2025-09-05 Charles Jones , Ben Glocker

In today's society, AI systems are increasingly used to make critical decisions such as credit scoring and patient triage. However, great convenience brought by AI systems comes with troubling prevalence of bias against underrepresented…

Machine Learning · Computer Science 2021-05-11 Yan Zhou , Murat Kantarcioglu , Chris Clifton

Mitigating bias in training on biased datasets is an important open problem. Several techniques have been proposed, however the typical evaluation regime is very limited, considering very narrow data conditions. For instance, the effect of…

Machine Learning · Computer Science 2022-10-18 Xudong Han , Aili Shen , Trevor Cohn , Timothy Baldwin , Lea Frermann

Clustering methods are popular for revealing structure in data, particularly in the high-dimensional setting common to contemporary data science. A central statistical question is, "are the clusters really there?" One pioneering method in…

Methodology · Statistics 2023-08-28 Thomas H. Keefe , J. S. Marron

Imbalance in the proportion of training samples belonging to different classes often poses performance degradation of conventional classifiers. This is primarily due to the tendency of the classifier to be biased towards the majority…

Machine Learning · Computer Science 2021-03-30 Ayush Tripathi , Rupayan Chakraborty , Sunil Kumar Kopparapu

The insurance industry, with its large datasets, is a natural place to use big data solutions. However it must be stressed, that significant number of applications for machine learning in insurance industry, like fraud detection or claim…

Statistical Finance · Quantitative Finance 2022-04-14 Sebastian Baran , Przemysław Rola

The problem of class imbalanced data is that the generalization performance of the classifier deteriorates due to the lack of data from minority classes. In this paper, we propose a novel minority over-sampling method to augment diversified…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Seulki Park , Youngkyu Hong , Byeongho Heo , Sangdoo Yun , Jin Young Choi

Most state-of-the-art computer vision models heavily depend on data. However, many datasets exhibit extreme class imbalance which has been shown to negatively impact model performance. Among the training-time and data-generation solutions…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Indu Panigrahi , Richard Zhu

Class imbalance problem has been a challenging research problem in the fields of machine learning and data mining as most real life datasets are imbalanced. Several existing machine learning algorithms try to maximize the accuracy…

Algorithms and technologies are essential tools that pervade all aspects of our daily lives. In the last decades, health care research benefited from new computer-based recruiting methods, the use of federated architectures for data…

Computers and Society · Computer Science 2023-01-26 Chiara Criscuolo , Tommaso Dolci , Mattia Salnitri

Recent studies showed that datasets used in fairness-aware machine learning for multiple protected attributes (referred to as multi-discrimination hereafter) are often imbalanced. The class-imbalance problem is more severe for the often…

Machine Learning · Computer Science 2022-06-22 Arjun Roy , Vasileios Iosifidis , Eirini Ntoutsi

Data Science and Machine Learning have become fundamental assets for companies and research institutions alike. As one of its fields, supervised classification allows for class prediction of new samples, learning from given training data.…

Machine learning algorithms permeate the day-to-day aspects of our lives and therefore studying the fairness of these algorithms before implementation is crucial. One way in which bias can manifest in a dataset is through missing values.…

Machine Learning · Statistics 2026-02-23 Aeysha Bhatti , Trudie Sandrock , Johane Nienkemper-Swanepoel

The increasing impact of algorithmic decisions on people's lives compels us to scrutinize their fairness and, in particular, the disparate impacts that ostensibly-color-blind algorithms can have on different groups. Examples include credit…

Machine Learning · Statistics 2020-06-17 Nathan Kallus , Xiaojie Mao , Angela Zhou

Real-world data often follow a long-tailed distribution as the frequency of each class is typically different. For example, a dataset can have a large number of under-represented classes and a few classes with more than sufficient data.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Peng Chu , Xiao Bian , Shaopeng Liu , Haibin Ling

AI-driven decision-making systems are becoming instrumental in the public sector, with applications spanning areas like criminal justice, social welfare, financial fraud detection, and public health. While these systems offer great…

Machine Learning · Computer Science 2024-10-15 Unai Fischer-Abaigar , Christoph Kern , Noam Barda , Frauke Kreuter

Class imbalance refers to a situation where certain classes in a dataset have significantly fewer samples than oth- ers, leading to biased model performance. Class imbalance in network intrusion detection using Tabular Denoising Diffusion…

Cryptography and Security · Computer Science 2026-02-02 Aravind B , Anirud R. S. , Sai Surya Teja N , Bala Subrahmanya Sriranga Navaneeth A , Karthika R , Mohankumar N

Data class imbalance is a common problem in classification problems, where minority class samples are often more important and more costly to misclassify in a classification task. Therefore, it is very important to solve the data class…

Machine Learning · Statistics 2023-10-11 Shuangshuang Yuan , Peng Wu , Yuehui Chen

Statistical samples, in order to be representative, have to be drawn from a population in a random and unbiased way. Nevertheless, it is common practice in the field of model-based diagnosis to make estimations from (biased) best-first…

Artificial Intelligence · Computer Science 2022-08-05 Patrick Rodler , Fatima Elichanova