English
Related papers

Related papers: Imbalance in Regression Datasets

200 papers

This paper addresses a regression problem in which output label values are the results of sensing the magnitude of a phenomenon. A low value of such labels can mean either that the actual magnitude of the phenomenon was low or that the…

Machine Learning · Computer Science 2023-06-01 Takayuki Katsuki , Takayuki Osogami

Internet services have led to the eruption of network traffic, and machine learning on these Internet data has become an indispensable tool, especially when the application is risk-sensitive. This paper focuses on network traffic…

Machine Learning · Statistics 2025-02-12 Wumei Du , Dong Liang , Yiqin Lv , Xingxing Liang , Guanlin Wu , Qi Wang , Zheng Xie

This paper introduces a new approach to address the issue of class imbalance in graph neural networks (GNNs) for learning on graph-structured data. Our approach integrates imbalanced node classification and Bias-Variance Decomposition,…

Machine Learning · Computer Science 2025-02-26 Liang Yan , Gengchen Wei , Chen Yang , Shengzhong Zhang , Zengfeng Huang

Deep learning algorithms can fare poorly when the training dataset suffers from heavy class-imbalance but the testing criterion requires good generalization on less frequent classes. We design two novel methods to improve performance in…

Machine Learning · Computer Science 2019-10-29 Kaidi Cao , Colin Wei , Adrien Gaidon , Nikos Arechiga , Tengyu Ma

Class imbalanced datasets are common in real-world applications that range from credit card fraud detection to rare disease diagnostics. Several popular classification algorithms assume that classes are approximately balanced, and hence…

Machine Learning · Statistics 2018-09-10 Val Andrei Fajardo , David Findlay , Roshanak Houmanfar , Charu Jaiswal , Jiaxi Liang , Honglei Xie

Deep imbalanced regression (DIR), where the target values have a highly skewed distribution and are also continuous, is an intriguing yet under-explored problem in machine learning. While recent works have already shown that incorporating…

Machine Learning · Computer Science 2024-12-20 Ruizhi Pu , Gezheng Xu , Ruiyi Fang , Binkun Bao , Charles X. Ling , Boyu Wang

Mitigating bias in training on biased datasets is an important open problem. Several techniques have been proposed, however the typical evaluation regime is very limited, considering very narrow data conditions. For instance, the effect of…

Machine Learning · Computer Science 2022-10-18 Xudong Han , Aili Shen , Trevor Cohn , Timothy Baldwin , Lea Frermann

Class imbalance exists in many classification problems, and since the data is designed for accuracy, imbalance in data classes can lead to classification challenges with a few classes having higher misclassification costs. The Backblaze…

Machine Learning · Computer Science 2023-10-16 Shuangshuang Yuan , Peng Wu , Yuehui Chen , Qiang Li

Recent state-of-the-art forecasting methods are trained on collections of time series. These methods, often referred to as global models, can capture common patterns in different time series to improve their generalization performance.…

Machine Learning · Computer Science 2024-04-30 Vitor Cerqueira , Nuno Moniz , Ricardo Inácio , Carlos Soares

The problem of model collapse has presented new challenges in iterative training of generative models, where such training with synthetic data leads to an overall degradation of performance. This paper looks at the problem from a…

Machine Learning · Statistics 2026-02-19 Soham Bakshi , Sunrit Chakraborty

When training a machine learning classifier on data where one of the classes is intrinsically rare, the classifier will often assign too few sources to the rare class. To address this, it is common to up-weight the examples of the rare…

Machine Learning · Computer Science 2022-08-02 Sean E. Lake , Chao-Wei Tsai

Data rebalancing techniques, including oversampling and undersampling, are a common approach to addressing the challenges of imbalanced data. To tackle unresolved problems related to both oversampling and undersampling, we propose a new…

Machine Learning · Computer Science 2025-07-11 Karen Medlin , Sven Leyffer , Krishnan Raghavan

Automated Machine Learning has grown very successful in automating the time-consuming, iterative tasks of machine learning model development. However, current methods struggle when the data is imbalanced. Since many real-world datasets are…

Machine Learning · Computer Science 2022-11-02 Prabhant Singh , Joaquin Vanschoren

Imbalanced data set is a problem often found and well-studied in financial industry. In this paper, we reviewed and compared some popular methodologies handling data imbalance. We then applied the under-sampling/over-sampling methodologies…

Machine Learning · Statistics 2021-04-07 Lian Yu , Nengfeng Zhou

In clinical trials and other applications, we often see regions of the feature space that appear to exhibit interesting behaviour, but it is unclear whether these observed phenomena are reflected at the population level. Focusing on a…

Statistics Theory · Mathematics 2023-09-21 Henry W. J. Reeve , Timothy I. Cannings , Richard J. Samworth

Neural networks can be trained to solve regression problems by using gradient-based methods to minimize the square loss. However, practitioners often prefer to reformulate regression as a classification problem, observing that training on…

Machine Learning · Computer Science 2023-03-02 Lawrence Stewart , Francis Bach , Quentin Berthet , Jean-Philippe Vert

Both classification and regression tasks are susceptible to the biased distribution of training data. However, existing approaches are focused on the class-imbalanced learning and cannot be applied to the problems of numerical regression…

Machine Learning · Computer Science 2021-09-15 Wentai Wu , Ligang He , Weiwei Lin

Class imbalance remains a major challenge in machine learning, especially in multi-class problems with long-tailed distributions. Existing methods, such as data resampling, cost-sensitive techniques, and logistic loss modifications, though…

Machine Learning · Computer Science 2025-12-30 Corinna Cortes , Anqi Mao , Mehryar Mohri , Yutao Zhong

Imbalanced regression arises when the target distribution is skewed, causing models to focus on dense regions and struggle with underrepresented (minority) samples. Despite its relevance across many applications, few methods have been…

Machine Learning · Computer Science 2025-08-05 Shayan Alahyari , Shiva Mehdipour Ghobadlou , Mike Domaratzki

Heterogeneity is a hallmark of complex diseases. Regression-based heterogeneity analysis, which is directly concerned with outcome-feature relationships, has led to a deeper understanding of disease biology. Such an analysis identifies the…

Methodology · Statistics 2022-11-29 Ziye Luo , Xinyue Yao , Yifan Sun , Xinyan Fan