English
Related papers

Related papers: Representation Invariance and Allocation: When Sub…

200 papers

Traditional learning-based approaches to student modeling generalize poorly to underrepresented student groups due to biases in data availability. In this paper, we propose a methodology for predicting student performance from their online…

We propose a novel unsupervised generative model that learns to disentangle object identity from other low-level aspects in class-imbalanced data. We first investigate the issues surrounding the assumptions about uniformity made by InfoGAN,…

Machine Learning · Computer Science 2020-11-02 Utkarsh Ojha , Krishna Kumar Singh , Cho-Jui Hsieh , Yong Jae Lee

Pretrained machine learning models are known to perpetuate and even amplify existing biases in data, which can result in unfair outcomes that ultimately impact user experience. Therefore, it is crucial to understand the mechanisms behind…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Laura Cabello , Emanuele Bugliarello , Stephanie Brandl , Desmond Elliott

Data imbalance is a fundamental challenge in applying language models to biomedical applications, particularly in ICD code prediction tasks where label and demographic distributions are uneven. While state-of-the-art language models have…

Machine Learning · Computer Science 2025-02-17 Precious Jones , Weisi Liu , I-Chan Huang , Xiaolei Huang

In machine learning, disparity metrics are often defined by measuring the difference in the performance or outcome of a model, across different sub-populations (groups) of datapoints. Thus, the inputs to disparity quantification consist of…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Shervin Ardeshir , Cristina Segalin , Nathan Kallus

Imbalanced data poses a significant challenge in classification as model performance is affected by insufficient learning from minority classes. Balancing methods are often used to address this problem. However, such techniques can lead to…

Machine Learning · Computer Science 2024-06-18 Adrian Stando , Mustafa Cavus , Przemysław Biecek

One challenging property lurking in medical datasets is the imbalanced data distribution, where the frequency of the samples between the different classes is not balanced. Training a model on an imbalanced dataset can introduce unique…

Image and Video Processing · Electrical Eng. & Systems 2022-04-06 Ashkan Khakzar , Yawei Li , Yang Zhang , Mirac Sanisoglu , Seong Tae Kim , Mina Rezaei , Bernd Bischl , Nassir Navab

Although disentangled representations are often said to be beneficial for downstream tasks, current empirical and theoretical understanding is limited. In this work, we provide evidence that disentangled representations coupled with sparse…

Despite extensive research spanning several decades, class imbalance is still considered a profound difficulty for both machine learning and deep learning models. While data oversampling is the foremost technique to address this issue,…

Machine Learning · Computer Science 2025-02-12 Sukumar Kishanthan , Asela Hevapathige

Predicting future behavior of other traffic participants is an essential task that needs to be solved by automated vehicles and human drivers alike to achieve safe and situationaware driving. Modern approaches to vehicles trajectory…

Computer Vision and Pattern Recognition · Computer Science 2020-10-02 Florian Mirus , Terrence C. Stewart , Jorg Conradt

Accurately measuring discrimination is crucial to faithfully assessing fairness of trained machine learning (ML) models. Any bias in measuring discrimination leads to either amplification or underestimation of the existing disparity.…

Machine Learning · Computer Science 2023-06-09 Sami Zhioua , Rūta Binkytė

Datasets are rarely a realistic approximation of the target population. Say, prevalence is misrepresented, image quality is above clinical standards, etc. This mismatch is known as sampling bias. Sampling biases are a major hindrance for…

Despite the constant development of new bias mitigation methods for machine learning, no method consistently succeeds, and a fundamental question remains unanswered: when and why do bias mitigation techniques fail? In this paper, we…

Machine Learning · Computer Science 2025-07-15 Anissa Alloula , Charles Jones , Ben Glocker , Bartłomiej W. Papież

Although binary classification is a well-studied problem, training reliable classifiers under severe class imbalance remains a challenge. Recent techniques mitigate the ill effects of imbalance on training by modifying the loss functions or…

Machine Learning · Computer Science 2024-10-07 Kelsey Lieberman , Swarna Kamlam Ravindran , Shuai Yuan , Carlo Tomasi

Does the dominant approach to learn representations (as a side effect of optimizing an expected cost for a single training distribution) remain a good approach when we are dealing with multiple distributions? Our thesis is that such…

Machine Learning · Computer Science 2023-08-02 Jianyu Zhang , Léon Bottou

Collaborative learning through latent shared feature representations enables heterogeneous clients to train personalized models with improved performance and reduced sample complexity. Despite empirical success and extensive study, the…

Machine Learning · Computer Science 2025-11-25 Xiaochun Niu , Lili Su , Jiaming Xu , Pengkun Yang

Disparate treatment occurs when a machine learning model yields different decisions for individuals based on a sensitive attribute (e.g., age, sex). In domains where prediction accuracy is paramount, it could potentially be acceptable to…

Machine Learning · Computer Science 2022-04-15 Hao Wang , Hsiang Hsu , Mario Diaz , Flavio P. Calmon

Unwanted and often harmful social biases are becoming ever more salient in NLP research, affecting both models and datasets. In this work, we ask whether training on demographically perturbed data leads to fairer language models. We collect…

Computation and Language · Computer Science 2022-10-14 Rebecca Qian , Candace Ross , Jude Fernandes , Eric Smith , Douwe Kiela , Adina Williams

Large language models often achieve strong benchmark gains without corresponding improvements in broader capability. We hypothesize that this discrepancy arises from differences in training regimes induced by data distribution. To…

Machine Learning · Computer Science 2026-04-10 Hongjian Zou , Yidan Wang , Qi Ding , Yixuan Liao , Xiaoxin Chen

Learning from imbalanced data is one of the most significant challenges in real-world classification tasks. In such cases, neural networks performance is substantially impaired due to preference towards the majority class. Existing…

Machine Learning · Computer Science 2022-11-13 Bronislav Yasinnik , Moshe Salhov , Ofir Lindenbaum , Amir Averbuch