English
Related papers

Related papers: On how to avoid exacerbating spurious correlations…

200 papers

In fitting a mixture of linear regression models, normal assumption is traditionally used to model the error and then regression parameters are estimated by the maximum likelihood estimators (MLE). This procedure is not valid if the normal…

Methodology · Statistics 2018-11-06 Yanyuan Ma , Shaoli Wang , Lin Xu , Weixin Yao

Class imbalance poses a challenge for developing unbiased, accurate predictive models. In particular, in image segmentation neural networks may overfit to the foreground samples from small structures, which are often heavily…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Zeju Li , Konstantinos Kamnitsas , Ben Glocker

This paper presents a conformal prediction method for classification in highly imbalanced and open-set settings, where there are many possible classes and not all may be represented in the data. Existing approaches require a finite, known…

Machine Learning · Statistics 2025-10-16 Tianmin Xie , Yanfei Zhou , Ziyi Liang , Stefano Favaro , Matteo Sesia

Although many real-world applications, such as disease prediction, and fault detection suffer from class imbalance, most existing graph-based classification methods ignore the skewness of the distribution of classes; therefore, tend to be…

Machine Learning · Computer Science 2024-07-01 Mahdi Mohammadizadeh , Arash Mozhdehi , Yani Ioannou , Xin Wang

Data rebalancing techniques, including oversampling and undersampling, are a common approach to addressing the challenges of imbalanced data. To tackle unresolved problems related to both oversampling and undersampling, we propose a new…

Machine Learning · Computer Science 2025-07-11 Karen Medlin , Sven Leyffer , Krishnan Raghavan

We consider high-dimensional estimation problems where the number of parameters diverges with the sample size. General conditions are established for consistency, uniqueness, and asymptotic normality in both unpenalized and penalized…

Statistics Theory · Mathematics 2025-04-08 Jana Gauss , Thomas Nagler

Class-imbalance is an inherent characteristic of multi-label data which affects the prediction accuracy of most multi-label learning methods. One efficient strategy to deal with this problem is to employ resampling techniques before…

Machine Learning · Computer Science 2021-05-18 Bin Liu , Grigorios Tsoumakas

Learning with Noisy Labels (LNL) has attracted significant attention from the research community. Many recent LNL methods rely on the assumption that clean samples tend to have "small loss". However, this assumption always fails to…

Machine Learning · Computer Science 2022-11-17 MingCai Chen , Yu Zhao , Bing He , Zongbo Han , Bingzhe Wu , Jianhua Yao

Recent work has shown that pre-trained language models such as BERT improve robustness to spurious correlations in the dataset. Intrigued by these results, we find that the key to their success is generalization from a small amount of…

Computation and Language · Computer Science 2020-08-12 Lifu Tu , Garima Lalwani , Spandana Gella , He He

The presence of spurious features interferes with the goal of obtaining robust models that perform well across many groups within the population. A natural remedy is to remove spurious features from the model. However, in this work we show…

Machine Learning · Computer Science 2020-12-09 Fereshte Khani , Percy Liang

There is no such thing as a perfect dataset. In some datasets, deep neural networks discover underlying heuristics that allow them to take shortcuts in the learning process, resulting in poor generalization capability. Instead of using…

Computation and Language · Computer Science 2022-11-28 Frano Rajič , Ivan Stresec , Axel Marmet , Tim Poštuvan

Class imbalance is a pervasive issue among classification models including deep learning, whose capacity to extract task-specific features is affected in imbalanced settings. However, the challenges of handling imbalance among a large…

Machine Learning · Computer Science 2018-10-31 Shin Ando

We propose a novel framework for incorporating unlabeled data into semi-supervised classification problems, where scenarios involving the minimization of either i) adversarially robust or ii) non-robust loss functions have been considered.…

Class-imbalanced data, in which some classes contain far more samples than others, is ubiquitous in real-world applications. Standard techniques for handling class-imbalance usually work by training on a re-weighted loss or on re-balanced…

Artificial Intelligence · Computer Science 2021-06-18 Arpit Bansal , Micah Goldblum , Valeriia Cherepanova , Avi Schwarzschild , C. Bayan Bruss , Tom Goldstein

In supervised learning, it is quite frequent to be confronted with real imbalanced datasets. This situation leads to a learning difficulty for standard algorithms. Research and solutions in imbalanced learning have mainly focused on…

Machine Learning · Statistics 2023-08-08 Samuel Stocksieker , Denys Pommeret , Arthur Charpentier

Machine learning models often rely on simple spurious features -- patterns in training data that correlate with targets but are not causally related to them, like image backgrounds in foreground classification. This reliance typically leads…

Machine Learning · Computer Science 2025-06-06 Chenyu You , Haocheng Dai , Yifei Min , Jasjeet S. Sekhon , Sarang Joshi , James S. Duncan

Discriminative approaches to classification often learn shortcuts that hold in-distribution but fail even under minor distribution shift. This failure mode stems from an overreliance on features that are spuriously correlated with the…

Machine Learning · Computer Science 2026-01-01 Alexander C. Li , Ananya Kumar , Deepak Pathak

Deep learning algorithms can fare poorly when the training dataset suffers from heavy class-imbalance but the testing criterion requires good generalization on less frequent classes. We design two novel methods to improve performance in…

Machine Learning · Computer Science 2019-10-29 Kaidi Cao , Colin Wei , Adrien Gaidon , Nikos Arechiga , Tengyu Ma

Imbalanced Learning is an important learning algorithm for the classification models, which have enjoyed much popularity on many applications. Typically, imbalanced learning algorithms can be partitioned into two types, i.e., data level…

Machine Learning · Computer Science 2018-10-25 Tianlun Zhang , Xi Yang

By inferring latent groups in the training data, recent works introduce invariant learning to the case where environment annotations are unavailable. Typically, learning group invariance under a majority/minority split is empirically shown…

Machine Learning · Computer Science 2022-10-19 Yimeng Chen , Ruibin Xiong , Zhiming Ma , Yanyan Lan
‹ Prev 1 3 4 5 6 7 10 Next ›