English
Related papers

Related papers: Revisiting the Dataset Bias Problem from a Statist…

200 papers

Partial Label Learning (PLL) is a typical weakly supervised learning task, which assumes each training instance is annotated with a set of candidate labels containing the ground-truth label. Recent PLL methods adopt identification-based…

Machine Learning · Computer Science 2024-10-01 Jiayu Hu , Senlin Shu , Beibei Li , Tao Xiang , Zhongshi He

The fate of scientific hypotheses often relies on the ability of a computational model to explain the data, quantified in modern statistical approaches by the likelihood function. The log-likelihood is the key element for parameter…

Machine Learning · Computer Science 2021-01-27 Bas van Opheusden , Luigi Acerbi , Wei Ji Ma

Class imbalance is an inherent characteristic of multi-label data that hinders most multi-label learning methods. One efficient and flexible strategy to deal with this problem is to employ sampling techniques before training a multi-label…

Machine Learning · Computer Science 2020-05-20 Bin Liu , Konstantinos Blekas , Grigorios Tsoumakas

We propose a meta-learning method for positive and unlabeled (PU) classification, which improves the performance of binary classifiers obtained from only PU data in unseen target tasks. PU learning is an important problem since PU data…

Machine Learning · Computer Science 2024-06-07 Atsutoshi Kumagai , Tomoharu Iwata , Yasuhiro Fujiwara

Misclassification of binary responses, if ignored, may severely bias the maximum likelihood estimators (MLE) of regression parameters. For such data, a binary regression model incorporating misclassification probabilities is extensively…

Statistics Theory · Mathematics 2020-09-28 Arindam Chatterjee , Tathagata Bandyopadhyay , Sumanta Adhya

Learning with noisy labels has gained increasing attention because the inevitable imperfect labels in real-world scenarios can substantially hurt the deep model performance. Recent studies tend to regard low-loss samples as clean ones and…

Machine Learning · Computer Science 2024-02-20 Huafeng Liu , Mengmeng Sheng , Zeren Sun , Yazhou Yao , Xian-Sheng Hua , Heng-Tao Shen

When mining large datasets in order to predict new data, limitations of the principles behind statistical machine learning pose a serious challenge not only to the Big Data deluge, but also to the traditional assumptions that data…

Information Theory · Computer Science 2023-04-26 Felipe S. Abrahão , Hector Zenil , Fabio Porto , Michael Winter , Klaus Wehmuth , Itala M. L. D'Ottaviano

We consider the problem of learning from data corrupted by underrepresentation bias, where positive examples are filtered from the data at different, unknown rates for a fixed number of sensitive groups. We show that with a small amount of…

Machine Learning · Computer Science 2024-06-05 Emily Diana , Alexander Williams Tolbert

Selection bias arises when the probability that an observation enters a dataset depends on variables related to the quantities of interest, leading to systematic distortions in estimation and uncertainty quantification. For example, in…

Semi-supervised learning by self-training heavily relies on pseudo-label selection (PLS). The selection often depends on the initial model fit on labeled data. Early overfitting might thus be propagated to the final model by selecting…

Machine Learning · Statistics 2023-06-27 Julian Rodemann , Jann Goschenhofer , Emilio Dorigatti , Thomas Nagler , Thomas Augustin

Spurious correlations in training data significantly hinder the generalization capability of machine learning models when faced with distribution shifts, leading to the proposition of numberous debiasing methods. However, it remains to be…

Machine Learning · Computer Science 2025-05-22 Peng Kuang , Zhibo Wang , Zhixuan Chu , Jingyi Wang , Kui Ren

The desire to train complex machine learning algorithms and to increase the statistical power in association studies drives neuroimaging research to use ever-larger datasets. The most obvious way to increase sample size is by pooling scans…

Computer Vision and Pattern Recognition · Computer Science 2020-10-29 Christian Wachinger , Anna Rieckmann , Sebastian Pölsterl

Denoising diffusion models have emerged as a dominant approach for image generation, however they still suffer from slow convergence in training and color shift issues in sampling. In this paper, we identify that these obstacles can be…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Hu Yu , Li Shen , Jie Huang , Hongsheng Li , Feng Zhao

There has been increased interest in devising learning techniques that combine unlabeled data with labeled data ? i.e. semi-supervised learning. However, to the best of our knowledge, no study has been performed across various techniques…

Machine Learning · Computer Science 2011-09-12 N. V. Chawla , Grigoris Karakoulas

Positive-unlabeled (PU) learning is a weakly supervised binary classification problem, in which the goal is to learn a binary classifier from only positive and unlabeled data, without access to negative data. In recent years, many PU…

Machine Learning · Computer Science 2026-02-24 Wei Wang , Dong-Dong Wu , Ming Li , Jingxiong Zhang , Gang Niu , Masashi Sugiyama

Biases in existing datasets used to train algorithmic decision rules can raise ethical and economic concerns due to the resulting disparate treatment of different groups. We propose an algorithm for sequentially debiasing such datasets…

Machine Learning · Computer Science 2023-01-11 Yifan Yang , Yang Liu , Parinaz Naghizadeh

Neural networks often learn to make predictions that overly rely on spurious correlation existing in the dataset, which causes the model to be biased. While previous work tackles this issue by using explicit labeling on the spuriously…

Machine Learning · Computer Science 2020-11-24 Junhyun Nam , Hyuntak Cha , Sungsoo Ahn , Jaeho Lee , Jinwoo Shin

Recent works find that AI algorithms learn biases from data. Therefore, it is urgent and vital to identify biases in AI algorithms. However, the previous bias identification pipeline overly relies on human experts to conjecture potential…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Zhiheng Li , Chenliang Xu

In observational studies, researchers must select a method to control for confounding. Options include propensity score methods and regression. It remains unclear how dataset characteristics (size, overlap in propensity scores, exposure…

Methodology · Statistics 2022-10-21 J. Wilkinson , M. A. Mamas , E. Kontopantelis

Complementary-label learning is a weakly supervised learning problem in which each training example is associated with one or multiple complementary labels indicating the classes to which it does not belong. Existing consistent approaches…

Machine Learning · Computer Science 2024-10-14 Wei Wang , Takashi Ishida , Yu-Jie Zhang , Gang Niu , Masashi Sugiyama