中文
相关论文

相关论文: Learning Debiased Classifier with Biased Committee

200 篇论文

Neural networks are often biased to spuriously correlated features that provide misleading statistical evidence that does not generalize. This raises an interesting question: ``Does an optimal unbiased functional subnetwork exist in a…

机器学习 · 计算机科学 2023-06-27 Geon Yeong Park , Sangmin Lee , Sang Wan Lee , Jong Chul Ye

Deep neural networks trained on biased data often inadvertently learn unintended inference rules, particularly when labels are strongly correlated with biased features. Existing bias mitigation methods typically involve either a)…

计算机视觉与模式识别 · 计算机科学 2024-10-22 Rajeev Ranjan Dwivedi , Priyadarshini Kumari , Vinod K Kurmi

Natural language processing models often exploit spurious correlations between task-independent features and labels in datasets to perform well only within the distributions they are trained on, while not generalising to different task…

计算与语言 · 计算机科学 2022-03-25 Yuxiang Wu , Matt Gardner , Pontus Stenetorp , Pradeep Dasigi

Improperly constructed datasets can result in inaccurate inferences. For instance, models trained on biased datasets perform poorly in terms of generalization (i.e., dataset bias). Recent debiasing techniques have successfully achieved…

机器学习 · 计算机科学 2022-12-05 Sumyeong Ahn , Se-Young Yun

Most existing Graph Neural Networks (GNNs) are proposed without considering the selection bias in data, i.e., the inconsistent distribution between the training set with test set. In reality, the test data is not even available during the…

机器学习 · 计算机科学 2022-01-27 Shaohua Fan , Xiao Wang , Chuan Shi , Kun Kuang , Nian Liu , Bai Wang

In many real-world scenarios, labeled data for a specific machine learning task is costly to obtain. Semi-supervised training methods make use of abundantly available unlabeled data and a smaller number of labeled examples. We propose a new…

计算机视觉与模式识别 · 计算机科学 2017-06-06 Philip Häusser , Alexander Mordvintsev , Daniel Cremers

Collider bias is a harmful form of sample selection bias that neural networks are ill-equipped to handle. This bias manifests itself when the underlying causal signal is strongly correlated with other confounding signals due to the training…

机器学习 · 计算机科学 2020-11-24 Luke Darlow , Stanisław Jastrzębski , Amos Storkey

Machine learning models are known to learn spurious correlations, i.e., features having strong relations with class labels but no causal relation. Relying on those correlations leads to poor performance in the data groups without these…

机器学习 · 计算机科学 2026-04-28 Phuong Quynh Le , Jörg Schlötterer , Christin Seifert

Deep neural networks do not discriminate between spurious and causal patterns, and will only learn the most predictive ones while ignoring the others. This shortcut learning behaviour is detrimental to a network's ability to generalize to…

机器学习 · 计算机科学 2023-01-11 Thomas Duboudin , Emmanuel Dellandréa , Corentin Abgrall , Gilles Hénaff , Liming Chen

A prominent technique for self-supervised representation learning has been to contrast semantically similar and dissimilar pairs of samples. Without access to labels, dissimilar (negative) points are typically taken to be randomly sampled…

机器学习 · 计算机科学 2020-10-22 Ching-Yao Chuang , Joshua Robinson , Lin Yen-Chen , Antonio Torralba , Stefanie Jegelka

Deep learning models can perform well in complex medical imaging classification tasks, even when basing their conclusions on spurious correlations (i.e. confounders), should they be prevalent in the training dataset, rather than on the…

计算机视觉与模式识别 · 计算机科学 2023-08-23 Amar Kumar , Nima Fathi , Raghav Mehta , Brennan Nichyporuk , Jean-Pierre R. Falet , Sotirios Tsaftaris , Tal Arbel

Deep neural networks often struggle to learn robust representations in the presence of dataset biases, leading to suboptimal generalization on unbiased datasets. This limitation arises because the models heavily depend on peripheral and…

机器学习 · 计算机科学 2024-12-11 Carlo Alberto Barbano , Enzo Tartaglione , Marco Grangetto

We propose a novel regularization algorithm to train deep neural networks, in which data at training time is severely biased. Since a neural network efficiently learns data distribution, a network is likely to learn the bias information to…

计算机视觉与模式识别 · 计算机科学 2019-04-16 Byungju Kim , Hyunwoo Kim , Kyungsu Kim , Sungjin Kim , Junmo Kim

Deep neural networks have been shown to be very powerful methods for many supervised learning tasks. However, they can also easily overfit to training set biases, i.e., label noise and class imbalance. While both learning with noisy labels…

计算机视觉与模式识别 · 计算机科学 2021-10-25 Tong Wei , Jiang-Xin Shi , Yu-Feng Li , Min-Ling Zhang

Spurious correlations can cause strong biases in deep neural networks, impairing generalization ability. While most existing debiasing methods require full supervision on either spurious attributes or target labels, training a debiased…

机器学习 · 计算机科学 2023-10-10 Geon Yeong Park , Chanyong Jung , Sangmin Lee , Jong Chul Ye , Sang Wan Lee

State-of-the-art, high capacity deep neural networks not only require large amounts of labelled training data, they are also highly susceptible to label errors in this data, typically resulting in large efforts and costs and therefore…

机器学习 · 计算机科学 2020-07-20 Christian Haase-Schütz , Rainer Stal , Heinz Hertlein , Bernhard Sick

Datasets often contain biases which unfairly disadvantage certain groups, and classifiers trained on such datasets can inherit these biases. In this paper, we provide a mathematical formulation of how this bias can arise. We do so by…

机器学习 · 计算机科学 2019-01-16 Heinrich Jiang , Ofir Nachum

Learning with noisy labels aims to ensure model generalization given a label-corrupted training set. The sample selection strategy achieves promising performance by selecting a label-reliable subset for model training. In this paper, we…

机器学习 · 计算机科学 2025-04-11 Qi Wei , Lei Feng , Haobo Wang , Bo An

Image classification has become a ubiquitous task. Models trained on good quality data achieve accuracy which in some application domains is already above human-level performance. Unfortunately, real-world data are quite often degenerated…

计算机视觉与模式识别 · 计算机科学 2022-08-17 Stanisław Kaźmierczak , Jacek Mańdziuk

Recent research has revealed that deep neural networks often take dataset biases as a shortcut to make decisions rather than understand tasks, leading to failures in real-world applications. In this study, we focus on the spurious…

计算与语言 · 计算机科学 2023-06-23 Yanrui Du , Jing Yan , Yan Chen , Jing Liu , Sendong Zhao , Qiaoqiao She , Hua Wu , Haifeng Wang , Bing Qin