中文
相关论文

相关论文: Nuisances via Negativa: Adjusting for Spurious Cor…

200 篇论文

Existing research often posits spurious features as easier to learn than core features in neural network optimization, but the impact of their relative simplicity remains under-explored. Moreover, studies mainly focus on end performance…

机器学习 · 计算机科学 2024-08-27 GuanWen Qiu , Da Kuang , Surbhi Goel

This study explores the robustness of label noise classifiers, aiming to enhance model resilience against noisy data in complex real-world scenarios. Label noise in supervised learning, characterized by erroneous or imprecise labels,…

机器学习 · 计算机科学 2023-12-13 Cheng Zeng , Yixuan Xu , Jiaqi Tian

Explainability in classification results are dependent upon the features used for classification. Data dependency graph features representing data movement are directly correlated with operational semantics, and subject to fine grained…

密码学与安全 · 计算机科学 2024-07-09 John Musgrave , Anca Ralescu

In low-resource settings, the performance of supervised labeling models can be improved with automatically annotated or distantly supervised data, which is cheap to create but often noisy. Previous works have shown that significant…

计算与语言 · 计算机科学 2019-11-06 Lukas Lange , Michael A. Hedderich , Dietrich Klakow

This work examines how to train fair classifiers in settings where training labels are corrupted with random noise, and where the error rates of corruption depend both on the label class and on the membership function for a protected…

机器学习 · 计算机科学 2021-02-18 Jialu Wang , Yang Liu , Caleb Levy

Large datasets in NLP suffer from noisy labels, due to erroneous automatic and human annotation procedures. We study the problem of text classification with label noise, and aim to capture this noise through an auxiliary noise model over…

计算与语言 · 计算机科学 2022-06-22 Siddhant Garg , Goutham Ramakrishnan , Varun Thumbe

The growing importance of massive datasets used for deep learning makes robustness to label noise a critical property for classifiers to have. Sources of label noise include automatic labeling, non-expert labeling, and label corruption by…

机器学习 · 计算机科学 2019-01-30 Dan Hendrycks , Mantas Mazeika , Duncan Wilson , Kevin Gimpel

Segmentation uncertainty models predict a distribution over plausible segmentations for a given input, which they learn from the annotator variation in the training set. However, in practice these annotations can differ systematically in…

计算机视觉与模式识别 · 计算机科学 2023-03-29 Kilian Zepf , Eike Petersen , Jes Frellsen , Aasa Feragen

Noisy labels are both inevitable and problematic in machine learning methods, as they negatively impact models' generalization ability by causing overfitting. In the context of learning with noise, the transition matrix plays a crucial role…

机器学习 · 计算机科学 2025-03-26 Jiahui Li , Tai-Wei Chang , Kun Kuang , Ximing Li , Long Chen , Jun Zhou

Neural networks employ spurious correlations in their predictions, resulting in decreased performance when these correlations do not hold. Recent works suggest fixing pretrained representations and training a classification head that does…

机器学习 · 计算机科学 2023-06-23 Rafayel Darbinyan , Hrayr Harutyunyan , Aram H. Markosyan , Hrant Khachatrian

Causal models bring many benefits to decision-making systems (or agents) by making them interpretable, sample-efficient, and robust to changes in the input distribution. However, spurious correlations can lead to wrong causal models and…

机器学习 · 计算机科学 2020-12-09 Sergei Volodin , Nevan Wichers , Jeremy Nixon

Deep Neural Networks (DNNs) are prone to learning spurious features that correlate with the label during training but are irrelevant to the learning problem. This hurts model generalization and poses problems when deploying them in…

机器学习 · 计算机科学 2023-10-17 Nihal Murali , Aahlad Puli , Ke Yu , Rajesh Ranganath , Kayhan Batmanghelich

Current state-of-the-art deep learning systems for visual object recognition and detection use purely supervised training with regularization such as dropout to avoid overfitting. The performance depends critically on the amount of labeled…

计算机视觉与模式识别 · 计算机科学 2015-04-16 Scott Reed , Honglak Lee , Dragomir Anguelov , Christian Szegedy , Dumitru Erhan , Andrew Rabinovich

We propose an information-theoretic bias measurement technique through a causal interpretation of spurious correlation, which is effective to identify the feature-level algorithmic bias by taking advantage of conditional mutual information.…

机器学习 · 计算机科学 2022-01-11 Seonguk Seo , Joon-Young Lee , Bohyung Han

Deep learning has seen widespread success in various domains such as science, industry, and society. However, it is acknowledged that certain approaches suffer from non-robustness, relying on spurious correlations for predictions.…

机器学习 · 计算机科学 2025-05-22 Xiaoling Zhou , Wei Ye , Rui Xie , Shikun Zhang

Among the most critical limitations of deep learning NLP models are their lack of interpretability, and their reliance on spurious correlations. Prior work proposed various approaches to interpreting the black-box models to unveil the…

计算与语言 · 计算机科学 2021-10-08 Xiaochuang Han , Yulia Tsvetkov

Few-shot adaptation for Vision-Language Models (VLMs) presents a dilemma: balancing in-distribution accuracy with out-of-distribution generalization. Recent research has utilized low-level concepts such as visual attributes to enhance…

机器学习 · 计算机科学 2025-02-25 Xinyu Tian , Shu Zou , Zhaoyuan Yang , Mengqi He , Jing Zhang

Incorrect labels in training data occur when human annotators make mistakes or when the data is generated via weak or distant supervision. It has been shown that complex noise-handling techniques - by modeling, cleaning or filtering the…

计算与语言 · 计算机科学 2022-04-21 Dawei Zhu , Michael A. Hedderich , Fangzhou Zhai , David Ifeoluwa Adelani , Dietrich Klakow

Deep neural networks can memorize corrupted labels, making data quality critical for model performance, yet real-world datasets are frequently compromised by both label noise and input noise. This paper proposes a mutual information-based…

机器学习 · 计算机科学 2025-08-12 Jinghan Yang , Jiayu Weng

Noisy data, crawled from the web or supplied by volunteers such as Mechanical Turkers or citizen scientists, is considered an alternative to professionally labeled data. There has been research focused on mitigating the effects of label…

计算机视觉与模式识别 · 计算机科学 2020-10-14 Clemens-Alexander Brust , Björn Barz , Joachim Denzler