English
Related papers

Related papers: Measuring Spurious Correlation in Classification: …

200 papers

The ability of semantic reasoning over the sentence pair is essential for many natural language understanding tasks, e.g., natural language inference and machine reading comprehension. A recent significant improvement in these tasks comes…

Computation and Language · Computer Science 2021-06-18 Weidi Xu , Xingyi Cheng , Kunlong Chen , Wei Wang , Bin Bi , Ming Yan , Chen Wu , Luo Si , Wei Chu , Taifeng Wang

Metaphors play a significant role in our everyday communication, yet detecting them presents a challenge. Traditional methods often struggle with improper application of language rules and a tendency to overlook data sparsity. To address…

Computation and Language · Computer Science 2024-04-10 Kaidi Jia , Rongsheng Li

In learning tasks with label noise, improving model robustness against overfitting is a pivotal challenge because the model eventually memorizes labels, including the noisy ones. Identifying the samples with noisy labels and preventing the…

Machine Learning · Computer Science 2023-09-28 Reihaneh Torkzadehmahani , Reza Nasirigerdeh , Daniel Rueckert , Georgios Kaissis

Being able to rank the similarity of short text segments is an interesting bonus feature of neural machine translation. Translation-based similarity measures include direct and pivot translation probability, as well as translation…

Computation and Language · Computer Science 2022-10-20 Jannis Vamvas , Rico Sennrich

Cross-correlation is a popular signal processing technique used in numerous location tracking systems for obtaining reliable range information. However, its efficient design and practical implementation has not yet been achieved on mote…

Other Computer Science · Computer Science 2016-06-14 Prasant Misra , Wen Hu , Mingrui Yang , Marco Duarte , Sanjay Jha

Hate speech classifiers exhibit substantial performance degradation when evaluated on datasets different from the source. This is due to learning spurious correlations between words that are not necessarily relevant to hateful language, and…

Computation and Language · Computer Science 2022-03-24 Tulika Bose , Nikolaos Aletras , Irina Illina , Dominique Fohr

Neural networks often exhibit simplicity bias, favoring simpler features over more complex ones, even when both are equally predictive. We introduce a novel method called imbalanced label coupling to explore and extend this simplicity bias…

Machine Learning · Computer Science 2024-10-23 Zhehang Du

We introduce a data-centric hypothesis-testing framework to quantify the influence of sequentially correlated literary properties--such as thematic continuity--on textual classification tasks. Our method models label sequences as stochastic…

Computation and Language · Computer Science 2025-04-25 Gideon Yoffe , Nachum Dershowitz , Ariel Vishne , Barak Sober

Machine learning models often rely on simple spurious features -- patterns in training data that correlate with targets but are not causally related to them, like image backgrounds in foreground classification. This reliance typically leads…

Machine Learning · Computer Science 2025-06-06 Chenyu You , Haocheng Dai , Yifei Min , Jasjeet S. Sekhon , Sarang Joshi , James S. Duncan

Label noise is ubiquitous in various machine learning scenarios such as self-labeling with model predictions and erroneous data annotation. Many existing approaches are based on heuristics such as sample losses, which might not be flexible…

Machine Learning · Computer Science 2022-12-29 Zhihao Wang , Zongyu Lin , Peiqi Liu , Guidong ZHeng , Junjie Wen , Xianxin Chen , Yujun Chen , Zhilin Yang

Spurious correlations that degrade model generalization or lead the model to be right for the wrong reasons are one of the main robustness concerns for real-world deployments. However, mitigating these correlations during pre-training for…

Machine Learning · Computer Science 2023-06-01 Yu Yang , Besmira Nushi , Hamid Palangi , Baharan Mirzasoleiman

Class labels used for machine learning are relatable to each other, with certain class labels being more similar to each other than others (e.g. images of cats and dogs are more similar to each other than those of cats and cars). Such…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Gautam Rajendrakumar Gare , John Michael Galeotti

Neural networks can fail when the data contains spurious correlations. To understand this phenomenon, researchers have proposed numerous spurious correlations benchmarks upon which to evaluate mitigation methods. However, we observe that…

Machine Learning · Computer Science 2024-09-09 Samuel J. Bell , Diane Bouchacourt , Levent Sagun

Multimodal models like CLIP have gained significant attention due to their remarkable zero-shot performance across various tasks. However, studies have revealed that CLIP can inadvertently learn spurious associations between target…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Wei Jie Yeo , Rui Mao , Moloud Abdar , Erik Cambria , Ranjan Satapathy

The classic supervised classification algorithms are efficient, but time-consuming, complicated and not interpretable, which makes it difficult to analyze their results that limits the possibility to improve them based on real observations.…

Computation and Language · Computer Science 2018-03-05 Hussam Hamdan

Generalized Category Discovery is a crucial real-world task. Despite the improved performance on known categories, current methods perform poorly on novel categories. We attribute the poor performance to two reasons: biased knowledge…

Computation and Language · Computer Science 2023-12-29 Wenbin An , Feng Tian , Wenkai Shi , Yan Chen , Yaqiang Wu , Qianying Wang , Ping Chen

The similarity among samples and the discrepancy between clusters are two crucial aspects of image clustering. However, current deep clustering methods suffer from the inaccurate estimation of either feature similarity or semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Chuang Niu , Hongming Shan , Ge Wang

While large language models (LLMs) have demonstrated remarkable capabilities in language modeling, recent studies reveal that they often fail on out-of-distribution (OOD) samples due to spurious correlations acquired during pre-training.…

Machine Learning · Computer Science 2025-06-12 Shurui Gui , Shuiwang Ji

Learning invariant representations is an important requirement when training machine learning models that are driven by spurious correlations in the datasets. These spurious correlations, between input samples and the target labels, wrongly…

Machine Learning · Computer Science 2022-01-12 Vishnu Suresh Lokhande , Kihyuk Sohn , Jinsung Yoon , Madeleine Udell , Chen-Yu Lee , Tomas Pfister

Supervisory signals have the potential to make low-dimensional data representations, like those learned by mixture and topic models, more interpretable and useful. We propose a framework for training latent variable models that explicitly…

‹ Prev 1 3 4 5 6 7 10 Next ›