English
Related papers

Related papers: Measuring Spurious Correlation in Classification: …

200 papers

Interpretation of topics is crucial for their downstream applications. State-of-the-art evaluation measures of topic quality such as coherence and word intrusion do not measure how much a topic facilitates the exploration of a corpus. To…

Computation and Language · Computer Science 2025-07-28 Swapnil Hingmire , Ze Shi Li , Shiyu , Zeng , Ahmed Musa Awon , Luiz Franciscatto Guerra , Neil Ernst

Citation classification, which identifies the intention behind academic citations, is pivotal for scholarly analysis. Previous works suggest fine-tuning pretrained language models (PLMs) on citation classification datasets, reaping the…

Computation and Language · Computer Science 2025-05-29 Tong Li , Jiachuan Wang , Yongqi Zhang , Shuangyin Li , Lei Chen

Making decent multi-lingual sentence representations is critical to achieve high performances in cross-lingual downstream tasks. In this work, we propose a novel method to align multi-lingual embeddings based on the similarity of sentences…

Computation and Language · Computer Science 2024-05-29 Minsu Park , Seyeon Choi , Chanyeol Choi , Jun-Seong Kim , Jy-yong Sohn

Distant supervision for relation extraction provides uniform bag labels for each sentence inside the bag, while accurate sentence labels are important for downstream applications that need the exact relation type. Directly using bag labels…

Computation and Language · Computer Science 2021-06-23 Ruotian Ma , Tao Gui , Linyang Li , Qi Zhang , Yaqian Zhou , Xuanjing Huang

Adapting to latent confounded shift remains a core challenge in modern AI. This setting is driven by hidden variables that induce spurious correlations between inputs and outputs during training, leading models to rely on non-causal…

Machine Learning · Computer Science 2026-05-14 Jialin Yu , Yuxiang Zhou , Haoxuan Li , Junchi Yu , Mengyue Yang , Yulan He , Nevin L. Zhang , Philip Torr , Ricardo Silva

Deep neural networks have exhibited remarkable performance in various domains. However, the reliance of these models on spurious features has raised concerns about their reliability. A promising solution to this problem is last-layer…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Mohammad Azizmalayeri , Reza Abbasi , Amir Hosein Haji Mohammad rezaie , Reihaneh Zohrabi , Mahdi Amiri , Mohammad Taghi Manzuri , Mohammad Hossein Rohban

Shortcut learning, or `Clever Hans effect` refers to situations where a learning agent (e.g., deep neural networks) learns spurious correlations present in data, resulting in biased models. We focus on finding shortcuts in deep learning…

Machine Learning · Computer Science 2023-06-02 Hye-jin Shim , Rosa González Hautamäki , Md Sahidullah , Tomi Kinnunen

While deep neural networks can achieve state-of-the-art performance in many tasks, these models are more fragile than they appear. They are prone to learning spurious correlations in their training data, leading to surprising failure cases.…

Machine Learning · Computer Science 2024-09-05 Jeff Mitchell , Jesús Martínez del Rincón , Niall McLaughlin

Discriminative approaches to classification often learn shortcuts that hold in-distribution but fail even under minor distribution shift. This failure mode stems from an overreliance on features that are spuriously correlated with the…

Machine Learning · Computer Science 2026-01-01 Alexander C. Li , Ananya Kumar , Deepak Pathak

Active learning (AL) techniques reduce labeling costs for training neural machine translation (NMT) models by selecting smaller representative subsets from unlabeled data for annotation. Diversity sampling techniques select heterogeneous…

Computation and Language · Computer Science 2024-12-19 Abdul Hameed Azeemi , Ihsan Ayyub Qazi , Agha Ali Raza

Deep neural networks often rely on spurious correlations to make predictions, which hinders generalization beyond training environments. For instance, models that associate cats with bed backgrounds can fail to predict the existence of cats…

Machine Learning · Computer Science 2023-06-06 Shirley Wu , Mert Yuksekgonul , Linjun Zhang , James Zou

The reliability of machine learning systems critically assumes that the associations between features and labels remain similar between training and test distributions. However, unmeasured variables, such as confounders, break this…

Machine Learning · Computer Science 2020-08-17 Megha Srivastava , Tatsunori Hashimoto , Percy Liang

Objective: Translational science aims at "translating" basic scientific discoveries into clinical applications. The identification of translational science has practicality such as evaluating the effectiveness of investments made into large…

Digital Libraries · Computer Science 2020-07-13 Qing Ke

Fine-grained classification remains a very challenging problem, because of the absence of well-labeled training data caused by the high cost of annotating a large number of fine-grained categories. In the extreme case, given a set of test…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Li Niu , Ashok Veeraraghavan , Ashu Sabharwal

We study Label Smoothing (LS), a widely used regularization technique, in the context of neural learning to rank (L2R) models. LS combines the ground-truth labels with a uniform distribution, encouraging the model to be less confident in…

Information Retrieval · Computer Science 2020-12-17 Gustavo Penha , Claudia Hauff

We propose a framework using contrastive learning as a pre-training task to perform image classification in the presence of noisy labels. Recent strategies such as pseudo-labeling, sample selection with Gaussian Mixture models, weighted…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Madalina Ciortan , Romain Dupuis , Thomas Peel

Despite the great success of spoken language understanding (SLU) in high-resource languages, it remains challenging in low-resource languages mainly due to the lack of labeled training data. The recent multilingual code-switching approach…

Computation and Language · Computer Science 2022-10-26 Shining Liang , Linjun Shou , Jian Pei , Ming Gong , Wanli Zuo , Xianglin Zuo , Daxin Jiang

Learning binary classifiers from positive and unlabeled data (PUL) is vital in many real-world applications, especially when verifying negative examples is difficult. Despite the impressive empirical performance of recent PUL methods,…

Machine Learning · Computer Science 2024-10-14 Xinrui Wang , Wenhai Wan , Chuanxin Geng , Shaoyuan LI , Songcan Chen

Neural networks are prone to be biased towards spurious correlations between classes and latent attributes exhibited in a major portion of training data, which ruins their generalization capability. We propose a new method for training…

Machine Learning · Computer Science 2023-05-02 Nayeong Kim , Sehyun Hwang , Sungsoo Ahn , Jaesik Park , Suha Kwak

As a promising solution of reducing annotation cost, training multi-label models with partial positive labels (MLR-PPL), in which merely few positive labels are known while other are missing, attracts increasing attention. Due to the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Tao Pu , Qianru Lao , Hefeng Wu , Tianshui Chen , Liang Lin