English
Related papers

Related papers: Explore Spurious Correlations at the Concept Level…

200 papers

Recently, prompt-based learning has gained popularity across many natural language processing (NLP) tasks by reformulating them into a cloze-style format to better align pre-trained language models (PLMs) with downstream tasks. However,…

Computation and Language · Computer Science 2023-08-15 Wenjie Zhang , Xiaoning Song , Zhenhua Feng , Tianyang Xu , Xiaojun Wu

AI in dermatology is evolving at a rapid pace but the major limitation to training trustworthy classifiers is the scarcity of data with ground-truth concept level labels, which are meta-labels semantically meaningful to humans. Foundation…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Soham Gadgil , Mahtab Bigverdi

Recent work has shown evidence of 'Clever Hans' behavior in high-performance neural translationese classifiers, where BERT-based classifiers capitalize on spurious correlations, in particular topic information, between data and target…

Computation and Language · Computer Science 2024-06-13 Angana Borah , Daria Pylypenko , Cristina Espana-Bonet , Josef van Genabith

Fine-tuned vision-language models (VLMs) often capture spurious correlations between image features and textual attributes, resulting in degraded zero-shot performance at test time. Existing approaches for addressing spurious correlations…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Maya Varma , Jean-Benoit Delbrouck , Zhihong Chen , Akshay Chaudhari , Curtis Langlotz

The rise of social networks has not only facilitated communication but also allowed the spread of harmful content. Although significant advances have been made in detecting toxic language in textual data, the exploration of concept-based…

Computation and Language · Computer Science 2025-12-16 Samarth Garg , Divya Singh , Deeksha Varshney , Mamta

Adapting vision-language models (VLMs) to downstream tasks with pseudolabels has gained increasing attention. A major obstacle is that the pseudolabels generated by VLMs tend to be imbalanced, leading to inferior performance. While existing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Yuchen Wang , Xuefeng Bai , Xiucheng Li , Weili Guan , Liqiang Nie , Xinyang Chen

Deep neural classifiers tend to rely on spurious correlations between spurious attributes of inputs and targets to make predictions, which could jeopardize their generalization capability. Training classifiers robust to spurious…

Machine Learning · Computer Science 2024-05-07 Guangtao Zheng , Wenqian Ye , Aidong Zhang

Large Language Models (LLMs) such as ChatGPT, have gained significant attention due to their impressive natural language processing capabilities. It is crucial to prioritize human-centered principles when utilizing these models.…

Computation and Language · Computer Science 2023-06-21 Yue Huang , Qihui Zhang , Philip S. Y , Lichao Sun

In-context learning (ICL) has transformed the use of large language models (LLMs) for NLP tasks, enabling few-shot learning by conditioning on labeled examples without finetuning. Despite its effectiveness, ICL is prone to errors,…

Computation and Language · Computer Science 2025-03-21 Mario Sanz-Guerrero , Katharina von der Wense

Topic modeling is a fundamental task in natural language processing, allowing the discovery of latent thematic structures in text corpora. While Large Language Models (LLMs) have demonstrated promising capabilities in topic discovery, their…

Computation and Language · Computer Science 2025-06-03 Xiaohao Yang , He Zhao , Weijie Xu , Yuanyuan Qi , Jueqing Lu , Dinh Phung , Lan Du

Recent advancement in large language models (LLMs) has offered a strong potential for natural language systems to process informal language. A representative form of informal language is slang, used commonly in daily conversations and…

Computation and Language · Computer Science 2024-04-16 Zhewei Sun , Qian Hu , Rahul Gupta , Richard Zemel , Yang Xu

Fine-tuning a pretrained language model on a curated dataset can produce spurious correlations between the fine-tuning task and unintended latent factors -- such as misaligned personas or political slant -- that the curation procedure has…

Machine Learning · Statistics 2026-05-28 Ciarán M. Gilligan-Lee , Joseph Egan , Yuchen Zhu , Michael O'Riordan

Text classification, a core component of task-oriented dialogue systems, attracts continuous research from both the research and industry community, and has resulted in tremendous progress. However, existing method does not consider the use…

Computation and Language · Computer Science 2022-12-16 Yifeng Xie

The predictions of Large Language Models (LLMs) on downstream tasks often improve significantly when including examples of the input--label relationship in the context. However, there is currently no consensus about how this in-context…

Computation and Language · Computer Science 2024-03-14 Jannik Kossen , Yarin Gal , Tom Rainforth

Automated assessment in natural language generation is a challenging task. Instruction-tuned large language models (LLMs) have shown promise in reference-free evaluation, particularly through comparative assessment. However, the quadratic…

Computation and Language · Computer Science 2024-09-25 Vatsal Raina , Adian Liusie , Mark Gales

With the advent of conversational assistants, like Amazon Alexa, Google Now, etc., dialogue systems are gaining a lot of traction, especially in industrial setting. These systems typically consist of Spoken Language understanding component…

Computation and Language · Computer Science 2019-07-19 Arshit Gupta , John Hewitt , Katrin Kirchhoff

Automatic pathological speech detection approaches have shown promising results, gaining attention as potential diagnostic tools alongside costly traditional methods. While these approaches can achieve high accuracy, their lack of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-01 Mahdi Amiri , Hatef Otroshi Shahreza , Ina Kodrasi

Large language models (LLMs) have shown remarkable capacity for in-context learning (ICL), where learning a new task from just a few training examples is done without being explicitly pre-trained. However, despite the success of LLMs, there…

Computation and Language · Computer Science 2023-08-02 Xindi Wang , Yufei Wang , Can Xu , Xiubo Geng , Bowen Zhang , Chongyang Tao , Frank Rudzicz , Robert E. Mercer , Daxin Jiang

Timeseries regression models often struggle to leverage large volumes of labeled multimodal data, particularly when the data are irregularly sampled or contain missing values. This is common in domains like healthcare and predictive…

Machine Learning · Computer Science 2026-05-18 Antoine Honoré , Ming Xiao

In recent years, pretrained language models have revolutionized the NLP world, while achieving state of the art performance in various downstream tasks. However, in many cases, these models do not perform well when labeled data is scarce…

Computation and Language · Computer Science 2022-04-06 Liat Ein-Dor , Ilya Shnayderman , Artem Spector , Lena Dankin , Ranit Aharonov , Noam Slonim