English
Related papers

Related papers: Which Spurious Correlations Impact Reasoning in NL…

200 papers

There has been a growing interest in model-agnostic methods that can make deep learning models more transparent and explainable to a user. Some researchers recently argued that for a machine to achieve a certain degree of human-level…

Artificial Intelligence · Computer Science 2021-06-09 Yu-Liang Chou , Catarina Moreira , Peter Bruza , Chun Ouyang , Joaquim Jorge

Conventional supervised learning methods are often vulnerable to spurious correlations, particularly under distribution shifts in test data. To address this issue, several approaches, most notably Group DRO, have been developed. While these…

Machine Learning · Computer Science 2026-02-13 Sung Ho Jo , Seonghwi Kim , Minwoo Chae

In various natural language processing (NLP) tasks, fine-tuning Pre-trained Language Models (PLMs) often leads to the issue of spurious correlations, which negatively impacts performance, particularly when dealing with out-of-distribution…

Computation and Language · Computer Science 2025-04-17 Suyoung Bae , Hyojun Kim , YunSeok Choi , Jee-Hyong Lee

We present a randomized controlled trial for a model-in-the-loop regression task, with the goal of measuring the extent to which (1) good explanations of model predictions increase human accuracy, and (2) faulty explanations decrease human…

Machine Learning · Computer Science 2020-07-27 Eric Chu , Deb Roy , Jacob Andreas

Deep classifiers are known to rely on spurious features $\unicode{x2013}$ patterns which are correlated with the target on the training data but not inherently relevant to the learning problem, such as the image backgrounds when classifying…

Machine Learning · Computer Science 2022-10-21 Pavel Izmailov , Polina Kirichenko , Nate Gruver , Andrew Gordon Wilson

Language models (LMs) have been argued to overlap substantially with human beings in grammaticality judgment tasks. But when humans systematically make errors in language processing, should we expect LMs to behave like cognitive models of…

Computation and Language · Computer Science 2024-02-06 Yuhan Zhang , Edward Gibson , Forrest Davis

How can we interpret and retrieve medical evidence to support clinical decisions? Clinical trial reports (CTR) amassed over the years contain indispensable information for the development of personalized medicine. However, it is practically…

Computation and Language · Computer Science 2023-10-31 Maël Jullien , Marco Valentino , Hannah Frost , Paul O'Regan , Donal Landers , André Freitas

Recently, large language models have shown great potential to transform online medical consultation. Despite this, most research targets improving diagnostic accuracy with ample information, often overlooking the inquiry phase. Some studies…

Computation and Language · Computer Science 2025-03-12 Zhaocheng Liu , Quan Tu , Wen Ye , Yu Xiao , Zhishou Zhang , Hengfu Cui , Yalun Zhu , Qiang Ju , Shizheng Li , Jian Xie

Recent studies show that crowd-sourced Natural Language Inference (NLI) datasets may suffer from significant biases like annotation artifacts. Models utilizing these superficial clues gain mirage advantages on the in-domain testing set,…

Computation and Language · Computer Science 2020-10-16 Guanhua Zhang , Bing Bai , Jian Liang , Kun Bai , Conghui Zhu , Tiejun Zhao

Large Vision-Language Models (LVLMs) often suffer from object hallucination, making erroneous judgments about the presence of objects in images. We propose this primar- ily stems from spurious correlations arising when models strongly…

Artificial Intelligence · Computer Science 2025-11-14 Zhe Xu , Zhicai Wang , Junkang Wu , Jinda Lu , Xiang Wang

LLMs are often claimed to be capable of Natural Language Inference (NLI), which is widely regarded as a cornerstone of more complex forms of reasoning. However, recent works show that LLMs still suffer from hallucinations in NLI due to…

Computation and Language · Computer Science 2025-03-17 Liang Cheng , Tianyi Li , Zhaowei Wang , Tianyang Liu , Mark Steedman

Specific Language Impairment (SLI) is a disorder that affects communication and can affect both comprehension and expression. This study focuses on effectively detecting SLI in children using transcripts of spontaneous narratives from 1063…

Computation and Language · Computer Science 2024-07-18 Santiago Arena , Antonio Quintero-Rincón

While there has been a recent explosion of work on ExplainableAI ExAI on deep models that operate on imagery and tabular data, textual datasets present new challenges to the ExAI community. Such challenges can be attributed to the lack of…

Computation and Language · Computer Science 2022-10-14 Julia El Zini , Mariette Awad

Counterfactual explanations are increasingly used to address interpretability, recourse, and bias in AI decisions. However, we do not know how well counterfactual explanations help users to understand a systems decisions, since no large…

Human-Computer Interaction · Computer Science 2023-04-04 Greta Warren , Mark T Keane , Ruth M J Byrne

Recent advances in eXplainable AI (XAI) have provided new insights into how models for vision, language, and tabular data operate. However, few approaches exist for understanding speech models. Existing work focuses on a few spoken language…

Computation and Language · Computer Science 2023-09-15 Eliana Pastor , Alkis Koudounas , Giuseppe Attanasio , Dirk Hovy , Elena Baralis

Neural networks trained with (stochastic) gradient descent have an inductive bias towards learning simpler solutions. This makes them highly prone to learning spurious correlations in the training data, that may not hold at test time. In…

Machine Learning · Computer Science 2024-03-08 Yu Yang , Eric Gan , Gintare Karolina Dziugaite , Baharan Mirzasoleiman

Finding counterevidence to statements is key to many tasks, including counterargument generation. We build a system that, given a statement, retrieves counterevidence from diverse sources on the Web. At the core of this system is a natural…

Computation and Language · Computer Science 2021-09-21 Yohan Jo , Haneul Yoo , JinYeong Bak , Alice Oh , Chris Reed , Eduard Hovy

Data-driven statistical Natural Language Processing (NLP) techniques leverage large amounts of language data to build models that can understand language. However, most language data reflect the public discourse at the time the data was…

Computation and Language · Computer Science 2019-10-11 Vinodkumar Prabhakaran , Ben Hutchinson , Margaret Mitchell

Despite the recent advances in abstractive text summarization, current summarization models still suffer from generating factually inconsistent summaries, reducing their utility for real-world application. We argue that the main reason for…

Computation and Language · Computer Science 2023-10-16 Polina Zablotskaia , Misha Khalman , Rishabh Joshi , Livio Baldini Soares , Shoshana Jakobovits , Joshua Maynez , Shashi Narayan

Topic models are widely used analysis techniques for clustering documents and surfacing thematic elements of text corpora. These models remain challenging to optimize and often require a "human-in-the-loop" approach where domain experts use…

Human-Computer Interaction · Computer Science 2021-01-08 Anamaria Crisan , Michael Correll