English
Related papers

Related papers: LLMs Are Prone to Fallacies in Causal Inference

200 papers

Computational analysis of time-course data with an underlying causal structure is needed in a variety of domains, including neural spike trains, stock price movements, and gene expression levels. However, it can be challenging to determine…

Artificial Intelligence · Computer Science 2012-05-14 Samantha Kleinberg , Bud Mishra

LLMs can be unpredictable, as even slight alterations to the prompt can cause the output to change in unexpected ways. Thus, the ability of models to accurately explain their behavior is critical, especially in high-stakes settings. One…

Computation and Language · Computer Science 2025-11-26 Marvin Limpijankit , Yanda Chen , Melanie Subbiah , Nicholas Deas , Kathleen McKeown

We examine the role of textual data as study units when conducting causal inference by drawing parallels between human subjects and organized texts. %in human population research. We elaborate on key causal concepts and principles, and…

Computation and Language · Computer Science 2022-02-03 Bo Zhang , Jiayao Zhang

Interpretability research takes counterfactual theories of causality for granted. Most causal methods rely on counterfactual interventions to inputs or the activations of particular model components, followed by observations of the change…

Machine Learning · Computer Science 2024-07-08 Aaron Mueller

Large language models (LLMs) can recall a wide range of factual knowledge across languages. However, existing factual recall evaluations primarily assess fact retrieval in isolation, where the queried entity is explicitly named and the fact…

Computation and Language · Computer Science 2026-01-21 Yihong Liu , Bingyu Xiong , Hinrich Schütze

During disasters, extracting causal relations from social media can strengthen situational awareness by identifying factors linked to casualties, physical damage, infrastructure disruption, and cascading impacts. However, disaster-related…

Computation and Language · Computer Science 2026-05-13 Ujun Jeong , Saketh Vishnubhatla , Bohan Jiang , Andre Harrison , Adrienne Raglin , Huan Liu

Do LMs infer the semantics of text from co-occurrence patterns in their training data? Merrill et al. (2022) argue that, in theory, sentence co-occurrence probabilities predicted by an optimal LM should reflect the entailment relationship…

Computation and Language · Computer Science 2024-07-18 William Merrill , Zhaofeng Wu , Norihito Naka , Yoon Kim , Tal Linzen

Recent breakthroughs in artificial intelligence have driven a paradigm shift, where large language models (LLMs) with billions or trillions of parameters are trained on vast datasets, achieving unprecedented success across a series of…

Computation and Language · Computer Science 2024-10-22 Anpeng Wu , Kun Kuang , Minqin Zhu , Yingrong Wang , Yujia Zheng , Kairong Han , Baohong Li , Guangyi Chen , Fei Wu , Kun Zhang

Causal understanding is essential for many kinds of decision-making, but causal inference from observational data has typically only been applied to structured, low-dimensional datasets. While text classifiers produce low-dimensional…

Computation and Language · Computer Science 2018-10-03 Zach Wood-Doughty , Ilya Shpitser , Mark Dredze

Numerous decision-making tasks require estimating causal effects under interventions on different parts of a system. As practitioners consider using large language models (LLMs) to automate decisions, studying their causal reasoning…

Machine Learning · Computer Science 2024-12-24 Tejas Kasetty , Divyat Mahajan , Gintare Karolina Dziugaite , Alexandre Drouin , Dhanya Sridhar

Large language model (LLM) development is currently driven by large-scale empirical iteration over data mixtures, reward models, routing strategies, and evaluation pipelines. Here, we argue that many central questions in LLM development and…

Causal reasoning, the ability to identify cause-and-effect relationship, is crucial in human thinking. Although large language models (LLMs) succeed in many NLP tasks, it is still challenging for them to conduct complex causal reasoning…

Computation and Language · Computer Science 2023-05-31 Xiao Liu , Da Yin , Chen Zhang , Yansong Feng , Dongyan Zhao

Some argue scale is all what is needed to achieve AI, covering even causal models. We make it clear that large language models (LLMs) cannot be causal and give reason onto why sometimes we might feel otherwise. To this end, we define and…

Artificial Intelligence · Computer Science 2023-08-28 Matej Zečević , Moritz Willig , Devendra Singh Dhami , Kristian Kersting

Mainstream methods for Legal Judgment Prediction (LJP) based on Pre-trained Language Models (PLMs) heavily rely on the statistical correlation between case facts and judgment results. This paradigm lacks explicit modeling of legal…

Computation and Language · Computer Science 2026-03-13 Yuzhi Liang , Lixiang Ma , Xinrong Zhu

Reliable causal inference is essential for making decisions in high-stakes areas like medicine, economics, and public policy. However, it remains unclear whether large language models (LLMs) can handle rigorous and trustworthy statistical…

Artificial Intelligence · Computer Science 2026-05-13 Jin Du , Li Chen , Xun Xian , An Luo , Fangqiao Tian , Ganghua Wang , Charles Doss , Xiaotong Shen , Jie Ding

The scale and scope of scholarly articles today are overwhelming human researchers who seek to timely digest and synthesize knowledge. In this paper, we seek to develop natural language processing (NLP) models to accelerate the speed of…

Computation and Language · Computer Science 2020-06-17 Victor Zitian Chen , Felipe Montano-Campos , Wlodek Zadrozny

Causal learning is the cognitive process of developing the capability of making causal inferences based on available information, often guided by normative principles. This process is prone to errors and biases, such as the illusion of…

LLMs suffer from critical reasoning issues such as unfaithfulness, bias, and inconsistency, since they lack robust causal underpinnings and may rely on superficial correlations rather than genuine understanding. Successive LRMs have emerged…

Artificial Intelligence · Computer Science 2025-09-23 Zhizhang FU , Guangsheng Bao , Hongbo Zhang , Chenkai Hu , Yue Zhang

New text as data techniques offer a great promise: the ability to inductively discover measures that are useful for testing social science theories of interest from large collections of text. We introduce a conceptual framework for making…

Machine Learning · Statistics 2018-02-08 Naoki Egami , Christian J. Fong , Justin Grimmer , Margaret E. Roberts , Brandon M. Stewart

Causal structure discovery from observations can be improved by integrating background knowledge provided by an expert to reduce the hypothesis space. Recently, Large Language Models (LLMs) have begun to be considered as sources of prior…

Machine Learning · Computer Science 2024-05-24 Victor-Alexandru Darvariu , Stephen Hailes , Mirco Musolesi