English
Related papers

Related papers: Counterfactual Causal Inference in Natural Languag…

200 papers

Large Language Models (LLMs) have recently shown great promise in planning and reasoning applications. These tasks demand robust systems, which arguably require a causal understanding of the environment. While LLMs can acquire and reflect…

Artificial Intelligence · Computer Science 2024-10-29 John Gkountouras , Matthias Lindemann , Phillip Lippe , Efstratios Gavves , Ivan Titov

Causal discovery from observational data is pivotal for deciphering complex relationships. Causal Structure Learning (CSL), which focuses on deriving causal Directed Acyclic Graphs (DAGs) from data, faces challenges due to vast DAG spaces…

Artificial Intelligence · Computer Science 2023-11-21 Taiyu Ban , Lyuzhou Chen , Derui Lyu , Xiangyu Wang , Huanhuan Chen

Causal inference is one of the hallmarks of human intelligence. While the field of CausalNLP has attracted much interest in the recent years, existing causal inference datasets in NLP primarily rely on discovering causality from empirical…

Computation and Language · Computer Science 2024-04-18 Zhijing Jin , Jiarui Liu , Zhiheng Lyu , Spencer Poff , Mrinmaya Sachan , Rada Mihalcea , Mona Diab , Bernhard Schölkopf

Causal discovery traditionally relies on statistical methods applied to observational data, often requiring large datasets and assumptions about underlying causal structures. Recent advancements in Large Language Models (LLMs) have…

Machine Learning · Computer Science 2025-04-16 Yuni Susanti , Michael Färber

Causality is essential in scientific research, enabling researchers to interpret true relationships between variables. These causal relationships are often represented by causal graphs, which are directed acyclic graphs. With the recent…

Computation and Language · Computer Science 2025-02-19 Ivaxi Sheth , Bahare Fatemi , Mario Fritz

Scaling laws have allowed Pre-trained Language Models (PLMs) into the field of causal reasoning. Causal reasoning of PLM relies solely on text-based descriptions, in contrast to causal discovery which aims to determine the causal…

Despite the groundbreaking advancements made by large language models (LLMs), hallucination remains a critical bottleneck for their deployment in high-stakes domains. Existing classification-based methods mainly rely on static and passive…

Machine Learning · Computer Science 2026-05-12 Linggang Kong , Lei Wu , Yunlong Zhang , Xiaofeng Zhong , Zhen Wang , Yongjie Wang , Yao Pan

Recent work shows that causal facts can be effectively extracted from LLMs through prompting, facilitating the creation of causal graphs for causal inference tasks. However, it is unclear if this success is limited to explicitly-mentioned…

Computation and Language · Computer Science 2024-06-19 Nitish Joshi , Abulhair Saparov , Yixin Wang , He He

Revealing hidden causal variables alongside the underlying causal mechanisms is essential to the development of science. Despite the progress in the past decades, existing practice in causal discovery (CD) heavily relies on high-quality…

Machine Learning · Computer Science 2025-10-14 Chenxi Liu , Yongqiang Chen , Tongliang Liu , Mingming Gong , James Cheng , Bo Han , Kun Zhang

Counterfactual reasoning has emerged as a crucial technique for generalizing the reasoning capabilities of large language models (LLMs). By generating and analyzing counterfactual scenarios, researchers can assess the adaptability and…

Artificial Intelligence · Computer Science 2026-02-17 Shuai Yang , Qi Yang , Luoxi Tang , Yuqiao Meng , Nancy Guo , Jeremy Blackburn , Zhaohan Xi

During disasters, extracting causal relations from social media can strengthen situational awareness by identifying factors linked to casualties, physical damage, infrastructure disruption, and cascading impacts. However, disaster-related…

Computation and Language · Computer Science 2026-05-13 Ujun Jeong , Saketh Vishnubhatla , Bohan Jiang , Andre Harrison , Adrienne Raglin , Huan Liu

As language models (LMs) deliver increasing performance on a range of NLP tasks, probing classifiers have become an indispensable technique in the effort to better understand their inner workings. A typical setup involves (1) defining an…

Computation and Language · Computer Science 2024-08-01 Charles Jin , Martin Rinard

Large language models (LLMs) have shown various ability on natural language processing, including problems about causality. It is not intuitive for LLMs to command causality, since pretrained models usually work on statistical associations,…

Computation and Language · Computer Science 2024-08-27 Chenyang Zhang , Haibo Tong , Bin Zhang , Dongyu Zhang

Causal reasoning is a cornerstone of human intelligence and a critical capability for artificial systems aiming to achieve advanced understanding and decision-making. This thesis delves into various dimensions of causal reasoning and…

Computation and Language · Computer Science 2025-04-22 Zhijing Jin

Structural causal models are the basic modelling unit in Pearl's causal theory; in principle they allow us to solve counterfactuals, which are at the top rung of the ladder of causation. But they often contain latent variables that limit…

Artificial Intelligence · Computer Science 2021-11-23 Marco Zaffalon , Alessandro Antonucci , Rafael Cabañas

Causal reasoning in natural language requires identifying relevant variables, understanding their interactions, and reasoning about effects and interventions, often under noisy or ambiguous conditions. While large language models (LLMs)…

Computation and Language · Computer Science 2026-05-07 Zhi Xu , Yun Fu

In knowledge-intensive tasks, especially in high-stakes domains like medicine and law, it is critical not only to retrieve relevant information but also to provide causal reasoning and explainability. Large language models (LLMs) have…

Artificial Intelligence · Computer Science 2025-03-18 Hang Luo , Jian Zhang , Chujun Li

Counterfactual reasoning is widely recognized as one of the most challenging and intricate aspects of causality in artificial intelligence. In this paper, we evaluate the performance of large language models (LLMs) in counterfactual…

Computation and Language · Computer Science 2026-04-14 Yuefei Chen , Vivek K. Singh , Jing Ma , Ruixiang Tang

Large Language Models (LLMs) have shown their success in language understanding and reasoning on general topics. However, their capability to perform inference based on user-specified structured data and knowledge in corpus-rare concepts,…

Computation and Language · Computer Science 2024-10-29 Haitao Jiang , Lin Ge , Yuhe Gao , Jianian Wang , Rui Song

Causal learning is the cognitive process of developing the capability of making causal inferences based on available information, often guided by normative principles. This process is prone to errors and biases, such as the illusion of…