English
Related papers

Related papers: Counterfactual Causal Inference in Natural Languag…

200 papers

The ability to understand causality significantly impacts the competence of large language models (LLMs) in output explanation and counterfactual reasoning, as causality reveals the underlying data distribution. However, the lack of a…

Machine Learning · Computer Science 2024-09-30 Yu Zhou , Xingyu Wu , Beicheng Huang , Jibin Wu , Liang Feng , Kay Chen Tan

The validity of medical studies based on real-world clinical data, such as observational studies, depends on critical assumptions necessary for drawing causal conclusions about medical interventions. Many published studies are flawed…

Artificial Intelligence · Computer Science 2024-07-30 Ahmed Alaa , Rachael V. Phillips , Emre Kıcıman , Laura B. Balzer , Mark van der Laan , Maya Petersen

Large Language Models (LLMs) have demonstrated strong performance across a wide range of tasks, yet they still struggle with complex mathematical reasoning, a challenge fundamentally rooted in deep structural dependencies. To address this…

Artificial Intelligence · Computer Science 2025-12-01 Lei Zan , Keli Zhang , Ruichu Cai , Lujia Pan

Causal explanations of the predictions of NLP systems are essential to ensure safety and establish trust. Yet, existing methods often fall short of explaining model predictions effectively or efficiently and are often model-specific. In…

Computation and Language · Computer Science 2023-11-23 Yair Gat , Nitay Calderon , Amir Feder , Alexander Chapanin , Amit Sharma , Roi Reichart

Large Language Models (LLMs) show promise in biomedicine but lack true causal understanding, relying instead on correlations. This paper envisions causal LLM agents that integrate multimodal data (text, images, genomics, etc.) and perform…

Artificial Intelligence · Computer Science 2025-05-23 Adib Bazgir , Amir Habibdoust Lafmajani , Yuwen Zhang

Large language models (LLMs) offer the potential to automate a large number of tasks that previously have not been possible to automate, including some in science. There is considerable interest in whether LLMs can automate the process of…

Econometrics · Economics 2024-12-17 Nick Huntington-Klein , Eleanor J. Murray

We propose a novel framework for generating causal graphs from narrative texts, bridging high-level causality and detailed event-specific relationships. Our method first extracts concise, agent-centered vertices using large language model…

Computation and Language · Computer Science 2025-04-11 Zehan Li , Ruhua Pan , Xinyu Pi

A fundamental goal of scientific research is to learn about causal relationships. However, despite its critical role in the life and social sciences, causality has not had the same importance in Natural Language Processing (NLP), which has…

Large language models (LLMs) have made remarkable progress in a wide range of natural language understanding and generation tasks. However, their ability to generate counterfactuals has not been examined systematically. To bridge this gap,…

Computation and Language · Computer Science 2024-02-26 Yongqi Li , Mayi Xu , Xin Miao , Shen Zhou , Tieyun Qian

In causal inference, generalization capability refers to the ability to conduct causal inference methods on new data to estimate the causal-effect between unknown phenomenon, which is crucial for expanding the boundaries of knowledge.…

Computation and Language · Computer Science 2024-10-16 Chen Wang , Dongming Zhao , Bo Wang , Ruifang He , Yuexian Hou

The need for interpretability in deep learning has driven interest in counterfactual explanations, which identify minimal changes to an instance that change a model's prediction. Current counterfactual (CF) generation methods require…

Computation and Language · Computer Science 2025-12-11 Van Bach Nguyen , Christin Seifert , Jörg Schlötterer

Causality plays a pivotal role in various fields of study. Based on the framework of causal graphical models, previous works have proposed identifying whether a variable is a cause or non-cause of a target in every Markov equivalent graph…

Machine Learning · Statistics 2024-08-16 Qingyuan Zheng , Yue Liu , Yangbo He

In the field of Artificial Intelligence for Information Technology Operations, causal discovery is pivotal for operation and maintenance of graph construction, facilitating downstream industrial tasks such as root cause analysis. Temporal…

Artificial Intelligence · Computer Science 2024-05-28 Peiwen Li , Xin Wang , Zeyang Zhang , Yuan Meng , Fang Shen , Yue Li , Jialong Wang , Yang Li , Wenweu Zhu

Scientific discovery catalyzes human intellectual advances, driven by the cycle of hypothesis generation, experimental design, evaluation, and assumption refinement. Central to this process is causal inference, uncovering the mechanisms…

Machine Learning · Computer Science 2025-09-26 Ivaxi Sheth , Sahar Abdelnabi , Mario Fritz

As an essential component of human cognition, cause-effect relations appear frequently in text, and curating cause-effect relations from text helps in building causal networks for predictive tasks. Existing causality extraction techniques…

Information Retrieval · Computer Science 2021-11-02 Jie Yang , Soyeon Caren Han , Josiah Poon

Causal learning is the cognitive process of developing the capability of making causal inferences based on available information, often guided by normative principles. This process is prone to errors and biases, such as the illusion of…

Understanding the behavior of large language models (LLMs) is crucial for ensuring their safe and reliable use. However, existing explainable AI (XAI) methods for LLMs primarily rely on word-level explanations, which are often…

Computation and Language · Computer Science 2025-08-08 Furui Cheng , Vilém Zouhar , Robin Shing Moon Chan , Daniel Fürst , Hendrik Strobelt , Mennatallah El-Assady

Numerous benchmarks aim to evaluate the capabilities of Large Language Models (LLMs) for causal inference and reasoning. However, many of them can likely be solved through the retrieval of domain knowledge, questioning whether they achieve…

Machine Learning · Computer Science 2024-07-12 Linying Yang , Vik Shirvaikar , Oscar Clivio , Fabian Falck

With the advent of larger and more complex deep learning models, such as in Natural Language Processing (NLP), model qualities like explainability and interpretability, albeit highly desirable, are becoming harder challenges to tackle and…

Computation and Language · Computer Science 2024-01-30 Amrita Bhattacharjee , Raha Moraffah , Joshua Garland , Huan Liu

Large Vision-Language Models (LVLMs) achieve strong performance on visual question answering benchmarks, yet often rely on spurious correlations rather than genuine causal reasoning. Existing evaluations primarily assess the correctness of…

Artificial Intelligence · Computer Science 2026-02-25 Dhita Putri Pratama , Soyeon Caren Han , Yihao Ding