English
Related papers

Related papers: Can LLMs Leverage Observational Data? Towards Data…

200 papers

Causal effect estimation from observational data is a challenging problem, especially with high dimensional data and in the presence of unobserved variables. The available data-driven methods for tackling the problem either provide an…

Methodology · Statistics 2022-07-25 Debo Cheng , Jiuyong Li , Lin Liu , Jiji Zhang , Jixue Liu , Thuc Duy Le

Large Language Models (LLMs) offer natural language explanations as an alternative to feature attribution methods for model interpretability. However, despite their plausibility, they may not reflect the model's true reasoning faithfully.…

Computation and Language · Computer Science 2025-12-29 Kerem Zaman , Shashank Srivastava

Causal discovery from observational data typically assumes access to complete data and availability of perfect domain experts. In practice, data often arrive in batches, are subject to sampling bias, and expert knowledge is scarce. Language…

Machine Learning · Computer Science 2026-05-12 Prakhar Verma , David Arbour , Sunav Choudhary , Harshita Chopra , Arno Solin , Atanu R. Sinha

Understanding how events in a scenario causally connect with each other is important for effectively modeling and reasoning about events. But event reasoning remains a difficult challenge, and despite recent advances, Large Language Models…

Artificial Intelligence · Computer Science 2025-06-10 Mahnaz Koupaee , Xueying Bai , Mudan Chen , Greg Durrett , Nathanael Chambers , Niranjan Balasubramanian

This article presents a novel method for causal discovery with generalized structural equation models suited for analyzing diverse types of outcomes, including discrete, continuous, and mixed data. Causal discovery often faces challenges…

Methodology · Statistics 2023-10-26 Minjie Wang , Xiaotong Shen , Wei Pan

Hypothetical induction is recognized as the main reasoning type when scientists make observations about the world and try to propose hypotheses to explain those observations. Past research on hypothetical induction is under a constrained…

Computation and Language · Computer Science 2024-06-13 Zonglin Yang , Xinya Du , Junxian Li , Jie Zheng , Soujanya Poria , Erik Cambria

Large Language Models (LLMs) have transformed artificial intelligence by excelling in complex natural language processing tasks. Their ability to generate human-like text has opened new possibilities for market research, particularly in…

Artificial Intelligence · Computer Science 2026-04-20 Mengxin Wang , Dennis J. Zhang , Heng Zhang

Causal discovery is crucial for understanding complex systems and informing decisions. While observational data can uncover causal relationships under certain assumptions, it often falls short, making active interventions necessary. Current…

Machine Learning · Computer Science 2024-06-18 Yuxuan Wang , Mingzhou Liu , Xinwei Sun , Wei Wang , Yizhou Wang

Identifying causal relationships from observational time series data is a key problem in disciplines such as climate science or neuroscience, where experiments are often not possible. Data-driven causal inference is challenging since…

Methodology · Statistics 2019-12-03 Jakob Runge , Peer Nowack , Marlene Kretschmer , Seth Flaxman , Dino Sejdinovic

We present DMCD (DataMap Causal Discovery), a two-phase causal discovery framework that integrates LLM-based semantic drafting from variable metadata with statistical validation on observational data. In Phase I, a large language model…

Artificial Intelligence · Computer Science 2026-02-25 Samarth KaPatel , Sofia Nikiforova , Giacinto Paolo Saggese , Paul Smith

Large language models (LLMs) show promise for health applications when combined with behavioral sensing data. Traditional approaches convert sensor data into text prompts, but this process is prone to errors, computationally expensive, and…

State of the art large language models (LLMs) have shown impressive performance on a variety of benchmark tasks and are increasingly used as components in larger applications, where LLM-based predictions serve as proxies for human…

Computation and Language · Computer Science 2024-06-14 Michael Franke , Polina Tsvilodub , Fausto Carcassi

Causal discovery problems use a set of observations to deduce causality between variables in the real world, typically to answer questions about biological or physical systems. These observations are often recorded at regular time…

Signal Processing · Electrical Eng. & Systems 2026-02-24 Kurt Butler , Damian Machlanski , Panagiotis Dimitrakopoulos , Sotirios A. Tsaftaris

Large language models (LLMs) have mastered abundant simple and explicit commonsense knowledge through pre-training, enabling them to achieve human-like performance in simple commonsense reasoning. Nevertheless, LLMs struggle to reason with…

Computation and Language · Computer Science 2025-06-10 Kai Xiong , Xiao Ding , Yixin Cao , Yuxiong Yan , Li Du , Yufei Zhang , Jinglong Gao , Jiaqian Liu , Bing Qin , Ting Liu

Data is fundamental to large language models (LLMs). However, understanding of what makes certain data useful for different stages of an LLM workflow, including training, tuning, alignment, in-context learning, etc., and why, remains an…

Artificial Intelligence · Computer Science 2026-05-20 Shiqiang Wang , Herbert Woisetschläger , Hans Arno Jacobsen , Mingyue Ji

Large language models (LLMs) can be controlled at inference time through prompts (in-context learning) and internal activations (activation steering). Different accounts have been proposed to explain these methods, yet their common goal of…

Machine Learning · Computer Science 2026-03-13 Eric Bigelow , Daniel Wurgaft , YingQiao Wang , Noah Goodman , Tomer Ullman , Hidenori Tanaka , Ekdeep Singh Lubana

Causal discovery methods aim to determine the causal direction between variables using observational data. Functional causal discovery methods, such as those based on the Linear Non-Gaussian Acyclic Model (LiNGAM), rely on structural and…

Methodology · Statistics 2024-09-27 Shreya Prakash , Fan Xia , Elena Erosheva

With the rise of Large Language Models(LLMs), it has become crucial to understand their capabilities and limitations in deciphering and explaining the complex web of causal relationships that language entails. Current methods use either…

We study how well large language models (LLMs) explain their generations through rationales -- a set of tokens extracted from the input text that reflect the decision-making process of LLMs. Specifically, we systematically study rationales…

Computation and Language · Computer Science 2024-10-23 Mohsen Fayyaz , Fan Yin , Jiao Sun , Nanyun Peng

Unraveling the causal relationships among the execution of process activities is a crucial element in predicting the consequences of process interventions and making informed decisions regarding process improvements. Process discovery…

Artificial Intelligence · Computer Science 2025-01-15 Fabiana Fournier , Lior Limonad , Inna Skarbovsky , Yuval David