English
Related papers

Related papers: Assessing LLM Reasoning Through Implicit Causal Ch…

200 papers

Despite superior reasoning prowess demonstrated by Large Language Models (LLMs) with Chain-of-Thought (CoT) prompting, a lack of understanding prevails around the internal mechanisms of the models that facilitate CoT generation. This work…

Computation and Language · Computer Science 2024-05-07 Subhabrata Dutta , Joykirat Singh , Soumen Chakrabarti , Tanmoy Chakraborty

Large language model (LLM) agents-especially smaller, open-source models-often produce causally invalid or incoherent actions in collaborative tasks due to their reliance on surface-level correlations rather than grounded causal reasoning.…

Artificial Intelligence · Computer Science 2025-08-20 Minh Hoang Nguyen , Van Dai Do , Dung Nguyen , Thin Nguyen , Hung Le

Understanding causal explanations - reasons given for happenings in one's life - has been found to be an important psychological factor linked to physical and mental health. Causal explanations are often studied through manual…

Computation and Language · Computer Science 2018-10-19 Youngseo Son , Nipun Bayas , H. Andrew Schwartz

Language Models (LMs) have emerged as powerful sources of evidence for linguists seeking to develop theories of syntax. In this paper, we argue that causal interpretability methods, applied to LMs, can greatly enhance the value of such…

Computation and Language · Computer Science 2025-10-01 Sasha Boguraev , Christopher Potts , Kyle Mahowald

Large Language Models (LLMs) have demonstrated remarkable abilities to solve problems requiring multiple reasoning steps, yet the internal mechanisms enabling such capabilities remain elusive. Unlike existing surveys that primarily focus on…

Computation and Language · Computer Science 2026-01-22 Liangming Pan , Jason Liang , Jiaran Ye , Minglai Yang , Xinyuan Lu , Fengbin Zhu

Large language models (LLMs) increasingly solve difficult problems by producing "reasoning traces" before emitting a final response. However, it remains unclear how accuracy and decision commitment evolve along a reasoning trajectory, and…

Machine Learning · Computer Science 2026-02-02 Marthe Ballon , Brecht Verbeken , Vincent Ginis , Andres Algaba

Chain-of-Thought (CoT) prompting can dramatically improve the multi-step reasoning abilities of large language models (LLMs). CoT explicitly encourages the LLM to generate intermediate rationales for solving a problem, by providing a series…

Computation and Language · Computer Science 2023-06-02 Boshi Wang , Sewon Min , Xiang Deng , Jiaming Shen , You Wu , Luke Zettlemoyer , Huan Sun

Recent studies have shown that Large Language Models (LLMs) can achieve strong reasoning performance by incorporating functional symbolic representations that abstractly describe graph traversal algorithms and step-by-step reasoning in…

Artificial Intelligence · Computer Science 2026-05-28 Phuong Minh Nguyen , Tien Huu Dang , Naoya Inoue

Large language models (LLMs) are proficient at generating fluent text with minimal task-specific supervision. Yet, their ability to provide well-grounded rationalizations for knowledge-intensive tasks remains under-explored. Such tasks,…

Computation and Language · Computer Science 2024-02-02 Aditi Mishra , Sajjadur Rahman , Hannah Kim , Kushan Mitra , Estevam Hruschka

We study how well large language models (LLMs) explain their generations through rationales -- a set of tokens extracted from the input text that reflect the decision-making process of LLMs. Specifically, we systematically study rationales…

Computation and Language · Computer Science 2024-10-23 Mohsen Fayyaz , Fan Yin , Jiao Sun , Nanyun Peng

Large Language Models (LLMs) are increasingly positioned as decision engines for hiring, healthcare, and economic judgment, yet real-world human judgment reflects a balance between rational deliberation and emotion-driven bias. If LLMs are…

Understanding climate change requires reasoning over complex causal networks. Yet, existing causal discovery datasets predominantly capture explicit, direct causal relations. We introduce ClimateCause, a manually expert-annotated dataset of…

Computation and Language · Computer Science 2026-04-17 Liesbeth Allein , Nataly Pineda-Castañeda , Andrea Rocci , Marie-Francine Moens

In this paper, we compare data generated with mono- and multilingual LLMs spanning a range of model sizes with data provided by human participants in an experimental setting investigating well-established discourse biases. Beyond the…

Computation and Language · Computer Science 2025-01-23 Florian Kankowski , Torgrim Solstad , Sina Zarriess , Oliver Bott

Language model (LM) agents are increasingly used as autonomous decision-makers which need to actively gather information to guide their decisions. A crucial cognitive skill for such agents is the efficient exploration and understanding of…

Artificial Intelligence · Computer Science 2025-10-07 Anthony GX-Chen , Dongyan Lin , Mandana Samiei , Doina Precup , Blake A. Richards , Rob Fergus , Kenneth Marino

The discovery of causal relationships between random variables is an important yet challenging problem that has applications across many scientific domains. Differentiable causal discovery (DCD) methods are effective in uncovering causal…

Machine Learning · Computer Science 2024-10-29 Shiv Kampani , David Hidary , Constantijn van der Poel , Martin Ganahl , Brenda Miao

Language is not only a tool for communication but also a medium for human cognition and reasoning. If, as linguistic relativity suggests, the structure of language shapes cognitive patterns, then large language models (LLMs) trained on…

Computation and Language · Computer Science 2025-06-23 Chenxi Wang , Yixuan Zhang , Lang Gao , Zixiang Xu , Zirui Song , Yanbo Wang , Xiuying Chen

Large Language Models (LLMs) still struggle with multi-step logical reasoning. Existing approaches either purely refine the reasoning chain in natural language form or attach a symbolic solver as an external module. In this work, we instead…

Computation and Language · Computer Science 2026-04-22 Feihao Fang , My T. Thai , Yuanyuan Lei

We propose a machine-learning tool that yields causal inference on text in randomized trials. Based on a simple econometric framework in which text may capture outcomes of interest, our procedure addresses three questions: First, is the…

Econometrics · Economics 2025-03-04 Iman Modarressi , Jann Spiess , Amar Venugopal

The reasoning abilities of Large Language Models (LLMs) are becoming a central focus of study in NLP. In this paper, we consider the case of syllogistic reasoning, an area of deductive reasoning studied extensively in logic and cognitive…

Computation and Language · Computer Science 2024-10-18 Leonardo Bertolazzi , Albert Gatt , Raffaella Bernardi

Empathetic response generation endows agents with the capability to comprehend dialogue contexts and react to expressed emotions. Previous works predominantly focus on leveraging the speaker's emotional labels, but ignore the importance of…

Computation and Language · Computer Science 2024-08-22 Xinhao Chen , Chong Yang , Man Lan , Li Cai , Yang Chen , Tu Hu , Xinlin Zhuang , Aimin Zhou