English
Related papers

Related papers: CLadder: Assessing Causal Reasoning in Language Mo…

200 papers

Chain-of-thought (CoT) rationales, which provide step-by-step reasoning to derive final answers, benefit LLMs in both inference and training. Incorporating rationales, either by generating them before answering during inference, or by…

Computation and Language · Computer Science 2025-10-21 Wenhang Shi , Shuqing Bian , Yiren Chen , Xinyi Zhang , Zhe Zhao , Pengfei Hu , Wei Lu , Xiaoyong Du

We propose a machine-learning tool that yields causal inference on text in randomized trials. Based on a simple econometric framework in which text may capture outcomes of interest, our procedure addresses three questions: First, is the…

Econometrics · Economics 2025-03-04 Iman Modarressi , Jann Spiess , Amar Venugopal

Despite their linguistic competence, Large Language Models (LLMs) often struggle to reason reliably and flexibly. To identify these shortcomings, we introduce the Non-Linear Reasoning (NLR) dataset, a collection of 55 unique, hand-designed…

Computation and Language · Computer Science 2025-12-02 Nasim Borazjanizadeh , Steven T. Piantadosi

Despite impressive performance on language modelling and complex reasoning tasks, Large Language Models (LLMs) fall short on the same tasks in uncommon settings or with distribution shifts, exhibiting a lack of generalisation ability. By…

Computation and Language · Computer Science 2024-09-11 Gaël Gendron , Bao Trung Nguyen , Alex Yuxuan Peng , Michael Witbrock , Gillian Dobbie

Large Language Models (LLMs) are increasingly used for boosting organizational efficiency and automating tasks. While not originally designed for complex cognitive processes, recent efforts have further extended to employ LLMs in activities…

Artificial Intelligence · Computer Science 2024-08-13 Fabiana Fournier , Lior Limonad , Inna Skarbovsky

Large Language Models (LLMs) and causal learning each hold strong potential for clinical decision making (CDM). However, their synergy remains poorly understood, largely due to the lack of systematic benchmarks evaluating their integration…

Machine Learning · Computer Science 2025-11-14 Linna Wang , Zhixuan You , Qihui Zhang , Jiunan Wen , Ji Shi , Yimin Chen , Yusen Wang , Fanqi Ding , Ziliang Feng , Li Lu

Commonsense inference to understand and explain human language is a fundamental research problem in natural language processing. Explaining human conversations poses a great challenge as it requires contextual understanding, planning,…

Computation and Language · Computer Science 2021-07-01 Deepanway Ghosal , Pengfei Hong , Siqi Shen , Navonil Majumder , Rada Mihalcea , Soujanya Poria

Large language models (LLMs) have shown remarkable reasoning capabilities given chain-of-thought prompts (examples with intermediate reasoning steps). Existing benchmarks measure reasoning ability indirectly, by evaluating accuracy on…

Computation and Language · Computer Science 2023-03-03 Abulhair Saparov , He He

Large language models (LLMs) are a promising venue for natural language understanding and generation tasks. However, current LLMs are far from reliable: they are prone to generate non-factual information and, more crucially, to contradict…

Machine Learning · Computer Science 2024-04-22 Diego Calanzone , Stefano Teso , Antonio Vergari

The reasoning abilities of large language models (LLMs) are the topic of a growing body of research in AI and cognitive science. In this paper, we probe the extent to which twenty-nine LLMs are able to distinguish logically correct…

Computation and Language · Computer Science 2024-10-15 Wesley H. Holliday , Matthew Mandelkern , Cedegao E. Zhang

Recent advances in Vision-Language Models (VLMs) have demonstrated impressive capabilities in perception and reasoning. However, the ability to perform causal inference -- a core aspect of human cognition -- remains underexplored,…

Computation and Language · Computer Science 2025-08-14 Keummin Ka , Junhyeong Park , Jaehyun Jeon , Youngjae Yu

Large language models (LLMs) often struggle with complex mathematical tasks, prone to "hallucinating" incorrect answers due to their reliance on statistical patterns. This limitation is further amplified in average Small LangSLMs with…

Large Language Models (LLMs) have shown impressive capabilities in natural language processing but still struggle to perform well on knowledge-intensive tasks that require deep reasoning and the integration of external knowledge. Although…

Computation and Language · Computer Science 2025-08-26 Bo Zhao , Yinghao Zhang , Ziqi Xu , Yongli Ren , Xiuzhen Zhang , Renqiang Luo , Zaiwen Feng , Feng Xia

Causal discovery is becoming a key part in medical AI research. These methods can enhance healthcare by identifying causal links between biomarkers, demographics, treatments and outcomes. They can aid medical professionals in choosing more…

To address this gap, our study introduces the concept of causal epistemic consistency, which focuses on the self-consistency of Large Language Models (LLMs) in differentiating intermediates with nuanced differences in causal reasoning. We…

Computation and Language · Computer Science 2024-09-04 Shaobo Cui , Junyou Li , Luca Mouchel , Yiyang Feng , Boi Faltings

Genes, proteins and other biological entities influence one another via causal molecular networks. Causal relationships in such networks are mediated by complex and diverse mechanisms, through latent variables, and are often specific to…

Machine Learning · Computer Science 2025-03-07 Izzy Newsham , Luka Kovačević , Richard Moulange , Nan Rosemary Ke , Sach Mukherjee

To effectively interact with the real world, Large Language Models (LLMs) require entity-based commonsense reasoning, a challenging task that necessitates integrating factual knowledge about specific entities with commonsense inference.…

Computation and Language · Computer Science 2026-05-14 Armin Toroghi , Faeze Moradi Kalarde , Scott Sanner

Large language models (LLMs) typically improve performance by either retrieving semantically similar information, or enhancing reasoning abilities through structured prompts like chain-of-thought. While both strategies are considered…

Computation and Language · Computer Science 2024-10-16 Yejin Kim , Eojin Kang , Juae Kim , H. Howie Huang

Understanding how events in a scenario causally connect with each other is important for effectively modeling and reasoning about events. But event reasoning remains a difficult challenge, and despite recent advances, Large Language Models…

Artificial Intelligence · Computer Science 2025-06-10 Mahnaz Koupaee , Xueying Bai , Mudan Chen , Greg Durrett , Nathanael Chambers , Niranjan Balasubramanian

Large Language Models (LLMs) are capable of generating persuasive Natural Language Explanations (NLEs) to justify their answers. However, the faithfulness of these explanations should not be readily trusted at face value. Recent studies…

Computation and Language · Computer Science 2024-11-04 Wei Jie Yeo , Ranjan Satapathy , Erik Cambria