English
Related papers

Related papers: ExpliCa: Evaluating Explicit Causal Reasoning in L…

200 papers

While large language models (LLMs) play increasingly significant roles in society, research shows they continue to generate content that reflects social bias against sensitive groups. Existing benchmarks effectively identify these biases,…

Computation and Language · Computer Science 2026-03-12 Tian Xie , Tongxin Yin , Vaishakh Keshava , Xueru Zhang , Siddhartha Reddy Jonnalagadda

The advancement of Large Language Models (LLMs) has greatly improved our ability to process complex language. However, accurately detecting logical fallacies remains a significant challenge. This study presents a novel and effective prompt…

Artificial Intelligence · Computer Science 2025-04-01 Jiwon Jeong , Hyeju Jang , Hogun Park

Large Language Models (LLMs) are increasingly deployed to automatically label and analyze educational dialogue at scale, yet current pipelines lack reliable ways to detect when models are wrong. We investigate whether reasoning generated by…

Computation and Language · Computer Science 2026-02-11 Bakhtawar Ahtisham , Kirk Vanacore , Zhuqian Zhou , Jinsook Lee , Rene F. Kizilcec

Large language models (LLMs) have revolutionized NLP research. Notably, in-context learning enables their use as evaluation metrics for natural language generation, making them particularly advantageous in low-resource scenarios and…

Computation and Language · Computer Science 2024-11-19 Christoph Leiter , Steffen Eger

Causal reasoning capabilities are essential for large language models (LLMs) in a wide range of applications, such as education and healthcare. But there is still a lack of benchmarks for a better understanding of such capabilities. Current…

Computation and Language · Computer Science 2024-12-25 Ruibo Tu , Hedvig Kjellström , Gustav Eje Henter , Cheng Zhang

Large Language Models (LLMs) have shown their success in language understanding and reasoning on general topics. However, their capability to perform inference based on user-specified structured data and knowledge in corpus-rare concepts,…

Computation and Language · Computer Science 2024-10-29 Haitao Jiang , Lin Ge , Yuhe Gao , Jianian Wang , Rui Song

Recent advancements in Large Language Models (LLMs) have demonstrated exceptional capabilities in complex tasks like machine translation, commonsense reasoning, and language understanding. One of the primary reasons for the adaptability of…

Computation and Language · Computer Science 2024-07-12 Nicholas Kroeger , Dan Ley , Satyapriya Krishna , Chirag Agarwal , Himabindu Lakkaraju

Large language models (LLMs) are increasingly used in domains where causal reasoning matters, yet it remains unclear whether their judgments reflect normative causal computation, human-like shortcuts, or brittle pattern matching. We…

Artificial Intelligence · Computer Science 2026-03-16 Hanna M. Dettki , Charley M. Wu , Bob Rehder

Large Language Models (LLMs) achieve impressive performance in a wide range of tasks, even if they are often trained with the only objective of chatting fluently with users. Among other skills, LLMs show emergent abilities in mathematical…

Computation and Language · Computer Science 2024-06-12 Flavio Petruzzellis , Alberto Testolin , Alessandro Sperduti

The ability to perform causal reasoning is widely considered a core feature of intelligence. In this work, we investigate whether large language models (LLMs) can coherently reason about causality. Much of the existing work in natural…

Understanding and inferring causal relationships from texts is a core aspect of human cognition and is essential for advancing large language models (LLMs) towards artificial general intelligence. Existing work evaluating LLM causal…

Artificial Intelligence · Computer Science 2026-04-14 Ryan Saklad , Aman Chadha , Oleg Pavlov , Raha Moraffah

Despite impressive performance on language modelling and complex reasoning tasks, Large Language Models (LLMs) fall short on the same tasks in uncommon settings or with distribution shifts, exhibiting a lack of generalisation ability. By…

Computation and Language · Computer Science 2024-09-11 Gaël Gendron , Bao Trung Nguyen , Alex Yuxuan Peng , Michael Witbrock , Gillian Dobbie

This paper introduces a causal attribution model to enhance the interpretability of large language models (LLMs) and improve their causal reasoning abilities via precise fine-tuning. Despite LLMs' proficiency in diverse tasks, their…

Artificial Intelligence · Computer Science 2026-05-22 Hengrui Cai , Shengjie Liu , Rui Song

Generating rational and generally accurate responses to tasks, often accompanied by example demonstrations, highlights Large Language Model's (LLM's) remarkable In-Context Learning (ICL) capabilities without requiring updates to the model's…

Machine Learning · Computer Science 2025-06-17 Debanjan Dutta , Faizanuddin Ansari , Swagatam Das

Large Language Models (LLMs) have shown promise in clinical applications through prompt engineering, allowing flexible clinical predictions. However, they struggle to produce reliable prediction probabilities, which are crucial for…

Artificial Intelligence · Computer Science 2024-12-05 Bowen Gu , Rishi J. Desai , Kueiyu Joshua Lin , Jie Yang

This paper investigates the reliability of explanations generated by large language models (LLMs) when prompted to explain their previous output. We evaluate two kinds of such self-explanations - extractive and counterfactual - using three…

Computation and Language · Computer Science 2025-02-03 Korbinian Randl , John Pavlopoulos , Aron Henriksson , Tony Lindgren

The reasoning abilities of Large Language Models (LLMs) are attracting increasing attention. In this work, we focus on causal reasoning and address the task of establishing causal relationships based on correlation information, a highly…

Computation and Language · Computer Science 2024-12-19 Eleni Sgouritsa , Virginia Aglietti , Yee Whye Teh , Arnaud Doucet , Arthur Gretton , Silvia Chiappa

Large Language Models (LLM), which have developed in recent years, enable credit risk assessment through the analysis of financial texts such as analyst reports and corporate disclosures. This paper presents the first systematic review and…

Risk Management · Quantitative Finance 2025-06-10 Muhammed Golec , Maha AlabdulJalil

Despite widespread success in language understanding and generation, large language models (LLMs) exhibit unclear and often inconsistent behavior when faced with tasks that require probabilistic reasoning. In this work, we present the first…

Computation and Language · Computer Science 2025-09-29 Mobina Pournemat , Keivan Rezaei , Gaurang Sriramanan , Arman Zarei , Jiaxiang Fu , Yang Wang , Hamid Eghbalzadeh , Soheil Feizi

Large Language Models (LLMs) have demonstrated remarkable capabilities in various reasoning and generation tasks. However, their proficiency in complex causal reasoning, discovery, and estimation remains an area of active development, often…

Artificial Intelligence · Computer Science 2025-09-03 Adib Bazgir , Amir Habibdoust , Yuwen Zhang , Xing Song