English
Related papers

Related papers: Causality by Abstraction: Symbolic Rule Learning i…

200 papers

Despite the increasing use of large language models (LLMs) for context-grounded tasks like summarization and question-answering, understanding what makes an LLM produce a certain response is challenging. We propose Multi-Level Explanations…

As large language models (LLMs) witness increasing deployment in complex, high-stakes decision-making scenarios, it becomes imperative to ground their reasoning in causality rather than spurious correlations. However, strong performance on…

Artificial Intelligence · Computer Science 2026-02-24 Yuzhe Wang , Yaochen Zhu , Jundong Li

Mainstream methods for Legal Judgment Prediction (LJP) based on Pre-trained Language Models (PLMs) heavily rely on the statistical correlation between case facts and judgment results. This paradigm lacks explicit modeling of legal…

Computation and Language · Computer Science 2026-03-13 Yuzhi Liang , Lixiang Ma , Xinrong Zhu

This paper introduces a causal attribution model to enhance the interpretability of large language models (LLMs) and improve their causal reasoning abilities via precise fine-tuning. Despite LLMs' proficiency in diverse tasks, their…

Artificial Intelligence · Computer Science 2026-05-22 Hengrui Cai , Shengjie Liu , Rui Song

We address causal reasoning in multivariate time series data generated by stochastic processes. Existing approaches are largely restricted to static settings, ignoring the continuity and emission of variations across time. In contrast, we…

Machine Learning · Computer Science 2024-02-29 Mehdi Fatemi , Sindhu Gowda

This paper explores whether enhancing temporal reasoning capabilities in Large Language Models (LLMs) can improve the quality of timeline summarisation, the task of summarising long texts containing sequences of events, such as social media…

Computation and Language · Computer Science 2025-07-21 Jiayu Song , Mahmud Elahi Akhter , Dana Atzil Slonim , Maria Liakata

Traditional time series analysis has long relied on pattern recognition, trained on static and well-established benchmarks. However, in real-world settings -- where policies shift, human behavior adapts, and unexpected events unfold --…

Artificial Intelligence · Computer Science 2025-10-16 Xinlei Wang , Mingtian Tan , Jing Qiu , Junhua Zhao , Jinjin Gu

Causal inference in a nonlinear system of multivariate timeseries is instrumental in disentangling the intricate web of relationships among variables, enabling us to make more accurate predictions and gain deeper insights into real-world…

Machine Learning · Computer Science 2024-01-17 Wasim Ahmad , Maha Shadaydeh , Joachim Denzler

This paper investigates how hallucination rates in Large Language Models (LLMs) may be controlled via a symbolic data generation framework, exploring a fundamental relationship between the rate of certain mathematical errors and types of…

Computation and Language · Computer Science 2025-01-14 Jordan Meadows , Marco Valentino , Andre Freitas

Genes, proteins and other biological entities influence one another via causal molecular networks. Causal relationships in such networks are mediated by complex and diverse mechanisms, through latent variables, and are often specific to…

Machine Learning · Computer Science 2025-03-07 Izzy Newsham , Luka Kovačević , Richard Moulange , Nan Rosemary Ke , Sach Mukherjee

Scaling laws have allowed Pre-trained Language Models (PLMs) into the field of causal reasoning. Causal reasoning of PLM relies solely on text-based descriptions, in contrast to causal discovery which aims to determine the causal…

Large language models (LLMs) have shown great potential in decision-making due to the vast amount of knowledge stored within the models. However, these pre-trained models are prone to lack reasoning abilities and are difficult to adapt to…

Machine Learning · Computer Science 2025-06-02 Wei Chen , Jiahao Zhang , Haipeng Zhu , Boyan Xu , Zhifeng Hao , Keli Zhang , Junjian Ye , Ruichu Cai

Large Language Models excel in tasks like natural language understanding and text generation. Prompt engineering plays a critical role in leveraging LLM effectively. However, LLMs black-box nature hinders its interpretability and effective…

Computation and Language · Computer Science 2024-10-31 Ximing Dong , Shaowei Wang , Dayi Lin , Gopi Krishnan Rajbahadur , Boquan Zhou , Shichao Liu , Ahmed E. Hassan

For text-based AI systems to interact in the real world, causal reasoning is an essential skill. Since active interventions are costly, we study to what extent a system can learn causal reasoning from symbolic demonstrations of causal…

Large Language Models (LLMs) have shown remarkable ability in solving complex tasks, making them a promising tool for enhancing tabular learning. However, existing LLM-based methods suffer from high resource requirements, suboptimal…

Machine Learning · Computer Science 2025-05-12 Ruxue Shi , Hengrui Gu , Xu Shen , Xin Wang

Large language model (LLM) agents-especially smaller, open-source models-often produce causally invalid or incoherent actions in collaborative tasks due to their reliance on surface-level correlations rather than grounded causal reasoning.…

Artificial Intelligence · Computer Science 2025-08-20 Minh Hoang Nguyen , Van Dai Do , Dung Nguyen , Thin Nguyen , Hung Le

Simulation is an invaluable tool for developing and evaluating controllers for self-driving cars. Current simulation frameworks are driven by highly-specialist domain specific languages, and so a natural language interface would greatly…

Artificial Intelligence · Computer Science 2023-10-27 Antonio Valerio Miceli-Barone , Alex Lascarides , Craig Innes

Large language models (LLMs) have shown remarkable ability in various language tasks, especially with their emergent in-context learning capability. Extending LLMs to incorporate visual inputs, large vision-language models (LVLMs) have…

Machine Learning · Computer Science 2025-10-13 Aneesh Komanduri , Karuna Bhaila , Xintao Wu

Despite the broad applicability of large language models (LLMs), their reliance on probabilistic inference makes them vulnerable to errors such as hallucination in generated facts and inconsistent output structure in natural language…

Computation and Language · Computer Science 2025-10-24 Xin Lian , Kenneth D. Forbus

Large language models (LLMs) have achieved impressive human-like performance across various reasoning tasks. However, their mastery of underlying inferential rules still falls short of human capabilities. To investigate this, we propose a…

Computation and Language · Computer Science 2024-06-24 Siyuan Wang , Zhongyu Wei , Yejin Choi , Xiang Ren