English
Related papers

Related papers: CausalEval: Towards Better Causal Reasoning in Lan…

200 papers

The ability to understand causality significantly impacts the competence of large language models (LLMs) in output explanation and counterfactual reasoning, as causality reveals the underlying data distribution. However, the lack of a…

Machine Learning · Computer Science 2024-09-30 Yu Zhou , Xingyu Wu , Beicheng Huang , Jibin Wu , Liang Feng , Kay Chen Tan

The leaderboard of Large Language Models (LLMs) in mathematical tasks has been continuously updated. However, the majority of evaluations focus solely on the final results, neglecting the quality of the intermediate steps. This oversight…

Computation and Language · Computer Science 2025-01-15 Shijie Xia , Xuefeng Li , Yixin Liu , Tongshuang Wu , Pengfei Liu

Causal inference is one of the hallmarks of human intelligence. While the field of CausalNLP has attracted much interest in the recent years, existing causal inference datasets in NLP primarily rely on discovering causality from empirical…

Computation and Language · Computer Science 2024-04-18 Zhijing Jin , Jiarui Liu , Zhiheng Lyu , Spencer Poff , Mrinmaya Sachan , Rada Mihalcea , Mona Diab , Bernhard Schölkopf

Recent breakthroughs in artificial intelligence have driven a paradigm shift, where large language models (LLMs) with billions or trillions of parameters are trained on vast datasets, achieving unprecedented success across a series of…

Computation and Language · Computer Science 2024-10-22 Anpeng Wu , Kun Kuang , Minqin Zhu , Yingrong Wang , Yujia Zheng , Kairong Han , Baohong Li , Guangyi Chen , Fei Wu , Kun Zhang

Large Language Models (LLMs) have demonstrated remarkable capabilities in various reasoning and generation tasks. However, their proficiency in complex causal reasoning, discovery, and estimation remains an area of active development, often…

Artificial Intelligence · Computer Science 2025-09-03 Adib Bazgir , Amir Habibdoust , Yuwen Zhang , Xing Song

With the rise of Large Language Models(LLMs), it has become crucial to understand their capabilities and limitations in deciphering and explaining the complex web of causal relationships that language entails. Current methods use either…

As large language models (LLMs) witness increasing deployment in complex, high-stakes decision-making scenarios, it becomes imperative to ground their reasoning in causality rather than spurious correlations. However, strong performance on…

Artificial Intelligence · Computer Science 2026-02-24 Yuzhe Wang , Yaochen Zhu , Jundong Li

Large language models (LLMs) have shown various ability on natural language processing, including problems about causality. It is not intuitive for LLMs to command causality, since pretrained models usually work on statistical associations,…

Computation and Language · Computer Science 2024-08-27 Chenyang Zhang , Haibo Tong , Bin Zhang , Dongyu Zhang

Causal reasoning is fundamental to human intelligence and crucial for effective decision-making in real-world environments. Despite recent advancements in large vision-language models (LVLMs), their ability to comprehend causality remains…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Meiqi Chen , Bo Peng , Yan Zhang , Chaochao Lu

Genuine human-like causal reasoning is fundamental for strong artificial intelligence. Humans typically identify whether an event is part of the causal chain first, and then influenced by modulatory factors such as morality, normality, and…

Computation and Language · Computer Science 2025-10-21 Yanxi Zhang , Xin Cong , Zhong Zhang , Xiao Liu , Dongyan Zhao , Yesai Wu

Large Language Models (LLMs) have shown their success in language understanding and reasoning on general topics. However, their capability to perform inference based on user-specified structured data and knowledge in corpus-rare concepts,…

Computation and Language · Computer Science 2024-10-29 Haitao Jiang , Lin Ge , Yuhe Gao , Jianian Wang , Rui Song

Causal reasoning is a cornerstone of how humans interpret the world. To model and reason about causality, causal graphs offer a concise yet effective solution. Given the impressive advancements in language models, a crucial question arises:…

Computation and Language · Computer Science 2024-06-25 Sirui Chen , Mengying Xu , Kun Wang , Xingyu Zeng , Rui Zhao , Shengjie Zhao , Chaochao Lu

LLMs suffer from critical reasoning issues such as unfaithfulness, bias, and inconsistency, since they lack robust causal underpinnings and may rely on superficial correlations rather than genuine understanding. Successive LRMs have emerged…

Artificial Intelligence · Computer Science 2025-09-23 Zhizhang FU , Guangsheng Bao , Hongbo Zhang , Chenkai Hu , Yue Zhang

Large language models (LLMs) have revolutionized natural language processing (NLP), particularly through Retrieval-Augmented Generation (RAG), which enhances LLM capabilities by integrating external knowledge. However, traditional RAG…

Computation and Language · Computer Science 2025-10-23 Nengbo Wang , Xiaotian Han , Jagdip Singh , Jing Ma , Vipin Chaudhary

Large language models (LLMs) have recently demonstrated impressive capabilities across a range of reasoning and generation tasks. However, research studies have shown that LLMs lack the ability to identify causal relationships, a…

Machine Learning · Computer Science 2025-11-21 Juncheng Dong , Yiling Liu , Ahmed Aloui , Vahid Tarokh , David Carlson

Reasoning is central to human intelligence, enabling structured problem-solving across diverse tasks. Recent advances in large language models (LLMs) have greatly enhanced their reasoning abilities in arithmetic, commonsense, and symbolic…

Despite surpassing human performance across mathematics, coding, and other knowledge-intensive tasks, large language models (LLMs) continue to struggle with causal reasoning. A core obstacle is the target data itself: causal systems are…

Artificial Intelligence · Computer Science 2026-05-12 Nicolás Astorga , Anita Kriz , Mihaela van der Schaar

Recent years have witnessed the rapid growth of machine learning in a wide range of fields such as image recognition, text classification, credit scoring prediction, recommendation system, etc. In spite of their great performance in…

Machine Learning · Computer Science 2021-09-20 Guandong Xu , Tri Dung Duong , Qian Li , Shaowu Liu , Xianzhi Wang

Large Language Models (LLMs) have shown state-of-the-art performance in a variety of tasks, including arithmetic and reasoning; however, to gauge the intellectual capabilities of LLMs, causal reasoning has become a reliable proxy for…

Computation and Language · Computer Science 2024-12-02 Abhinav Joshi , Areeb Ahmad , Ashutosh Modi

Interpretability research on large language models (LLMs) has yielded important insights into model behaviour, yet recurring pitfalls persist: findings that do not generalise, and causal interpretations that outrun the evidence. Our…

Machine Learning · Computer Science 2026-03-20 Shruti Joshi , Aaron Mueller , David Klindt , Wieland Brendel , Patrik Reizinger , Dhanya Sridhar