English
Related papers

Related papers: CELLO: Causal Evaluation of Large Vision-Language …

200 papers

It is crucial to consider the social and ethical consequences of AI and ML based decisions for the safe and acceptable use of these emerging technologies. Fairness, in particular, guarantees that the ML decisions do not result in…

Artificial Intelligence · Computer Science 2022-06-15 Rūta Binkytė-Sadauskienė , Karima Makhlouf , Carlos Pinzón , Sami Zhioua , Catuscia Palamidessi

Contextual causal reasoning is a critical yet challenging capability for Large Language Models (LLMs). Existing benchmarks, however, often evaluate this skill in fragmented settings, failing to ensure context consistency or cover the full…

Computation and Language · Computer Science 2026-04-17 Pengfeng Li , Chen Huang , Chaoqun Hao , Hongyao Chen , Xiao-Yong Wei , Wenqiang Lei , See-Kiong Ng

Defeasibility in causal reasoning implies that the causal relationship between cause and effect can be strengthened or weakened. Namely, the causal strength between cause and effect should increase or decrease with the incorporation of…

Computation and Language · Computer Science 2024-06-28 Shaobo Cui , Lazar Milikic , Yiyang Feng , Mete Ismayilzada , Debjit Paul , Antoine Bosselut , Boi Faltings

Event Causality Identification (ECI) requires models to determine whether a given pair of events in a context exhibits a causal relationship. While Large Language Models (LLMs) have demonstrated strong performance across various NLP tasks,…

Computation and Language · Computer Science 2026-05-06 Zhifeng Hao , Zhongjie Chen , Junhao Lu , Shengyin Yu , Guimin Hu , Keli Zhang , Ruichu Cai , Boyan Xu

Autoregressive (AR) language models and Diffusion Language Models (DLMs) constitute the two principal paradigms of large language models. However, both paradigms suffer from insufficient reasoning capabilities. Human reasoning inherently…

Computation and Language · Computer Science 2025-12-01 Kairong Han , Nuanqiao Shan , Ziyu Zhao , Zijing Hu , Xinpeng Dong , Junjian Ye , Lujia Pan , Fei Wu , Kun Kuang

Large language models (LLMs) have achieved remarkable performance on a variety of natural language understanding tasks. However, existing benchmarks are inadequate in measuring the complex logical reasoning capabilities of a model. We…

Many benchmarks for automated causal inference evaluate a system's performance based on a single numerical output, such as an Average Treatment Effect (ATE). This approach conflates two distinct steps in causal analysis: identification -…

Artificial Intelligence · Computer Science 2026-05-15 Ayush Sawarni , Jiyuan Tan , Vasilis Syrgkanis

Large language models (LLMs) have been widely adopted across diverse domains of software engineering, such as code generation, program repair, and vulnerability detection. These applications require understanding beyond surface-level code…

Software Engineering · Computer Science 2026-01-21 Danning Xie , Mingwei Zheng , Xuwei Liu , Jiannan Wang , Chengpeng Wang , Lin Tan , Xiangyu Zhang

The validity of medical studies based on real-world clinical data, such as observational studies, depends on critical assumptions necessary for drawing causal conclusions about medical interventions. Many published studies are flawed…

Artificial Intelligence · Computer Science 2024-07-30 Ahmed Alaa , Rachael V. Phillips , Emre Kıcıman , Laura B. Balzer , Mark van der Laan , Maya Petersen

While LLMs exhibit impressive fluency and factual recall, they struggle with robust causal reasoning, often relying on spurious correlations and brittle patterns. Similarly, traditional Reinforcement Learning agents also lack causal…

Machine Learning · Computer Science 2025-09-26 Abi Aryan , Zac Liu

Causal discovery (CD) and Large Language Models (LLMs) have emerged as transformative fields in artificial intelligence that have evolved largely independently. While CD specializes in uncovering cause-effect relationships from data, and…

Computation and Language · Computer Science 2025-02-18 Guangya Wan , Yunsheng Lu , Yuqi Wu , Mengxuan Hu , Sheng Li

Chain-of-thought (CoT) reasoning enhances performance of large language models, but questions remain about whether these reasoning traces faithfully reflect the internal processes of the model. We present the first comprehensive study of…

Computation and Language · Computer Science 2025-11-04 Sriram Balasubramanian , Samyadeep Basu , Soheil Feizi

Large-scale human mobility exhibits spatial and temporal patterns that can assist policymakers in decision making. Although traditional prediction models attempt to capture these patterns, they often interfered by non-periodic public…

Machine Learning · Computer Science 2025-04-17 Xiaojie Yang , Hangli Ge , Jiawei Wang , Zipei Fan , Renhe Jiang , Ryosuke Shibasaki , Noboru Koshizuka

Cause-effect relations are an important part of human knowledge. In real life, humans often reason about complex causes linked to complex effects. By comparison, existing formalisms for representing knowledge about causal relations are…

Logic in Computer Science · Computer Science 2014-05-12 Bart Bogaerts , Joost Vennekens , Marc Denecker , Jan Van den Bussche

Inducing causal relationships from observations is a classic problem in machine learning. Most work in causality starts from the premise that the causal variables themselves are observed. However, for AI agents such as robots trying to make…

Recent studies have shown that Large Language Models (LLMs) can achieve strong reasoning performance by incorporating functional symbolic representations that abstractly describe graph traversal algorithms and step-by-step reasoning in…

Artificial Intelligence · Computer Science 2026-05-28 Phuong Minh Nguyen , Tien Huu Dang , Naoya Inoue

Causal discovery is at the core of human cognition. It enables us to reason about the environment and make counterfactual predictions about unseen scenarios that can vastly differ from our previous experiences. We consider the task of…

Machine Learning · Computer Science 2020-12-01 Yunzhu Li , Antonio Torralba , Animashree Anandkumar , Dieter Fox , Animesh Garg

Deep learning (DL) has recently drawn much attention in image analysis, natural language process, and high-dimensional medical data analysis. Under the causal direct acyclic graph (DAG) interpretation, the input variables without incoming…

Applications · Statistics 2022-03-22 Jong-Hyeon Jeong , Yichen Jia

Building causal graphs can be a laborious process. To ensure all relevant causal pathways have been captured, researchers often have to discuss with clinicians and experts while also reviewing extensive relevant medical literature. By…

Computation and Language · Computer Science 2024-02-26 Stephanie Long , Tibor Schuster , Alexandre Piché

A chief goal of artificial intelligence is to build machines that think like people. Yet it has been argued that deep neural network architectures fail to accomplish this. Researchers have asserted these models' limitations in the domains…

Machine Learning · Computer Science 2024-08-09 Luca M. Schulze Buschoff , Elif Akata , Matthias Bethge , Eric Schulz