English
Related papers

Related papers: Separable Pathways for Causal Reasoning: How Archi…

200 papers

While Large Language Models have achieved notable success on formal mathematics benchmarks such as MiniF2F, it remains unclear whether these results stem from genuine logical reasoning or semantic pattern matching against pre-training data.…

Machine Learning · Computer Science 2026-05-04 Lixing Li

Causal reasoning is a crucial part of science and human intelligence. In order to discover causal relationships from data, we need structure discovery methods. We provide a review of background theory and a survey of methods for structure…

Machine Learning · Computer Science 2021-03-05 Matthew J. Vowels , Necati Cihan Camgoz , Richard Bowden

Large language model (LLM) agents often struggle in long-context interactions. As the agent accumulates more interaction history, context management approaches such as sliding window and prompt compression may omit earlier structured…

Computation and Language · Computer Science 2026-04-28 Yating Wu , Yuhao Zhang , Sayan Ghosh , Sourya Basu , Anoop Deoras , Jun Huan , Gaurav Gupta

Large-language-model (LLM)-based AI agents have recently showcased impressive versatility by employing dynamic reasoning, an adaptive, multi-step process that coordinates with external tools. This shift from static, single-turn inference to…

Machine Learning · Computer Science 2026-01-08 Jiin Kim , Byeongjun Shin , Jinha Chung , Minsoo Rhu

The rapid evolution of artificial intelligence has led to expectations of transformative impact on science, yet current systems remain fundamentally limited in enabling genuine scientific discovery. This perspective contends that progress…

Artificial Intelligence · Computer Science 2025-12-16 Karthik Duraisamy

The Bhatt Conjectures framework introduces rigorous, hierarchical benchmarks for evaluating AI reasoning and understanding, moving beyond pattern matching to assess representation invariance, robustness, and metacognitive self-awareness.…

Cryptography and Security · Computer Science 2025-06-23 Manish Bhatt

Memory plays a foundational role in augmenting the reasoning, adaptability, and contextual fidelity of modern Large Language Models and Multi-Modal LLMs. As these models transition from static predictors to interactive systems capable of…

Artificial Intelligence · Computer Science 2026-01-15 Zixia Jia , Jiaqi Li , Yipeng Kang , Yuxuan Wang , Tong Wu , Quansen Wang , Xiaobo Wang , Shuyi Zhang , Junzhe Shen , Qing Li , Siyuan Qi , Yitao Liang , Di He , Zilong Zheng , Song-Chun Zhu

Extracting abstract causal structures and applying them to novel situations is a hallmark of human intelligence. While Large Language Models (LLMs) and Vision Language Models (VLMs) have shown strong performance on a wide range of reasoning…

Artificial Intelligence · Computer Science 2026-04-28 Liangru Xiang , Yuxi Ma , Zhihao Cao , Yixin Zhu , Song-Chun Zhu

Clinical diagnosis is a complex reasoning process in which clinicians gather evidence, form hypotheses, and test them against alternative explanations. In medical training, this reasoning is explicitly developed through counterfactual…

Computation and Language · Computer Science 2026-04-24 Zhiwen You , Xi Chen , Aniket Vashishtha , Simo Du , Gabriel Erion-Barner , Hongyuan Mei , Hao Peng , Yue Guo

This paper introduces ARCADIA, an agentic AI framework for causal discovery that integrates large-language-model reasoning with statistical diagnostics to construct valid, temporally coherent causal structures. Unlike traditional…

Artificial Intelligence · Computer Science 2025-12-02 Fabrizio Maturo , Donato Riccio , Andrea Mazzitelli , Giuseppe Bifulco , Francesco Paolone , Iulia Brezeanu

AI agents -- systems that combine foundation models with reasoning, planning, memory, and tool use -- are rapidly becoming a practical interface between natural-language intent and real-world computation. This survey synthesizes the…

Artificial Intelligence · Computer Science 2026-01-06 Bin Xu

Situational awareness, the capacity of an AI system to recognize its own nature, understand its training and deployment context, and reason strategically about its circumstances, is widely considered among the most dangerous emergent…

Artificial Intelligence · Computer Science 2026-03-11 Subramanyam Sahoo , Aman Chadha , Vinija Jain , Divya Chaudhary

Large language model (LLM) agents-especially smaller, open-source models-often produce causally invalid or incoherent actions in collaborative tasks due to their reliance on surface-level correlations rather than grounded causal reasoning.…

Artificial Intelligence · Computer Science 2025-08-20 Minh Hoang Nguyen , Van Dai Do , Dung Nguyen , Thin Nguyen , Hung Le

With the rapid progress of Large Language Models (LLMs), it becomes increasingly important to understand their abilities and limitations. In two experiments, we investigate the causal and compositional reasoning abilities of LLMs and humans…

Computation and Language · Computer Science 2025-02-27 Magnus F. Gjerde , Vanessa Cheung , David Lagnado

Inducing causal relationships from observations is a classic problem in machine learning. Most work in causality starts from the premise that the causal variables themselves are observed. However, for AI agents such as robots trying to make…

The ability to perform causal and counterfactual reasoning are central properties of human intelligence. Decision-making systems that can perform these types of reasoning have the potential to be more generalizable and interpretable.…

Artificial Intelligence · Computer Science 2021-06-28 Daniel McDuff , Yale Song , Jiyoung Lee , Vibhav Vineet , Sai Vemprala , Nicholas Gyde , Hadi Salman , Shuang Ma , Kwanghoon Sohn , Ashish Kapoor

Early artificial intelligence paradigms exhibited separated cognitive functions: Neural Networks focused on "perception-representation," Reinforcement Learning on "decision-making-behavior," and Symbolic AI on "knowledge-reasoning." With…

Artificial Intelligence · Computer Science 2026-01-07 Zhi Liu , Guangzhi Wang

We present a method for diagnosing interpretation in neural networks by identifying an input subspace where a proposed interpretation is highly faithful. Our method is particularly useful for causal-abstraction-style interpretability, where…

Artificial Intelligence · Computer Science 2026-05-05 Li Puyin , Jiyuan Tan , Ahmad Jabbar , Thomas Icard , Atticus Geiger

LLM agents excel when environments are mostly static and the needed information fits in a model's context window, but they often fail in open-ended investigations where explanations must be constructed by iteratively mining evidence from…

Artificial Intelligence · Computer Science 2026-01-30 Saurabh Jha , Rohan Arora , Bhavya , Noah Zheutlin , Paulina Toro Isaza , Laura Shwartz , Yu Deng , Daby Sow , Ruchi Mahindru , Ruchir Puri

Large language models show promise as autonomous decision-making agents, yet their deployment in high-stakes domains remains fraught with risk. Without architectural safeguards, LLM agents exhibit catastrophic brittleness: identical…

Machine Learning · Computer Science 2025-10-29 Gokturk Aytug Akarlar