English
Related papers

Related papers: Language Agents Meet Causality -- Bridging LLMs an…

200 papers

Numerous decision-making tasks require estimating causal effects under interventions on different parts of a system. As practitioners consider using large language models (LLMs) to automate decisions, studying their causal reasoning…

Machine Learning · Computer Science 2024-12-24 Tejas Kasetty , Divyat Mahajan , Gintare Karolina Dziugaite , Alexandre Drouin , Dhanya Sridhar

Though large language models (LLMs) have enabled great success across a wide variety of tasks, they still appear to fall short of one of the loftier goals of artificial intelligence research: creating an artificial system that can adapt its…

Computation and Language · Computer Science 2026-05-04 Michael A. Lepori , Tal Linzen , Ann Yuan , Katja Filippova

Causal discovery is becoming a key part in medical AI research. These methods can enhance healthcare by identifying causal links between biomarkers, demographics, treatments and outcomes. They can aid medical professionals in choosing more…

Large language models (LLMs) offer the potential to automate a large number of tasks that previously have not been possible to automate, including some in science. There is considerable interest in whether LLMs can automate the process of…

Econometrics · Economics 2024-12-17 Nick Huntington-Klein , Eleanor J. Murray

While code generation has been widely used in various software development scenarios, the quality of the generated code is not guaranteed. This has been a particular concern in the era of large language models (LLMs)- based code generation,…

Software Engineering · Computer Science 2023-10-11 Zhenlan Ji , Pingchuan Ma , Zongjie Li , Shuai Wang

Large Language Models (LLMs) have demonstrated strong performance across a wide range of tasks, yet they still struggle with complex mathematical reasoning, a challenge fundamentally rooted in deep structural dependencies. To address this…

Artificial Intelligence · Computer Science 2025-12-01 Lei Zan , Keli Zhang , Ruichu Cai , Lujia Pan

Recent advancements in large language models (LLMs) have shown remarkable progress, yet their ability to solve complex problems remains limited. In this work, we introduce Cumulative Reasoning (CR), a structured framework that enhances LLM…

Artificial Intelligence · Computer Science 2026-05-22 Yifan Zhang , Jingqin Yang , Yang Yuan , Andrew Chi-Chih Yao

The use of large language models either as decision support systems, or in agentic workflows, is rapidly transforming the digital ecosystem. However, the understanding of LLM decision-making under uncertainty remains limited. We study LLM…

Artificial Intelligence · Computer Science 2026-04-22 Luise Ge , Yongyan Zhang , Yevgeniy Vorobeychik

Reinforcement learning (RL) has shown impressive results in sequential decision-making tasks. Meanwhile, Large Language Models (LLMs) and Vision-Language Models (VLMs) have emerged, exhibiting impressive capabilities in multimodal…

With the advent of Large Language Models (LLMs), generating rule-based data for real-world applications has become more accessible. Due to the inherent ambiguity of natural language and the complexity of rule sets, especially in long…

Computation and Language · Computer Science 2025-04-21 Teng Wang , Zhenqi He , Wing-Yin Yu , Xiaojin Fu , Xiongwei Han

Large language models (LLMs) have become phenomenally surging, since 2018--two decades after introducing context-awareness into computing systems. Through taking into account the situations of ubiquitous devices, users and the societies,…

Computation and Language · Computer Science 2023-12-27 Haoyi Xiong , Jiang Bian , Sijia Yang , Xiaofei Zhang , Linghe Kong , Daqing Zhang

Understanding predictions made by deep neural networks is notoriously difficult, but also crucial to their dissemination. As all machine learning based methods, they are as good as their training data, and can also capture unwanted biases.…

Computation and Language · Computer Science 2022-11-15 Amir Feder , Nadav Oved , Uri Shalit , Roi Reichart

Causal representation learning (CRL) has garnered increasing interest from the causal inference and artificial intelligence communities due to its potential to disentangle complex data-generating mechanism into causally interpretable latent…

Machine Learning · Statistics 2026-05-28 Hao Chen , Lin Liu , Yu Guang Wang

Large language models (LLMs) have achieved remarkable success in text-based tasks but often struggle to provide actionable guidance in real-world physical environments. This is because of their inability to recognize their limited…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Muhammad Saif Ullah Khan , Muhammad Zeshan Afzal , Didier Stricker

Pretrained large Language Models (LLMs) are able to answer questions that are unlikely to have been encountered during training. However a diversity of potential applications exist in the broad domain of reasoning systems and considerations…

Computation and Language · Computer Science 2024-11-27 Tim Hartill

Recent advances in the intrinsic reasoning capabilities of large language models (LLMs) have given rise to LLM-based agent systems that exhibit near-human performance on a variety of automated tasks. However, although these systems share…

Artificial Intelligence · Computer Science 2025-08-26 Bingxi Zhao , Lin Geng Foo , Ping Hu , Christian Theobalt , Hossein Rahmani , Jun Liu

Causal representation learning (CRL) aims at recovering latent causal variables from high-dimensional observations to solve causal downstream tasks, such as predicting the effect of new interventions or more robust classification. A…

Machine Learning · Computer Science 2025-03-06 Dingling Yao , Dario Rancati , Riccardo Cadei , Marco Fumero , Francesco Locatello

Precisely understanding users' contextual search intent has been an important challenge for conversational search. As conversational search sessions are much more diverse and long-tailed, existing methods trained on limited data still show…

Information Retrieval · Computer Science 2023-10-23 Kelong Mao , Zhicheng Dou , Fengran Mo , Jiewen Hou , Haonan Chen , Hongjin Qian

The emergent few-shot reasoning capabilities of Large Language Models (LLMs) have excited the natural language and machine learning community over recent years. Despite of numerous successful applications, the underlying mechanism of such…

Computation and Language · Computer Science 2023-06-09 Xiaojuan Tang , Zilong Zheng , Jiaqi Li , Fanxu Meng , Song-Chun Zhu , Yitao Liang , Muhan Zhang

Prevalent theories in cognitive science propose that humans understand and represent the knowledge of the world through causal relationships. In making sense of the world, we build causal models in our mind to encode cause-effect relations…

Machine Learning · Computer Science 2019-11-21 Prashan Madumal , Tim Miller , Liz Sonenberg , Frank Vetere