English
Related papers

Related papers: Asking Before Acting: Gather Information in Embodi…

200 papers

Unlike reinforcement learning (RL) agents, humans remain capable multitaskers in changing environments. In spite of only experiencing the world through their own observations and interactions, people know how to balance focusing on tasks…

Artificial Intelligence · Computer Science 2024-07-02 Rishav Bhagat , Jonathan Balloch , Zhiyu Lin , Julia Kim , Mark Riedl

There are two main barriers to using large language models (LLMs) in clinical reasoning. Firstly, while LLMs exhibit significant promise in Natural Language Processing (NLP) tasks, their performance in complex reasoning and planning falls…

Artificial Intelligence · Computer Science 2024-12-31 Shengxin Hong , Liang Xiao , Xin Zhang , Jianxia Chen

In sequential decision-making (SDM) tasks, methods like reinforcement learning (RL) and heuristic search have made notable advances in specific cases. However, they often require extensive exploration and face challenges in generalizing…

Machine Learning · Computer Science 2024-10-11 Xue Yan , Yan Song , Xidong Feng , Mengyue Yang , Haifeng Zhang , Haitham Bou Ammar , Jun Wang

Multi-agent debate has been shown to improve reasoning in large language models (LLMs). However, it is compute-intensive, requiring generation of long transcripts before answering questions. To address this inefficiency, we develop a…

Artificial Intelligence · Computer Science 2026-04-29 John Seon Keun Yi , Aaron Mueller , Dokyun Lee

Large language models (LLMs) have recently demonstrated the potential in acting as autonomous agents for sequential decision-making tasks. However, most existing methods either take actions greedily without planning or rely on static plans…

Computation and Language · Computer Science 2023-06-01 Haotian Sun , Yuchen Zhuang , Lingkai Kong , Bo Dai , Chao Zhang

Despite substantial advances in large language models (LLMs), generating factually consistent responses for knowledge-intensive question answering remains challenging. These difficulties are primarily due to hallucinations and the…

Computation and Language · Computer Science 2026-05-19 Taolin Zhang , Dongyang Li , Chen Chen , Qizhou Chen , Jiuheng Wan , Xiaofeng He , Chengyu Wang , Richang Hong

Large Language Models (LLMs) have demonstrated great potential in complex reasoning tasks, yet they fall short when tackling more sophisticated challenges, especially when interacting with environments through generating executable actions.…

Computation and Language · Computer Science 2025-02-25 Yuqi Zhu , Shuofei Qiao , Yixin Ou , Shumin Deng , Shiwei Lyu , Yue Shen , Lei Liang , Jinjie Gu , Huajun Chen , Ningyu Zhang

Language agents based on large language models (LLMs) have demonstrated great promise in automating web-based tasks. Recent work has shown that incorporating advanced planning algorithms, e.g., tree search, is advantageous over reactive…

Artificial Intelligence · Computer Science 2025-04-02 Yu Gu , Kai Zhang , Yuting Ning , Boyuan Zheng , Boyu Gou , Tianci Xue , Cheng Chang , Sanjari Srivastava , Yanan Xie , Peng Qi , Huan Sun , Yu Su

State abstraction is an effective technique for planning in robotics environments with continuous states and actions, long task horizons, and sparse feedback. In object-oriented environments, predicates are a particularly useful form of…

Robotics · Computer Science 2023-06-21 Amber Li , Tom Silver

The recent surge in research interest in applying large language models (LLMs) to decision-making tasks has flourished by leveraging the extensive world knowledge embedded in LLMs. While there is a growing demand to tailor LLMs for custom…

Machine Learning · Computer Science 2024-12-23 Andrew Zhao , Daniel Huang , Quentin Xu , Matthieu Lin , Yong-Jin Liu , Gao Huang

Large language models (LLMs) have shown great potential in decision-making due to the vast amount of knowledge stored within the models. However, these pre-trained models are prone to lack reasoning abilities and are difficult to adapt to…

Machine Learning · Computer Science 2025-06-02 Wei Chen , Jiahao Zhang , Haipeng Zhu , Boyan Xu , Zhifeng Hao , Keli Zhang , Junjian Ye , Ruichu Cai

Large Language Models (LLMs) have demonstrated remarkable capabilities in interactive decision-making tasks, but existing methods often struggle with error accumulation and lack robust self-correction mechanisms. We introduce "Reflect…

Machine Learning · Computer Science 2025-09-24 Qiuhai Zeng , Sarvesh Rajkumar , Di Wang , Narendra Gyanchandani , Wenbo Yan

Large language models (LLMs) have demonstrated remarkable capabilities in tool learning. In real-world scenarios, user queries are often ambiguous and incomplete, requiring effective clarification. However, existing interactive…

Computation and Language · Computer Science 2025-06-12 Xuan Zhang , Yongliang Shen , Zhe Zheng , Linjuan Wu , Wenqi Zhang , Yuchen Yan , Qiuying Peng , Jun Wang , Weiming Lu

Large Language Models (LLMs) and Multimodal LLMs (MLLMs) have demonstrated immense potential in autonomous driving (AD) by offering human-like reasoning and open-world generalization. However, the excessive computational overhead and high…

Robotics · Computer Science 2026-05-26 Ruoyu Yao , Ruiguo Zhong , Pei Liu , Mingxing Peng , Rui Yang , Jun Ma

Recent months have seen the emergence of a powerful new trend in which large language models (LLMs) are augmented to become autonomous language agents capable of performing objective oriented multi-step tasks on their own, rather than…

In order for AI systems to communicate effectively with people, they must understand how we make decisions. However, people's decisions are not always rational, so the implicit internal models of human decision-making in Large Language…

Computation and Language · Computer Science 2025-03-11 Ryan Liu , Jiayi Geng , Joshua C. Peterson , Ilia Sucholutsky , Thomas L. Griffiths

Foundation models, including large language models (LLMs) and vision-language models (VLMs), have recently enabled novel approaches to robot autonomy and human-robot interfaces. In parallel, vision-language-action models (VLAs) or large…

Large pretrained models are showing increasingly better performance in reasoning and planning tasks across different modalities, opening the possibility to leverage them for complex sequential decision making problems. In this paper, we…

Artificial Intelligence · Computer Science 2024-10-10 Martin Klissarov , Devon Hjelm , Alexander Toshev , Bogdan Mazoure

Owing to recent advancements, Large Language Models (LLMs) can now be deployed as agents for increasingly complex decision-making applications in areas including robotics, gaming, and API integration. However, reflecting past experiences in…

A burgeoning area within reinforcement learning (RL) is the design of sequential decision-making agents centered around large language models (LLMs). While autonomous decision-making agents powered by modern LLMs could facilitate numerous…

Machine Learning · Computer Science 2026-02-10 Dilip Arumugam , Thomas L. Griffiths