English
Related papers

Related papers: Plancraft: an evaluation dataset for planning with…

200 papers

Developers spend much time finding information that is relevant to their questions. Stack Overflow has been the leading resource, and with the advent of Large Language Models (LLMs), generative models such as ChatGPT are used frequently.…

Artificial Intelligence · Computer Science 2024-06-21 Davit Abrahamyan , Fatemeh H. Fard

Generating plans of action, and reasoning about change have long been considered a core competence of intelligent agents. It is thus no surprise that evaluating the planning and reasoning capabilities of large language models (LLMs) has…

Computation and Language · Computer Science 2023-11-28 Karthik Valmeekam , Matthew Marquez , Alberto Olmo , Sarath Sreedharan , Subbarao Kambhampati

Large language models (LLMs) demonstrate impressive performance on a wide variety of tasks, but they often struggle with tasks that require multi-step reasoning or goal-directed planning. Both cognitive neuroscience and reinforcement…

Artificial Intelligence · Computer Science 2025-10-16 Taylor Webb , Shanka Subhra Mondal , Ida Momennejad

LLM-based agents have emerged as promising tools, which are crafted to fulfill complex tasks by iterative planning and action. However, these agents are susceptible to undesired planning hallucinations when lacking specific knowledge for…

Computation and Language · Computer Science 2024-06-24 Ruixuan Xiao , Wentao Ma , Ke Wang , Yuchuan Wu , Junbo Zhao , Haobo Wang , Fei Huang , Yongbin Li

Despite recent advances, LLM-based web agents still struggle with limited exploration, omission of critical steps, and sensitivity to task constraints. Prior work suggests that many of these failures stem from weaknesses in planning, yet…

Computation and Language · Computer Science 2026-05-29 Alejandra Zambrano , Sara Vera Marjanovic , Imene Kerboua , Xing Han Lù , Leila Kosseim

Multi-agent systems (MAS) have shown great potential in executing complex tasks, but coordination and safety remain significant challenges. Multi-Agent Reinforcement Learning (MARL) offers a promising framework for agent collaboration, but…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Ziqi Jia , Junjie Li , Xiaoyang Qu , Jianzong Wang

We investigate the challenge of task planning for multi-task embodied agents in open-world environments. Two main difficulties are identified: 1) executing plans in an open-world environment (e.g., Minecraft) necessitates accurate and…

Artificial Intelligence · Computer Science 2024-07-09 Zihao Wang , Shaofei Cai , Guanzhou Chen , Anji Liu , Xiaojian Ma , Yitao Liang

Large Language Models (LLMs) have revolutionized the simulation of agent societies, enabling autonomous planning, memory formation, and social interactions. However, existing frameworks often overlook systematic evaluations for event…

Artificial Intelligence · Computer Science 2025-09-17 Yuyang Tian , Shunqiang Mao , Wenchang Gao , Lanlan Qiu , Tianxing He

With the rapid progress of large language models (LLMs), LLM-powered multi-agent systems (MAS) are drawing increasing interest across academia and industry. However, many current MAS frameworks struggle with reliability and scalability,…

Multiagent Systems · Computer Science 2025-11-04 Yang Li , Siqi Ping , Xiyu Chen , Xiaojian Qi , Zigan Wang , Ye Luo , Xiaowei Zhang

Large Language Models (LLMs) exhibit impressive general-purpose capabilities but also introduce serious safety risks, particularly the potential for deception as models acquire increased agency and human oversight diminishes. In this work,…

Artificial Intelligence · Computer Science 2026-03-10 Matthew Lyle Olson , Neale Ratzlaff , Musashi Hinck , Tri Nguyen , Vasudev Lal , Joseph Campbell , Simon Stepputtis , Shao-Yen Tseng

Large language model (LLM) agents are increasingly deployed to tackle complex tasks, often necessitating collaboration among multiple specialized agents. However, multi-agent collaboration introduces new challenges in planning,…

Computation and Language · Computer Science 2025-10-21 Tianyang Xu , Dan Zhang , Kushan Mitra , Estevam Hruschka

Due to the dynamic and unpredictable open-world setting, navigating complex environments in Minecraft poses significant challenges for multi-agent systems. Agents must interact with the environment and coordinate their actions with other…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Zhonghan Zhao , Kewei Chen , Dongxu Guo , Wenhao Chai , Tian Ye , Yanting Zhang , Gaoang Wang

Large language models (LLMs) demonstrate strong potential as agents for tool invocation due to their advanced comprehension and planning capabilities. Users increasingly rely on LLM-based agents to solve complex missions through iterative…

Artificial Intelligence · Computer Science 2025-04-17 Peijie Yu , Yifan Yang , Jinjian Li , Zelong Zhang , Haorui Wang , Xiao Feng , Feng Zhang

Language model (LM)-based agents have demonstrated promising capabilities in automating complex tasks from natural language instructions, yet they continue to struggle with long-horizon planning and reasoning. To address this, we propose an…

Artificial Intelligence · Computer Science 2026-05-05 Wenyi Wu , Sibo Zhu , Kun Zhou , Biwei Huang

While agent evaluation has shifted toward long-horizon tasks, most benchmarks still emphasize local, step-level reasoning rather than the global constrained optimization (e.g., time and financial budgets) that demands genuine planning…

Artificial Intelligence · Computer Science 2026-01-27 Yinger Zhang , Shutong Jiang , Renhao Li , Jianhong Tu , Yang Su , Lianghao Deng , Xudong Guo , Chenxu Lv , Junyang Lin

Training large language models (LLMs) to reason via reinforcement learning (RL) significantly improves their problem-solving capabilities. In agentic settings, existing methods like ReAct prompt LLMs to explicitly plan before every action;…

Large Language Models (LLMs) and Visual Language Models (VLMs) are attracting increasing interest due to their improving performance and applications across various domains and tasks. However, LLMs and VLMs can produce erroneous results,…

Artificial Intelligence · Computer Science 2024-12-31 Michele Brienza , Francesco Argenziano , Vincenzo Suriani , Domenico D. Bloisi , Daniele Nardi

We present APT, an advanced Large Language Model (LLM)-driven framework that enables autonomous agents to construct complex and creative structures within the Minecraft environment. Unlike previous approaches that primarily concentrate on…

Machine Learning · Computer Science 2024-12-03 Jun Yu Chen , Tao Gao

Recent advancements in Large Language Model~(LLM)-based Multi-Agent Systems (MAS) have demonstrated remarkable potential for tackling complex decision-making tasks. However, existing frameworks inevitably rely on serialized execution…

Artificial Intelligence · Computer Science 2026-03-10 Yaoru Li , Shunyu Liu , Tongya Zheng , Li Sun , Mingli Song

Owing to recent advancements, Large Language Models (LLMs) can now be deployed as agents for increasingly complex decision-making applications in areas including robotics, gaming, and API integration. However, reflecting past experiences in…