English
Related papers

Related papers: PARTNR: A Benchmark for Planning and Reasoning in …

200 papers

Large Language Models (LLMs) have achieved high accuracy on complex commonsense and mathematical problems that involve the composition of multiple reasoning steps. However, current compositional benchmarks testing these skills tend to focus…

Computation and Language · Computer Science 2026-05-26 Lisa Alazraki , Lihu Chen , Ana Brassard , Joe Stacey , Hossein A. Rahmani , Marek Rei

This benchmark suite provides a comprehensive evaluation framework for assessing both individual LLMs and multi-agent systems in Real-world planning and scheduling scenarios. The suite encompasses 14 designed planning and scheduling…

Artificial Intelligence · Computer Science 2025-08-06 Longling Geng , Edward Y. Chang

Large Language Models (LLMs) have demonstrated emergent common-sense reasoning and Theory of Mind (ToM) capabilities, making them promising candidates for developing coordination agents. This study introduces the LLM-Coordination Benchmark,…

Computation and Language · Computer Science 2025-04-30 Saaket Agashe , Yue Fan , Anthony Reyna , Xin Eric Wang

Embodied agents operating in the physical world must make decisions that are not only effective but also safe, spatially coherent, and grounded in context. While recent advances in large multimodal models (LMMs) have shown promising…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Dinura Dissanayake , Ahmed Heakl , Omkar Thawakar , Noor Ahsan , Ritesh Thawkar , Ketan More , Jean Lahoud , Rao Anwer , Hisham Cholakkal , Ivan Laptev , Fahad Shahbaz Khan , Salman Khan

This study introduces intelligent frameworks that use Large Language Models (LLMs) to improve task scheduling for construction robots. The LLM is fed with key data about the desired task, such as agent action abilities, and the desired end…

Robotics · Computer Science 2026-05-18 Swayamjit Saha , Subhabrata Das , Haonan Duan , Xiao-Yang Liu

Large Language Models (LLMs) have been recently used in robot applications for grounding LLM common-sense reasoning with the robot's perception and physical abilities. In humanoid robots, memory also plays a critical role in fostering…

For effective human-robot interaction, robots need to understand, plan, and execute complex, long-horizon tasks described by natural language. Recent advances in large language models (LLMs) have shown promise for translating natural…

Robotics · Computer Science 2024-03-25 Yongchao Chen , Jacob Arkin , Charles Dawson , Yang Zhang , Nicholas Roy , Chuchu Fan

Robotic agents must master common sense and long-term sequential decisions to solve daily tasks through natural language instruction. The developments in Large Language Models (LLMs) in natural language processing have inspired efforts to…

Robotics · Computer Science 2024-09-16 Yaran Chen , Wenbo Cui , Yuanwen Chen , Mining Tan , Xinyao Zhang , Dongbin Zhao , He Wang

This paper addresses task planning problems for language-instructed robot teams. Tasks are expressed in natural language (NL), requiring the robots to apply their capabilities at various locations and semantic objects. Several recent works…

Robotics · Computer Science 2024-11-22 Jun Wang , Guocheng He , Yiannis Kantaros

The recent breakthroughs in the research on Large Language Models (LLMs) have triggered a transformation across several research domains. Notably, the integration of LLMs has greatly enhanced performance in robot Task And Motion Planning…

Robotics · Computer Science 2024-06-12 Yuchen Liu , Luigi Palmieri , Sebastian Koch , Ilche Georgievski , Marco Aiello

Large language models (LLMs) are increasingly explored for their reasoning capabilities, yet their ability to perform structured, constraint-based optimization from natural language remains insufficiently understood. This study evaluates…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-18 Aasish Kumar Sharma , Julian Kunkel

Planning has been part of the core pursuit for artificial intelligence since its conception, but earlier AI agents mostly focused on constrained settings because many of the cognitive substrates necessary for human-level planning have been…

Computation and Language · Computer Science 2024-10-24 Jian Xie , Kai Zhang , Jiangjie Chen , Tinghui Zhu , Renze Lou , Yuandong Tian , Yanghua Xiao , Yu Su

This paper presents a novel framework, called PLANTOR (PLanning with Natural language for Task-Oriented Robots), that integrates Large Language Models (LLMs) with Prolog-based knowledge management and planning for multi-robot tasks. The…

Artificial Intelligence · Computer Science 2025-02-27 Enrico Saccon , Ahmet Tikna , Davide De Martini , Edoardo Lamon , Luigi Palopoli , Marco Roveri

Leveraging the powerful reasoning capabilities of large language models (LLMs), recent LLM-based robot task planning methods yield promising results. However, they mainly focus on single or multiple homogeneous robots on simple tasks.…

Robotics · Computer Science 2025-04-01 Kehui Liu , Zixin Tang , Dong Wang , Zhigang Wang , Xuelong Li , Bin Zhao

We propose a novel approach to multi-robot collaboration that harnesses the power of pre-trained large language models (LLMs) for both high-level communication and low-level path planning. Robots are equipped with LLMs to discuss and…

Robotics · Computer Science 2023-07-11 Zhao Mandi , Shreeya Jain , Shuran Song

Large Language Models (LLMs) based agent systems have made great strides in real-world applications beyond traditional NLP tasks. This paper proposes a new LLM-based Multi-Agent System (LLM-MAS) benchmark, Collab-Overcooked, built on the…

Computation and Language · Computer Science 2025-12-02 Haochen Sun , Shuwen Zhang , Lujie Niu , Lei Ren , Hao Xu , Hao Fu , Fangkun Zhao , Caixia Yuan , Xiaojie Wang

Large language models (LLMs) have undergone significant expansion and have been increasingly integrated across various domains. Notably, in the realm of robot task planning, LLMs harness their advanced reasoning and language comprehension…

This study proposes Tool-RoCo, a novel benchmark for evaluating large language models (LLMs) in long-term multi-agent cooperation based on RoCo, a multi-robot cooperative benchmark. Recent research on LLM-based multi-agent systems has…

Multiagent Systems · Computer Science 2025-12-02 Ke Zhang , Xiaoning Zhao , Ce Zheng , Jiahong Ning , Dandan Zhu , Wenqi Zhang , Chen Sun , Toshiharu Sugawara

While there has been a lot of research recently on robots in household environments, at the present time, most robots in existence can be found on shop floors, and most interactions between humans and robots happen there. ``Collaborative…

Computation and Language · Computer Science 2025-09-09 Chalamalasetti Kranti , Sherzod Hakimov , David Schlangen

Planning is a fundamental task in artificial intelligence that involves finding a sequence of actions that achieve a specified goal in a given environment. Large language models (LLMs) are increasingly used for applications that require…

Computation and Language · Computer Science 2024-05-24 Eran Hirsch , Guy Uziel , Ateret Anaby-Tavor