中文
相关论文

相关论文: NATURAL PLAN: Benchmarking LLMs on Natural Languag…

200 篇论文

Successful application of large language models (LLMs) to robotic planning and execution may pave the way to automate numerous real-world tasks. Promising recent research has been conducted showing that the knowledge contained in LLMs can…

机器人学 · 计算机科学 2024-07-23 Ateeq Sharfuddin , Travis Breaux

As large language models (LLMs) increasingly integrate into vehicle navigation systems, understanding their path-planning capability is crucial. We tested three LLMs through six real-world path-planning scenarios in various settings and…

人工智能 · 计算机科学 2024-12-03 Wanyi Chen , Meng-Wen Su , Nafisa Mehjabin , Mary L. Cummings

Large language models (LLMs) have demonstrated impressive task-solving capabilities through prompting techniques and system designs, including solving planning tasks (e.g., math proofs, basic travel planning) when sufficient data is…

人工智能 · 计算机科学 2025-04-25 Wenjun Li , Changyu Chen , Pradeep Varakantham

In the field of urban planning, general-purpose large language models often struggle to meet the specific needs of planners. Tasks like generating urban planning texts, retrieving related information, and evaluating planning documents pose…

计算与语言 · 计算机科学 2024-03-01 He Zhu , Wenjia Zhang , Nuoxian Huang , Boyang Li , Luyao Niu , Zipei Fan , Tianle Lun , Yicheng Tao , Junyou Su , Zhaoya Gong , Chenyu Fang , Xing Liu

Large language models (LLMs) are incredible and versatile tools for text-based tasks that have enabled countless, previously unimaginable, applications. Retrieval models, in contrast, have not yet seen such capable general-purpose models…

信息检索 · 计算机科学 2025-09-10 Julian Killingback , Hamed Zamani

Classical planners are powerful systems, but modeling tasks in input formats such as PDDL is tedious and error-prone. In contrast, planning with Large Language Models (LLMs) allows for almost any input text, but offers no guarantees on plan…

人工智能 · 计算机科学 2025-10-02 Elliot Gestrin , Marco Kuhlmann , Jendrik Seipp

Despite significant advances in Large Language Models (LLMs), planning tasks still present challenges for LLM-based agents. Existing planning methods face two key limitations: heavy constraints and cascading errors. To address these…

计算与语言 · 计算机科学 2025-06-04 Zhengdong Lu , Weikai Lu , Yiling Tao , Yun Dai , ZiXuan Chen , Huiping Zhuang , Cen Chen , Hao Peng , Ziqian Zeng

Large Language Models (LLMs) have empowered autonomous agents to handle complex web navigation tasks. While recent studies integrate tree search to enhance long-horizon reasoning, applying these algorithms in web navigation faces two…

Recent trends in planning research have led to empirical comparison becoming commonplace. The field has started to settle into a methodology for such comparisons, which for obvious practical reasons requires running a subset of planners on…

人工智能 · 计算机科学 2011-06-10 E. Dahlman , A. E. Howe

Fulfilling user needs through Large Language Model multi-turn, multi-step tool-use is rarely a straightforward process. Real user interactions are inherently wild, being intricate, messy, and flexible. We identify three key challenges from…

人机交互 · 计算机科学 2026-04-09 Peijie Yu , Wei Liu , Yifan Yang , Jinjian Li , Zelong Zhang , Xiao Feng , Feng Zhang

Replicating human-level intelligence in the execution of embodied tasks remains challenging due to the unconstrained nature of real-world environments. Novel use of large language models (LLMs) for task planning seeks to address the…

Large language model (LLM)-based agents have demonstrated remarkable capabilities in decision-making tasks, but struggle significantly with complex, long-horizon planning scenarios. This arises from their lack of macroscopic guidance,…

计算与语言 · 计算机科学 2025-08-27 Ziyue Li , Yuan Chang , Gaihong Yu , Xiaoqiu Le

Task planning in language agents is emerging as an important research topic alongside the development of large language models (LLMs). It aims to break down complex user requests in natural language into solvable sub-tasks, thereby…

机器学习 · 计算机科学 2024-10-29 Xixi Wu , Yifei Shen , Caihua Shan , Kaitao Song , Siwei Wang , Bohang Zhang , Jiarui Feng , Hong Cheng , Wei Chen , Yun Xiong , Dongsheng Li

Modern large language models (LLMs) have demonstrated impressive performance across a wide range of multi-step reasoning tasks. Recent work suggests that LLMs may perform planning - selecting a future target token in advance and generating…

计算与语言 · 计算机科学 2025-08-26 Jatin Nainani , Sankaran Vaidyanathan , Connor Watts , Andre N. Assis , Alice Rigg

Despite significant advancements in large language models (LLMs) that enhance robot agents' understanding and execution of natural language (NL) commands, ensuring the agents adhere to user-specified constraints remains challenging,…

机器人学 · 计算机科学 2025-02-17 Yi Wu , Zikang Xiong , Yiran Hu , Shreyash S. Iyengar , Nan Jiang , Aniket Bera , Lin Tan , Suresh Jagannathan

The ability of Language Models (LMs) to understand natural language makes them a powerful tool for parsing human instructions into task plans for autonomous robots. Unlike traditional planning methods that rely on domain-specific knowledge…

Language models (LMs) have demonstrated their capability in possessing commonsense knowledge of the physical world, a crucial aspect of performing tasks in everyday life. However, it remains unclear **whether LMs have the capacity to…

人工智能 · 计算机科学 2023-07-18 Bill Yuchen Lin , Chengsong Huang , Qian Liu , Wenda Gu , Sam Sommerer , Xiang Ren

In this work, we provide a systematic analysis of how large language models (LLMs) contribute to solving planning problems. In particular, we examine how LLMs perform when they are used as problem solver, solution verifier, and heuristic…

人工智能 · 计算机科学 2024-12-16 Haoming Li , Zhaoliang Chen , Songyuan Liu , Yiming Lu , Fei Liu

To solve complex tasks, large language models (LLMs) often require multiple rounds of interactions with the user, sometimes assisted by external tools. However, current evaluation protocols often emphasize benchmark performance with…

计算与语言 · 计算机科学 2024-03-13 Xingyao Wang , Zihan Wang , Jiateng Liu , Yangyi Chen , Lifan Yuan , Hao Peng , Heng Ji

Large language models (LLMs) have become increasingly embedded in organizational workflows. This has raised concerns over their energy consumption, financial costs, and data sovereignty. While performance benchmarks often celebrate…

计算与语言 · 计算机科学 2026-05-19 Jennifer Haase , Finn Klessascheck , Jan Mendling , Sebastian Pokutta