English
Related papers

Related papers: NATURAL PLAN: Benchmarking LLMs on Natural Languag…

200 papers

Planning in complex environments requires an agent to efficiently query a world model to find a feasible sequence of actions from start to goal. Recent work has shown that Large Language Models (LLMs), with their rich prior knowledge and…

Artificial Intelligence · Computer Science 2024-12-10 Gonzalo Gonzalez-Pumariega , Wayne Chen , Kushal Kedia , Sanjiban Choudhury

Recent advancements have significantly enhanced the performance of large language models (LLMs) in tackling complex reasoning tasks, achieving notable success in domains like mathematical and logical reasoning. However, these methods…

Artificial Intelligence · Computer Science 2025-05-30 Runquan Gui , Zhihai Wang , Jie Wang , Chi Ma , Huiling Zhen , Mingxuan Yuan , Jianye Hao , Defu Lian , Enhong Chen , Feng Wu

Large Language Models (LLMs) excel in various natural language tasks but often struggle with long-horizon planning problems requiring structured reasoning. This limitation has drawn interest in integrating neuro-symbolic approaches within…

Artificial Intelligence · Computer Science 2025-10-28 Marcus Tantakoun , Xiaodan Zhu , Christian Muise

While Large Language Model-based agents have demonstrated substantial progress in task completion, existing evaluation benchmarks tend to overemphasize single-task performance, with insufficient attention given to the crucial aspects of…

Computation and Language · Computer Science 2025-03-05 Zirui Wu , Xiao Liu , Jiayi Li , Lingpeng Kong , Yansong Feng

Tool planning with large language models (LLMs), referring to selecting, organizing, and preparing the tools necessary to complete a user request, bridges the gap between natural language understanding and task execution. However, current…

Artificial Intelligence · Computer Science 2025-08-19 Wenjie Chen , Wenbin Li , Di Yao , Xuying Meng , Chang Gong , Jingping Bi

Travel behavior prediction is a core problem in transportation demand management and is traditionally addressed using numerical models calibrated on observed data. With recent advances in large language models (LLMs), new opportunities have…

Machine Learning · Computer Science 2026-03-12 Baichuan Mo , Hanyong Xu , Ruoyun Ma , Jung-Hoon Cho , Dingyi Zhuang , Xiaotong Guo , Jinhua Zhao

Large language model (LLM) based task plans and corresponding human demonstrations for embodied AI may be noisy, with unnecessary actions, redundant navigation, and logical errors that reduce policy quality. We propose an iterative…

Artificial Intelligence · Computer Science 2026-01-01 Ananth Hariharan , Vardhan Dongre , Dilek Hakkani-Tür , Gokhan Tur

The rapid development and dynamic nature of large language models (LLMs) make it difficult for conventional quantitative benchmarks to accurately assess their capabilities. We propose report cards, which are human-interpretable, natural…

Machine Learning · Computer Science 2024-09-04 Blair Yang , Fuyang Cui , Keiran Paster , Jimmy Ba , Pashootan Vaezipoor , Silviu Pitis , Michael R. Zhang

Generating plans of action, and reasoning about change have long been considered a core competence of intelligent agents. It is thus no surprise that evaluating the planning and reasoning capabilities of large language models (LLMs) has…

Computation and Language · Computer Science 2023-11-28 Karthik Valmeekam , Matthew Marquez , Alberto Olmo , Sarath Sreedharan , Subbarao Kambhampati

There is a growing interest in applying pre-trained large language models (LLMs) to planning problems. However, methods that use LLMs directly as planners are currently impractical due to several factors, including limited correctness of…

Artificial Intelligence · Computer Science 2023-11-03 Lin Guan , Karthik Valmeekam , Sarath Sreedharan , Subbarao Kambhampati

Large language models show promising results in various NLP tasks. Despite these successes, the robustness and consistency of LLMs in underrepresented languages remain largely unexplored, especially concerning local dialects. Existing…

Recent efforts like TripCraft and TravelPlanner have advanced the use of Large Language Models ( LLMs) for personalized, constraint aware travel itinerary generation. Yet, real travel often faces disruptions. To address this, we present…

Computation and Language · Computer Science 2025-10-27 Priyanshu Karmakar , Soumyabrata Chaudhuri , Shubhojit Mallick , Manish Gupta , Abhik Jana , Shreya Ghosh

Multi-constraint planning involves identifying, evaluating, and refining candidate plans while satisfying multiple, potentially conflicting constraints. Existing large language model (LLM) approaches face fundamental limitations in this…

Artificial Intelligence · Computer Science 2026-01-26 Derrick Goh Xin Deik , Quanyu Long , Zhengyuan Liu , Nancy F. Chen , Wenya Wang

Path planning is a fundamental scientific problem in robotics and autonomous navigation, requiring the derivation of efficient routes from starting to destination points while avoiding obstacles. Traditional algorithms like A* and its…

Robotics · Computer Science 2025-04-10 Silin Meng , Yiwei Wang , Cheng-Fu Yang , Nanyun Peng , Kai-Wei Chang

Although planning is a crucial component of the autonomous driving stack, researchers have yet to develop robust planning algorithms that are capable of safely handling the diverse range of possible driving scenarios. Learning-based…

Artificial Intelligence · Computer Science 2024-01-02 S P Sharan , Francesco Pittaluga , Vijay Kumar B G , Manmohan Chandraker

Large Language Models (LLMs) have shown remarkable performance in various natural language tasks, but they often struggle with planning problems that require structured reasoning. To address this limitation, the conversion of planning…

Machine Learning · Computer Science 2024-11-12 Sadegh Mahdavi , Raquel Aoki , Keyi Tang , Yanshuai Cao

While Large Language Models (LLMs) have shown remarkable advancements in reasoning and tool use, they often fail to generate optimal, grounded solutions under complex constraints. Real-world travel planning exemplifies these challenges,…

Artificial Intelligence · Computer Science 2025-10-01 Jihye Choi , Jinsung Yoon , Jiefeng Chen , Somesh Jha , Tomas Pfister

Large language models (LLMs) have recently received considerable attention as alternative solutions for task planning. However, comparing the performance of language-oriented task planners becomes difficult, and there exists a dearth of…

Artificial Intelligence · Computer Science 2024-02-14 Jae-Woo Choi , Youngwoo Yoon , Hyobin Ong , Jaehong Kim , Minsu Jang

Human decision-making often involves constrained optimization. As LLM agents are deployed to assist with real-world tasks like travel planning, shopping, and scheduling, they must mirror this capability. We introduce COMPASS, a benchmark…

By combining classical planning methods with large language models (LLMs), recent research such as LLM+P has enabled agents to plan for general tasks given in natural language. However, scaling these methods to general-purpose service…

Robotics · Computer Science 2025-08-05 Krish Agarwal , Yuqian Jiang , Jiaheng Hu , Bo Liu , Peter Stone
‹ Prev 1 3 4 5 6 7 10 Next ›