中文
相关论文

相关论文: NATURAL PLAN: Benchmarking LLMs on Natural Languag…

200 篇论文

In contemporary workplaces, meetings are essential for exchanging ideas and ensuring team alignment but often face challenges such as time consumption, scheduling conflicts, and inefficient participation. Recent advancements in Large…

计算与语言 · 计算机科学 2025-02-10 Lingxiang Hu , Shurun Yuan , Xiaoting Qin , Jue Zhang , Qingwei Lin , Dongmei Zhang , Saravan Rajmohan , Qi Zhang

Travel planning is a valuable yet complex task that poses significant challenges even for advanced large language models (LLMs). While recent benchmarks have advanced in evaluating LLMs' planning capabilities, they often fall short in…

人工智能 · 计算机科学 2025-10-17 Yincen Qu , Huan Xiao , Feng Li , Gregory Li , Hui Zhou , Xiangying Dai , Xiaoru Dai

The reasoning and planning abilities of Large Language Models (LLMs) have been a frequent topic of discussion in recent years. Their ability to take unstructured planning problems as input has made LLMs' integration into AI planning an area…

人工智能 · 计算机科学 2025-08-05 Ma'ayan Armony , Albert Meroño-Peñuela , Gerard Canal

We introduce LLM-Wikirace, a benchmark for evaluating planning, reasoning, and world knowledge in large language models (LLMs). In LLM-Wikirace, models must efficiently navigate Wikipedia hyperlinks step by step to reach a target page from…

人工智能 · 计算机科学 2026-02-24 Juliusz Ziomek , William Bankes , Lorenz Wolf , Shyam Sundhar Ramesh , Xiaohang Tang , Ilija Bogunovic

Large language models (LLMs) have brought autonomous agents closer to artificial general intelligence (AGI) due to their promising generalization and emergent capabilities. There is, however, a lack of studies on how LLM-based agents…

人工智能 · 计算机科学 2024-08-13 Yanan Chen , Ali Pesaranghader , Tanmana Sadhu , Dong Hoon Yi

The advent of Large Language Models (LLMs) holds promise for revolutionizing various fields traditionally dominated by human expertise. Urban planning, a professional discipline that fundamentally shapes our daily surroundings, is one such…

计算与语言 · 计算机科学 2025-05-01 Yu Zheng , Longyi Liu , Yuming Lin , Jie Feng , Guozhen Zhang , Depeng Jin , Yong Li

Recent studies have highlighted their proficiency in some simple tasks like writing and coding through various reasoning strategies. However, LLM agents still struggle with tasks that require comprehensive planning, a process that…

人工智能 · 计算机科学 2024-05-29 Chengxing Xie , Difan Zou

Comprehensive planning agents have been a long term goal in the field of artificial intelligence. Recent innovations in Natural Language Processing have yielded success through the advent of Large Language Models (LLMs). We seek to improve…

人工智能 · 计算机科学 2024-07-30 Annabelle Miin , Timothy Wei

This study introduces a benchmark framework for evaluating the financial decision-making capabilities of large language models (LLMs) through portfolio optimization problems with mathematically explicit solutions. Unlike existing financial…

投资组合管理 · 定量金融 2026-05-28 Hanyong Cho , Jang Ho Kim

As robots become increasingly capable, users will want to describe high-level missions and have robots infer the relevant details. Because pre-built maps are difficult to obtain in many realistic settings, accomplishing such missions will…

机器人学 · 计算机科学 2025-03-24 Zachary Ravichandran , Varun Murali , Mariliza Tzes , George J. Pappas , Vijay Kumar

LLMs have immense potential for generating plans, transforming an initial world state into a desired goal state. A large body of research has explored the use of LLMs for various planning tasks, from web navigation to travel planning and…

人工智能 · 计算机科学 2025-06-24 Hui Wei , Zihao Zhang , Shenghua He , Tian Xia , Shijia Pan , Fei Liu

Autonomous navigation guided by natural language instructions is essential for improving human-robot interaction and enabling complex operations in dynamic environments. While large language models (LLMs) are not inherently designed for…

机器人学 · 计算机科学 2024-12-04 Pranav Doma , Aliasghar Arab , Xuesu Xiao

Large language models (LLMs) with advanced cognitive capabilities are emerging as agents for various reasoning and planning tasks. Traditional evaluations often focus on specific reasoning or planning questions within controlled…

人工智能 · 计算机科学 2026-03-23 Tianlong Wang , Pinqiao Wang , Weili Shi , Sheng li

Planning represents a fundamental capability of intelligent agents, requiring comprehensive environmental understanding, rigorous logical reasoning, and effective sequential decision-making. While Large Language Models (LLMs) have…

人工智能 · 计算机科学 2025-05-27 Pengfei Cao , Tianyi Men , Wencan Liu , Jingwen Zhang , Xuzhao Li , Xixun Lin , Dianbo Sui , Yanan Cao , Kang Liu , Jun Zhao

Recent works have explored using language models for planning problems. One approach examines translating natural language descriptions of planning tasks into structured planning languages, such as the planning domain definition language…

计算与语言 · 计算机科学 2025-11-12 Max Zuo , Francisco Piedrahita Velez , Xiaochen Li , Michael L. Littman , Stephen H. Bach

For effective human-robot interaction, robots need to understand, plan, and execute complex, long-horizon tasks described by natural language. Recent advances in large language models (LLMs) have shown promise for translating natural…

机器人学 · 计算机科学 2024-03-25 Yongchao Chen , Jacob Arkin , Charles Dawson , Yang Zhang , Nicholas Roy , Chuchu Fan

Although large language models have enhanced automated travel planning abilities, current systems remain misaligned with real-world scenarios. First, they assume users provide explicit queries, while in reality requirements are often…

人工智能 · 计算机科学 2025-08-22 Bin Deng , Yizhe Feng , Zeming Liu , Qing Wei , Xiangrong Zhu , Shuai Chen , Yuanfang Guo , Yunhong Wang

Recently, decomposing complex problems into simple subtasks--a crucial part of human-like natural planning--to solve the given problem has significantly boosted the performance of large language models (LLMs). However, leveraging such…

计算与语言 · 计算机科学 2025-07-11 Mihir Parmar , Palash Goyal , Xin Liu , Yiwen Song , Mingyang Ling , Chitta Baral , Hamid Palangi , Tomas Pfister

Planning is a fundamental property of human intelligence. Reasoning about asynchronous plans is challenging since it requires sequential and parallel planning to optimize time costs. Can large language models (LLMs) succeed at this task?…

Results on existing LLM benchmarks capture little information over the model capabilities in low-resource tasks, making it difficult to develop effective solutions in these domains. To address these challenges, we curated 14 travel-domain…

计算与语言 · 计算机科学 2025-10-06 Srinivas Billa , Xiaonan Jing