中文
相关论文

相关论文: NATURAL PLAN: Benchmarking LLMs on Natural Languag…

200 篇论文

While Large Language Models (LLMs) possess significant capabilities in open-world agent tasks, they also face challenges in rapidly adapting to new, specialized tasks due to their reliance on static pre-trained knowledge. Traditional…

计算与语言 · 计算机科学 2025-06-25 Kelin Fu , Kaigui Bian

Large Language Models (LLMs) have shown remarkable capabilities in natural language processing, mathematical problem solving, and tasks related to program synthesis. However, their effectiveness in long-term planning and higher-order…

人工智能 · 计算机科学 2024-10-08 Erik Wu , Sayan Mitra

The resurgence and rapid advancement of Generative Artificial Intelligence (GenAI) in 2023 has catalyzed transformative shifts across numerous industry sectors, including urban transportation and logistics. This study investigates the…

人工智能 · 计算机科学 2024-09-24 Shaowei Ying , Zhenlong Li , Manzhu Yu

Location-based services play an critical role in improving the quality of our daily lives. Despite the proliferation of numerous specialized AI models within spatio-temporal context of location-based services, these models struggle to…

机器学习 · 计算机科学 2024-06-19 Yue Jiang , Qin Chao , Yile Chen , Xiucheng Li , Shuai Liu , Gao Cong

This paper focuses on planning robot navigation tasks from natural language specifications. We develop a modular approach, where a large language model (LLM) translates the natural language instructions into a linear temporal logic (LTL)…

机器人学 · 计算机科学 2025-08-07 Behrad Rabiei , Mahesh Kumar A. R. , Zhirui Dai , Surya L. S. R. Pilla , Qiyue Dong , Nikolay Atanasov

Existing navigation systems often fail during urban disruptions, struggling to incorporate real-time events and complex user constraints, such as avoiding specific areas. We address this gap with TraveLLM, a system using Large Language…

人工智能 · 计算机科学 2025-10-30 Bowen Fang , Zixiao Yang , Xuan Di

Large Language Models (LLMs) hold the potential to revolutionize autoformalization. The introduction of Lean4, a mathematical programming language, presents an unprecedented opportunity to rigorously assess the autoformalization…

机器学习 · 计算机科学 2024-06-12 Aryan Gulati , Devanshu Ladsaria , Shubhra Mishra , Jasdeep Sidhu , Brando Miranda

Effective collaboration requires groups to strategically regulate themselves to overcome challenges. Research has shown that groups may fail to regulate due to differences in members' perceptions of challenges which may benefit from…

计算与语言 · 计算机科学 2024-01-04 Wannapon Suraworachet , Jennifer Seon , Mutlu Cukurova

Temporal reasoning and planning are essential capabilities for large language models (LLMs), yet most existing benchmarks evaluate them in isolation and under limited forms of complexity. To address this gap, we introduce the Temporal…

人工智能 · 计算机科学 2025-10-14 Zifeng Ding , Sikuan Yan , Zhangdie Yuan , Xianglong Hu , Fangru Lin , Andreas Vlachos

Whether in agentic workflows, social studies, or chat settings, large language models (LLMs) are increasingly being asked to replace humans in choosing which goals to pursue, rather than completing predefined tasks. However, the assumption…

计算与语言 · 计算机科学 2026-05-14 Gaia Molinaro , Dave August , Danielle Perszyk , Anne G. E. Collins

We present PricingLogic, the first benchmark that probes whether Large Language Models(LLMs) can reliably automate tourism-related prices when multiple, overlapping fare rules apply. Travel agencies are eager to offload this error-prone…

人工智能 · 计算机科学 2025-10-15 Yunuo Liu , Dawei Zhu , Zena Al-Khalili , Dai Cheng , Yanjun Chen , Dietrich Klakow , Wei Zhang , Xiaoyu Shen

Large Language Models (LLMs) have shown impressive capabilities across a wide variety of tasks. However, they still face challenges with long-horizon planning. To study this, we propose path planning tasks as a platform to evaluate LLMs'…

人工智能 · 计算机科学 2024-06-24 Mohamed Aghzal , Erion Plaku , Ziyu Yao

Large language models~(LLMs) have been adopted to process textual task description and accomplish procedural planning in embodied AI tasks because of their powerful reasoning ability. However, there is still lack of study on how vision…

计算与语言 · 计算机科学 2024-10-08 Ying Su , Zhan Ling , Haochen Shi , Jiayang Cheng , Yauwai Yim , Yangqiu Song

Autonomous agents powered by language models (LMs) have demonstrated promise in their ability to perform decision-making tasks such as web automation. However, a key limitation remains: LMs, primarily optimized for natural language…

人工智能 · 计算机科学 2026-02-10 Jing Yu Koh , Stephen McAleer , Daniel Fried , Ruslan Salakhutdinov

Recent advancements in Large Language Models (LLMs) have spurred numerous attempts to apply these technologies to embodied tasks, particularly focusing on high-level task planning and task decomposition. To further explore this area, we…

Planning is an important capability of artificial agents that perform long-horizon tasks in real-world environments. In this work, we explore the use of pre-trained language models (PLMs) to reason about plan sequences from text…

计算与语言 · 计算机科学 2023-03-17 Anthony Z. Liu , Lajanugen Logeswaran , Sungryull Sohn , Honglak Lee

This paper presents an incremental replanning algorithm, dubbed LTL-D*, for temporal-logic-based task planning in a dynamically changing environment. Unexpected changes in the environment may lead to failures in satisfying a task…

机器人学 · 计算机科学 2024-04-02 Jiming Ren , Haris Miller , Karen M. Feigh , Samuel Coogan , Ye Zhao

In recent years, large language models (LLMs) have achieved remarkable success in natural language processing (NLP). LLMs require an extreme amount of parameters to attain high performance. As models grow into the trillion-parameter range,…

计算与语言 · 计算机科学 2024-09-10 Zhyar Rzgar K Rostam , Sándor Szénási , Gábor Kertész

Improving the performance of large language models (LLMs) in complex question-answering (QA) scenarios has always been a research focal point. Recent studies have attempted to enhance LLMs' performance by combining step-wise planning with…

Inspired by the recent success of large language models (LLMs) like ChatGPT, researchers start to explore the adoption of LLMs for agile hardware design, such as generating design RTL based on natural-language instructions. However, in…

机器学习 · 计算机科学 2023-11-14 Yao Lu , Shang Liu , Qijun Zhang , Zhiyao Xie