English

Revisiting the Travel Planning Capabilities of Large Language Models

Artificial Intelligence 2026-05-06 v1

Abstract

Travel planning serves as a critical task for long-horizon reasoning, exposing significant deficits in LLMs. However, existing benchmarks and evaluations primarily assess final plans in an end-to-end manner, which lacks interpretability and makes it difficult to analyze the root causes of failures. To bridge this gap, we decompose travel planning into five constituent atomic sub-capabilities, including \emph{Constraint Extraction}, \emph{Tool Use}, \emph{Plan Generation}, \emph{Error Identification}, and \emph{Error Correction}. We implement a decoupled evaluation protocol leveraging oracle intermediate contexts to rigorously isolate these components, thereby measuring the atomic performance boundary without the noise of cascading errors. Our results highlight a clear contrast in performance: while LLMs are proficient in extracting explicit constraints, they struggle to infer implicit, open-world requirements. Furthermore, they exhibit structural biases in plan generation and suffer from ineffective self-correction, characterized by excessive sensitivity and erroneous persistence. These findings offer precise directions for improving LLM reasoning and planning abilities.

Keywords

Cite

@article{arxiv.2605.03308,
  title  = {Revisiting the Travel Planning Capabilities of Large Language Models},
  author = {Bo-Wen Zhang and Jin Ye and Peng-Yu Hua and Jia-Wei Cao and Jie-Jing Shao and Yu-Feng Li and Lan-Zhe Guo},
  journal= {arXiv preprint arXiv:2605.03308},
  year   = {2026}
}