Rethinking Positional Encoding for Neural Vehicle Routing
Abstract
Transformer-based models have become the dominant paradigm for neural combinatorial optimization (NCO) of vehicle routing problems (VRPs), yet the role of positional encoding (PE) in these architectures remains largely unexplored. Unlike natural language, where tokens are uniformly spaced on a line, routing solutions exhibit several properties that render standard NLP positional encodings inadequate. In this work, we formalize three such structural properties that a routing-aware PE should respect, namely anisometric node distances, cyclic and direction-aware topology, and hierarchical depot-anchored global multi-route structure, combining them with a unifying design principle of geometric grounding. Guided by these criteria, we analyze and compare PE methods spanning NLP, graph-transformer, and routing-specific families, and propose a hierarchical anisometric PE that combines a distance-indexed, circularly consistent in-route encoding with a depot-anchored angular cross-route encoding. Extensive experiments across diverse VRP variants demonstrate that geometry-grounded PE consistently outperforms index-based alternatives, with gains that transfer across problem variants, model architectures, and distribution shifts.
Keywords
Cite
@article{arxiv.2605.11910,
title = {Rethinking Positional Encoding for Neural Vehicle Routing},
author = {Chuanbo Hua and Federico Berto and Andre Hottung and Nayeli Gast Zepeda and Yining Ma and Zihan Ma and Paula Wong-Chung and Changhyun Kwon and Cathy Wu and Kevin Tierney and Jinkyoo Park},
journal= {arXiv preprint arXiv:2605.11910},
year = {2026}
}