Monocular re-localization plays a crucial role in enabling intelligent agents to achieve human-like perception. However, traditional methods rely on dense maps, which face scalability limitations and privacy risks. OpenStreetMap (OSM), as a lightweight map that protects privacy, offers semantic and geometric information with global scalability. Nonetheless, there are still challenges in using OSM for localization: the inherent cross-modal discrepancies between natural images and OSM, as well as the high computational cost of global map-based localization. In this paper, we propose a hierarchical search framework with semantic alignment for localization in OSM. First, the semantic awareness capability of DINO-ViT is utilised to deconstruct visual elements to establish semantic relationships with OSM. Second, a coarse-to-fine search paradigm is designed to replace global dense matching, enabling efficient progressive refinement. Extensive experiments demonstrate that our method significantly improves both localization accuracy and speed. When trained on a single dataset, the 3{\deg} orientation recall of our method even outperforms the 5{\deg} recall of state-of-the-art methods.
@article{arxiv.2603.01613,
title = {Coarse-to-Fine Monocular Re-Localization in OpenStreetMap via Semantic Alignment},
author = {Yuchen Zou and Xiao Hu and Dexing Zhong and Yuqing Tang},
journal= {arXiv preprint arXiv:2603.01613},
year = {2026}
}