English

BEV-CV: Birds-Eye-View Transform for Cross-View Geo-Localisation

Computer Vision and Pattern Recognition 2024-09-25 v2 Machine Learning

Abstract

Cross-view image matching for geo-localisation is a challenging problem due to the significant visual difference between aerial and ground-level viewpoints. The method provides localisation capabilities from geo-referenced images, eliminating the need for external devices or costly equipment. This enhances the capacity of agents to autonomously determine their position, navigate, and operate effectively in GNSS-denied environments. Current research employs a variety of techniques to reduce the domain gap such as applying polar transforms to aerial images or synthesising between perspectives. However, these approaches generally rely on having a 360{\deg} field of view, limiting real-world feasibility. We propose BEV-CV, an approach introducing two key novelties with a focus on improving the real-world viability of cross-view geo-localisation. Firstly bringing ground-level images into a semantic Birds-Eye-View before matching embeddings, allowing for direct comparison with aerial image representations. Secondly, we adapt datasets into application realistic format - limited Field-of-View images aligned to vehicle direction. BEV-CV achieves state-of-the-art recall accuracies, improving Top-1 rates of 70{\deg} crops of CVUSA and CVACT by 23% and 24% respectively. Also decreasing computational requirements by reducing floating point operations to below previous works, and decreasing embedding dimensionality by 33% - together allowing for faster localisation capabilities.

Keywords

Cite

@article{arxiv.2312.15363,
  title  = {BEV-CV: Birds-Eye-View Transform for Cross-View Geo-Localisation},
  author = {Tavis Shore and Simon Hadfield and Oscar Mendez},
  journal= {arXiv preprint arXiv:2312.15363},
  year   = {2024}
}

Comments

8 pages, 6 figures

R2 v1 2026-06-28T14:00:52.060Z