English

Introspection in Learned Semantic Scene Graph Localisation

Machine Learning 2025-10-09 v1 Artificial Intelligence Computer Vision and Pattern Recognition Robotics

Abstract

This work investigates how semantics influence localisation performance and robustness in a learned self-supervised, contrastive semantic localisation framework. After training a localisation network on both original and perturbed maps, we conduct a thorough post-hoc introspection analysis to probe whether the model filters environmental noise and prioritises distinctive landmarks over routine clutter. We validate various interpretability methods and present a comparative reliability analysis. Integrated gradients and Attention Weights consistently emerge as the most reliable probes of learned behaviour. A semantic class ablation further reveals an implicit weighting in which frequent objects are often down-weighted. Overall, the results indicate that the model learns noise-robust, semantically salient relations about place definition, thereby enabling explainable registration under challenging visual and structural variations.

Keywords

Cite

@article{arxiv.2510.07053,
  title  = {Introspection in Learned Semantic Scene Graph Localisation},
  author = {Manshika Charvi Bissessur and Efimia Panagiotaki and Daniele De Martini},
  journal= {arXiv preprint arXiv:2510.07053},
  year   = {2025}
}

Comments

IEEE IROS 2025 Workshop FAST

R2 v1 2026-07-01T06:24:01.455Z