In this paper, we present a novel method for reliable frontier selection in Zero-Shot Object Goal Navigation (ZS-OGN), enhancing robotic navigation systems with foundation models to improve commonsense reasoning in indoor environments. Our approach introduces a multi-expert decision framework to address the nonsensical or irrelevant reasoning often seen in foundation model-based systems. The method comprises two key components: Diversified Expert Frontier Analysis (DEFA) and Consensus Decision Making (CDM). DEFA utilizes three expert models: furniture arrangement, room type analysis, and visual scene reasoning, while CDM aggregates their outputs, prioritizing unanimous or majority consensus for more reliable decisions. Demonstrating state-of-the-art performance on the RoboTHOR and HM3D datasets, our method excels at navigating towards untrained objects or goals and outperforms various baselines, showcasing its adaptability to dynamic real-world conditions and superior generalization capabilities.
@article{arxiv.2410.21037,
title = {Exploring the Reliability of Foundation Model-Based Frontier Selection in Zero-Shot Object Goal Navigation},
author = {Shuaihang Yuan and Halil Utku Unlu and Hao Huang and Congcong Wen and Anthony Tzes and Yi Fang},
journal= {arXiv preprint arXiv:2410.21037},
year = {2024}
}