English

Learning to Navigate from Scratch using World Models and Curiosity: the Good, the Bad, and the Ugly

Robotics 2023-09-19 v2

Abstract

Learning to navigate unknown environments from scratch is a challenging problem. This work presents a system that integrates world models with curiosity-driven exploration for autonomous navigation in new environments. We evaluate performance through simulations and real-world experiments of varying scales and complexities. In simulated environments, the approach rapidly and comprehensively explores the surroundings. Real-world scenarios introduce additional challenges. Despite demonstrating promise in a small controlled environment, we acknowledge that larger and dynamic environments can pose challenges for the current system. Our analysis emphasizes the significance of developing adaptable and robust world models that can handle environmental changes to prevent repetitive exploration of the same areas.

Keywords

Cite

@article{arxiv.2308.15852,
  title  = {Learning to Navigate from Scratch using World Models and Curiosity: the Good, the Bad, and the Ugly},
  author = {Daria de Tinguy and Sven Remmery and Pietro Mazzaglia and Tim Verbelen and Bart Dhoedt},
  journal= {arXiv preprint arXiv:2308.15852},
  year   = {2023}
}

Comments

IROS 2023 workshop World Models and Predictive Coding in Cognitive Robotics and IROS 2023 workshop Learning Robot Super Autonomy