English

CLIMB: Language-Guided Continual Learning for Task Planning with Iterative Model Building

Robotics 2024-10-18 v1 Artificial Intelligence Machine Learning

Abstract

Intelligent and reliable task planning is a core capability for generalized robotics, requiring a descriptive domain representation that sufficiently models all object and state information for the scene. We present CLIMB, a continual learning framework for robot task planning that leverages foundation models and execution feedback to guide domain model construction. CLIMB can build a model from a natural language description, learn non-obvious predicates while solving tasks, and store that information for future problems. We demonstrate the ability of CLIMB to improve performance in common planning environments compared to baseline methods. We also develop the BlocksWorld++ domain, a simulated environment with an easily usable real counterpart, together with a curriculum of tasks with progressing difficulty for evaluating continual learning. Additional details and demonstrations for this system can be found at https://plan-with-climb.github.io/ .

Keywords

Cite

@article{arxiv.2410.13756,
  title  = {CLIMB: Language-Guided Continual Learning for Task Planning with Iterative Model Building},
  author = {Walker Byrnes and Miroslav Bogdanovic and Avi Balakirsky and Stephen Balakirsky and Animesh Garg},
  journal= {arXiv preprint arXiv:2410.13756},
  year   = {2024}
}

Comments

6 pages, 6 figures

R2 v1 2026-06-28T19:26:11.374Z