English

Automatic Behavior Tree Expansion with LLMs for Robotic Manipulation

Robotics 2024-09-23 v1

Abstract

Robotic systems for manipulation tasks are increasingly expected to be easy to configure for new tasks or unpredictable environments, while keeping a transparent policy that is readable and verifiable by humans. We propose the method BEhavior TRee eXPansion with Large Language Models (BETR-XP-LLM) to dynamically and automatically expand and configure Behavior Trees as policies for robot control. The method utilizes an LLM to resolve errors outside the task planner's capabilities, both during planning and execution. We show that the method is able to solve a variety of tasks and failures and permanently update the policy to handle similar problems in the future.

Keywords

Cite

@article{arxiv.2409.13356,
  title  = {Automatic Behavior Tree Expansion with LLMs for Robotic Manipulation},
  author = {Jonathan Styrud and Matteo Iovino and Mikael Norrlöf and Mårten Björkman and Christian Smith},
  journal= {arXiv preprint arXiv:2409.13356},
  year   = {2024}
}

Comments

Submitted to ICRA 2025

R2 v1 2026-06-28T18:51:10.489Z