English

Grounding Complex Natural Language Commands for Temporal Tasks in Unseen Environments

Robotics 2023-10-19 v2 Artificial Intelligence Computation and Language Formal Languages and Automata Theory

Abstract

Grounding navigational commands to linear temporal logic (LTL) leverages its unambiguous semantics for reasoning about long-horizon tasks and verifying the satisfaction of temporal constraints. Existing approaches require training data from the specific environment and landmarks that will be used in natural language to understand commands in those environments. We propose Lang2LTL, a modular system and a software package that leverages large language models (LLMs) to ground temporal navigational commands to LTL specifications in environments without prior language data. We comprehensively evaluate Lang2LTL for five well-defined generalization behaviors. Lang2LTL demonstrates the state-of-the-art ability of a single model to ground navigational commands to diverse temporal specifications in 21 city-scaled environments. Finally, we demonstrate a physical robot using Lang2LTL can follow 52 semantically diverse navigational commands in two indoor environments.

Keywords

Cite

@article{arxiv.2302.11649,
  title  = {Grounding Complex Natural Language Commands for Temporal Tasks in Unseen Environments},
  author = {Jason Xinyu Liu and Ziyi Yang and Ifrah Idrees and Sam Liang and Benjamin Schornstein and Stefanie Tellex and Ankit Shah},
  journal= {arXiv preprint arXiv:2302.11649},
  year   = {2023}
}

Comments

Conference on Robot Learning 2023

R2 v1 2026-06-28T08:47:21.561Z