GRILLBot: An Assistant for Real-World Tasks with Neural Semantic Parsing and Graph-Based Representations

Carlos Gemmell; Iain Mackie; Paul Owoicho; Federico Rossetto; Sophie Fischer; Jeffrey Dalton

GRILLBot: An Assistant for Real-World Tasks with Neural Semantic Parsing and Graph-Based Representations

Computation and Language 2022-09-01 v1 Artificial Intelligence

Authors: Carlos Gemmell , Iain Mackie , Paul Owoicho , Federico Rossetto , Sophie Fischer , Jeffrey Dalton

Abstract

GRILLBot is the winning system in the 2022 Alexa Prize TaskBot Challenge, moving towards the next generation of multimodal task assistants. It is a voice assistant to guide users through complex real-world tasks in the domains of cooking and home improvement. These are long-running and complex tasks that require flexible adjustment and adaptation. The demo highlights the core aspects, including a novel Neural Decision Parser for contextualized semantic parsing, a new "TaskGraph" state representation that supports conditional execution, knowledge-grounded chit-chat, and automatic enrichment of tasks with images and videos.

Keywords

task assistant semantic parsing neural decision parser taskgraph multimodal assistant knowledge-grounded chit-chat alexa prize

Cite

@article{arxiv.2208.14884,
  title  = {GRILLBot: An Assistant for Real-World Tasks with Neural Semantic Parsing and Graph-Based Representations},
  author = {Carlos Gemmell and Iain Mackie and Paul Owoicho and Federico Rossetto and Sophie Fischer and Jeffrey Dalton},
  journal= {arXiv preprint arXiv:2208.14884},
  year   = {2022}
}

GRILLBot: An Assistant for Real-World Tasks with Neural Semantic Parsing and Graph-Based Representations

Abstract

Keywords

Cite

Related papers