English

Enhancing Consistency in Multimodal Dialogue System Using LLM with Dialogue Scenario

Computation and Language 2023-12-21 v1

Abstract

This paper describes our dialogue system submitted to Dialogue Robot Competition 2023. The system's task is to help a user at a travel agency decide on a plan for visiting two sightseeing spots in Kyoto City that satisfy the user. Our dialogue system is flexible and stable and responds to user requirements by controlling dialogue flow according to dialogue scenarios. We also improved user satisfaction by introducing motion and speech control based on system utterances and user situations. In the preliminary round, our system was ranked fifth in the impression evaluation and sixth in the plan evaluation among all 12 teams.

Keywords

Cite

@article{arxiv.2312.12808,
  title  = {Enhancing Consistency in Multimodal Dialogue System Using LLM with Dialogue Scenario},
  author = {Hiroki Onozeki and Zhiyang Qi and Kazuma Akiyama and Ryutaro Asahara and Takumasa Kaneko and Michimasa Inaba},
  journal= {arXiv preprint arXiv:2312.12808},
  year   = {2023}
}

Comments

This paper is part of the proceedings of the Dialogue Robot Competition 2023

R2 v1 2026-06-28T13:57:13.759Z