English
Related papers

Related papers: Enhancing Consistency in Multimodal Dialogue Syste…

200 papers

In this paper we present Meeting Bot, a reinforcement learning based conversational system that interacts with multiple users to schedule meetings. The system is able to interpret user utterences and map them to preferred time slots, which…

Artificial Intelligence · Computer Science 2018-12-31 Vishwanath D , Lovekesh Vig , Gautam Shroff , Puneet Agarwal

In today's society, information overload presents challenges in providing optimal recommendations. Consequently, the importance of dialogue systems that can discern and provide the necessary information through dialogue is increasingly…

Robotics · Computer Science 2023-12-22 Hyejin Hong , Hibiki Kawano , Takuto Maekawa , Naoki Yoshimaru , Takamasa Iio , Kenji Hatano

The Werewolf Game is a communication game where players' reasoning and discussion skills are essential. In this study, we present a Werewolf AI agent developed for the AIWolfDial 2024 shared task, co-hosted with the 17th INLG. In recent…

We describe a class of tasks called decision-oriented dialogues, in which AI assistants such as large language models (LMs) must collaborate with one or more humans via natural language to help them make complex decisions. We formalize…

Computation and Language · Computer Science 2024-05-07 Jessy Lin , Nicholas Tomlin , Jacob Andreas , Jason Eisner

We present a generative dialogue system capable of operating in a full-duplex manner, allowing for seamless interaction. It is based on a large language model (LLM) carefully aligned to be aware of a perception module, a motor function…

Computation and Language · Computer Science 2024-10-30 Peng Wang , Songshuo Lu , Yaohua Tang , Sijie Yan , Wei Xia , Yuanjun Xiong

Due to strong capabilities in conducting fluent, multi-turn conversations with users, Large Language Models (LLMs) have the potential to further improve the performance of Conversational Recommender System (CRS). Unlike the aimless…

Information Retrieval · Computer Science 2024-02-05 Jiabao Fang , Shen Gao , Pengjie Ren , Xiuying Chen , Suzan Verberne , Zhaochun Ren

We propose a novel approach to multi-robot collaboration that harnesses the power of pre-trained large language models (LLMs) for both high-level communication and low-level path planning. Robots are equipped with LLMs to discuss and…

Robotics · Computer Science 2023-07-11 Zhao Mandi , Shreeya Jain , Shuran Song

The emergence of instruction-tuned large language models (LLMs) has advanced the field of dialogue systems, enabling both realistic user simulations and robust multi-turn conversational agents. However, existing research often evaluates…

Computation and Language · Computer Science 2025-07-22 Chalamalasetti Kranti , Sherzod Hakimov , David Schlangen

LLM-driven dialog systems are used in a diverse set of applications, ranging from healthcare to customer service. However, given their generalization capability, it is difficult to ensure that these chatbots stay within the boundaries of…

Computation and Language · Computer Science 2024-08-06 Stuti Agrawal , Nishi Uppuluri , Pranav Pillai , Revanth Gangi Reddy , Zoey Li , Gokhan Tur , Dilek Hakkani-Tur , Heng Ji

TalkWithMachines aims to enhance human-robot interaction by contributing to interpretable industrial robotic systems, especially for safety-critical applications. The presented paper investigates recent advancements in Large Language Models…

Robotics · Computer Science 2024-12-23 Ammar N. Abbas , Csaba Beleznai

One of the major impediments to the development of new task-oriented dialogue (TOD) systems is the need for human evaluation at multiple stages and iterations of the development process. In an effort to move toward automated evaluation of…

Computation and Language · Computer Science 2023-09-26 Sam Davidson , Salvatore Romeo , Raphael Shu , James Gung , Arshit Gupta , Saab Mansour , Yi Zhang

Large language models (LLMs) have emerged as powerful and general solutions to many natural language tasks. However, many of the most important applications of language generation are interactive, where an agent has to talk to a person to…

Machine Learning · Computer Science 2023-11-10 Joey Hong , Sergey Levine , Anca Dragan

Programming robot behavior in a complex world faces challenges on multiple levels, from dextrous low-level skills to high-level planning and reasoning. Recent pre-trained Large Language Models (LLMs) have shown remarkable reasoning ability…

Robotics · Computer Science 2023-10-12 Xufeng Zhao , Mengdi Li , Cornelius Weber , Muhammad Burhan Hafez , Stefan Wermter

Most dialog systems posit that users have figured out clear and specific goals before starting an interaction. For example, users have determined the departure, the destination, and the travel time for booking a flight. However, in many…

Computation and Language · Computer Science 2022-04-18 Zeming Liu , Jun Xu , Zeyang Lei , Haifeng Wang , Zheng-Yu Niu , Hua Wu

Chatbots via large language models (LLMs) generate fluent responses but often struggle with when to speak, especially for brief, timely listener reactions during ongoing dialogue. We present a multimodal strategy for LLMs, which leverages…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Zikai Liao , Yi Ouyang , Yi-Lun Lee , Chen-Ping Yu , Yi-Hsuan Tsai , Zhaozheng Yin

Dialogue systems, commonly known as chatbots, have gained escalating popularity in recent times due to their wide-spread applications in carrying out chit-chat conversations with users and task-oriented dialogues to accomplish various user…

Computation and Language · Computer Science 2024-06-18 Sahisnu Mazumder , Bing Liu

The article proposes a system for knowledge-based conversation designed for Social Robots and other conversational agents. The proposed system relies on an Ontology for the description of all concepts that may be relevant conversation…

Robotics · Computer Science 2022-08-23 Lucrezia Grassi , Carmine Tommaso Recchiuto , Antonio Sgorbissa

This paper presents the design and evaluation of a novel multi-level LLM interface for supermarket robots to assist customers. The proposed interface allows customers to convey their needs through both generic and specific queries. While…

Robotics · Computer Science 2026-02-17 Chandran Nandkumar , Luka Peternel

In recent years, research in the area of human-robot interaction has focused on developing robots capable of understanding complex human instructions and performing tasks in dynamic and diverse environments. These systems have a wide range…

Robotics · Computer Science 2024-11-25 Simone Colombani , Dimitri Ognibene , Giuseppe Boccignone

Current conversational systems can follow simple commands and answer basic questions, but they have difficulty maintaining coherent and open-ended conversations about specific topics. Competitions like the Conversational Intelligence…

Computation and Language · Computer Science 2018-11-09 Nicolas Gontier , Koustuv Sinha , Peter Henderson , Iulian Serban , Michael Noseworthy , Prasanna Parthasarathi , Joelle Pineau