English
Related papers

Related papers: SCOUT: A Situated and Multi-Modal Human-Robot Dial…

200 papers

Knowledge graphs are often used to represent structured information in a flexible and efficient manner, but their use in situated dialogue remains under-explored. This paper presents a novel conversational model for human--robot interaction…

Robotics · Computer Science 2025-04-02 Nicholas Thomas Walker , Stefan Ultes , Pierre Lison

We describe the adaptation and refinement of a graphical user interface designed to facilitate a Wizard-of-Oz (WoZ) approach to collecting human-robot dialogue data. The data collected will be used to develop a dialogue system for robot…

Even though machine learning has become the major scene in dialogue research community, the real breakthrough has been blocked by the scale of data available. To address this fundamental obstacle, we introduce the Multi-Domain Wizard-of-Oz…

Computation and Language · Computer Science 2020-04-21 Paweł Budzianowski , Tsung-Hsien Wen , Bo-Hsiang Tseng , Iñigo Casanueva , Stefan Ultes , Osman Ramadan , Milica Gašić

People spend a substantial portion of their lives engaged in conversation, and yet our scientific understanding of conversation is still in its infancy. In this report we advance an interdisciplinary science of conversation, with findings…

Computation and Language · Computer Science 2022-03-02 Andrew Reece , Gus Cooney , Peter Bull , Christine Chung , Bryn Dawson , Casey Fitzpatrick , Tamara Glazer , Dean Knox , Alex Liebscher , Sebastian Marin

Multimodal machine translation and textual chat translation have received considerable attention in recent years. Although the conversation in its natural form is usually multimodal, there still lacks work on multimodal machine translation…

Computation and Language · Computer Science 2022-03-01 Yunlong Liang , Fandong Meng , Jinan Xu , Yufeng Chen , Jie Zhou

This paper introduces the SAMSum Corpus, a new dataset with abstractive dialogue summaries. We investigate the challenges it poses for automated summarization by testing several models and comparing their results with those obtained on a…

Computation and Language · Computer Science 2019-12-02 Bogdan Gliwa , Iwona Mochol , Maciej Biesek , Aleksander Wawer

Our overall program objective is to provide more natural ways for soldiers to interact and communicate with robots, much like how soldiers communicate with other soldiers today. We describe how the Wizard-of-Oz (WOz) method can be applied…

Computation and Language · Computer Science 2017-03-13 Matthew Marge , Claire Bonial , Brendan Byrne , Taylor Cassidy , A. William Evans , Susan G. Hill , Clare Voss

Most research on task oriented dialog modeling is based on written text input. However, users interact with practical dialog systems often using speech as input. Typically, systems convert speech into text using an Automatic Speech…

Artificial Intelligence · Computer Science 2022-12-20 Hagen Soltau , Izhak Shafran , Mingqiu Wang , Abhinav Rastogi , Jeffrey Zhao , Ye Jia , Wei Han , Yuan Cao , Aramys Miranda

This article presents the design and the implementation of a cloud system for knowledge-based autonomous interaction devised for Social Robots and other conversational agents. The system is particularly convenient for low-cost robots and…

Robotics · Computer Science 2023-03-17 Lucrezia Grassi , Carmine Tommaso Recchiuto , Antonio Sgorbissa

In order to alleviate the shortage of multi-domain data and to capture discourse phenomena for task-oriented dialogue modeling, we propose RiSAWOZ, a large-scale multi-domain Chinese Wizard-of-Oz dataset with Rich Semantic Annotations.…

Computation and Language · Computer Science 2020-10-20 Jun Quan , Shian Zhang , Qian Cao , Zizhong Li , Deyi Xiong

A slot value might be provided segment by segment over multiple-turn interactions in a dialog, especially for some important information such as phone numbers and names. It is a common phenomenon in daily life, but little attention has been…

Computation and Language · Computer Science 2023-09-26 Sai Zhang , Yuwei Hu , Yuchuan Wu , Jiaman Wu , Yongbin Li , Jian Sun , Caixia Yuan , Xiaojie Wang

Transitioning between topics is a natural component of human-human dialog. Although topic transition has been studied in dialogue for decades, only a handful of corpora based studies have been performed to investigate the subtleties of…

Computation and Language · Computer Science 2022-07-21 Mayank Soni , Brendan Spillane , Emer Gilmartin , Christian Saam , Benjamin R. Cowan , Vincent Wade

The utility of collocating robots largely depends on the easy and intuitive interaction mechanism with the human. If a robot accepts task instruction in natural language, first, it has to understand the user's intention by decoding the…

Robotics · Computer Science 2022-06-23 Pradip Pramanick , Chayan Sarkar , Snehasis Banerjee , Brojeshwar Bhowmick

Discourse parsing is an important task useful for NLU applications such as summarization, machine comprehension, and emotion recognition. The current discourse parsing datasets based on conversations consists of written English dialogues…

Computation and Language · Computer Science 2025-06-11 Divyaksh Shukla , Ritesh Baviskar , Dwijesh Gohil , Aniket Tiwari , Atul Shree , Ashutosh Modi

Agile methodologies have become increasingly popular in recent years. Due to its inherent nature, agile methodologies involve stakeholders with a wide range of expertise and require interaction between them, relying on collaboration and…

Software Engineering · Computer Science 2023-01-25 Salih Göktuğ Köse , Fatma Başak Aydemir

Recent advances in multimodal Human-Robot Interaction (HRI) datasets emphasize the integration of speech and gestures, allowing robots to absorb explicit knowledge and tacit understanding. However, existing datasets primarily focus on…

Robotics · Computer Science 2025-02-25 Snehesh Shrestha , Yantian Zha , Saketh Banagiri , Ge Gao , Yiannis Aloimonos , Cornelia Fermüller

We introduce Vocal Sandbox, a framework for enabling seamless human-robot collaboration in situated environments. Systems in our framework are characterized by their ability to adapt and continually learn at multiple levels of abstraction…

Robotics · Computer Science 2024-11-06 Jennifer Grannen , Siddharth Karamcheti , Suvir Mirchandani , Percy Liang , Dorsa Sadigh

We present Sense Clustering over Time (SCoT), a novel network-based tool for analysing lexical change. SCoT represents the meanings of a word as clusters of similar words. It visualises their formation, change, and demise. There are two…

Computation and Language · Computer Science 2022-03-21 Christian Haase , Saba Anwar , Seid Muhie Yimam , Alexander Friedrich , Chris Biemann

This paper introduces the Ubuntu Dialogue Corpus, a dataset containing almost 1 million multi-turn dialogues, with a total of over 7 million utterances and 100 million words. This provides a unique resource for research into building…

Computation and Language · Computer Science 2016-07-26 Ryan Lowe , Nissan Pow , Iulian Serban , Joelle Pineau

Autonomous vehicles navigate in dynamically changing environments under a wide variety of conditions, being continuously influenced by surrounding objects. Modelling interactions among agents is essential for accurately forecasting other…

Machine Learning · Computer Science 2021-06-01 Sandra Carrasco , David Fernández Llorca , Miguel Ángel Sotelo