English
Related papers

Related papers: Dialogos: a Robust System for Human-Machine Spoken…

200 papers

Building an open-domain conversational agent is a challenging problem. Current evaluation methods, mostly post-hoc judgments of static conversation, do not capture conversation quality in a realistic interactive context. In this paper, we…

Computation and Language · Computer Science 2019-11-05 Asma Ghandeharioun , Judy Hanwen Shen , Natasha Jaques , Craig Ferguson , Noah Jones , Agata Lapedriza , Rosalind Picard

With the increasing prevalence and diversity of robots interacting in the real world, there is need for flexible, on-the-fly planning and cooperation. Large Language Models are starting to be explored in a multimodal setup for…

Robotics · Computer Science 2024-03-01 William Hunt , Toby Godfrey , Mohammad D. Soorati

To train a statistical spoken dialogue system (SDS) it is essential that an accurate method for measuring task success is available. To date training has relied on presenting a task to either simulated or paid users and inferring the…

Machine Learning · Computer Science 2015-08-17 Pei-Hao Su , David Vandyke , Milica Gasic , Dongho Kim , Nikola Mrksic , Tsung-Hsien Wen , Steve Young

Task-oriented dialogue systems are broadly used in virtual assistants and other automated services, providing interfaces between users and machines to facilitate specific tasks. Nowadays, task-oriented dialogue systems have greatly…

Computation and Language · Computer Science 2024-05-17 Ruolin Su , Biing-Hwang Juang

The use of natural language interfaces in the field of human-computer interaction is undergoing intense study through dedicated scientific and industrial research. The latest contributions in the field, including deep learning approaches…

Computation and Language · Computer Science 2024-02-07 Quim Motger , Xavier Franch , Jordi Marco

In response generation task, proper sentimental expressions can obviously improve the human-like level of the responses. However, for real application in online systems, high QPS (queries per second, an indicator of the flow capacity of…

Computation and Language · Computer Science 2021-03-05 Shuangyong Song , Kexin Wang , Chao Wang , Haiqing Chen , Huan Chen

In today's society, information overload presents challenges in providing optimal recommendations. Consequently, the importance of dialogue systems that can discern and provide the necessary information through dialogue is increasingly…

Robotics · Computer Science 2023-12-22 Hyejin Hong , Hibiki Kawano , Takuto Maekawa , Naoki Yoshimaru , Takamasa Iio , Kenji Hatano

Turn-taking is a crucial aspect of human-robot interaction, directly influencing conversational fluidity and user engagement. While previous research has explored turn-taking models in controlled environments, their robustness in real-world…

Robotics · Computer Science 2025-07-15 Koji Inoue , Yuki Okafuji , Jun Baba , Yoshiki Ohira , Katsuya Hyodo , Tatsuya Kawahara

Data for human-human spoken dialogues for research and development are currently very limited in quantity, variety, and sources; such data are even scarcer in healthcare. In this work, we investigate fast prototyping of a dialogue…

This study focuses on emotion-sensitive spoken dialogue in human-machine speech interaction. With the advancement of Large Language Models (LLMs), dialogue systems can handle multimodal data, including audio. Recent models have enhanced the…

Sound · Computer Science 2024-07-30 Hongfei Xue , Yuhao Liang , Bingshen Mu , Shiliang Zhang , Mengzhe Chen , Qian Chen , Lei Xie

This review gives an extensive overview of evaluation methods for task-oriented dialogue systems, paying special attention to practical applications of dialogue systems, for example for customer service. The review (1) provides an overview…

Computation and Language · Computer Science 2024-04-09 Anouck Braggaar , Christine Liebrecht , Emiel van Miltenburg , Emiel Krahmer

In order to take up the challenge of realising user-adaptive system behaviour, we present an extension for the existing OwlSpeak Dialogue Manager which enables the handling of dynamically created dialogue actions. This leads to an increase…

Human-Computer Interaction · Computer Science 2019-07-02 Juliana Miehle , Louisa Pragst , Wolfgang Minker , Stefan Ultes

Morality in dialogue systems has raised great attention in research recently. A moral dialogue system aligned with users' values could enhance conversation engagement and user connections. In this paper, we propose a framework, MoralDial to…

Computation and Language · Computer Science 2023-05-29 Hao Sun , Zhexin Zhang , Fei Mi , Yasheng Wang , Wei Liu , Jianwei Cui , Bin Wang , Qun Liu , Minlie Huang

In this work, we present a hybrid learning method for training task-oriented dialogue systems through online user interactions. Popular methods for learning task-oriented dialogues include applying reinforcement learning with user feedback…

Computation and Language · Computer Science 2018-04-19 Bing Liu , Gokhan Tur , Dilek Hakkani-Tur , Pararth Shah , Larry Heck

Spoken conversational systems require more than accurate speech generation to have human-like conversations: to feel natural and engaging, they must produce conversational behaviour that adapts dynamically to the context. Current spoken…

Computation and Language · Computer Science 2026-04-16 Maike Züfle , Ondrej Klejch , Nicholas Sanders , Jan Niehues , Alexandra Birch , Tsz Kin Lam

We present a generative dialogue system capable of operating in a full-duplex manner, allowing for seamless interaction. It is based on a large language model (LLM) carefully aligned to be aware of a perception module, a motor function…

Computation and Language · Computer Science 2024-10-30 Peng Wang , Songshuo Lu , Yaohua Tang , Sijie Yan , Wei Xia , Yuanjun Xiong

We have reached a practical and realistic phase in human-support dialogue agents by developing a large language model (LLM). However, when requiring expert knowledge or anticipating the utterance content using the massive size of the…

Human-Computer Interaction · Computer Science 2023-12-22 Naoki Yoshimaru , Motoharu Okuma , Takamasa Iio , Kenji Hatano

Automatic dialogue response evaluator has been proposed as an alternative to automated metrics and human evaluation. However, existing automatic evaluators achieve only moderate correlation with human judgement and they are not robust. In…

Computation and Language · Computer Science 2020-04-27 Tianyu Zhao , Divesh Lala , Tatsuya Kawahara

Large Pre-Trained Language Models have demonstrated state-of-the-art performance in different downstream tasks, including dialogue state tracking and end-to-end response generation. Nevertheless, most of the publicly available datasets and…

Computation and Language · Computer Science 2024-01-05 Seyed Mahed Mousavi , Gabriel Roccabruna , Simone Alghisi , Massimo Rizzoli , Mirco Ravanelli , Giuseppe Riccardi

In recent years, large language models (LLMs) have rapidly proliferated and have been utilized in various tasks, including research in dialogue systems. We aimed to construct a system that not only leverages the flexible conversational…

Computation and Language · Computer Science 2023-12-25 Katsumasa Yoshikawa , Takato Yamazaki , Masaya Ohagi , Tomoya Mizumoto , Keiya Sato