English
Related papers

Related papers: PARADISE: A Framework for Evaluating Spoken Dialog…

200 papers

There has recently been an explosion of work on spoken dialogue systems, along with an increased interest in open-domain systems that engage in casual conversations on popular topics such as movies, books and music. These systems aim to…

Computation and Language · Computer Science 2021-10-22 Marilyn Walker , Colin Harmon , James Graupera , Davan Harrison , Steve Whittaker

This paper reports experimental results comparing a mixed-initiative to a system-initiative dialog strategy in the context of a personal voice email agent. To independently test the effects of dialog strategy and user expertise, users…

cmp-lg · Computer Science 2008-02-03 Marilyn Walker , Donald Hindle , Jeanne Fromer , Giuseppe Di Fabbrizio , Craig Mestel

Recently, there has been growing interest within the community regarding whether large language models are capable of planning or executing plans. However, most prior studies use LLMs to generate high-level plans for simplified scenarios…

Computation and Language · Computer Science 2024-06-07 Arda Uzunoglu , Abdalfatah Rashid Safa , Gözde Gül Şahin

Recent advances in large-scale language modeling and generation have enabled the creation of dialogue agents that exhibit human-like responses in a wide range of conversational scenarios spanning a diverse set of tasks, from general…

Computation and Language · Computer Science 2022-05-12 Abraham Sanders , Tomek Strzalkowski , Mei Si , Albert Chang , Deepanshu Dey , Jonas Braasch , Dakuo Wang

In this paper we survey the methods and concepts developed for the evaluation of dialogue systems. Evaluation is a crucial part during the development process. Often, dialogue systems are evaluated by means of human evaluations and…

Computation and Language · Computer Science 2020-06-29 Jan Deriu , Alvaro Rodrigo , Arantxa Otegi , Guillermo Echegoyen , Sophie Rosset , Eneko Agirre , Mark Cieliebak

As conversational AI-based dialogue management has increasingly become a trending topic, the need for a standardized and reliable evaluation procedure grows even more pressing. The current state of affairs suggests various evaluation…

Computation and Language · Computer Science 2020-06-12 Sarah E. Finch , Jinho D. Choi

For task-oriented dialog systems to be maximally useful, it must be able to process conversations in a way that is (1) generalizable with a small number of training examples for new task domains, and (2) robust to user input in various…

Computation and Language · Computer Science 2021-01-01 Baolin Peng , Chunyuan Li , Zhu Zhang , Chenguang Zhu , Jinchao Li , Jianfeng Gao

This paper describes a novel method by which a spoken dialogue system can learn to choose an optimal dialogue strategy from its experience interacting with human users. The method is based on a combination of reinforcement learning and…

Artificial Intelligence · Computer Science 2011-06-02 M. A. Walker

Morality in dialogue systems has raised great attention in research recently. A moral dialogue system aligned with users' values could enhance conversation engagement and user connections. In this paper, we propose a framework, MoralDial to…

Computation and Language · Computer Science 2023-05-29 Hao Sun , Zhexin Zhang , Fei Mi , Yasheng Wang , Wei Liu , Jianwei Cui , Bin Wang , Qun Liu , Minlie Huang

We present a novel framework designed to extend model reconciliation approaches, commonly used in human-aware planning, for enhanced human-AI interaction. By adopting a structured argumentation-based dialogue paradigm, our framework enables…

Artificial Intelligence · Computer Science 2024-08-09 Stylianos Loukas Vasileiou , Ashwin Kumar , William Yeoh , Tran Cao Son , Francesca Toni

Evaluating the quality of a dialogue system is an understudied problem. The recent evolution of evaluation method motivated this survey, in which an explicit and comprehensive analysis of the existing methods is sought. We are first to…

Computation and Language · Computer Science 2021-08-04 Xinmeng Li , Wansen Wu , Long Qin , Quanjun Yin

Sharing ideas through communication with peers is the primary mode of human interaction. Consequently, extensive research has been conducted in the area of conversational AI, leading to an increase in the availability and diversity of…

Computation and Language · Computer Science 2024-05-24 Shivani Kumar , Sumit Bhatia , Milan Aggarwal , Tanmoy Chakraborty

An important aspect of developing dialogue systems is how to evaluate and compare the performance of different systems. Existing automatic evaluation metrics are based on turn-level quality evaluation and use average scores for system-level…

Computation and Language · Computer Science 2021-05-28 Jiannan Xiang , Yahui Liu , Deng Cai , Huayang Li , Defu Lian , Lemao Liu

Conversational agents are exploding in popularity. However, much work remains in the area of non goal-oriented conversations, despite significant growth in research interest over recent years. To advance the state of the art in…

A Dialogue System is a system which interacts with human in natural language. At present many universities are developing the dialogue system in their regional language. This paper will discuss about dialogue system, its components,…

Computation and Language · Computer Science 2013-06-19 Suket Arora , Kamaljeet Batra , Sarabjit Singh

This paper presents Dialogos, a real-time system for human-machine spoken dialogue on the telephone in task-oriented domains. The system has been tested in a large trial with inexperienced users and it has proved robust enough to allow…

Visually-grounded dialog systems, which integrate multiple modes of communication such as text and visual inputs, have become an increasingly popular area of investigation. However, the absence of a standardized evaluation framework poses a…

Computation and Language · Computer Science 2023-09-15 Yunshui Li , Binyuan Hui , Zhaochao Yin , Wanwei He , Run Luo , Yuxing Long , Min Yang , Fei Huang , Yongbin Li

Our goal in this paper is to establish a means for a dialogue platform to be able to cope with open domains considering the possible interaction between the embodied agent and humans. To this end we present an algorithm capable of…

Computation and Language · Computer Science 2012-07-19 Artur Ventura , Nuno Diegues , David Martins de Matos

How to build and use dialogue data efficiently, and how to deploy models in different domains at scale can be two critical issues in building a task-oriented dialogue system. In this paper, we propose a novel manual-guided dialogue scheme…

Computation and Language · Computer Science 2022-08-17 Ryuichi Takanobu , Hao Zhou , Yankai Lin , Peng Li , Jie Zhou , Minlie Huang

On-the-job learning consists in continuously learning while being used in production, in an open environment, meaning that the system has to deal on its own with situations and elements never seen before. The kind of systems that seem to be…

Computation and Language · Computer Science 2021-03-01 Mathilde Veron , Sophie Rosset , Olivier Galibert , Guillaume Bernard
‹ Prev 1 2 3 10 Next ›