English
Related papers

Related papers: Improving Automated Evaluation of Open Domain Dial…

200 papers

Human dialogues are scenario-based and appropriate responses generally relate to the latent context knowledge entailed by the specific scenario. To enable responses that are more meaningful and context-specific, we propose to improve…

Computation and Language · Computer Science 2020-10-07 Shaoxiong Feng , Xuancheng Ren , Hongshen Chen , Bin Sun , Kan Li , Xu Sun

This paper presents a dataset collected from natural dialogs which enables to test the ability of dialog systems to learn new facts from user utterances throughout the dialog. This interactive learning will help with one of the most…

Computation and Language · Computer Science 2016-05-17 Miroslav Vodolán , Filip Jurčíček

Open-domain dialogue systems aim to converse with humans through text, and dialogue research has heavily relied on benchmark datasets. In this work, we observe the overlapping problem in DailyDialog and OpenSubtitles, two popular…

Computation and Language · Computer Science 2022-05-10 Yuqiao Wen , Guoqing Luo , Lili Mou

Conversational Tree Search (V\"ath et al., 2023) is a recent approach to controllable dialog systems, where domain experts shape the behavior of a Reinforcement Learning agent through a dialog tree. The agent learns to efficiently navigate…

Computation and Language · Computer Science 2024-03-27 Dirk Väth , Lindsey Vanderlyn , Ngoc Thang Vu

Building dialogue systems requires a large corpus of annotated dialogues. Such datasets are usually created via crowdsourcing, which is expensive and time-consuming. In this paper, we propose \textsc{Dialogic}, a novel dialogue simulation…

Computation and Language · Computer Science 2023-06-07 Zekun Li , Wenhu Chen , Shiyang Li , Hong Wang , Jing Qian , Xifeng Yan

In cognitive science and linguistic theory, dialogue is not seen as a chain of independent utterances but rather as a joint activity sustained by coherence, consistency, and shared understanding. However, many systems for open-domain and…

Computation and Language · Computer Science 2026-03-24 Tianyi Zhang , David Traum

Automatic evaluation is beneficial for open-domain dialog system development. However, standard word-overlap metrics (BLEU, ROUGE) do not correlate well with human judgements of open-domain dialog systems. In this work we propose to use the…

Computation and Language · Computer Science 2022-02-18 Sarik Ghazarian , Behnam Hedayatnia , Alexandros Papangelis , Yang Liu , Dilek Hakkani-Tur

Crowdsourced dialogue corpora are usually limited in scale and topic coverage due to the expensive cost of data curation. This would hinder the generalization of downstream dialogue models to open-domain topics. In this work, we leverage…

Computation and Language · Computer Science 2023-05-19 Chujie Zheng , Sahand Sabour , Jiaxin Wen , Zheng Zhang , Minlie Huang

Goal-oriented dialog systems enable users to complete specific goals like requesting information about a movie or booking a ticket. Typically the dialog system pipeline contains multiple ML models, including natural language understanding,…

Advancements in conversational systems have revolutionized information access, surpassing the limitations of single queries. However, developing dialogue systems requires a large amount of training data, which is a challenge in low-resource…

Computation and Language · Computer Science 2024-03-05 Heydar Soudani , Evangelos Kanoulas , Faegheh Hasibi

This paper provides preliminary results on exploring the task of performing turn-level data augmentation for dialogue system based on different types of commonsense relationships, and the automatic evaluation of the generated synthetic…

Computation and Language · Computer Science 2025-06-25 Marcos Estecha-Garitagoitia , Chen Zhang , Mario Rodríguez-Cantelar , Luis Fernando D'Haro

Some robots can interact with humans using natural language, and identify service requests through human-robot dialog. However, few robots are able to improve their language capabilities from this experience. In this paper, we develop a…

Robotics · Computer Science 2019-11-14 Saeid Amiri , Sujay Bajracharya , Cihangir Goktolga , Jesse Thomason , Shiqi Zhang

Response generation is one of the critical components in task-oriented dialog systems. Existing studies have shown that large pre-trained language models can be adapted to this task. The typical paradigm of adapting such extremely large…

Computation and Language · Computer Science 2023-02-14 Sandesh Swamy , Narges Tabari , Chacha Chen , Rashmi Gangadharaiah

Collecting human judgements is currently the most reliable evaluation method for natural language generation systems. Automatic metrics have reported flaws when applied to measure quality aspects of generated text and have been shown to…

Computation and Language · Computer Science 2022-04-29 Thórhildur Thorleiksdóttir , Cedric Renggli , Nora Hollenstein , Ce Zhang

There is growing interest in the automated extraction of relevant information from clinical dialogues. However, it is difficult to collect and construct large annotated resources for clinical dialogue tasks. Recent developments in natural…

Computation and Language · Computer Science 2022-06-07 Zhengyuan Liu , Pavitra Krishnaswamy , Nancy F. Chen

Existing open-domain dialog models are generally trained to minimize the perplexity of target human responses. However, some human replies are more engaging than others, spawning more followup interactions. Current conversational models are…

Computation and Language · Computer Science 2020-09-16 Xiang Gao , Yizhe Zhang , Michel Galley , Chris Brockett , Bill Dolan

We present Contextual Query Rewrite (CQR) a dataset for multi-domain task-oriented spoken dialogue systems that is an extension of the Stanford dialog corpus (Eric et al., 2017a). While previous approaches have addressed the issue of…

Computation and Language · Computer Science 2019-04-02 Michael Regan , Pushpendre Rastogi , Arpit Gupta , Lambert Mathias

In this study, we tackle the challenge of inadequate and costly training data that has hindered the development of conversational question answering (ConvQA) systems. Enterprises have a large corpus of diverse internal documents. Instead of…

Computation and Language · Computer Science 2024-06-07 Fanyou Wu , Weijie Xu , Chandan K. Reddy , Srinivasan H. Sengamedu

The development of Open-Domain Dialogue Systems (ODS)is a trending topic due to the large number of research challenges, large societal and business impact, and advances in the underlying technology. However, the development of these kinds…

Computation and Language · Computer Science 2021-12-28 Chen Zhang , João Sedoc , Luis Fernando D'Haro , Rafael Banchs , Alexander Rudnicky

Automatic data augmentation (AutoAugment) (Cubuk et al., 2019) searches for optimal perturbation policies via a controller trained using performance rewards of a sampled policy on the target task, hence reducing data-level model bias. While…

Computation and Language · Computer Science 2019-10-01 Tong Niu , Mohit Bansal