English
Related papers

Related papers: Modeling Performance in Open-Domain Dialogue with …

200 papers

In this paper, we present a probabilistic framework for goal-driven spoken dialog systems. A new dynamic stochastic state (DS-state) is then defined to characterize the goal set of a dialog state at different stages of the dialog process.…

Artificial Intelligence · Computer Science 2015-04-28 Ji Wu , Miao Li , Chin-Hui Lee

Recent advances in open-domain dialogue systems rely on the success of neural models that are trained on large-scale data. However, collecting large-scale dialogue data is usually time-consuming and labor-intensive. To address this data…

Computation and Language · Computer Science 2020-11-11 Rongsheng Zhang , Yinhe Zheng , Jianzhi Shao , Xiaoxi Mao , Yadong Xi , Minlie Huang

The emergence of pretrained large language models has led to the deployment of a range of social chatbots for chitchat. Although these chatbots demonstrate language ability and fluency, they are not guaranteed to be engaging and can…

Large language models (LLMs) have achieved remarkable breakthroughs in new dialogue capabilities by leveraging instruction tuning, which refreshes human impressions of dialogue systems. The long-standing goal of dialogue systems is to be…

Computation and Language · Computer Science 2024-04-01 Jiao Ou , Junda Lu , Che Liu , Yihong Tang , Fuzheng Zhang , Di Zhang , Kun Gai

We present the first complete spoken dialogue system driven by a multi-dimensional statistical dialogue manager. This framework has been shown to substantially reduce data needs by leveraging domain-independent dimensions, such as social…

Computation and Language · Computer Science 2019-09-09 Simon Keizer , Ondřej Dušek , Xingkun Liu , Verena Rieser

Open-domain dialogue systems have made promising progress in recent years. While the state-of-the-art dialogue agents are built upon large-scale text-based social media data and large pre-trained models, there is no guarantee these agents…

Computation and Language · Computer Science 2023-06-16 Jingsheng Gao , Yixin Lian , Ziyi Zhou , Yuzhuo Fu , Baoyuan Wang

This paper reports experimental results comparing a mixed-initiative to a system-initiative dialog strategy in the context of a personal voice email agent. To independently test the effects of dialog strategy and user expertise, users…

cmp-lg · Computer Science 2008-02-03 Marilyn Walker , Donald Hindle , Jeanne Fromer , Giuseppe Di Fabbrizio , Craig Mestel

Online conversations can go in many directions: some turn out poorly due to antisocial behavior, while others turn out positively to the benefit of all. Research on improving online spaces has focused primarily on detecting and reducing…

Computers and Society · Computer Science 2021-02-17 Jiajun Bao , Junjie Wu , Yiming Zhang , Eshwar Chandrasekharan , David Jurgens

Automatically evaluating text-based, non-task-oriented dialogue systems (i.e., `chatbots') remains an open problem. Previous approaches have suffered challenges ranging from poor correlation with human judgment to poor generalization and…

Computation and Language · Computer Science 2021-04-14 Ian Berlot-Attwell , Frank Rudzicz

Automatic measures of similarity between utterances are invaluable for training speech synthesizers, evaluating machine translation, and assessing learner productions. While there exist measures for semantic similarity and prosodic…

Computation and Language · Computer Science 2024-03-25 Nigel G. Ward , Divette Marco

Spoken dialogue systems allow humans to interact with machines using natural speech. As such, they have many benefits. By using speech as the primary communication medium, a computer interface can facilitate swift, human-like acquisition of…

Computation and Language · Computer Science 2016-09-12 Milica Gasic , Nikola Mrksic , Lina M. Rojas-Barahona , Pei-Hao Su , Stefan Ultes , David Vandyke , Tsung-Hsien Wen , Steve Young

Although human evaluation remains the gold standard for open-domain dialogue evaluation, the growing popularity of automated evaluation using Large Language Models (LLMs) has also extended to dialogue. However, most frameworks leverage…

Computation and Language · Computer Science 2024-10-07 John Mendonça , Isabel Trancoso , Alon Lavie

Dialog response ranking is used to rank response candidates by considering their relation to the dialog history. Although researchers have addressed this concept for open-domain dialogs, little attention has been focused on task-oriented…

Computation and Language · Computer Science 2018-11-29 Junki Ohmura , Maxine Eskenazi

Measuring user satisfaction level is a challenging task, and a critical component in developing large-scale conversational agent systems serving the needs of real users. An widely used approach to tackle this is to collect human annotation…

Recently, large language models (LLMs) like ChatGPT, LLaMA, and Claude have prevailed in countless domains, including legal scenarios. With LLMs' rapid technological progress, the development of prompt engineering (PE) as an interface…

Computation and Language · Computer Science 2024-10-16 Xiao Peng , Liang Chen

Open-ended human learning and information-seeking are increasingly mediated by digital assistants. However, such systems often ignore the user's pre-existing knowledge. Assuming a correlation between engagement and user responses such as…

Computation and Language · Computer Science 2021-02-15 Pedro Rodriguez , Paul Crook , Seungwhan Moon , Zhiguang Wang

We describe a class of tasks called decision-oriented dialogues, in which AI assistants such as large language models (LMs) must collaborate with one or more humans via natural language to help them make complex decisions. We formalize…

Computation and Language · Computer Science 2024-05-07 Jessy Lin , Nicholas Tomlin , Jacob Andreas , Jason Eisner

We explore the task of improving persona consistency of dialogue agents. Recent models tackling consistency often train with additional Natural Language Inference (NLI) labels or attach trained extra modules to the generative agent for…

Computation and Language · Computer Science 2020-10-07 Hyunwoo Kim , Byeongchang Kim , Gunhee Kim

Recent advances in large-scale language modeling and generation have enabled the creation of dialogue agents that exhibit human-like responses in a wide range of conversational scenarios spanning a diverse set of tasks, from general…

Computation and Language · Computer Science 2022-05-12 Abraham Sanders , Tomek Strzalkowski , Mei Si , Albert Chang , Deepanshu Dey , Jonas Braasch , Dakuo Wang

Nowadays, open-domain dialogue models can generate acceptable responses according to the historical context based on the large-scale pre-trained language models. However, they generally concatenate the dialogue history directly as the model…

Computation and Language · Computer Science 2021-06-07 Zekang Li , Jinchao Zhang , Zhengcong Fei , Yang Feng , Jie Zhou