中文
相关论文

相关论文: Multi-domain Conversation Quality Evaluation via U…

200 篇论文

Previous studies showed that replying to a user review usually has a positive effect on the rating that is given by the user to the app. For example, Hassan et al. found that responding to a review increases the chances of a user updating…

软件工程 · 计算机科学 2020-02-11 Cuiyun Gao , Jichuan Zeng , Xin Xia , David Lo , Michael R. Lyu , Irwin King

Conversational search systems, such as Google Assistant and Microsoft Cortana, enable users to interact with search systems in multiple rounds through natural language dialogues. Evaluating such systems is very challenging given that any…

信息检索 · 计算机科学 2021-04-29 Zeyang Liu , Ke Zhou , Max L. Wilson

Automatic open-domain dialogue evaluation is a crucial component of dialogue systems. Recently, learning-based evaluation metrics have achieved state-of-the-art performance in open-domain dialogue evaluation. However, these metrics, which…

计算与语言 · 计算机科学 2022-06-22 Pengfei Zhang , Xiaohui Hu , Kaidong Yu , Jian Wang , Song Han , Cao Liu , Chunyang Yuan

Neural task-oriented dialogue systems often struggle to smoothly interface with a knowledge base. In this work, we seek to address this problem by proposing a new neural dialogue agent that is able to effectively sustain grounded,…

计算与语言 · 计算机科学 2017-07-17 Mihail Eric , Christopher D. Manning

We demonstrate that large language models are able to simulate Task Oriented Dialogues in novel domains, provided only with an API implementation and a list of goals. We show these simulations can formulate online, automatic metrics that…

计算与语言 · 计算机科学 2021-10-14 Moya Chen , Paul A. Crook , Stephen Roller

Prompt-tuning has become an increasingly popular parameter-efficient method for adapting large pretrained language models to downstream tasks. However, both discrete prompting and continuous prompting assume fixed prompts for all data…

计算与语言 · 计算机科学 2023-07-12 Runcheng Liu , Ahmad Rashid , Ivan Kobyzev , Mehdi Rezagholizadeh , Pascal Poupart

Large pre-trained language models have exhibited unprecedented capabilities in producing high-quality text via prompting techniques. This fact introduces new possibilities for data collection and annotation, particularly in situations where…

计算与语言 · 计算机科学 2023-05-25 Tiziano Labruna , Sofia Brenna , Andrea Zaninello , Bernardo Magnini

Most prior work on task-oriented dialogue systems are restricted to limited coverage of domain APIs. However, users oftentimes have requests that are out of the scope of these APIs. This work focuses on responding to these…

计算与语言 · 计算机科学 2021-06-18 Di Jin , Seokhwan Kim , Dilek Hakkani-Tur

Conversational assistants are increasingly popular across diverse real-world applications, highlighting the need for advanced multimodal speech modeling. Speech, as a natural mode of communication, encodes rich user-specific characteristics…

计算与语言 · 计算机科学 2024-12-23 Maximillian Chen , Ruoxi Sun , Sercan Ö. Arık

Empirical research has shown performance improvement of many different technological domains occurs exponentially but with widely varying improvement rates. What causes some technologies to improve faster than others do? Previous…

经济学 · 定量金融 2016-02-24 Subarna Basnet , Christopher L. Magee

Task-oriented dialogue systems in industry settings need to have high conversational capability, be easily adaptable to changing situations and conform to business constraints. This paper describes a 3-step procedure to develop a…

计算与语言 · 计算机科学 2022-10-27 Lahari Poddar , György Szarvas , Cheng Wang , Jorge Balazs , Pavel Danchenko , Patrick Ernst

Evaluating open-domain dialogue systems is difficult due to the diversity of possible correct answers. Automatic metrics such as BLEU correlate weakly with human annotations, resulting in a significant bias across different models and…

计算与语言 · 计算机科学 2020-04-02 Nouha Dziri , Ehsan Kamalloo , Kory W. Mathewson , Osmar Zaiane

Accurate prediction of conversation topics can be a valuable signal for creating coherent and engaging dialog systems. In this work, we focus on context-aware topic classification methods for identifying topics in free-form human-chatbot…

In task-oriented dialogue systems the dialogue state tracker (DST) component is responsible for predicting the state of the dialogue based on the dialogue history. Current DST approaches rely on a predefined domain ontology, a fact that…

计算与语言 · 计算机科学 2020-01-22 Vevake Balaraman , Bernardo Magnini

Machine learning approaches for building task-oriented dialogue systems require large conversational datasets with labels to train on. We are interested in building task-oriented dialogue systems from human-human conversations, which may be…

计算与语言 · 计算机科学 2019-07-09 Shachi Paul , Rahul Goel , Dilek Hakkani-Tür

Target-guided response generation enables dialogue systems to smoothly transition a conversation from a dialogue context toward a target sentence. Such control is useful for designing dialogue systems that direct a conversation toward…

计算与语言 · 计算机科学 2022-05-20 Prakhar Gupta , Harsh Jhamtani , Jeffrey P. Bigham

Building an open-domain conversational agent is a challenging problem. Current evaluation methods, mostly post-hoc judgments of static conversation, do not capture conversation quality in a realistic interactive context. In this paper, we…

To build an open-domain multi-turn conversation system is one of the most interesting and challenging tasks in Artificial Intelligence. Many research efforts have been dedicated to building such dialogue systems, yet few shed light on…

计算与语言 · 计算机科学 2018-11-20 Lili Yao , Ruijian Xu , Chao Li , Dongyan Zhao , Rui Yan

Statistical spoken dialogue systems usually rely on a single- or multi-domain dialogue model that is restricted in its capabilities of modelling complex dialogue structures, e.g., relations. In this work, we propose a novel dialogue model…

While multi-party conversations are often less structured than monologues and documents, they are implicitly organized by semantic level correlations across the interactive turns, and dialogue discourse analysis can be applied to predict…

计算与语言 · 计算机科学 2021-10-12 Zhengyuan Liu , Nancy F. Chen