English
Related papers

Related papers: Automatic Evaluation and Moderation of Open-domain…

200 papers

Maintaining persona consistency is paramount in the application of open-domain dialogue systems, as exemplified by models like ChatGPT. Despite significant advancements, the limited scale and diversity of current persona dialogue datasets…

Computation and Language · Computer Science 2025-02-20 Mengze Hong , Chen Jason Zhang , Chaotao Chen , Rongzhong Lian , Di Jiang

This paper describes our submission for the End-to-end Multi-domain Task Completion Dialog shared task at the 9th Dialog System Technology Challenge (DSTC-9). Participants in the shared task build an end-to-end task completion dialog system…

Computation and Language · Computer Science 2021-02-10 Boliang Zhang , Ying Lyu , Ning Ding , Tianhao Shen , Zhaoyang Jia , Kun Han , Kevin Knight

Dialogue systems are a popular natural language processing (NLP) task as it is promising in real-life applications. It is also a complicated task since many NLP tasks deserving study are involved. As a result, a multitude of novel works on…

Computation and Language · Computer Science 2022-03-31 Jinjie Ni , Tom Young , Vlad Pandelea , Fuzhao Xue , Erik Cambria

The use of dialogue systems as a medium for human-machine interaction is an increasingly prevalent paradigm. A growing number of dialogue systems use conversation strategies that are learned from large datasets. There are well documented…

Computation and Language · Computer Science 2017-11-27 Peter Henderson , Koustuv Sinha , Nicolas Angelard-Gontier , Nan Rosemary Ke , Genevieve Fried , Ryan Lowe , Joelle Pineau

Automatically evaluating text-based, non-task-oriented dialogue systems (i.e., `chatbots') remains an open problem. Previous approaches have suffered challenges ranging from poor correlation with human judgment to poor generalization and…

Computation and Language · Computer Science 2021-04-14 Ian Berlot-Attwell , Frank Rudzicz

This review gives an extensive overview of evaluation methods for task-oriented dialogue systems, paying special attention to practical applications of dialogue systems, for example for customer service. The review (1) provides an overview…

Computation and Language · Computer Science 2024-04-09 Anouck Braggaar , Christine Liebrecht , Emiel van Miltenburg , Emiel Krahmer

Companies are dealing with many cognitive changes with the introduction of the Industry 4.0 paradigm. In this constantly changing environment, knowledge management is a key factor. Dialog systems, being able to hold a conversation with…

Human-Computer Interaction · Computer Science 2020-05-15 Elena Coli , Nicola Melluso , Gualtiero Fantoni , Daniele Mazzei

Although there have been remarkable advances in dialogue systems through the dialogue systems technology competition (DSTC), it remains one of the key challenges to building a robust task-oriented dialogue system with a speech interface.…

Computation and Language · Computer Science 2024-01-10 Jaeseok Yoon , Seunghyun Hwang , Ran Han , Jeonguk Bang , Kee-Eung Kim

Task-oriented dialogue systems have been plagued by the difficulties of obtaining large-scale and high-quality annotated conversations. Furthermore, most of the publicly available datasets only include written conversations, which are…

Computation and Language · Computer Science 2021-12-24 Xin Tian , Xinxian Huang , Dongfeng He , Yingzhan Lin , Siqi Bao , Huang He , Liankai Huang , Qiang Ju , Xiyuan Zhang , Jian Xie , Shuqi Sun , Fan Wang , Hua Wu , Haifeng Wang

Dialogue system (DS) attracts great attention from industry and academia because of its wide application prospects. Researchers usually divide the DS according to the function. However, many conversations require the DS to switch between…

Computation and Language · Computer Science 2020-04-30 Longxuan Ma , Wei-Nan Zhang , Mingda Li , Ting Liu

Stylistic variation is critical to render the utterances generated by conversational agents natural and engaging. In this paper, we focus on sequence-to-sequence models for open-domain dialogue response generation and propose a new method…

Computation and Language · Computer Science 2018-10-02 Yujie Xing , Raquel Fernández

The use of chatbots has spread, generating great interest in the industry for the possibility of automating tasks within the execution of their processes. The implementation of chatbots, however simple, is a complex endeavor that involves…

Software Engineering · Computer Science 2021-09-03 Bedilia Estrada-Torres , Adela del-Río-Ortega , Manuel Resinas

We describe a class of tasks called decision-oriented dialogues, in which AI assistants such as large language models (LMs) must collaborate with one or more humans via natural language to help them make complex decisions. We formalize…

Computation and Language · Computer Science 2024-05-07 Jessy Lin , Nicholas Tomlin , Jacob Andreas , Jason Eisner

Clarifying user needs is essential for existing task-oriented dialogue systems. However, in real-world applications, developers can never guarantee that all possible user demands are taken into account in the design phase. Consequently,…

Computation and Language · Computer Science 2019-06-13 Weikang Wang , Jiajun Zhang , Qian Li , Mei-Yuh Hwang , Chengqing Zong , Zhifei Li

Studies have shown that toxic behavior can cause contributors to leave, and hinder newcomers' (especially from underrepresented communities) participation in Open Source Software (OSS) projects. Thus, detection of toxic language plays a…

Software Engineering · Computer Science 2025-01-28 Ramtin Ehsani , Rezvaneh Rezapour , Preetha Chatterjee

Open-domain conversation models have become good at generating natural-sounding dialogue, using very large architectures with billions of trainable parameters. The vast training data required to train these architectures aggregates many…

Computation and Language · Computer Science 2020-09-24 Eric Michael Smith , Diana Gonzalez-Rico , Emily Dinan , Y-Lan Boureau

Despite significant research effort in the development of automatic dialogue evaluation metrics, little thought is given to evaluating dialogues other than in English. At the same time, ensuring metrics are invariant to semantically similar…

Computation and Language · Computer Science 2023-09-11 John Mendonça , Patrícia Pereira , Helena Moniz , João Paulo Carvalho , Alon Lavie , Isabel Trancoso

Dialog act prediction is an essential language comprehension task for both dialog system building and discourse analysis. Previous dialog act schemes, such as SWBD-DAMSL, are designed for human-human conversations, in which conversation…

Computation and Language · Computer Science 2019-08-28 Dian Yu , Zhou Yu

Dialog management (DM) is a crucial component in a task-oriented dialog system. Given the dialog history, DM predicts the dialog state and decides the next action that the dialog agent should take. Recently, dialog policy learning has been…

Computation and Language · Computer Science 2021-10-26 Yinpei Dai , Huihua Yu , Yixuan Jiang , Chengguang Tang , Yongbin Li , Jian Sun

Spoken dialogue generation is crucial for applications like podcasts, dynamic commentary, and entertainment content, but poses significant challenges compared to single-utterance text-to-speech (TTS). Key requirements include accurate…