English
Related papers

Related papers: Pre-Trained and Attention-Based Neural Networks fo…

200 papers

This paper presents a novel approach for multi-task learning of language understanding (LU) and dialogue state tracking (DST) in task-oriented dialogue systems. Multi-task training enables the sharing of the neural network layers…

Computation and Language · Computer Science 2018-11-14 Abhinav Rastogi , Raghav Gupta , Dilek Hakkani-Tur

Task-oriented dialogue systems aim at providing users with task-specific services. Users of such systems often do not know all the information about the task they are trying to accomplish, requiring them to seek information about the task.…

Computation and Language · Computer Science 2023-05-24 Yue Feng , Hossein A. Rahmani , Aldo Lipani , Emine Yilmaz

Non-task oriented dialogue systems have achieved great success in recent years due to largely accessible conversation data and the development of deep learning techniques. Given a context, current systems are able to yield a relevant and…

Computation and Language · Computer Science 2020-04-10 Leyang Cui , Yu Wu , Shujie Liu , Yue Zhang , Ming Zhou

The underlying difference of linguistic patterns between general text and task-oriented dialogue makes existing pre-trained language models less useful in practice. In this work, we unify nine human-human and multi-turn task-oriented…

Computation and Language · Computer Science 2020-10-02 Chien-Sheng Wu , Steven Hoi , Richard Socher , Caiming Xiong

The growing number of generative AI-based dialogue systems has made their evaluation a crucial challenge. This paper presents our contribution to this important problem through the Dialogue System Technology Challenge (DSTC-12, Track 1),…

In this work, we explore the application of PLATO-2 on various dialogue systems, including open-domain conversation, knowledge grounded dialogue, and task-oriented conversation. PLATO-2 is initially designed as an open-domain chatbot,…

Computation and Language · Computer Science 2021-05-28 Siqi Bao , Bingjin Chen , Huang He , Xin Tian , Han Zhou , Fan Wang , Hua Wu , Haifeng Wang , Wenquan Wu , Yingzhan Lin

We study multi-turn response generation for open-domain dialogues. The existing state-of-the-art addresses the problem with deep neural architectures. While these models improved response quality, their complexity also hinders the…

Computation and Language · Computer Science 2020-11-10 Yufan Zhao , Can Xu , Wei Wu , Lei Yu

This paper presents an ontology-aware pretrained language model (OPAL) for end-to-end task-oriented dialogue (TOD). Unlike chit-chat dialogue models, task-oriented dialogue models fulfill at least two task-specific modules: dialogue state…

Computation and Language · Computer Science 2022-09-13 Zhi Chen , Yuncong Liu , Lu Chen , Su Zhu , Mengyue Wu , Kai Yu

Task 1 of the DSTC8-track1 challenge aims to develop an end-to-end multi-domain dialogue system to accomplish complex users' goals under tourist information desk settings. This paper describes our submitted solution, Hierarchical Context…

Artificial Intelligence · Computer Science 2020-03-04 Jingyuan Yang , Guang Liu , Yuzhao Mao , Zhiwei Zhao , Weiguo Gao , Xuan Li , Haiqin Yang , Jianping Shen

Multi-turn dialogue reading comprehension aims to teach machines to read dialogue contexts and solve tasks such as response selection and answering questions. The major challenges involve noisy history contexts and especial prerequisites of…

Computation and Language · Computer Science 2021-02-11 Zhuosheng Zhang , Junlong Li , Hai Zhao

The ultimate goal of dialog research is to develop systems that can be effectively used in interactive settings by real users. To this end, we introduced the Interactive Evaluation of Dialog Track at the 9th Dialog System Technology…

Computation and Language · Computer Science 2022-08-01 Shikib Mehri , Yulan Feng , Carla Gordon , Seyed Hossein Alavi , David Traum , Maxine Eskenazi

Task-oriented conversational modeling with unstructured knowledge access, as track 1 of the 9th Dialogue System Technology Challenges (DSTC 9), requests to build a system to generate response given dialogue history and knowledge access.…

Computation and Language · Computer Science 2020-12-23 Chao-Hong Tan , Xiaoyu Yang , Zi'ou Zheng , Tianda Li , Yufei Feng , Jia-Chen Gu , Quan Liu , Dan Liu , Zhen-Hua Ling , Xiaodan Zhu

Neural Chat Translation (NCT) aims to translate conversational text into different languages. Existing methods mainly focus on modeling the bilingual dialogue characteristics (e.g., coherence) to improve chat translation via multi-task…

Computation and Language · Computer Science 2022-05-11 Yunlong Liang , Fandong Meng , Jinan Xu , Yufeng Chen , Jie Zhou

Task-oriented dialogue systems have been plagued by the difficulties of obtaining large-scale and high-quality annotated conversations. Furthermore, most of the publicly available datasets only include written conversations, which are…

Computation and Language · Computer Science 2021-12-24 Xin Tian , Xinxian Huang , Dongfeng He , Yingzhan Lin , Siqi Bao , Huang He , Liankai Huang , Qiang Ju , Xiyuan Zhang , Jian Xie , Shuqi Sun , Fan Wang , Hua Wu , Haifeng Wang

Task-oriented dialogue systems help users accomplish tasks such as booking a movie ticket and ordering food via conversation. Generative models parameterized by a deep neural network are widely used for next turn response generation in such…

Computation and Language · Computer Science 2020-10-13 Prasanna Parthasarathi , Arvind Neelakantan , Sharan Narang

Pre-trained language models have been successful in many scenarios. However, their usefulness in task-oriented dialogues is limited due to the intrinsic linguistic differences between general text and task-oriented dialogues. Current…

Computation and Language · Computer Science 2024-03-05 Weihao Zeng , Keqing He , Yejie Wang , Dayuan Fu , Weiran Xu

This paper gives an overview of the Schema-Guided Dialogue State Tracking task of the 8th Dialogue System Technology Challenge. The goal of this task is to develop dialogue state tracking models suitable for large-scale virtual assistants,…

Computation and Language · Computer Science 2020-02-05 Abhinav Rastogi , Xiaoxue Zang , Srinivas Sunkara , Raghav Gupta , Pranav Khaitan

Loading models pre-trained on the large-scale corpus in the general domain and fine-tuning them on specific downstream tasks is gradually becoming a paradigm in Natural Language Processing. Previous investigations prove that introducing a…

Computation and Language · Computer Science 2021-09-15 Yao Qiu , Jinchao Zhang , Jie Zhou

Tracking the state of the conversation is a central component in task-oriented spoken dialogue systems. One such approach for tracking the dialogue state is slot carryover, where a model makes a binary decision if a slot from the context is…

Computation and Language · Computer Science 2019-06-05 Tongfei Chen , Chetan Naik , Hua He , Pushpendre Rastogi , Lambert Mathias

Building an intelligent dialogue system with the ability to select a proper response according to a multi-turn context is a great challenging task. Existing studies focus on building a context-response matching model with various neural…

Computation and Language · Computer Science 2020-09-15 Ruijian Xu , Chongyang Tao , Daxin Jiang , Xueliang Zhao , Dongyan Zhao , Rui Yan