English
Related papers

Related papers: End to End Dialogue Transformer

200 papers

One of the major drawbacks of modularized task-completion dialogue systems is that each module is trained individually, which presents several challenges. For example, downstream modules are affected by earlier modules, and the performance…

Computation and Language · Computer Science 2018-02-13 Xiujun Li , Yun-Nung Chen , Lihong Li , Jianfeng Gao , Asli Celikyilmaz

Much of human dialogue occurs in semi-cooperative settings, where agents with different goals attempt to agree on common decisions. Negotiations require complex communication and reasoning skills, but success is easy to measure, making this…

Artificial Intelligence · Computer Science 2017-06-19 Mike Lewis , Denis Yarats , Yann N. Dauphin , Devi Parikh , Dhruv Batra

We propose a new end-to-end neural diarization (EEND) system that is based on Conformer, a recently proposed neural architecture that combines convolutional mappings and Transformer to model both local and global dependencies in speech. We…

Computation and Language · Computer Science 2022-02-22 Yi Chieh Liu , Eunjung Han , Chul Lee , Andreas Stolcke

Teaching machines to accomplish tasks by conversing naturally with humans is challenging. Currently, developing task-oriented dialogue systems requires creating multiple components and typically this involves either a large amount of…

Computation and Language · Computer Science 2017-04-25 Tsung-Hsien Wen , David Vandyke , Nikola Mrksic , Milica Gasic , Lina M. Rojas-Barahona , Pei-Hao Su , Stefan Ultes , Steve Young

In this work, we propose contextual language models that incorporate dialog level discourse information into language modeling. Previous works on contextual language model treat preceding utterances as a sequence of inputs, without…

Computation and Language · Computer Science 2017-01-17 Bing Liu , Ian Lane

Sequence-to-Sequence Text-to-Speech architectures that directly generate low level acoustic features from phonetic sequences are known to produce natural and expressive speech when provided with adequate amounts of training data. Such…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-26 Raul Fernandez , David Haws , Guy Lorberbom , Slava Shechtman , Alexander Sorin

Classic pipeline models for task-oriented dialogue system require explicit modeling the dialogue states and hand-crafted action spaces to query a domain-specific knowledge base. Conversely, sequence-to-sequence models learn to map dialogue…

Computation and Language · Computer Science 2018-06-13 Haoyang Wen , Yijia Liu , Wanxiang Che , Libo Qin , Ting Liu

Task-oriented dialogue systems help users accomplish tasks such as booking a movie ticket and ordering food via conversation. Generative models parameterized by a deep neural network are widely used for next turn response generation in such…

Computation and Language · Computer Science 2020-10-13 Prasanna Parthasarathi , Arvind Neelakantan , Sharan Narang

Researchers have recently started investigating deep neural networks for dialogue applications. In particular, generative sequence-to-sequence (Seq2Seq) models have shown promising results for unstructured tasks, such as word-level dialogue…

Computation and Language · Computer Science 2016-11-21 Iulian Vlad Serban , Ryan Lowe , Laurent Charlin , Joelle Pineau

While end-to-end neural conversation models have led to promising advances in reducing hand-crafted features and errors induced by the traditional complex system architecture, they typically require an enormous amount of data due to the…

Computation and Language · Computer Science 2018-01-10 Sungjin Lee

End-to-end design of dialogue systems has recently become a popular research topic thanks to powerful tools such as encoder-decoder architectures for sequence-to-sequence learning. Yet, most current approaches cast human-machine dialogue…

Computation and Language · Computer Science 2017-03-17 Florian Strub , Harm de Vries , Jeremie Mary , Bilal Piot , Aaron Courville , Olivier Pietquin

We present our work on Track 2 in the Dialog System Technology Challenges 7 (DSTC7). The DSTC7-Track 2 aims to evaluate the response generation of fully data-driven conversation models in knowledge-grounded settings, which provides the…

Computation and Language · Computer Science 2019-02-01 Yu-Ping Ruan , Zhen-Hua Ling , Quan Liu , Jia-Chen Gu , Xiaodan Zhu

A booming amount of information is continuously added to the Internet as structured and unstructured data, feeding knowledge bases such as DBpedia and Wikidata with billions of statements describing millions of entities. The aim of Question…

Computation and Language · Computer Science 2020-10-22 Anand Panchbhai , Tommaso Soru , Edgard Marx

This paper analyzes some speed and performance improvement methods of Transformer architecture in recent years, mainly its application in dedicated model training. The dedicated model studied here refers to the open domain persona-aware…

Computation and Language · Computer Science 2020-08-28 Qiang Han

We present a novel end-to-end trainable neural network model for task-oriented dialog systems. The model is able to track dialog state, issue API calls to knowledge base (KB), and incorporate structured KB query results into system…

Computation and Language · Computer Science 2017-08-22 Bing Liu , Ian Lane

End-to-end neural TTS has achieved superior performance on reading style speech synthesis. However, it's still a challenge to build a high-quality conversational TTS due to the limitations of the corpus and modeling capability. This study…

Sound · Computer Science 2020-11-17 Haohan Guo , Shaofei Zhang , Frank K. Soong , Lei He , Lei Xie

We present a novel natural language generation system for spoken dialogue systems capable of entraining (adapting) to users' way of speaking, providing contextually appropriate responses. The generator is based on recurrent neural networks…

Computation and Language · Computer Science 2017-09-18 Ondřej Dušek , Filip Jurčíček

Despite end-to-end neural systems making significant progress in the last decade for task-oriented as well as chit-chat based dialogue systems, most dialogue systems rely on hybrid approaches which use a combination of rule-based, retrieval…

Computation and Language · Computer Science 2021-05-07 Ashish Shrivastava , Kaustubh Dhole , Abhinav Bhatt , Sharvani Raghunath

Using neural networks to generate replies in human-computer dialogue systems is attracting increasing attention over the past few years. However, the performance is not satisfactory: the neural network tends to generate safe, universally…

Computation and Language · Computer Science 2016-10-14 Lili Mou , Yiping Song , Rui Yan , Ge Li , Lu Zhang , Zhi Jin

Existing speech recognition systems are typically built at the sentence level, although it is known that dialog context, e.g. higher-level knowledge that spans across sentences or speakers, can help the processing of long conversations. The…

Computation and Language · Computer Science 2018-08-08 Suyoun Kim , Florian Metze