English
Related papers

Related papers: Learning Knowledge Bases with Parameters for Task-…

200 papers

With the power of large pretrained language models, various research works have integrated knowledge into dialogue systems. The traditional techniques treat knowledge as part of the input sequence for the dialogue system, prepending a set…

Computation and Language · Computer Science 2023-02-14 Hsuan Su , Shachi H Kumar , Sahisnu Mazumder , Wenda Chen , Ramesh Manuvinakurike , Eda Okur , Saurav Sahay , Lama Nachman , Shang-Tse Chen , Hung-yi Lee

Task-oriented dialogue systems help users accomplish tasks such as booking a movie ticket and ordering food via conversation. Generative models parameterized by a deep neural network are widely used for next turn response generation in such…

Computation and Language · Computer Science 2020-10-13 Prasanna Parthasarathi , Arvind Neelakantan , Sharan Narang

Dialogue state tracking (DST) is an essential sub-task for task-oriented dialogue systems. Recent work has focused on deep neural models for DST. However, the neural models require a large dataset for training. Furthermore, applying them to…

Computation and Language · Computer Science 2022-10-06 Hyunmin Jeon , Gary Geunbae Lee

Large language models can produce fluent dialogue but often hallucinate factual inaccuracies. While retrieval-augmented models help alleviate this issue, they still face a difficult challenge of both reasoning to provide correct knowledge…

Computation and Language · Computer Science 2021-11-10 Leonard Adolphs , Kurt Shuster , Jack Urbanek , Arthur Szlam , Jason Weston

Despite their popularity in the chatbot literature, retrieval-based models have had modest impact on task-oriented dialogue systems, with the main obstacle to their application being the low-data regime of most task-oriented dialogue tasks.…

Current task-oriented dialog (TOD) systems mostly manage structured knowledge (e.g. databases and tables) to guide the goal-oriented conversations. However, they fall short of handling dialogs which also involve unstructured knowledge (e.g.…

Computation and Language · Computer Science 2022-02-02 Silin Gao , Ryuichi Takanobu , Antoine Bosselut , Minlie Huang

We introduce end-to-end neural network based models for simulating users of task-oriented dialogue systems. User simulation in dialogue systems is crucial from two different perspectives: (i) automatic evaluation of different dialogue…

Computation and Language · Computer Science 2018-11-13 Izzeddin Gur , Dilek Hakkani-Tur , Gokhan Tur , Pararth Shah

We demonstrate that large language models are able to simulate Task Oriented Dialogues in novel domains, provided only with an API implementation and a list of goals. We show these simulations can formulate online, automatic metrics that…

Computation and Language · Computer Science 2021-10-14 Moya Chen , Paul A. Crook , Stephen Roller

Dealing with previously unseen slots is a challenging problem in a real-world multi-domain dialogue state tracking task. Other approaches rely on predefined mappings to generate candidate slot keys, as well as their associated values. This,…

Machine Learning · Computer Science 2019-08-28 Adrian de Wynter , Lambert Mathias

End-to-end task-oriented dialogue (EToD) can directly generate responses in an end-to-end fashion without modular training, which attracts escalating popularity. The advancement of deep neural networks, especially the successful use of…

Computation and Language · Computer Science 2023-11-16 Libo Qin , Wenbo Pan , Qiguang Chen , Lizi Liao , Zhou Yu , Yue Zhang , Wanxiang Che , Min Li

In this work, we propose a novel framework that integrates large language models (LLMs) with an RL-based dialogue manager for open-ended dialogue with a specific goal. By leveraging hierarchical reinforcement learning to model the…

Computation and Language · Computer Science 2025-07-09 Lucie Galland , Catherine Pelachaud , Florian Pecune

Contextual word representations, typically trained on unstructured, unlabeled text, do not contain any explicit grounding to real world entities and are often unable to remember facts about those entities. We propose a general method to…

Computation and Language · Computer Science 2019-11-01 Matthew E. Peters , Mark Neumann , Robert L. Logan , Roy Schwartz , Vidur Joshi , Sameer Singh , Noah A. Smith

Pre-trained models have achieved excellent performance on the dialogue task. However, for the continual increase of online chit-chat scenarios, directly fine-tuning these models for each of the new tasks not only explodes the capacity of…

Computation and Language · Computer Science 2022-03-22 Shaoxiong Feng , Xuancheng Ren , Kan Li , Xu Sun

While transformers demonstrate impressive performance on many knowledge intensive (KI) tasks, their ability to serve as implicit knowledge bases (KBs) remains limited, as shown on several slot-filling, question-answering (QA), fact…

Computation and Language · Computer Science 2022-03-21 Nic Jedema , Thuy Vu , Manish Gupta , Alessandro Moschitti

Neural network models usually suffer from the challenge of incorporating commonsense knowledge into the open-domain dialogue systems. In this paper, we propose a novel knowledge-aware dialogue generation model (called TransDG), which…

Computation and Language · Computer Science 2019-12-17 Jian Wang , Junhao Liu , Wei Bi , Xiaojiang Liu , Kejing He , Ruifeng Xu , Min Yang

For each goal-oriented dialog task of interest, large amounts of data need to be collected for end-to-end learning of a neural dialog system. Collecting that data is a costly and time-consuming process. Instead, we show that we can use only…

Computation and Language · Computer Science 2021-11-01 Janarthanan Rajendran , Jonathan K. Kummerfeld , Satinder Singh

Representation learning of knowledge bases (KBs) aims to embed both entities and relations into a low-dimensional space. Most existing methods only consider direct relations in representation learning. We argue that multiple-step relation…

Computation and Language · Computer Science 2015-08-18 Yankai Lin , Zhiyuan Liu , Huanbo Luan , Maosong Sun , Siwei Rao , Song Liu

Recently several deep learning based models have been proposed for end-to-end learning of dialogs. While these models can be trained from data without the need for any additional annotations, it is hard to interpret them. On the other hand,…

Artificial Intelligence · Computer Science 2018-11-05 Dhiraj Madan , Dinesh Raghu , Gaurav Pandey , Sachindra Joshi

Collecting data for training dialog systems can be extremely expensive due to the involvement of human participants and need for extensive annotation. Especially in document-grounded dialog systems, human experts need to carefully read the…

Computation and Language · Computer Science 2021-12-16 Qingyang Wu , Song Feng , Derek Chen , Sachindra Joshi , Luis A. Lastras , Zhou Yu

End-to-End intelligent neural dialogue systems suffer from the problems of generating inconsistent and repetitive responses. Existing dialogue models pay attention to unilaterally incorporating personal knowledge into the dialog while…

Computation and Language · Computer Science 2021-07-19 Yajing Sun , Yue Hu , Luxi Xing , Yuqiang Xie , Xiangpeng Wei