English
Related papers

Related papers: Knowledge-Grounded Dialogue Generation with a Unif…

200 papers

The knowledge-grounded dialogue task aims to generate responses that convey information from given knowledge documents. However, it is a challenge for the current sequence-based model to acquire knowledge from complex documents and…

Computation and Language · Computer Science 2024-05-17 Yizhe Yang , Heyan Huang , Yang Gao , Jiawei Li and

Neural conversation models have shown great potentials towards generating fluent and informative responses by introducing external background knowledge. Nevertheless, it is laborious to construct such knowledge-grounded dialogues, and…

Computation and Language · Computer Science 2021-09-10 Shilei Liu , Xiaofeng Zhao , Bochao Li , Feiliang Ren , Longhui Zhang , Shujuan Yin

Natural language understanding (NLU) and natural language generation (NLG) are two fundamental and related tasks in building task-oriented dialogue systems with opposite objectives: NLU tackles the transformation from natural language to…

Computation and Language · Computer Science 2020-06-16 Bo-Hsiang Tseng , Jianpeng Cheng , Yimai Fang , David Vandyke

We study video-grounded dialogue generation, where a response is generated based on the dialogue context and the associated video. The primary challenges of this task lie in (1) the difficulty of integrating video data into pre-trained…

Computation and Language · Computer Science 2022-10-25 Xueliang Zhao , Yuxuan Wang , Chongyang Tao , Chenshuo Wang , Dongyan Zhao

We present a knowledge-grounded dialog system developed for the ninth Dialog System Technology Challenge (DSTC9) Track 1 - Beyond Domain APIs: Task-oriented Conversational Modeling with Unstructured Knowledge Access. We leverage transfer…

Computation and Language · Computer Science 2021-06-29 Weijie Zhang , Jiaoxuan Chen , Haipang Wu , Sanhui Wan , Gongfeng Li

Existing knowledge-grounded dialogue systems typically use finetuned versions of a pretrained language model (LM) and large-scale knowledge bases. These models typically fail to generalize on topics outside of the knowledge base, and…

Computation and Language · Computer Science 2022-03-17 Zihan Liu , Mostofa Patwary , Ryan Prenger , Shrimai Prabhumoye , Wei Ping , Mohammad Shoeybi , Bryan Catanzaro

This article presents a hybrid approach based on a Grounded Text Generation (GTG) model to building robust task bots at scale. GTG is a hybrid model which uses a large-scale Transformer neural network as its backbone, combined with…

Artificial Intelligence · Computer Science 2020-09-09 Jianfeng Gao , Baolin Peng , Chunyuan Li , Jinchao Li , Shahin Shayandeh , Lars Liden , Heung-Yeung Shum

Incorporating external knowledge into the response generation process is essential to building more helpful and reliable dialog agents. However, collecting knowledge-grounded conversations is often costly, calling for a better pre-trained…

Computation and Language · Computer Science 2022-12-06 Qi Zhu , Fei Mi , Zheng Zhang , Yasheng Wang , Yitong Li , Xin Jiang , Qun Liu , Xiaoyan Zhu , Minlie Huang

With the development of pre-trained language models, remarkable success has been witnessed in dialogue understanding (DU). However, current DU approaches usually employ independent models for each distinct DU task without considering shared…

Computation and Language · Computer Science 2022-07-26 Zhi Chen , Lu Chen , Bei Chen , Libo Qin , Yuncong Liu , Su Zhu , Jian-Guang Lou , Kai Yu

Existing knowledge-grounded conversation systems generate responses typically in a retrieve-then-generate manner. They require a large knowledge base and a strong knowledge retrieval component, which is time- and resource-consuming. In this…

Computation and Language · Computer Science 2023-06-28 Jiaqi Bai , Zhao Yan , Jian Yang , Xinnian Liang , Hongcheng Guo , Zhoujun Li

Building open-domain dialogue systems capable of rich human-like conversational ability is one of the fundamental challenges in language generation. However, even with recent advancements in the field, existing open-domain generative models…

Computation and Language · Computer Science 2022-06-14 Ritvik Choudhary , Daisuke Kawahara

We study knowledge-grounded dialogue generation with pre-trained language models. Instead of pursuing new state-of-the-art on benchmarks, we try to understand if the knowledge stored in parameters of the pre-trained models is already enough…

Computation and Language · Computer Science 2020-11-20 Yufan Zhao , Wei Wu , Can Xu

Knowledge retrieval is one of the major challenges in building a knowledge-grounded dialogue system. A common method is to use a neural retriever with a distributed approximate nearest-neighbor database to quickly find the relevant…

Information Retrieval · Computer Science 2024-05-09 Nhat Tran , Diane Litman

Grounding dialogue system with external knowledge is a promising way to improve the quality of responses. Most existing works adopt knowledge graphs (KGs) as the external resources, paying attention to the contribution of entities in the…

Computation and Language · Computer Science 2022-07-19 Kexin Wang , Zhixu Li , Jiaan Wang , Jianfeng Qu , Ying He , An Liu , Lei Zhao

Knowledge-grounded dialogue (KGD) learns to generate an informative response based on a given dialogue context and external knowledge (\emph{e.g.}, knowledge graphs; KGs). Recently, the emergence of large language models (LLMs) and…

Computation and Language · Computer Science 2024-01-10 Jiaan Wang , Jianfeng Qu , Kexin Wang , Zhixu Li , Wen Hua , Ximing Li , An Liu

For natural language understanding (NLU) technology to be maximally useful, both practically and as a scientific object of study, it must be general: it must be able to process language in a way that is not exclusively tailored to any one…

Computation and Language · Computer Science 2019-02-26 Alex Wang , Amanpreet Singh , Julian Michael , Felix Hill , Omer Levy , Samuel R. Bowman

Knowledge-grounded dialogue systems aim to generate coherent and engaging responses based on the dialogue contexts and selected external knowledge. Previous knowledge selection methods tend to rely too heavily on the dialogue contexts or…

Computation and Language · Computer Science 2024-03-05 Lin Xu , Qixian Zhou , Jinlan Fu , See-Kiong Ng

Knowledge (including structured knowledge such as schema and ontology, and unstructured knowledge such as web corpus) is a critical part of dialog understanding, especially for unseen tasks and domains. Traditionally, such domain-specific…

Computation and Language · Computer Science 2022-10-14 Dian Yu , Mingqiu Wang , Yuan Cao , Izhak Shafran , Laurent El Shafey , Hagen Soltau

Large language models (LLMs) excel at processing and generating both text and code. However, LLMs have had limited applicability in grounded task-oriented dialogue as they are difficult to steer toward task objectives and fail to handle…

Computation and Language · Computer Science 2023-10-27 Justin T. Chiu , Wenting Zhao , Derek Chen , Saujas Vaduguru , Alexander M. Rush , Daniel Fried

Building robust and general dialogue models for spoken conversations is challenging due to the gap in distributions of spoken and written data. This paper presents our approach to build generalized models for the Knowledge-grounded…

Computation and Language · Computer Science 2022-03-09 Ruijie Yan , Shuang Peng , Haitao Mi , Liang Jiang , Shihui Yang , Yuchi Zhang , Jiajun Li , Liangrui Peng , Yongliang Wang , Zujie Wen