English
Related papers

Related papers: Knowledge-Grounded Dialogue Generation with Pre-tr…

200 papers

Knowledge-grounded dialogue is a task of generating an informative response based on both discourse context and external knowledge. As we focus on better modeling the knowledge selection in the multi-turn knowledge-grounded dialogue, we…

Computation and Language · Computer Science 2020-06-17 Byeongchang Kim , Jaewoo Ahn , Gunhee Kim

Accurate knowledge selection is critical in knowledge-grounded dialogue systems. Towards a closer look at it, we offer a novel perspective to organize existing literature, i.e., knowledge selection coupled with, after, and before…

Computation and Language · Computer Science 2023-10-23 Lang Qin , Yao Zhang , Hongru Liang , Jun Wang , Zhenglu Yang

Conversational grounding is a collaborative mechanism for establishing mutual knowledge among participants engaged in a dialogue. This experimental study analyzes information-seeking conversations to investigate the capabilities of large…

Computation and Language · Computer Science 2024-06-05 Kristiina Jokinen , Phillip Schneider , Taiga Mori

A proactive dialogue system has the ability to proactively lead the conversation. Different from the general chatbots which only react to the user, proactive dialogue systems can be used to achieve some goals, e.g., to recommend some items…

Computation and Language · Computer Science 2021-07-20 Yutao Zhu , Jian-Yun Nie , Kun Zhou , Pan Du , Hao Jiang , Zhicheng Dou

Target-guided response generation enables dialogue systems to smoothly transition a conversation from a dialogue context toward a target sentence. Such control is useful for designing dialogue systems that direct a conversation toward…

Computation and Language · Computer Science 2022-05-20 Prakhar Gupta , Harsh Jhamtani , Jeffrey P. Bigham

Existing dialog datasets contain a sequence of utterances and responses without any explicit background knowledge associated with them. This has resulted in the development of models which treat conversation as a sequence-to-sequence…

Computation and Language · Computer Science 2018-09-24 Nikita Moghe , Siddhartha Arora , Suman Banerjee , Mitesh M. Khapra

We present an empirical investigation of pre-trained Transformer-based auto-regressive language models for the task of open-domain dialogue generation. Training paradigm of pre-training and fine-tuning is employed to conduct the parameter…

Computation and Language · Computer Science 2020-03-10 Piji Li

Building open-domain dialogue systems capable of rich human-like conversational ability is one of the fundamental challenges in language generation. However, even with recent advancements in the field, existing open-domain generative models…

Computation and Language · Computer Science 2022-06-14 Ritvik Choudhary , Daisuke Kawahara

We study video-grounded dialogue generation, where a response is generated based on the dialogue context and the associated video. The primary challenges of this task lie in (1) the difficulty of integrating video data into pre-trained…

Computation and Language · Computer Science 2022-10-25 Xueliang Zhao , Yuxuan Wang , Chongyang Tao , Chenshuo Wang , Dongyan Zhao

Pre-trained language models have been successfully used in response generation for open-domain dialogue. Four main frameworks have been proposed: (1) Transformer-ED using Transformer encoder and decoder separately for source and target…

Computation and Language · Computer Science 2020-10-27 Yan Zeng , Jian-Yun Nie

Mixed-initiative dialogue tasks involve repeated exchanges of information and conversational control. Conversational agents gain control by generating responses that follow particular dialogue intents or strategies, prescribed by a policy…

Computation and Language · Computer Science 2023-05-09 Maximillian Chen , Xiao Yu , Weiyan Shi , Urvi Awasthi , Zhou Yu

Scarcity of training data for task-oriented dialogue systems is a well known problem that is usually tackled with costly and time-consuming manual data annotation. An alternative solution is to rely on automatic text generation which,…

Computation and Language · Computer Science 2019-11-12 Stéphane d'Ascoli , Alice Coucke , Francesco Caltagirone , Alexandre Caulier , Marc Lelarge

Transformer-based pre-trained language models boost the performance of open-domain dialogue systems. Prior works leverage Transformer-based pre-trained language models to generate texts with desired attributes in two general approaches: (1)…

Computation and Language · Computer Science 2022-09-27 Wanyu Du , Yangfeng Ji

It has recently been observed that neural language models trained on unstructured text can implicitly store and retrieve knowledge using natural language queries. In this short paper, we measure the practical utility of this approach by…

Computation and Language · Computer Science 2020-10-07 Adam Roberts , Colin Raffel , Noam Shazeer

Commonsense and background knowledge is required for a QA model to answer many nontrivial questions. Different from existing work on knowledge-aware QA, we focus on a more challenging task of leveraging external knowledge to generate…

Computation and Language · Computer Science 2019-09-09 Bin Bi , Chen Wu , Ming Yan , Wei Wang , Jiangnan Xia , Chenliang Li

Scarcity of training data for task-oriented dialogue systems is a well known problem that is usually tackled with costly and time-consuming manual data annotation. An alternative solution is to rely on automatic text generation which,…

Computation and Language · Computer Science 2020-11-05 Stéphane d'Ascoli , Alice Coucke , Francesco Caltagirone , Alexandre Caulier , Marc Lelarge

Knowledge graph-based dialogue systems can narrow down knowledge candidates for generating informative and diverse responses with the use of prior information, e.g., triple attributes or graph paths. However, most current knowledge graph…

Computation and Language · Computer Science 2020-04-21 Hongcai Xu , Junpeng Bao , Junqing Wang

Text generation system has made massive promising progress contributed by deep learning techniques and has been widely applied in our life. However, existing end-to-end neural models suffer from the problem of tending to generate…

Artificial Intelligence · Computer Science 2020-03-03 Hao Wang , Bin Guo , Wei Wu , Zhiwen Yu

Pre-trained language models learn informative word representations on a large-scale text corpus through self-supervised learning, which has achieved promising performance in fields of natural language processing (NLP) after fine-tuning.…

Computation and Language · Computer Science 2023-10-31 Jian Yang , Xinyu Hu , Gang Xiao , Yulong Shen

Pre-trained models have proved to be powerful in enhancing task-oriented dialog systems. However, current pre-training methods mainly focus on enhancing dialog understanding and generation tasks while neglecting the exploitation of dialog…

Computation and Language · Computer Science 2022-03-30 Wanwei He , Yinpei Dai , Yinhe Zheng , Yuchuan Wu , Zheng Cao , Dermot Liu , Peng Jiang , Min Yang , Fei Huang , Luo Si , Jian Sun , Yongbin Li