English
Related papers

Related papers: Knowledge-Grounded Dialogue with Reward-Driven Kno…

200 papers

Large language models have become increasingly popular and demonstrated remarkable performance in various natural language processing (NLP) tasks. However, these models are typically computationally expensive and difficult to be deployed in…

Computation and Language · Computer Science 2024-09-20 Dongheng Li , Yongchang Hao , Lili Mou

Human conversations naturally evolve around related concepts and scatter to multi-hop concepts. This paper presents a new conversation generation model, ConceptFlow, which leverages commonsense knowledge graphs to explicitly model…

Computation and Language · Computer Science 2020-05-07 Houyu Zhang , Zhenghao Liu , Chenyan Xiong , Zhiyuan Liu

End-to-end dialog systems have become very popular because they hold the promise of learning directly from human to human dialog interaction. Retrieval and Generative methods have been explored in this area with mixed results. A key element…

Computation and Language · Computer Science 2018-04-24 Jatin Ganhotra , Lazaros Polymenakos

Knowledge-grounded dialogue systems powered by large language models often generate responses that, while fluent, are not attributable to a relevant source of information. Progress towards models that do not exhibit this issue requires…

Computation and Language · Computer Science 2022-06-29 Nouha Dziri , Hannah Rashkin , Tal Linzen , David Reitter

Knowledge Base, represents facts about the world, often in some form of subsumption ontology, rather than implicitly, embedded in procedural code, the way a conventional computer program does. While there is a rapid growth in knowledge…

Computation and Language · Computer Science 2020-10-20 Sai Sharath Japa , Rekabdar Banafsheh

A common practice in knowledge-grounded dialogue generation is to explicitly utilize intermediate steps (e.g., web-search, memory retrieval) with modular approaches. However, data for such steps are often inaccessible compared to those of…

Computation and Language · Computer Science 2024-10-28 Daejin Jo , Daniel Wontae Nam , Gunsoo Han , Kyoung-Woon On , Taehwan Kwon , Seungeun Rho , Sungwoong Kim

We develop an artificial agent motivated to augment its knowledge base beyond its initial training. The agent actively participates in dialogues with other agents, strategically acquiring new information. The agent models its knowledge as…

Artificial Intelligence · Computer Science 2024-07-01 Selene Baez Santamaria , Shihan Wang , Piek Vossen

Recent developments in pre-trained neural language modeling have led to leaps in accuracy on commonsense question-answering benchmarks. However, there is increasing concern that models overfit to specific tasks, without learning to utilize…

Computation and Language · Computer Science 2020-12-16 Kaixin Ma , Filip Ilievski , Jonathan Francis , Yonatan Bisk , Eric Nyberg , Alessandro Oltramari

Knowledge graph reasoning plays a vital role in various applications and has garnered considerable attention. Recently, path-based methods have achieved impressive performance. However, they may face limitations stemming from constraints in…

Artificial Intelligence · Computer Science 2024-12-18 Junnan Liu , Qianren Mao , Weifeng Jiang , Jianxin Li

Intelligent personal assistant systems that are able to have multi-turn conversations with human users are becoming increasingly popular. Most previous research has been focused on using either retrieval-based or generation-based methods to…

Information Retrieval · Computer Science 2019-08-27 Liu Yang , Junjie Hu , Minghui Qiu , Chen Qu , Jianfeng Gao , W. Bruce Croft , Xiaodong Liu , Yelong Shen , Jingjing Liu

Generative seq2seq dialogue systems are trained to predict the next word in dialogues that have already occurred. They can learn from large unlabeled conversation datasets, build a deep understanding of conversational context, and generate…

Computation and Language · Computer Science 2019-10-21 Sam Shleifer , Manish Chablani , Namit Katariya , Anitha Kannan , Xavier Amatriain

Although pre-training models have achieved great success in dialogue generation, their performance drops dramatically when the input contains an entity that does not appear in pre-training and fine-tuning datasets (unseen entity). To…

Computation and Language · Computer Science 2021-09-14 Leyang Cui , Yu Wu , Shujie Liu , Yue Zhang

Large Language Models (LLMs) are capable of performing zero-shot closed-book question answering tasks, based on their internal knowledge stored in parameters during pre-training. However, such internalized knowledge might be insufficient…

Computation and Language · Computer Science 2023-06-08 Jinheon Baek , Alham Fikri Aji , Amir Saffari

Current language models have a significant limitation in the ability to encode and decode factual knowledge. This is mainly because they acquire such knowledge from statistical co-occurrences although most of the knowledge words are rarely…

Computation and Language · Computer Science 2017-03-03 Sungjin Ahn , Heeyoul Choi , Tanel Pärnamaa , Yoshua Bengio

Task-oriented dialogue systems help users accomplish tasks such as booking a movie ticket and ordering food via conversation. Generative models parameterized by a deep neural network are widely used for next turn response generation in such…

Computation and Language · Computer Science 2020-10-13 Prasanna Parthasarathi , Arvind Neelakantan , Sharan Narang

Question generation over knowledge bases (KBQG) aims at generating natural-language questions about a subgraph, i.e. a set of (connected) triples. Two main challenges still face the current crop of encoder-decoder-based methods, especially…

Computation and Language · Computer Science 2020-10-26 Sheng Bi , Xiya Cheng , Yuan-Fang Li , Yongzhen Wang , Guilin Qi

The capability to generate responses with diversity and faithfulness using factual knowledge is paramount for creating a human-like, trustworthy dialogue system. Common strategies either adopt a two-step paradigm, which optimizes knowledge…

Computation and Language · Computer Science 2023-08-08 Yan Xu , Deqian Kong , Dehong Xu , Ziwei Ji , Bo Pang , Pascale Fung , Ying Nian Wu

Encoder-decoder based neural architectures serve as the basis of state-of-the-art approaches in end-to-end open domain dialog systems. Since most of such systems are trained with a maximum likelihood~(MLE) objective they suffer from issues…

Despite end-to-end neural systems making significant progress in the last decade for task-oriented as well as chit-chat based dialogue systems, most dialogue systems rely on hybrid approaches which use a combination of rule-based, retrieval…

Computation and Language · Computer Science 2021-05-07 Ashish Shrivastava , Kaustubh Dhole , Abhinav Bhatt , Sharvani Raghunath

Large language models (LLMs) sometimes demonstrate poor performance on knowledge-intensive tasks, commonsense reasoning is one of them. Researchers typically address these issues by retrieving related knowledge from knowledge graphs or…

Computation and Language · Computer Science 2024-10-15 Jiachun Li , Pengfei Cao , Chenhao Wang , Zhuoran Jin , Yubo Chen , Kang Liu , Xiaojian Jiang , Jiexin Xu , Jun Zhao