English
Related papers

Related papers: A Factuality and Diversity Reconciled Decoding Met…

200 papers

In open-domain conversational systems, it is important but challenging to leverage background knowledge. We can use the incorporation of knowledge to make the generation of dialogue controllable, and can generate more diverse sentences that…

Artificial Intelligence · Computer Science 2021-05-06 Cheng Luo , Dayiheng Liu , Chanjuan Li , Li Lu , Jiancheng Lv

Pretrained language models (PLMs) based knowledge-grounded dialogue systems are prone to generate responses that are factually inconsistent with the provided knowledge source. In such inconsistent responses, the dialogue models fail to…

Computation and Language · Computer Science 2023-11-06 Boyang Xue , Weichao Wang , Hongru Wang , Fei Mi , Rui Wang , Yasheng Wang , Lifeng Shang , Xin Jiang , Qun Liu , Kam-Fai Wong

Human dialogues are scenario-based and appropriate responses generally relate to the latent context knowledge entailed by the specific scenario. To enable responses that are more meaningful and context-specific, we propose to improve…

Computation and Language · Computer Science 2020-10-07 Shaoxiong Feng , Xuancheng Ren , Hongshen Chen , Bin Sun , Kan Li , Xu Sun

Inductive reasoning - the process of inferring general rules from a small number of observations - is a fundamental aspect of human intelligence. Recent works suggest that large language models (LLMs) can engage in inductive reasoning by…

Artificial Intelligence · Computer Science 2025-02-11 Kang-il Lee , Hyukhun Koh , Dongryeol Lee , Seunghyun Yoon , Minsung Kim , Kyomin Jung

Ensuring truthfulness in large language models (LLMs) remains a critical challenge for reliable text generation. While supervised fine-tuning and reinforcement learning with human feedback have shown promise, they require a substantial…

Machine Learning · Computer Science 2026-03-17 Manh Nguyen , Sunil Gupta , Hung Le

Knowledge-grounded dialogue (KGD) learns to generate an informative response based on a given dialogue context and external knowledge (\emph{e.g.}, knowledge graphs; KGs). Recently, the emergence of large language models (LLMs) and…

Computation and Language · Computer Science 2024-01-10 Jiaan Wang , Jianfeng Qu , Kexin Wang , Zhixu Li , Wen Hua , Ximing Li , An Liu

Knowledge-grounded dialogue generation aims to mitigate the issue of text degeneration by incorporating external knowledge to supplement the context. However, the model often fails to internalize this information into responses in a…

Computation and Language · Computer Science 2023-10-18 Chenxu Yang , Zheng Lin , Lanrui Wang , Chong Tian , Liang Pang , Jiangnan Li , Qirong Ho , Yanan Cao , Weiping Wang

Recent methods for knowledge grounded dialogs generate responses by incorporating information from an external textual document. These methods do not require the exact document to be known during training and rely on the use of a retrieval…

Computation and Language · Computer Science 2022-08-16 Mayank Mishra , Dhiraj Madan , Gaurav Pandey , Danish Contractor

In Knowledge Management, variations in information expressions have proven a real challenge. In particular, classical semantic relations (e.g. synonymy) do not connect words with different parts-of-speech. The method proposed tries to…

Information Retrieval · Computer Science 2010-10-28 Bernard Jacquemin

While conditional language models have greatly improved in their ability to output high-quality natural language, many NLP applications benefit from being able to generate a diverse set of candidate sequences. Diverse decoding strategies…

Computation and Language · Computer Science 2019-06-18 Daphne Ippolito , Reno Kriz , Maria Kustikova , João Sedoc , Chris Callison-Burch

We study video-grounded dialogue generation, where a response is generated based on the dialogue context and the associated video. The primary challenges of this task lie in (1) the difficulty of integrating video data into pre-trained…

Computation and Language · Computer Science 2022-10-25 Xueliang Zhao , Yuxuan Wang , Chongyang Tao , Chenshuo Wang , Dongyan Zhao

Knowledge-grounded dialogue is a task of generating an informative response based on both the dialogue history and external knowledge source. In general, there are two forms of knowledge: manually annotated knowledge graphs and knowledge…

Computation and Language · Computer Science 2023-12-14 Yizhe Yang , Heyan Huang , Yihang Liu , Yang Gao

Knowledge-grounded conversation (KGC) shows excellent potential to deliver an engaging and informative response. However, existing approaches emphasize selecting one golden knowledge given a particular dialogue context, overlooking the…

Computation and Language · Computer Science 2022-10-25 Xueliang Zhao , Tingchen Fu , Chongyang Tao , Rui Yan

We present chain-of-knowledge (CoK), a novel framework that augments large language models (LLMs) by dynamically incorporating grounding information from heterogeneous sources. It results in more factual rationales and reduced hallucination…

Computation and Language · Computer Science 2024-02-22 Xingxuan Li , Ruochen Zhao , Yew Ken Chia , Bosheng Ding , Shafiq Joty , Soujanya Poria , Lidong Bing

A limitation of current neural dialog models is that they tend to suffer from a lack of specificity and informativeness in generated responses, primarily due to dependence on training data that covers a limited variety of scenarios and…

Computation and Language · Computer Science 2022-03-23 Bodhisattwa Prasad Majumder , Harsh Jhamtani , Taylor Berg-Kirkpatrick , Julian McAuley

Automatic multi-hop fact verification task has gained significant attention in recent years. Despite impressive results, these well-designed models perform poorly on out-of-domain data. One possible solution is to augment the training data…

Computation and Language · Computer Science 2023-10-24 Yingjie Zhu , Jiasheng Si , Yibo Zhao , Haiyang Zhu , Deyu Zhou , Yulan He

For open-ended language generation tasks such as storytelling and dialogue, choosing the right decoding algorithm is critical to controlling the tradeoff between generation quality and diversity. However, there presently exists no consensus…

Computation and Language · Computer Science 2020-04-23 Hugh Zhang , Daniel Duckworth , Daphne Ippolito , Arvind Neelakantan

Dialogue summarization is abstractive in nature, making it suffer from factual errors. The factual correctness of summaries has the highest priority before practical applications. Many efforts have been made to improve faithfulness in text…

Computation and Language · Computer Science 2022-10-24 Bin Wang , Chen Zhang , Yan Zhang , Yiming Chen , Haizhou Li

In this paper, a novel Generation-Evaluation framework is developed for multi-turn conversations with the objective of letting both participants know more about each other. For the sake of rational knowledge utilization and coherent…

Computation and Language · Computer Science 2019-06-04 Siqi Bao , Huang He , Fan Wang , Rongzhong Lian , Hua Wu

Language models are becoming the default interface to factual knowledge, yet they often verify outputs more reliably than they generate them. This generation-verification gap (GV-gap) underlies many recent advances in self-improvement and…

Computation and Language · Computer Science 2026-05-28 Tim R. Davidson , Anja Surina , Caglar Gulcehre