English
Related papers

Related papers: Improving Factual Consistency for Knowledge-Ground…

200 papers

Knowledge-grounded dialogue is a task of generating a fluent and informative response based on both conversation context and a collection of external knowledge, in which knowledge selection plays an important role and attracts more and more…

Computation and Language · Computer Science 2021-09-01 Shilei Liu , Xiaofeng Zhao , Bochao Li , Feiliang Ren

In recent years, large language models (LLMs) have demonstrated significant success in performing varied natural language tasks such as language translation, question-answering, summarizing, fact-checking, etc. Despite LLMs' impressive…

Computation and Language · Computer Science 2025-03-03 Bishwamittra Ghosh , Sarah Hasan , Naheed Anjum Arafat , Arijit Khan

Language models (LMs) have been shown to memorize a great deal of factual knowledge contained in their training data. But when an LM generates an assertion, it is often difficult to determine where it learned this information and whether it…

Computation and Language · Computer Science 2022-10-26 Ekin Akyürek , Tolga Bolukbasi , Frederick Liu , Binbin Xiong , Ian Tenney , Jacob Andreas , Kelvin Guu

Large language models (LLMs) have shown impressive prowess in solving a wide range of tasks with world knowledge. However, it remains unclear how well LLMs are able to perceive their factual knowledge boundaries, particularly under…

Computation and Language · Computer Science 2024-11-20 Ruiyang Ren , Yuhao Wang , Yingqi Qu , Wayne Xin Zhao , Jing Liu , Hao Tian , Hua Wu , Ji-Rong Wen , Haifeng Wang

Pretrained language models can encode a large amount of knowledge and utilize it for various reasoning tasks, yet they can still struggle to learn novel factual knowledge effectively from finetuning on limited textual demonstrations. In…

Computation and Language · Computer Science 2025-06-17 Xiao Zhang , Miao Li , Ji Wu

Large language models have demonstrated significant potential as the next-generation information access engines. However, their reliability is hindered by issues of hallucination and generating non-factual content. This is particularly…

Computation and Language · Computer Science 2024-10-03 Chao-Wei Huang , Yun-Nung Chen

LLMs' sources of knowledge are data snapshots containing factual information about entities collected at different timestamps and from different media types (e.g. wikis, social media, etc.). Such unstructured knowledge is subject to change…

Computation and Language · Computer Science 2026-03-18 Seyed Mahed Mousavi , Simone Alghisi , Giuseppe Riccardi

As the modern tools of choice for text understanding and generation, large language models (LLMs) are expected to accurately output answers by leveraging the input context. This requires LLMs to possess both context-faithfulness and factual…

Computation and Language · Computer Science 2024-10-07 Baolong Bi , Shenghua Liu , Yiwei Wang , Lingrui Mei , Junfeng Fang , Hongcheng Gao , Shiyu Ni , Xueqi Cheng

In the real world, knowledge is constantly evolving, which can render existing knowledge-based datasets outdated. This unreliability highlights the critical need for continuous updates to ensure both accuracy and relevance in…

Computation and Language · Computer Science 2024-06-11 Dayoon Ko , Jinyoung Kim , Hahyeon Choi , Gunhee Kim

LLMs (Large Language Models) usually interact with users in the form of dialogue and generate responses following their instructions, which naturally require dialogue comprehension abilities. However, dialogue comprehension is a general…

Computation and Language · Computer Science 2024-04-02 Shuaijie She , Shujian Huang , Xingyun Wang , Yanke Zhou , Jiajun Chen

Factual consistency is an important quality in dialogue summarization. Large language model (LLM)-based automatic text summarization models generate more factually consistent summaries compared to those by smaller pretrained language…

Computation and Language · Computer Science 2024-06-24 Rongxin Zhu , Jey Han Lau , Jianzhong Qi

Large language models (LLMs) outperform information retrieval techniques for downstream knowledge-intensive tasks when being prompted to generate world knowledge. However, community concerns abound regarding the factuality and potential…

Computation and Language · Computer Science 2023-10-12 Liang Chen , Yang Deng , Yatao Bian , Zeyu Qin , Bingzhe Wu , Tat-Seng Chua , Kam-Fai Wong

Transformer-based language models (LMs) are at the core of modern NLP, but their internal prediction construction process is opaque and largely not understood. In this work, we make a substantial step towards unveiling this underlying…

Computation and Language · Computer Science 2022-10-14 Mor Geva , Avi Caciularu , Kevin Ro Wang , Yoav Goldberg

This study investigates an explainable reasoning method for financial decision-making based on knowledge-enhanced large language model agents. To address the limitations of traditional financial decision methods that rely on parameterized…

Computation and Language · Computer Science 2025-12-11 Qingyuan Zhang , Yuxi Wang , Cancan Hua , Yulin Huang , Ning Lyu

Large language models (LLMs), such as ChatGPT, are able to generate human-like, fluent responses for many downstream tasks, e.g., task-oriented dialog and question answering. However, applying LLMs to real-world, mission-critical…

Computation and Language · Computer Science 2023-03-10 Baolin Peng , Michel Galley , Pengcheng He , Hao Cheng , Yujia Xie , Yu Hu , Qiuyuan Huang , Lars Liden , Zhou Yu , Weizhu Chen , Jianfeng Gao

Despite advancements in large language models (LLMs), non-factual responses still persist in fact-seeking question answering. Unlike extensive studies on post-hoc detection of these responses, this work studies non-factuality prediction…

Computation and Language · Computer Science 2025-08-19 Yanling Wang , Haoyang Li , Hao Zou , Jing Zhang , Xinlei He , Qi Li , Ke Xu

Multilingual language models (MLMs) store factual knowledge across languages but often struggle to provide consistent responses to semantically equivalent prompts in different languages. While previous studies point out this cross-lingual…

Computation and Language · Computer Science 2025-04-08 Mingyang Wang , Heike Adel , Lukas Lange , Yihong Liu , Ercong Nie , Jannik Strötgen , Hinrich Schütze

The veracity of a factoid is largely independent of the language it is written in. However, language models are inconsistent in their ability to answer the same factual question across languages. This raises questions about how LLMs…

Computation and Language · Computer Science 2024-08-21 Maxim Ifergan , Leshem Choshen , Roee Aharoni , Idan Szpektor , Omri Abend

Knowledge-grounded dialogue (KGD) learns to generate an informative response based on a given dialogue context and external knowledge (\emph{e.g.}, knowledge graphs; KGs). Recently, the emergence of large language models (LLMs) and…

Computation and Language · Computer Science 2024-01-10 Jiaan Wang , Jianfeng Qu , Kexin Wang , Zhixu Li , Wen Hua , Ximing Li , An Liu

Neural network models usually suffer from the challenge of incorporating commonsense knowledge into the open-domain dialogue systems. In this paper, we propose a novel knowledge-aware dialogue generation model (called TransDG), which…

Computation and Language · Computer Science 2019-12-17 Jian Wang , Junhao Liu , Wei Bi , Xiaojiang Liu , Kejing He , Ruifeng Xu , Min Yang