English
Related papers

Related papers: Improving Model Factuality with Fine-grained Criti…

200 papers

As the modern tools of choice for text understanding and generation, large language models (LLMs) are expected to accurately output answers by leveraging the input context. This requires LLMs to possess both context-faithfulness and factual…

Computation and Language · Computer Science 2024-10-07 Baolong Bi , Shenghua Liu , Yiwei Wang , Lingrui Mei , Junfeng Fang , Hongcheng Gao , Shiyu Ni , Xueqi Cheng

Large language models (LLMs) are widely used in knowledge-intensive applications but often generate factually incorrect responses. A promising approach to rectify these flaws is correcting LLMs using feedback. Therefore, in this paper, we…

A prominent weakness of modern language models (LMs) is their tendency to generate factually incorrect text, which hinders their usability. A natural question is whether such factual errors can be detected automatically. Inspired by…

Computation and Language · Computer Science 2023-05-23 Roi Cohen , May Hamri , Mor Geva , Amir Globerson

Large Language Models (LLMs) have demonstrated significant performance improvements across various cognitive tasks. An emerging application is using LLMs to enhance retrieval-augmented generation (RAG) capabilities. These systems require…

Computation and Language · Computer Science 2025-01-28 Satyapriya Krishna , Kalpesh Krishna , Anhad Mohananey , Steven Schwarcz , Adam Stambler , Shyam Upadhyay , Manaal Faruqui

Evaluating the factuality of long-form text generated by large language models (LMs) is non-trivial because (1) generations often contain a mixture of supported and unsupported pieces of information, making binary judgments of quality…

Computation and Language · Computer Science 2023-10-12 Sewon Min , Kalpesh Krishna , Xinxi Lyu , Mike Lewis , Wen-tau Yih , Pang Wei Koh , Mohit Iyyer , Luke Zettlemoyer , Hannaneh Hajishirzi

The rapid adoption of language models (LMs) across diverse applications has raised concerns about their factuality, i.e., their consistency with real-world facts. We first present VERIFY (Verification and Evidence RetrIeval for FactualitY…

Computation and Language · Computer Science 2025-01-09 Farima Fatahi Bayat , Lechen Zhang , Sheza Munir , Lu Wang

Evaluating the factuality of long-form large language model (LLM)-generated text is an important challenge. Recently there has been a surge of interest in factuality evaluation for English, but little is known about the factuality…

Computation and Language · Computer Science 2024-10-04 Sheikh Shafayat , Eunsu Kim , Juhyun Oh , Alice Oh

Claim verification can be a challenging task. In this paper, we present a method to enhance the robustness and reasoning capabilities of automated claim verification through the extraction of short facts from evidence. Our novel approach,…

Computation and Language · Computer Science 2024-07-29 Nazanin Jafari , James Allan

Large language models (LLMs) often hallucinate, yet most existing fact-checking methods treat factuality evaluation as a binary classification problem, offering limited interpretability and failing to capture fine-grained error types. In…

Computation and Language · Computer Science 2026-01-13 Yuzhuo Bai , Shuzheng Si , Kangyang Luo , Qingyi Wang , Wenhao Li , Gang Chen , Fanchao Qi , Maosong Sun

Retrieval-Augmented Generation (RAG) has emerged as a powerful framework to improve factuality in large language models (LLMs) by grounding their outputs in retrieved documents. However, ensuring perfect retrieval of relevant information…

Computation and Language · Computer Science 2025-12-04 Zhan Peng Lee , Andre Lin , Calvin Tan

Fact-checking for health-related content is challenging due to the limited availability of annotated training data. In this study, we propose a synthetic data generation pipeline that leverages large language models (LLMs) to augment…

Artificial Intelligence · Computer Science 2025-08-29 Jingze Zhang , Jiahe Qian , Yiliang Zhou , Yifan Peng

In recent years, Large Language Models (LLMs) have gained immense attention due to their notable emergent capabilities, surpassing those seen in earlier language models. A particularly intriguing application of LLMs is their role as…

Computation and Language · Computer Science 2023-11-02 Xue-Yong Fu , Md Tahmid Rahman Laskar , Cheng Chen , Shashi Bhushan TN

Traditional fact-checking relies on humans to formulate relevant and targeted fact-checking questions (FCQs), search for evidence, and verify the factuality of claims. While Large Language Models (LLMs) have been commonly used to automate…

Computation and Language · Computer Science 2025-02-24 Alimohammad Beigi , Bohan Jiang , Dawei Li , Zhen Tan , Pouya Shaeri , Tharindu Kumarage , Amrita Bhattacharjee , Huan Liu

Large language models (LLMs) outperform information retrieval techniques for downstream knowledge-intensive tasks when being prompted to generate world knowledge. However, community concerns abound regarding the factuality and potential…

Computation and Language · Computer Science 2023-10-12 Liang Chen , Yang Deng , Yatao Bian , Zeyu Qin , Bingzhe Wu , Tat-Seng Chua , Kam-Fai Wong

Large language models (LLMs) encode knowledge with varying degrees of confidence. When responding to queries, models face an inherent trade-off: they can generate responses that are less informative but highly factual, or more informative…

Computation and Language · Computer Science 2026-02-03 Ziwei Gong , Yanda Chen , Julia Hirschberg , Chen Zhao , He He , Zhou Yu , Kathleen Mckeown

Large Language Models (LLMs) frequently generate hallucinated content, posing significant challenges for applications where factuality is crucial. While existing hallucination detection methods typically operate at the sentence level or…

Machine Learning · Computer Science 2026-02-02 Albert Sawczyn , Jakub Binkowski , Denis Janiak , Bogdan Gabrys , Tomasz Kajdanowicz

While large language models (LLMs) have demonstrated remarkable performance across diverse tasks, they fundamentally lack self-awareness and frequently exhibit overconfidence, assigning high confidence scores to incorrect predictions.…

Computation and Language · Computer Science 2025-08-19 Jinyi Han , Tingyun Li , Shisong Chen , Jie Shi , Xinyi Wang , Guanglei Yue , Jiaqing Liang , Xin Lin , Liqian Wen , Zulong Chen , Yanghua Xiao

Evaluating the factuality of long-form generations from Large Language Models (LLMs) remains challenging due to efficiency bottlenecks and reliability concerns. Prior efforts attempt this by decomposing text into claims, searching for…

Computation and Language · Computer Science 2025-11-06 Yingjia Wan , Haochen Tan , Xiao Zhu , Xinyu Zhou , Zhiwei Li , Qingsong Lv , Changxuan Sun , Jiaqi Zeng , Yi Xu , Jianqiao Lu , Yinhong Liu , Zhijiang Guo

Large language models (LLMs) have demonstrated strong capabilities in text understanding and generation. However, they often lack factuality, producing a mixture of true and false information, especially in long-form generation. In this…

Computation and Language · Computer Science 2025-09-26 Lifu Tu , Rui Meng , Shafiq Joty , Yingbo Zhou , Semih Yavuz

Large Language Models (LLMs) can generate factually inaccurate content even if they have corresponding knowledge, which critically undermines their reliability. Existing approaches attempt to mitigate this by incorporating uncertainty in QA…

Computation and Language · Computer Science 2026-04-14 Xiaoning Dong , Chengyan Wu , Yajie Wen , Yu Chen , Yun Xue , Jing Zhang , Wei Xu , Bolei Ma