English
Related papers

Related papers: Beyond Precision: Importance-Aware Recall for Fact…

200 papers

Pretrained language models (LMs) are susceptible to generate text with nonfactual information. In this work, we measure and improve the factual accuracy of large-scale LMs for open-ended text generation. We design the FactualityPrompts test…

Computation and Language · Computer Science 2023-03-03 Nayeon Lee , Wei Ping , Peng Xu , Mostofa Patwary , Pascale Fung , Mohammad Shoeybi , Bryan Catanzaro

Large language models (LLMs) often generate content that contains factual errors when responding to fact-seeking prompts on open-ended topics. To benchmark a model's long-form factuality in open domains, we first use GPT-4 to generate…

Computation and Language · Computer Science 2024-11-08 Jerry Wei , Chengrun Yang , Xinying Song , Yifeng Lu , Nathan Hu , Jie Huang , Dustin Tran , Daiyi Peng , Ruibo Liu , Da Huang , Cosmo Du , Quoc V. Le

Large language models (LLMs) have achieved remarkable success in generative tasks, yet they often fall short in ensuring the factual accuracy of their outputs, thus limiting their reliability in real-world applications where correctness is…

Large Language Models (LLMs) have shown impressive capability in language generation and understanding, but their tendency to hallucinate and produce factually incorrect information remains a key limitation. To verify LLM-generated contents…

Computation and Language · Computer Science 2025-06-03 Kushan Mitra , Dan Zhang , Sajjadur Rahman , Estevam Hruschka

Evaluating the factuality of long-form large language model (LLM)-generated text is an important challenge. Recently there has been a surge of interest in factuality evaluation for English, but little is known about the factuality…

Computation and Language · Computer Science 2024-10-04 Sheikh Shafayat , Eunsu Kim , Juhyun Oh , Alice Oh

A common strategy for fact-checking long-form content generated by Large Language Models (LLMs) is extracting simple claims that can be verified independently. Since inaccurate or incomplete claims compromise fact-checking results, ensuring…

Computation and Language · Computer Science 2025-06-09 Dasha Metropolitansky , Jonathan Larson

The increased use of large language models (LLMs) across a variety of real-world applications calls for mechanisms to verify the factual accuracy of their outputs. In this work, we present a holistic end-to-end solution for annotating the…

Before deploying a language model (LM) within a given domain, it is important to measure its tendency to generate factually incorrect information in that domain. Existing methods for factuality evaluation of LLM generation focus on facts…

Computation and Language · Computer Science 2024-02-06 Dor Muhlgay , Ori Ram , Inbal Magar , Yoav Levine , Nir Ratner , Yonatan Belinkov , Omri Abend , Kevin Leyton-Brown , Amnon Shashua , Yoav Shoham

Large Language Models (LLMs) are trained on vast and diverse internet corpora that often include inaccurate or misleading content. Consequently, LLMs can generate misinformation, making robust fact-checking essential. This review…

Large language models (LLMs) have shown remarkable performance on a variety of NLP tasks, and are being rapidly adopted in a wide range of use cases. It is therefore of vital importance to holistically evaluate the factuality of their…

Computation and Language · Computer Science 2024-04-26 Jiaqing Yuan , Lin Pan , Chung-Wei Hang , Jiang Guo , Jiarong Jiang , Bonan Min , Patrick Ng , Zhiguo Wang

Large language models (LLMs) frequently hallucinate, limiting their reliability in knowledge-intensive applications. Retrieval-augmented generation (RAG) and conformal factuality have emerged as potential ways to address this limitation.…

Artificial Intelligence · Computer Science 2026-03-18 Yi Chen , Daiwei Chen , Sukrut Madhav Chikodikar , Caitlyn Heqi Yin , Ramya Korlakai Vinayak

Large Language Models (LLMs) tend to be unreliable in the factuality of their answers. To address this problem, NLP researchers have proposed a range of techniques to estimate LLM's confidence over facts. However, due to the lack of a…

Computation and Language · Computer Science 2024-11-28 Matéo Mahaut , Laura Aina , Paula Czarnowska , Momchil Hardalov , Thomas Müller , Lluís Màrquez

Large language models (LLMs) exhibit extensive medical knowledge but are prone to hallucinations and inaccurate citations, which pose a challenge to their clinical adoption and regulatory compliance. Current methods, such as Retrieval…

To enhance Large Language Models' (LLMs) reliability, calibration is essential -- the model's assessed confidence scores should align with the actual likelihood of its responses being correct. However, current confidence elicitation methods…

Computation and Language · Computer Science 2024-10-29 Yukun Huang , Yixin Liu , Raghuveer Thirukovalluru , Arman Cohan , Bhuwan Dhingra

The use of large language models (LLMs) has significantly increased since the introduction of ChatGPT in 2022, demonstrating their value across various applications. However, a major challenge for enterprise and commercial adoption of LLMs…

Computation and Language · Computer Science 2024-08-28 N. E. Kriman

Reasoning Large Language Models (R-LLMs) have significantly advanced complex reasoning tasks but often struggle with factuality, generating substantially more hallucinations than their non-reasoning counterparts on long-form factuality…

Computation and Language · Computer Science 2025-08-08 Xilun Chen , Ilia Kulikov , Vincent-Pierre Berges , Barlas Oğuz , Rulin Shao , Gargi Ghosh , Jason Weston , Wen-tau Yih

The widespread adoption of Large Language Models (LLMs) raises critical concerns about the factual accuracy of their outputs, especially in high-risk domains such as biomedicine, law, and education. Existing evaluation methods for short…

Computation and Language · Computer Science 2025-10-30 Yucheng Ning , Xixun Lin , Fang Fang , Yanan Cao

Large Language Models (LLMs) are proficient at retrieving single facts from extended contexts, yet they struggle with tasks requiring the simultaneous retrieval of multiple facts, especially during generation. This paper identifies a novel…

Computation and Language · Computer Science 2024-10-29 Jinlin Wang , Suyuchen Wang , Ziwen Xia , Sirui Hong , Yun Zhu , Bang Liu , Chenglin Wu

Benchmarking modern large language models (LLMs) on complex and realistic tasks is critical to advancing their development. In this work, we evaluate the factual accuracy and citation performance of state-of-the-art LLMs on the task of…

Computation and Language · Computer Science 2024-12-25 Maya Patel , Aditi Anand

Large language models (LLMs) are increasingly used in applications requiring factual accuracy, yet their outputs often contain hallucinated responses. While fact-checking can mitigate these errors, existing methods typically retrieve…

Computation and Language · Computer Science 2026-01-07 Haoran Wang , Maryam Khalid , Qiong Wu , Jian Gao , Cheng Cao