English
Related papers

Related papers: Core: Robust Factual Precision with Informative Su…

200 papers

Large Language Models (LLMs) may hallucinate and generate fake information, despite pre-training on factual data. Inspired by the journalistic device of "according to sources", we propose according-to prompting: directing LLMs to ground…

Computation and Language · Computer Science 2024-02-28 Orion Weller , Marc Marone , Nathaniel Weir , Dawn Lawrie , Daniel Khashabi , Benjamin Van Durme

The increased use of large language models (LLMs) across a variety of real-world applications calls for mechanisms to verify the factual accuracy of their outputs. In this work, we present a holistic end-to-end solution for annotating the…

Large language models (LLMs) frequently hallucinate, limiting their reliability in knowledge-intensive applications. Retrieval-augmented generation (RAG) and conformal factuality have emerged as potential ways to address this limitation.…

Artificial Intelligence · Computer Science 2026-03-18 Yi Chen , Daiwei Chen , Sukrut Madhav Chikodikar , Caitlyn Heqi Yin , Ramya Korlakai Vinayak

The remarkable performance of Multimodal Large Language Models (MLLMs) has unequivocally demonstrated their proficient understanding capabilities in handling a wide array of visual tasks. Nevertheless, the opaque nature of their black-box…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Minghe Gao , Shuang Chen , Liang Pang , Yuan Yao , Jisheng Dang , Wenqiao Zhang , Juncheng Li , Siliang Tang , Yueting Zhuang , Tat-Seng Chua

Large Language Models (LLMs) are powerful linguistic engines but remain susceptible to hallucinations: plausible-sounding outputs that are factually incorrect or unsupported. In this work, we present a mathematically grounded framework to…

Computation and Language · Computer Science 2025-11-20 Moses Kiprono

Large Language Models (LLMs) demonstrate remarkable capabilities in text understanding and generation. However, their tendency to produce factually inconsistent outputs, commonly referred to as ''hallucinations'', remains a critical…

Computation and Language · Computer Science 2026-01-13 Dingwei Chen , Ziqiang Liu , Feiteng Fang , Chak Tou Leong , Shiwen Ni , Ahmadreza Argha , Hamid Alinejad-Rokny , Min Yang , Chengming Li

Unsupervised hallucination detection aims to identify hallucinated content generated by large language models (LLMs) without relying on labeled data. While unsupervised methods have gained popularity by eliminating labor-intensive human…

Computation and Language · Computer Science 2025-09-15 Ponhvoan Srey , Xiaobao Wu , Anh Tuan Luu

While personalized recommender systems excel at content discovery, they frequently expose users to undesirable or discomforting information, highlighting the critical need for user-centric filtering tools. Current methods leveraging Large…

Information Retrieval · Computer Science 2026-04-21 Chi Zhang , Zhipeng Xu , Jiahao Liu , Dongsheng Li , Hansu Gu , Peng Zhang , Ning Gu , Tun Lu

The proliferation of misinformation necessitates robust yet computationally efficient fact verification systems. While current state-of-the-art approaches leverage Large Language Models (LLMs) for generating explanatory rationales, these…

Computation and Language · Computer Science 2025-11-10 Alamgir Munir Qazi , John P. McCrae , Jamal Abdul Nasir

With the recent appearance of LLMs in practical settings, having methods that can effectively detect factual inconsistencies is crucial to reduce the propagation of misinformation and improve trust in model outputs. When testing on existing…

Computation and Language · Computer Science 2023-05-25 Philippe Laban , Wojciech Kryściński , Divyansh Agarwal , Alexander R. Fabbri , Caiming Xiong , Shafiq Joty , Chien-Sheng Wu

The most common training pipeline for large language models includes pretraining, finetuning and aligning phases, with their respective resulting models, such as the pretrained model and the finetuned model. Finetuned and aligned models…

Computation and Language · Computer Science 2024-02-29 Lifeng Jin , Baolin Peng , Linfeng Song , Haitao Mi , Ye Tian , Dong Yu

Despite rapid progress in claim verification, we lack a systematic understanding of what reasoning these benchmarks actually exercise. We generate structured reasoning traces for 24K claim-verification examples across 9 datasets using…

Computation and Language · Computer Science 2026-04-03 Delip Rao , Chris Callison-Burch

Hallucinations pose a significant obstacle to the reliability and widespread adoption of language models, yet their accurate measurement remains a persistent challenge. While many task- and domain-specific metrics have been proposed to…

Computation and Language · Computer Science 2025-10-10 Atharva Kulkarni , Yuan Zhang , Joel Ruben Antony Moniz , Xiou Ge , Bo-Hsiang Tseng , Dhivya Piraviperumal , Swabha Swayamdipta , Hong Yu

We proposed an end-to-end system design towards utilizing Retrieval Augmented Generation (RAG) to improve the factual accuracy of Large Language Models (LLMs) for domain-specific and time-sensitive queries related to private…

Computation and Language · Computer Science 2024-03-18 Jiarui Li , Ye Yuan , Zehua Zhang

Despite tremendous advancements, current state-of-the-art Vision-Language Models (VLMs) are still far from perfect. They tend to hallucinate and may generate biased responses. In such circumstances, having a way to assess the reliability of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Qian Yang , Weixiang Yan , Aishwarya Agrawal

Prior works have shown that fine-tuning on new knowledge can induce factual hallucinations in large language models (LLMs), leading to incorrect outputs when evaluated on previously known information. However, the specific manifestations of…

Computation and Language · Computer Science 2026-04-20 Renfei Dang , Peng Hu , Zhejian Lai , Changjiang Gao , Min Zhang , Shujian Huang

In our era of widespread false information, human fact-checkers often face the challenge of duplicating efforts when verifying claims that may have already been addressed in other countries or languages. As false information transcends…

Computation and Language · Computer Science 2025-09-25 Ivan Vykopal , Matúš Pikuliak , Simon Ostermann , Tatiana Anikina , Michal Gregor , Marián Šimko

RAG systems have transformed how LLMs access external knowledge, but we find that current implementations exhibit a bias toward factual, objective content, as evidenced by existing benchmarks and datasets that prioritize objective…

Artificial Intelligence · Computer Science 2026-04-15 Aditya Agrawal , Alwarappan Nakkiran , Darshan Fofadiya , Alex Karlsson , Harsha Aduri

Large Language Models (LLMs) frequently produce factually inaccurate outputs - a phenomenon known as hallucination - which limits their accuracy in knowledge-intensive NLP tasks. Retrieval-augmented generation and agentic frameworks such as…

Computation and Language · Computer Science 2025-04-01 Alexander Murphy , Mohd Sanad Zaki Rizvi , Aden Haussmann , Ping Nie , Guifu Liu , Aryo Pradipta Gema , Pasquale Minervini

This project develops a self correcting framework for large language models (LLMs) that detects and mitigates hallucinations during multi-step reasoning. Rather than relying solely on final answer correctness, our approach leverages fine…

Artificial Intelligence · Computer Science 2025-11-21 Chelsea Zou , Yiheng Yao , Basant Khalil