English
Related papers

Related papers: Bolster Hallucination Detection via Prompt-Guided …

200 papers

Large Language Models (LLMs) are revolutionizing software engineering (SE), with special emphasis on code generation and analysis. However, their applications to broader SE practices including conceptualization, design, and other non-code…

Software Engineering · Computer Science 2025-06-16 Fabian C. Peña

Hallucination is a well-known phenomenon in text generated by large language models (LLMs). The existence of hallucinatory responses is found in almost all application scenarios e.g., summarization, question-answering (QA) etc. For…

Computation and Language · Computer Science 2023-12-11 Mobashir Sadat , Zhengyu Zhou , Lukas Lange , Jun Araki , Arsalan Gundroo , Bingqing Wang , Rakesh R Menon , Md Rizwan Parvez , Zhe Feng

Large language models (LLMs) have revolutionized the field of natural language processing with their impressive reasoning and question-answering capabilities. However, these models are sometimes prone to generating credible-sounding but…

Computation and Language · Computer Science 2026-04-21 Ranganath Krishnan , Piyush Khanna , Omesh Tickoo

Hallucination, broadly referring to unfaithful, fabricated, or inconsistent content generated by LLMs, has wide-ranging implications. Therefore, a large body of effort has been devoted to detecting LLM hallucinations, as well as designing…

Artificial Intelligence · Computer Science 2026-05-13 Wenbo Chen , Veena Padmanabhan , Tootiya Giyahchi , Elaine Wong , Leman Akoglu

Large Language Models (LLMs) have demonstrated remarkable performance across various tasks but remain prone to hallucinations. Detecting hallucinations is essential for safety-critical applications, and recent methods leverage attention map…

Machine Learning · Computer Science 2025-10-21 Jakub Binkowski , Denis Janiak , Albert Sawczyn , Bogdan Gabrys , Tomasz Kajdanowicz

Hallucinations in large language models (LLMs) pose significant safety concerns that impede their broader deployment. Recent research in hallucination detection has demonstrated that LLMs' internal representations contain truthfulness…

Machine Learning · Computer Science 2025-11-11 Mengjia Niu , Hamed Haddadi , Guansong Pang

Large language models (LLMs) often generate fluent but factually incorrect statements despite having access to relevant evidence, a failure mode rooted in how they allocate attention between contextual and parametric knowledge.…

Computation and Language · Computer Science 2025-12-02 Kenji Sahay , Snigdha Pandya , Rohan Nagale , Anna Lin , Shikhar Shiromani , Kevin Zhu , Dev Sunishchal

As we all know, hallucinations prevail in Large Language Models (LLMs), where the generated content is coherent but factually incorrect, which inflicts a heavy blow on the widespread application of LLMs. Previous studies have shown that…

Computation and Language · Computer Science 2024-10-15 Xinping Zhao , Jindi Yu , Zhenyu Liu , Jifang Wang , Dongfang Li , Yibin Chen , Baotian Hu , Min Zhang

Despite the groundbreaking advancements made by large language models (LLMs), hallucination remains a critical bottleneck for their deployment in high-stakes domains. Existing classification-based methods mainly rely on static and passive…

Machine Learning · Computer Science 2026-05-12 Linggang Kong , Lei Wu , Yunlong Zhang , Xiaofeng Zhong , Zhen Wang , Yongjie Wang , Yao Pan

The emergence of large language models (LLMs) is a milestone in generative artificial intelligence, achieving significant success in text comprehension and generation tasks. Despite the tremendous success of LLMs in many downstream tasks,…

Computation and Language · Computer Science 2024-07-16 He Li , Haoang Chi , Mingyu Liu , Wenjing Yang

Large language models (LLMs) frequently generate non-factual content, known as hallucinations. Existing retrieval-augmented-based hallucination detection approaches typically address this by framing it as a classification task, evaluating…

Computation and Language · Computer Science 2024-07-19 Binjie Wang , Steffi Chern , Ethan Chern , Pengfei Liu

Large language models (LLMs) frequently hallucinate and produce factual errors, yet our understanding of why they make these errors remains limited. In this study, we delve into the underlying mechanisms of LLM hallucinations from the…

Computation and Language · Computer Science 2024-03-13 Shiqi Chen , Miao Xiong , Junteng Liu , Zhengxuan Wu , Teng Xiao , Siyang Gao , Junxian He

Hallucination poses a persistent challenge for multimodal large language models (MLLMs). However, existing benchmarks for evaluating hallucinations are generally static, which may overlook the potential risk of data contamination. To…

Computation and Language · Computer Science 2025-07-08 Yahan Tu , Rui Hu , Jitao Sang

In tasks like summarization and open-book question answering (QA), Large Language Models (LLMs) often encounter "contextual hallucination", where they produce irrelevant or incorrect responses despite having access to accurate source…

Computation and Language · Computer Science 2025-07-08 Yu Wang , Kamalika Das , Xiang Gao , Wendi Cui , Peng Li , Jiaxin Zhang

Recent advances in large language models (LLMs) have demonstrated remarkable capabilities in code generation tasks. However, when applied to hardware description languages (HDL), these models exhibit significant limitations due to data…

Computation and Language · Computer Science 2025-03-24 Heng Ping , Shixuan Li , Peiyu Zhang , Anzhe Cheng , Shukai Duan , Nikos Kanakaris , Xiongye Xiao , Wei Yang , Shahin Nazarian , Andrei Irimia , Paul Bogdan

Instruction-following Vision Large Language Models (VLLMs) have achieved significant progress recently on a variety of tasks. These approaches merge strong pre-trained vision models and large language models (LLMs). Since these components…

Machine Learning · Computer Science 2024-02-20 Yiyang Zhou , Chenhang Cui , Rafael Rafailov , Chelsea Finn , Huaxiu Yao

Large language models(LLMs) excel at text generation and knowledge question-answering tasks, but they are prone to generating hallucinated content, severely limiting their application in high-risk domains. Current hallucination detection…

Computation and Language · Computer Science 2025-12-25 Shize Liang , Hongzhi Wang

Large language models (LLMs) are prone to hallucinations, i.e., statements unsupported by the input or training data, hindering reliable deployment. In parallel, numerous uncertainty estimation (UE) methods have been proposed to quantify…

Computation and Language · Computer Science 2026-05-27 Yedidia Agnimo , Anna Korba , Annabelle Blangero , Nicolas Chesneau , Karteek Alahari

Large Language Models (LLMs) have facilitated structured data generation, with applications in domains like tabular data, document databases, product catalogs, etc. However, concerns persist about generation veracity due to incorrect…

Computation and Language · Computer Science 2024-06-04 Chengwei Wei , Kee Kiat Koo , Amir Tavanaei , Karim Bouyarmane

The Retrieval-augmented generation (RAG) system based on Large language model (LLM) has made significant progress. It can effectively reduce factuality hallucinations, but faithfulness hallucinations still exist. Previous methods for…

Computation and Language · Computer Science 2026-01-07 Jianpeng Hu , Yanzeng Li , Jialun Zhong , Wenfa Qi , Lei Zou