English
Related papers

Related papers: Analysis of Plan-based Retrieval for Grounded Text…

200 papers

Fact-seeking question answering with large language models (LLMs) remains unreliable when answers depend on up-to-date or conflicting information. Although retrieval-augmented and tool-using LLMs reduce hallucinations, they often rely on…

Computation and Language · Computer Science 2026-03-17 Auksarapak Kietkajornrit , Jad Tarifi , Nima Asgharbeygi

Retrieval-Augmented Generation (RAG) aims to mitigate hallucinations in large language models (LLMs) by grounding responses in retrieved documents. Yet, RAG-based LLMs still hallucinate even when provided with correct and sufficient…

Computation and Language · Computer Science 2026-02-04 Samuel Yeh , Sharon Li , Tanwi Mallick

Large language models (LLMs) frequently generate hallucinations-content that deviates from factual accuracy or provided context-posing challenges for diagnosis due to the complex interplay of underlying causes. This paper introduces a…

Computation and Language · Computer Science 2025-04-18 Yiyou Sun , Yu Gai , Lijie Chen , Abhilasha Ravichander , Yejin Choi , Dawn Song

Generative models for image generation are now commonly used for a wide variety of applications, ranging from guided image generation for entertainment to solving inverse problems. Nonetheless, training a generator is a non-trivial feat…

Machine Learning · Computer Science 2025-03-07 Eldad Haber , Shadab Ahamed , Md. Shahriar Rahim Siddiqui , Niloufar Zakariaei , Moshe Eliasof

Hallucination in a foundation model (FM) refers to the generation of content that strays from factual reality or includes fabricated information. This survey paper provides an extensive overview of recent efforts that aim to identify,…

Artificial Intelligence · Computer Science 2023-09-13 Vipula Rawte , Amit Sheth , Amitava Das

Large Language Models (LLMs) have shown significant potential in automating code generation tasks offering new opportunities across software engineering domains. However, their practical application remains limited due to hallucinations -…

Software Engineering · Computer Science 2025-08-18 Marc Pavel , Nenad Petrovic , Lukasz Mazur , Vahid Zolfaghari , Fengjunjie Pan , Alois Knoll

How to alleviate the hallucinations of Large Language Models (LLMs) has always been the fundamental goal pursued by the LLMs research community. Looking through numerous hallucination-related studies, a mainstream category of methods is to…

Computation and Language · Computer Science 2025-02-12 Yinghui Li , Haojing Huang , Jiayi Kuang , Yangning Li , Shu-Yu Guo , Chao Qu , Xiaoyu Tan , Hai-Tao Zheng , Ying Shen , Philip S. Yu

Score-based diffusion models have achieved incredible performance in generating realistic images, audio, and video data. While these models produce high-quality samples with impressive details, they often introduce unrealistic artifacts,…

Machine Learning · Computer Science 2025-03-06 Rui Lu , Runzhe Wang , Kaifeng Lyu , Xitai Jiang , Gao Huang , Mengdi Wang

Existing large language models (LLMs) are known for generating "hallucinated" content, namely a fabricated text of plausibly looking, yet unfounded, facts. To identify when these hallucination scenarios occur, we examine the properties of…

Computation and Language · Computer Science 2023-09-06 Mohamed Akrout

Large language models (LLMs) are susceptible to hallucinations -- factually incorrect outputs -- leading to a large body of work on detecting and mitigating such cases. We argue that it is important to distinguish between two types of…

Computation and Language · Computer Science 2025-02-19 Adi Simhi , Jonathan Herzig , Idan Szpektor , Yonatan Belinkov

Despite impressive advances in Natural Language Generation (NLG) and Large Language Models (LLMs), researchers are still unclear about important aspects of NLG evaluation. To substantiate this claim, I examine current classifications of…

Computation and Language · Computer Science 2024-01-17 Kees van Deemter

Despite achieving outstanding performance on various cross-modal tasks, current large vision-language models (LVLMs) still suffer from hallucination issues, manifesting as inconsistencies between their generated responses and the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Rui Hu , Yahan Tu , Shuyu Wei , Dongyuan Lu , Jitao Sang

Difficult decision-making problems abound in various disciplines and domains. The proliferation of generative techniques, especially large language models (LLMs), has excited interest in using them for decision support. However, LLMs cannot…

Artificial Intelligence · Computer Science 2025-09-16 Boris Kovalerchuk , Brent D. Fegley

While large language models (LLMs) have taken great strides towards helping humans with a plethora of tasks, hallucinations remain a major impediment towards gaining user trust. The fluency and coherence of model generations even when…

Computation and Language · Computer Science 2024-08-23 Ben Snyder , Marius Moisescu , Muhammad Bilal Zafar

This study aims to develop models that generate corpus informed clarifying questions for web search, in a way that ensures the questions align with the available information in the retrieval corpus. We demonstrate the effectiveness of…

Information Retrieval · Computer Science 2024-09-30 Antonios Minas Krasakis , Andrew Yates , Evangelos Kanoulas

In the context of knowledge-driven seq-to-seq generation tasks, such as document-based question answering and document summarization systems, two fundamental knowledge sources play crucial roles: the inherent knowledge embedded within model…

Computation and Language · Computer Science 2025-01-16 Han Cao , Zhaoyang Zhang , Xiangtian Li , Chufan Wu , Hansong Zhang , Wenqing Zhang

Large language models (LLMs), including ChatGPT, Bard, and Llama, have achieved remarkable successes over the last two years in a range of different applications. In spite of these successes, there exist concerns that limit the wide…

Computation and Language · Computer Science 2024-01-17 Junliang Luo , Tianyu Li , Di Wu , Michael Jenkin , Steve Liu , Gregory Dudek

We explore a strategy to handle controversial topics in LLM-based chatbots based on Wikipedia's Neutral Point of View (NPOV) principle: acknowledge the absence of a single true answer and surface multiple perspectives. We frame this as…

Computation and Language · Computer Science 2024-03-15 Tyler A. Chang , Katrin Tomanek , Jessica Hoffmann , Nithum Thain , Erin van Liemt , Kathleen Meier-Hellstern , Lucas Dixon

Large Language Models (LLMs) have demonstrated remarkable human-level natural language generation capabilities. However, their potential to generate misinformation, often called the hallucination problem, poses a significant risk to their…

Computation and Language · Computer Science 2023-10-16 Sehyun Choi , Tianqing Fang , Zhaowei Wang , Yangqiu Song

The emergence of large language models (LLMs) is a milestone in generative artificial intelligence, achieving significant success in text comprehension and generation tasks. Despite the tremendous success of LLMs in many downstream tasks,…

Computation and Language · Computer Science 2024-07-16 He Li , Haoang Chi , Mingyu Liu , Wenjing Yang