中文
相关论文

相关论文: From Single to Multi: How LLMs Hallucinate in Mult…

200 篇论文

Hallucination plagues even frontier LLMs--but how bad is it really for summarizing academic papers? We evaluate Factored Verification, a simple automated method for detecting hallucinations in abstractive summaries. This method sets a new…

计算与语言 · 计算机科学 2023-10-17 Charlie George , Andreas Stuhlmüller

Large language models (LLMs) can be prone to hallucinations - generating unreliable outputs that are unfaithful to their inputs, external facts or internally inconsistent. In this work, we address several challenges for post-hoc…

计算与语言 · 计算机科学 2024-08-12 Simon Valentin , Jinmiao Fu , Gianluca Detommaso , Shaoyuan Xu , Giovanni Zappella , Bryan Wang

Recent advancements in multimodal large language models (MLLMs) have shown unprecedented capabilities in advancing various vision-language tasks. However, MLLMs face significant challenges with hallucinations, and misleading outputs that do…

计算机视觉与模式识别 · 计算机科学 2024-12-24 Shengqiong Wu , Hao Fei , Liangming Pan , William Yang Wang , Shuicheng Yan , Tat-Seng Chua

The emergence of large language models (LLMs) is a milestone in generative artificial intelligence, achieving significant success in text comprehension and generation tasks. Despite the tremendous success of LLMs in many downstream tasks,…

计算与语言 · 计算机科学 2024-07-16 He Li , Haoang Chi , Mingyu Liu , Wenjing Yang

In recent years, large language models (LLMs) have become incredibly popular, with ChatGPT for example being used by over a billion users. While these models exhibit remarkable language understanding and logical prowess, a notable challenge…

计算与语言 · 计算机科学 2024-02-06 Elijah Berberette , Jack Hutchins , Amir Sadovnik

Hallucination refers to the inaccurate, irrelevant, and inconsistent text generated from large language models (LLMs). While the LLMs have shown great promise in a variety of tasks, the issue of hallucination still remains a major challenge…

计算与语言 · 计算机科学 2025-02-26 Junhyun Lee , Harshith Goka , Hyeonmok Ko

Recent development of Large Vision-Language Models (LVLMs) has attracted growing attention within the AI landscape for its practical implementation potential. However, ``hallucination'', or more specifically, the misalignment between…

计算机视觉与模式识别 · 计算机科学 2024-05-07 Hanchao Liu , Wenyuan Xue , Yifei Chen , Dapeng Chen , Xiutian Zhao , Ke Wang , Liping Hou , Rongjun Li , Wei Peng

Multi-round incomplete information tasks are crucial for evaluating the lateral thinking capabilities of large language models (LLMs). Currently, research primarily relies on multiple benchmarks and automated evaluation metrics to assess…

计算与语言 · 计算机科学 2025-06-02 Wenhan Dong , Tianyi Hu , Jingyi Zheng , Zhen Sun , Yuemeng Zhao , Yule Liu , Xinlei He , Xinyi Huang

Large language models (LLMs) hallucinate: they produce fluent outputs that are factually incorrect. We present a geometric dynamical systems framework in which hallucinations arise from task-dependent basin structure in latent space. Using…

计算与语言 · 计算机科学 2026-04-07 Kalyan Cherukuri , Lav R. Varshney

The rise of Large Language Models (LLMs) has significantly advanced various applications on software engineering tasks, particularly in code generation. Despite the promising performance, LLMs are prone to generate hallucinations, which…

软件工程 · 计算机科学 2026-01-22 Fang Liu , Yang Liu , Lin Shi , Zhen Yang , Li Zhang , Xiaoli Lian , Zhongqi Li , Yuchi Ma

While large language models (LLMs) have proven to be effective on a large variety of tasks, they are also known to hallucinate information. To measure whether an LLM prefers factually consistent continuations of its input, we propose a new…

计算与语言 · 计算机科学 2023-12-05 Derek Tam , Anisha Mascarenhas , Shiyue Zhang , Sarah Kwan , Mohit Bansal , Colin Raffel

The emergence of large language models (LLMs) has marked a significant breakthrough in natural language processing (NLP), fueling a paradigm shift in information acquisition. Nevertheless, LLMs are prone to hallucination, generating…

Multi-document summarization (MDS) is the task of reflecting key points from any set of documents into a concise text paragraph. In the past, it has been used to aggregate news, tweets, product reviews, etc. from various sources. Owing to…

计算与语言 · 计算机科学 2020-10-06 Alvin Dey , Tanya Chowdhury , Yash Kumar Atri , Tanmoy Chakraborty

Large Language Models (LLMs) have transformed the Natural Language Processing (NLP) landscape with their remarkable ability to understand and generate human-like text. However, these models are prone to ``hallucinations'' -- outputs that do…

Large Language Models (LLMs) driven by In-Context Learning (ICL) have significantly improved the performance of text-to-SQL. Previous methods generally employ a two-stage reasoning framework, namely 1) schema linking and 2) logical…

计算与语言 · 计算机科学 2024-05-27 Ge Qu , Jinyang Li , Bowen Li , Bowen Qin , Nan Huo , Chenhao Ma , Reynold Cheng

Large language models (LLMs) frequently generate confident yet inaccurate responses, introducing significant risks for deployment in safety-critical domains. We present a novel, test-time approach to detecting model hallucination through…

机器学习 · 计算机科学 2025-10-07 Hazel Kim , Tom A. Lamb , Adel Bibi , Philip Torr , Yarin Gal

A key challenge in Multi-Document Summarization (MDS) is effectively integrating information from multiple sources while maintaining coherence and topical relevance. While Large Language Models have shown impressive results in…

计算与语言 · 计算机科学 2025-09-15 Chuyuan Li , Austin Xu , Shafiq Joty , Giuseppe Carenini

This research paper focuses on the challenges posed by hallucinations in large language models (LLMs), particularly in the context of the medical domain. Hallucination, wherein these models generate plausible yet unverified or incorrect…

计算与语言 · 计算机科学 2023-10-17 Ankit Pal , Logesh Kumar Umapathi , Malaikannan Sankarasubbu

Hallucination is often regarded as a major impediment for using large language models (LLMs), especially for knowledge-intensive tasks. Even when the training corpus consists solely of true statements, language models still generate…

计算与语言 · 计算机科学 2024-07-12 Yuji Zhang , Sha Li , Jiateng Liu , Pengfei Yu , Yi R. Fung , Jing Li , Manling Li , Heng Ji

Hallucination in Large Language Models (LLMs) refers to the generation of content that is not faithful to the input or the real-world facts. This paper provides a rigorous treatment of hallucination in LLMs, including formal definitions and…

计算与语言 · 计算机科学 2025-08-01 Esmail Gumaan