English
Related papers

Related papers: Self-contradictory Hallucinations of Large Languag…

200 papers

Large language model (LLM) systems suffer from the models' unstable ability to generate valid and factual content, resulting in hallucination generation. Current hallucination detection methods heavily rely on out-of-model information…

Computation and Language · Computer Science 2025-02-20 Peiran Wang , Yang Liu , Yunfei Lu , Jue Hong , Ye Wu

Large Language Models (LLMs) have emerged as a groundbreaking technology with their unparalleled text generation capabilities across various applications. Nevertheless, concerns persist regarding the accuracy and appropriateness of their…

Computation and Language · Computer Science 2024-03-15 Jie Huang , Xinyun Chen , Swaroop Mishra , Huaixiu Steven Zheng , Adams Wei Yu , Xinying Song , Denny Zhou

Large Language Models (LLMs) suffer from hallucination problems, which hinder their reliability in sensitive applications. In the black-box setting, several self-consistency-based techniques have been proposed for hallucination detection.…

Computation and Language · Computer Science 2025-02-25 Yihao Xue , Kristjan Greenewald , Youssef Mroueh , Baharan Mirzasoleiman

Large Language Models (LLMs) are notorious for blending fact with fiction and generating non-factual content, known as hallucinations. To address this challenge, we propose an interactive system that helps users gain insight into the…

Human-Computer Interaction · Computer Science 2024-04-05 Furui Cheng , Vilém Zouhar , Simran Arora , Mrinmaya Sachan , Hendrik Strobelt , Mennatallah El-Assady

Large Language Models (LLMs) are widely used in critical fields such as healthcare, education, and finance due to their remarkable proficiency in various language-related tasks. However, LLMs are prone to generating factually incorrect…

Computation and Language · Computer Science 2023-11-27 Muneeswaran I , Shreya Saxena , Siva Prasad , M V Sai Prakash , Advaith Shankar , Varun V , Vishal Vaddina , Saisubramaniam Gopalakrishnan

Large Language models (LLMs) show extraordinary abilities, but they are still prone to hallucinations, especially when we use them for generating Academic content. We have investigated four popular LLMs, ChatGPT, Grok, Gemini, and Copilot…

Computation and Language · Computer Science 2026-05-07 Humam Khan , Md Tabrez Nafis , Shahab Saquib Sohail , Aqeel Khalique , Rehan Hasan Khan

Large Language Models (LLMs) frequently generate plausible but non-factual content, a phenomenon known as hallucination. While existing detection methods typically rely on computationally expensive sampling-based consistency checks or…

Machine Learning · Computer Science 2026-05-07 Dan Wilson , Mohamed Akrout

Large language models (LMs) are prone to generate factual errors, which are often called hallucinations. In this paper, we introduce a comprehensive taxonomy of hallucinations and argue that hallucinations manifest in diverse forms, each…

Computation and Language · Computer Science 2024-08-14 Abhika Mishra , Akari Asai , Vidhisha Balachandran , Yizhong Wang , Graham Neubig , Yulia Tsvetkov , Hannaneh Hajishirzi

Large-scale multilingual machine translation systems have demonstrated remarkable ability to translate directly between numerous languages, making them increasingly appealing for real-world applications. However, when deployed in the wild,…

Computation and Language · Computer Science 2023-03-29 Nuno M. Guerreiro , Duarte Alves , Jonas Waldendorf , Barry Haddow , Alexandra Birch , Pierre Colombo , André F. T. Martins

Large language models (LLMs), such as ChatGPT, have emerged with astonishing capabilities approaching artificial general intelligence. While providing convenience for various societal needs, LLMs have also lowered the cost of generating…

Computation and Language · Computer Science 2023-08-28 Zhenhua Wang , Wei Xie , Kai Chen , Baosheng Wang , Zhiwen Gui , Enze Wang

Large language models (LLMs) achieve remarkable fluency across linguistic and reasoning tasks but remain systematically prone to hallucination. Prevailing accounts attribute hallucinations to data gaps, limited context, or optimization…

Computers and Society · Computer Science 2025-09-23 Richard Ackermann , Simeon Emanuilov

Hallucination is a well-known phenomenon in text generated by large language models (LLMs). The existence of hallucinatory responses is found in almost all application scenarios e.g., summarization, question-answering (QA) etc. For…

Computation and Language · Computer Science 2023-12-11 Mobashir Sadat , Zhengyu Zhou , Lukas Lange , Jun Araki , Arsalan Gundroo , Bingqing Wang , Rakesh R Menon , Md Rizwan Parvez , Zhe Feng

Existing NLP work commonly treats contradictions as errors to be resolved by choosing which statements to accept or discard. Yet a key aspect of human reasoning in social interactions and professional domains is the ability to hypothesize…

Computation and Language · Computer Science 2026-05-28 Jason Chan , Zhixue Zhao , Robert Gaizauskas

This paper presents a systematic defense of large language model (LLM) hallucinations or 'confabulations' as a potential resource instead of a categorically negative pitfall. The standard view is that confabulations are inherently…

Computation and Language · Computer Science 2024-06-27 Peiqi Sui , Eamon Duede , Sophie Wu , Richard Jean So

The recent large language models (LLMs), e.g., ChatGPT, have been able to generate human-like and fluent responses when provided with specific instructions. While admitting the convenience brought by technological advancement, educators…

Computation and Language · Computer Science 2023-12-27 Zijie Zeng , Lele Sha , Yuheng Li , Kaixun Yang , Dragan Gašević , Guanliang Chen

Large language models are successful in answering factoid questions but are also prone to hallucination. We investigate the phenomenon of LLMs possessing correct answer knowledge yet still hallucinating from the perspective of inference…

Computation and Language · Computer Science 2024-10-29 Che Jiang , Biqing Qi , Xiangyu Hong , Dayuan Fu , Yang Cheng , Fandong Meng , Mo Yu , Bowen Zhou , Jie Zhou

The emergence of large language models (LLMs) has marked a significant breakthrough in natural language processing (NLP), fueling a paradigm shift in information acquisition. Nevertheless, LLMs are prone to hallucination, generating…

Computation and Language · Computer Science 2024-11-20 Lei Huang , Weijiang Yu , Weitao Ma , Weihong Zhong , Zhangyin Feng , Haotian Wang , Qianglong Chen , Weihua Peng , Xiaocheng Feng , Bing Qin , Ting Liu

Large Language Models (LLMs) have demonstrated remarkable capabilities, revolutionizing the integration of AI in daily life applications. However, they are prone to hallucinations, generating claims that contradict established facts,…

Computation and Language · Computer Science 2024-06-14 A B M Ashikur Rahman , Saeed Anwar , Muhammad Usman , Ajmal Mian

Safety-aligned large language models (LLMs) sometimes falsely refuse pseudo-harmful prompts, like "how to kill a mosquito," which are actually harmless. Frequent false refusals not only frustrate users but also provoke a public backlash…

Computation and Language · Computer Science 2025-06-12 Bang An , Sicheng Zhu , Ruiyi Zhang , Michael-Andrei Panaitescu-Liess , Yuancheng Xu , Furong Huang

Large Language Models (LLMs) have transformed the Natural Language Processing (NLP) landscape with their remarkable ability to understand and generate human-like text. However, these models are prone to ``hallucinations'' -- outputs that do…