English
Related papers

Related papers: Relational Linearity is a Predictor of Hallucinati…

200 papers

Large language models are known to hallucinate when faced with unfamiliar queries, but the underlying mechanism that govern how models hallucinate are not yet fully understood. In this work, we find that unfamiliar examples in the models'…

Machine Learning · Computer Science 2024-05-30 Katie Kang , Eric Wallace , Claire Tomlin , Aviral Kumar , Sergey Levine

Analogical reasoning is at the core of human cognition, serving as an important foundation for a variety of intellectual activities. While prior work has shown that LLMs can represent task patterns and surface-level concepts, it remains…

Computation and Language · Computer Science 2025-11-26 Taewhoo Lee , Minju Song , Chanwoong Yoon , Jungwoo Park , Jaewoo Kang

As large language models (LLMs) evolve from conversational assistants into agents capable of handling complex tasks, they are increasingly deployed in high-risk domains. However, existing benchmarks largely rely on mixed queries and…

Computation and Language · Computer Science 2026-04-28 Yuhe Wu , Guangyu Wang , Yuran Chen , Jiatong Zhang , Yutong Zhang , Yujie Chen , Jiaming Shang , Guang Zhang , Zhuang Liu

Machine Translation (MT) is undergoing a paradigm shift, with systems based on fine-tuned large language models (LLM) becoming increasingly competitive with traditional encoder-decoder models trained specifically for translation tasks.…

Computation and Language · Computer Science 2025-01-30 Zilu Tang , Rajen Chatterjee , Sarthak Garg

Failures in large language models (LLMs) are often analyzed from a behavioral perspective, where incorrect outputs in factual question answering are commonly associated with missing knowledge. In this work, focusing on entity-based factual…

Artificial Intelligence · Computer Science 2026-02-17 Haolang Lu , Hongrui Peng , WeiYe Fu , Guoshun Nan , Xinye Cao , Xingrui Li , Hongcan Guo , Kun Wang

Large language models (LLMs) are starting to complement traditional information seeking mechanisms such as web search. LLM-powered chatbots like ChatGPT are gaining prominence among the general public. AI chatbots are also increasingly…

Computation and Language · Computer Science 2025-11-25 Vibhor Agarwal , Yiqiao Jin , Mohit Chandra , Munmun De Choudhury , Srijan Kumar , Nishanth Sastry

This survey presents a comprehensive analysis of the phenomenon of hallucination in multimodal large language models (MLLMs), also known as Large Vision-Language Models (LVLMs), which have demonstrated significant advancements and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Zechen Bai , Pichao Wang , Tianjun Xiao , Tong He , Zongbo Han , Zheng Zhang , Mike Zheng Shou

Hallucination in a foundation model (FM) refers to the generation of content that strays from factual reality or includes fabricated information. This survey paper provides an extensive overview of recent efforts that aim to identify,…

Artificial Intelligence · Computer Science 2023-09-13 Vipula Rawte , Amit Sheth , Amitava Das

The generalization of language models (LMs) is undergoing active debates, contrasting their potential for general intelligence with their struggles with basic knowledge composition (e.g., reverse/transition curse). This paper uncovers the…

Computation and Language · Computer Science 2025-02-10 Letian Peng , Chenyang An , Shibo Hao , Chengyu Dong , Jingbo Shang

This paper primarily focuses on the hallucinations caused due to AI language models(LLMs).LLMs have shown extraordinary Language understanding and generation capabilities .Still it has major a disadvantage hallucinations which give outputs…

Computation and Language · Computer Science 2026-04-07 Sailesh kiran kurra , Shiek Ruksana , Vishal Borusu

We develop a principled procedure for determining when a large language model (LLM) should abstain from responding (e.g., by saying "I don't know") in a general domain, instead of resorting to possibly "hallucinating" a non-sensical or…

When large language models are aligned via supervised fine-tuning, they may encounter new factual information that was not acquired through pre-training. It is often conjectured that this can teach the model the behavior of hallucinating…

Computation and Language · Computer Science 2024-10-02 Zorik Gekhman , Gal Yona , Roee Aharoni , Matan Eyal , Amir Feder , Roi Reichart , Jonathan Herzig

Large Language Models (LLMs) exhibit remarkable capabilities in natural language understanding and reasoning, but suffer from hallucination: the generation of factually incorrect content. While numerous methods have been developed to reduce…

Computation and Language · Computer Science 2026-01-22 Mohor Banerjee , Nadya Yuki Wangsajaya , Syed Ali Redha Alsagoff , Min Sen Tan , Zachary Choy Kit Chun , Alvin Chan Guo Wei

Hallucinations in large language models (LLMs) refer to the phenomenon of LLMs producing responses that are coherent yet factually inaccurate. This issue undermines the effectiveness of LLMs in practical applications, necessitating research…

Computation and Language · Computer Science 2024-06-11 Weihang Su , Changyue Wang , Qingyao Ai , Yiran HU , Zhijing Wu , Yujia Zhou , Yiqun Liu

Large Language Models (LLMs) have significantly advanced communications fields, such as Telecom Q\&A, mathematical modeling, and coding. However, LLMs encounter an inherent issue known as hallucination, i.e., generating fact-conflicting or…

Networking and Internet Architecture · Computer Science 2024-12-10 Yinqiu Liu , Guangyuan Liu , Ruichen Zhang , Dusit Niyato , Zehui Xiong , Dong In Kim , Kaibin Huang , Hongyang Du

Large language models (LLMs) have demonstrated impressive capabilities across a variety of tasks, but their increasing autonomy in real-world applications raises concerns about their trustworthiness. While hallucinations-unintentional…

Machine Learning · Computer Science 2025-09-04 Haoran Huan , Mihir Prabhudesai , Mengning Wu , Shantanu Jaiswal , Deepak Pathak

Large language models have recently made great strides in reasoning task performance through chain-of-thought (CoT) strategies trained via reinforcement learning; however, these "reasoning large language models" (RLLMs) remain imperfect…

Machine Learning · Computer Science 2025-10-13 Alex Heyman , Joel Zylberberg

This research paper focuses on the challenges posed by hallucinations in large language models (LLMs), particularly in the context of the medical domain. Hallucination, wherein these models generate plausible yet unverified or incorrect…

Computation and Language · Computer Science 2023-10-17 Ankit Pal , Logesh Kumar Umapathi , Malaikannan Sankarasubbu

Large language models (LLMs) have gained broad applications across various domains but still struggle with hallucinations. Currently, hallucinations occur frequently in the generation of factual content and pose a great challenge to…

Computation and Language · Computer Science 2025-12-01 Zouying Cao , Yifei Yang , XiaoJing Li , Hai Zhao

Though advanced in understanding visual information with human languages, Large Vision-Language Models (LVLMs) still suffer from multimodal hallucinations. A natural concern is that during multimodal interaction, the generated…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Weihong Zhong , Xiaocheng Feng , Liang Zhao , Qiming Li , Lei Huang , Yuxuan Gu , Weitao Ma , Yuan Xu , Bing Qin