English
Related papers

Related papers: Understanding New-Knowledge-Induced Factual Halluc…

200 papers

Hallucinations are outputs by Large Language Models (LLMs) that are factually incorrect yet appear plausible [1]. This paper investigates how such hallucinations influence users' trust in LLMs and users' interaction with LLMs. To explore…

Artificial Intelligence · Computer Science 2025-12-11 Adrian Ryser , Florian Allwein , Tim Schlippe

Hallucination is a well-known phenomenon in text generated by large language models (LLMs). The existence of hallucinatory responses is found in almost all application scenarios e.g., summarization, question-answering (QA) etc. For…

Computation and Language · Computer Science 2023-12-11 Mobashir Sadat , Zhengyu Zhou , Lukas Lange , Jun Araki , Arsalan Gundroo , Bingqing Wang , Rakesh R Menon , Md Rizwan Parvez , Zhe Feng

Multi-round incomplete information tasks are crucial for evaluating the lateral thinking capabilities of large language models (LLMs). Currently, research primarily relies on multiple benchmarks and automated evaluation metrics to assess…

Computation and Language · Computer Science 2025-06-02 Wenhan Dong , Tianyi Hu , Jingyi Zheng , Zhen Sun , Yuemeng Zhao , Yule Liu , Xinlei He , Xinyi Huang

The widespread adoption and transformative effects of large language models (LLMs) have sparked concerns regarding their capacity to produce inaccurate and fictitious content, referred to as `hallucinations'. Given the potential risks…

Human-Computer Interaction · Computer Science 2024-08-13 Mahjabin Nahar , Haeseung Seo , Eun-Ju Lee , Aiping Xiong , Dongwon Lee

Large Language Models (LLMs) are prone to generating plausible yet incorrect responses, known as hallucinations. Effectively detecting hallucinations is therefore crucial for the safe deployment of LLMs. Recent research has linked…

Computation and Language · Computer Science 2026-03-03 Litian Liu , Reza Pourreza , Sunny Panchal , Apratim Bhattacharyya , Yubing Jian , Yao Qin , Roland Memisevic

Context-grounded hallucinations are cases where model outputs contain information not verifiable against the source text. We study the applicability of LLMs for localizing such hallucinations, as a more practical alternative to existing…

Computation and Language · Computer Science 2025-09-30 Yehonatan Peisakhovsky , Zorik Gekhman , Yosi Mass , Liat Ein-Dor , Roi Reichart

Large language models (LLMs) possess extensive world knowledge, including geospatial knowledge, which has been successfully applied to various geospatial tasks such as mobility prediction and social indicator prediction. However, LLMs often…

Computation and Language · Computer Science 2025-07-29 Shengyuan Wang , Jie Feng , Tianhui Liu , Dan Pei , Yong Li

Alignment is a standard procedure to fine-tune pre-trained large language models (LLMs) to follow natural language instructions and serve as helpful AI assistants. We have observed, however, that the conventional alignment process fails to…

Computation and Language · Computer Science 2024-05-03 Sheng-Chieh Lin , Luyu Gao , Barlas Oguz , Wenhan Xiong , Jimmy Lin , Wen-tau Yih , Xilun Chen

Recently evolved large reasoning models (LRMs) show powerful performance in solving complex tasks with long chain-of-thought (CoT) reasoning capability. As these LRMs are mostly developed by post-training on formal reasoning tasks, whether…

Computation and Language · Computer Science 2025-05-30 Zijun Yao , Yantao Liu , Yanxu Chen , Jianhui Chen , Junfeng Fang , Lei Hou , Juanzi Li , Tat-Seng Chua

Instruction-tuning enhances the ability of large language models (LLMs) to follow user instructions more accurately, improving usability while reducing harmful outputs. However, this process may increase the model's dependence on user…

Computation and Language · Computer Science 2025-07-25 Kyubeen Han , Junseo Jang , Hongjin Kim , Geunyeong Jeong , Harksoo Kim

Despite the many advances of Large Language Models (LLMs) and their unprecedented rapid evolution, their impact and integration into every facet of our daily lives is limited due to various reasons. One critical factor hindering their…

Computation and Language · Computer Science 2024-08-20 Yakir Yehuda , Itzik Malkiel , Oren Barkan , Jonathan Weill , Royi Ronen , Noam Koenigstein

Large Vision-Language Models (LVLMs) have made significant progress in recent years but are also prone to hallucination issues. They exhibit more hallucinations in longer, free-form responses, often attributed to accumulated uncertainties.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Ge Zheng , Jiaye Qian , Jiajin Tang , Sibei Yang

Large language models (LLMs), despite their remarkable text generation capabilities, often hallucinate and generate text that is factually incorrect and not grounded in real-world knowledge. This poses serious risks in domains like…

Computation and Language · Computer Science 2025-11-18 Raavi Gupta , Pranav Hari Panicker , Sumit Bhatia , Ganesh Ramakrishnan

Despite their success at many natural language processing (NLP) tasks, large language models still struggle to effectively leverage knowledge for knowledge-intensive tasks, manifesting limitations such as generating incomplete, non-factual,…

Computation and Language · Computer Science 2024-10-03 Yougang Lyu , Lingyong Yan , Shuaiqiang Wang , Haibo Shi , Dawei Yin , Pengjie Ren , Zhumin Chen , Maarten de Rijke , Zhaochun Ren

Despite showing increasingly human-like abilities, large language models (LLMs) often struggle with factual inaccuracies, i.e. "hallucinations", even when they hold relevant knowledge. To address these hallucinations, current approaches…

Computation and Language · Computer Science 2024-06-12 Xiaoying Zhang , Baolin Peng , Ye Tian , Jingyan Zhou , Lifeng Jin , Linfeng Song , Haitao Mi , Helen Meng

Language models (LMs) pretrained on large corpora of text from the web have been observed to contain large amounts of various types of knowledge about the world. This observation has led to a new and exciting paradigm in knowledge graph…

Computation and Language · Computer Science 2023-01-27 Mehran Kazemi , Sid Mittal , Deepak Ramachandran

Large language models (LLMs) frequently generate hallucinations-content that deviates from factual accuracy or provided context-posing challenges for diagnosis due to the complex interplay of underlying causes. This paper introduces a…

Computation and Language · Computer Science 2025-04-18 Yiyou Sun , Yu Gai , Lijie Chen , Abhilasha Ravichander , Yejin Choi , Dawn Song

Recent development of Large Vision-Language Models (LVLMs) has attracted growing attention within the AI landscape for its practical implementation potential. However, ``hallucination'', or more specifically, the misalignment between…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Hanchao Liu , Wenyuan Xue , Yifei Chen , Dapeng Chen , Xiutian Zhao , Ke Wang , Liping Hou , Rongjun Li , Wei Peng

Hallucinations in LLMs present a critical barrier to their reliable usage. Existing research usually categorizes hallucination by their external properties rather than by the LLMs' underlying internal properties. This external focus…

Computation and Language · Computer Science 2025-10-29 Adi Simhi , Jonathan Herzig , Itay Itzhak , Dana Arad , Zorik Gekhman , Roi Reichart , Fazl Barez , Gabriel Stanovsky , Idan Szpektor , Yonatan Belinkov

Large Language Models have demonstrated remarkable capabilities across diverse tasks, yet they frequently generate hallucinations outputs that are fluent but factually incorrect or unsupported. We propose Counterfactual Probing, a novel…

Computation and Language · Computer Science 2025-08-05 Yijun Feng