English
Related papers

Related papers: Probabilistic Guarantees for Reducing Contextual H…

200 papers

Large Language Models have demonstrated remarkable capabilities across diverse tasks, yet they frequently generate hallucinations outputs that are fluent but factually incorrect or unsupported. We propose Counterfactual Probing, a novel…

Computation and Language · Computer Science 2025-08-05 Yijun Feng

Large language models (LLMs) have shown substantial capacity for generating fluent, contextually appropriate responses. However, they can produce hallucinated outputs, especially when a user query includes one or more false premises-claims…

Computation and Language · Computer Science 2026-02-18 Yuehan Qin , Shawn Li , Yi Nian , Xinyan Velocity Yu , Yue Zhao , Xuezhe Ma

Large language models (LLMs) are promising tools for supporting security management tasks, such as incident response planning. However, their unreliability and tendency to hallucinate remain significant challenges. In this paper, we address…

Artificial Intelligence · Computer Science 2026-02-06 Kim Hammar , Tansu Alpcan , Emil Lupu

When asked to summarize articles or answer questions given a passage, large language models (LLMs) can hallucinate details and respond with unsubstantiated answers that are inaccurate with respect to the input context. This paper describes…

Computation and Language · Computer Science 2024-10-04 Yung-Sung Chuang , Linlu Qiu , Cheng-Yu Hsieh , Ranjay Krishna , Yoon Kim , James Glass

Large language models (LLMs) can generate fluent natural language texts when given relevant documents as background context. This ability has attracted considerable interest in developing industry applications of LLMs. However, LLMs are…

Computation and Language · Computer Science 2023-10-11 Deren Lei , Yaxi Li , Mengya Hu , Mingyu Wang , Vincent Yun , Emily Ching , Eslam Kamal

As Large Language Models become more ubiquitous across domains, it becomes important to examine their inherent limitations critically. This work argues that hallucinations in language models are not just occasional errors but an inevitable…

Machine Learning · Statistics 2024-09-10 Sourav Banerjee , Ayushi Agarwal , Saloni Singla

Hallucinations in multimodal large language models (MLLMs) hinder their practical applications. To address this, we propose a Magnifier Prompt (MagPrompt), a simple yet effective method to tackle hallucinations in MLLMs via extremely simple…

Computation and Language · Computer Science 2025-02-24 Yuhan Fu , Ruobing Xie , Jiazhen Liu , Bangxiang Lan , Xingwu Sun , Zhanhui Kang , Xirong Li

Large language models are successful in answering factoid questions but are also prone to hallucination. We investigate the phenomenon of LLMs possessing correct answer knowledge yet still hallucinating from the perspective of inference…

Computation and Language · Computer Science 2024-10-29 Che Jiang , Biqing Qi , Xiangyu Hong , Dayuan Fu , Yang Cheng , Fandong Meng , Mo Yu , Bowen Zhou , Jie Zhou

The detection of sophisticated hallucinations in Large Language Models (LLMs) is hampered by a ``Detection Dilemma'': methods probing internal states (Internal State Probing) excel at identifying factual inconsistencies but fail on logical…

Computation and Language · Computer Science 2026-01-09 Yusheng Song , Lirong Qiu , Xi Zhang , Zhihao Tang

Despite the many advances of Large Language Models (LLMs) and their unprecedented rapid evolution, their impact and integration into every facet of our daily lives is limited due to various reasons. One critical factor hindering their…

Computation and Language · Computer Science 2024-08-20 Yakir Yehuda , Itzik Malkiel , Oren Barkan , Jonathan Weill , Royi Ronen , Noam Koenigstein

Large language models (LLMs) are able to generate human-like responses to user queries. However, LLMs exhibit inherent limitations, especially because they hallucinate. This paper introduces LP-LM, a system that grounds answers to questions…

Artificial Intelligence · Computer Science 2025-02-14 Katherine Wu , Yanhong A. Liu

Test cases are essential for validating the reliability and quality of software applications. Recent studies have demonstrated the capability of Large Language Models (LLMs) to generate useful test cases for given source code. However, the…

Software Engineering · Computer Science 2025-01-03 Shuzheng Gao , Chaozheng Wang , Cuiyun Gao , Xiaoqian Jiao , Chun Yong Chong , Shan Gao , Michael Lyu

Large language models (LLMs) trained on datasets of publicly available source code have established a new state of the art in code generation tasks. However, these models are mostly unaware of the code that exists within a specific project,…

Software Engineering · Computer Science 2024-06-21 Aryaz Eghbali , Michael Pradel

Despite the growing demand for eliciting uncertainty from large language models (LLMs), empirical evidence suggests that LLM behavior is not always adequately captured by the elicitation techniques developed under the classical…

Artificial Intelligence · Computer Science 2026-03-12 Anita Yang , Krikamol Muandet , Michele Caprio , Siu Lun Chau , Masaki Adachi

Large language models (LLMs) have revolutionized natural language processing, yet their propensity for hallucination, generating plausible but factually incorrect or fabricated content, remains a critical challenge. This report provides a…

Computation and Language · Computer Science 2025-08-05 Manuel Cossio

Hallucinations in large language models (LLMs), defined as fluent yet incorrect or incoherent outputs, pose a significant challenge to the automatic generation of educational multiple-choice questions (MCQs). We identified four key…

Computation and Language · Computer Science 2026-01-22 Nicholas X. Wang , Aggelos K. Katsaggelos

Promptable segmentation typically requires instance-specific manual prompts to guide the segmentation of each desired object. To minimize such a need, task-generic promptable segmentation has been introduced, which employs a single…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Jian Hu , Jiayi Lin , Junchi Yan , Shaogang Gong

Large Language Models (LLMs) have become increasingly important in natural language processing, enabling advanced data analytics through natural language queries. However, these models often generate "hallucinations"-inaccurate or…

Computation and Language · Computer Science 2024-10-29 Mikhail Rumiantsau , Aliaksei Vertsel , Ilya Hrytsuk , Isaiah Ballah

Large language models (LLMs) are increasingly trained to abstain on difficult questions by answering unknown. However, we observe that LLMs often misuse this option: they output unknown even when LLMs can actually solve the questions, or…

Computation and Language · Computer Science 2026-01-07 Zipeng Ling , Yuehao Tang , Shuliang Liu , Junqi Yang , Shenghong Fu , Chen Huang , Kejia Huang , Yao Wan , Zhichao Hou , Xuming Hu

Prompt-based verification is widely used to mitigate hallucinations in large vision-language models (LVLMs), yet when it helps remains poorly understood. We systematically study verification prompting across two representative LVLM…

Computation and Language · Computer Science 2026-05-28 Yuang Huang , Yafeng Zhang , Yu Zilan