English
Related papers

Related papers: Learn to Refuse: Making Large Language Models More…

200 papers

Integrating large language models (LLMs) with rule-based reasoning offers a powerful solution for improving the flexibility and reliability of Knowledge Base Completion (KBC). Traditional rule-based KBC methods offer verifiable reasoning…

Computation and Language · Computer Science 2025-01-03 Qiyuan He , Jianfei Yu , Wenya Wang

Existing Large Reasoning Models (LRMs) have shown the potential of reinforcement learning (RL) to enhance the complex reasoning capabilities of Large Language Models~(LLMs). While they achieve remarkable performance on challenging tasks…

Artificial Intelligence · Computer Science 2025-03-19 Huatong Song , Jinhao Jiang , Yingqian Min , Jie Chen , Zhipeng Chen , Wayne Xin Zhao , Lei Fang , Ji-Rong Wen

Large language models (LLMs) have shown substantial capacity for generating fluent, contextually appropriate responses. However, they can produce hallucinated outputs, especially when a user query includes one or more false premises-claims…

Computation and Language · Computer Science 2026-02-18 Yuehan Qin , Shawn Li , Yi Nian , Xinyan Velocity Yu , Yue Zhao , Xuezhe Ma

The capacity of large language models (LLMs) to generate honest, harmless, and helpful responses heavily relies on the quality of user prompts. However, these prompts often tend to be brief and vague, thereby significantly limiting the full…

Computation and Language · Computer Science 2025-07-01 Xiaohua Wang , Zisu Huang , Feiran Zhang , Zhibo Xu , Cenyuan Zhang , Qi Qian , Xiaoqing Zheng , Xuanjing Huang

Large language models are known to hallucinate when faced with unfamiliar queries, but the underlying mechanism that govern how models hallucinate are not yet fully understood. In this work, we find that unfamiliar examples in the models'…

Machine Learning · Computer Science 2024-05-30 Katie Kang , Eric Wallace , Claire Tomlin , Aviral Kumar , Sergey Levine

Large Language Models (LLMs) currently respond to every prompt. However, they can produce incorrect answers when they lack knowledge or capability -- a problem known as hallucination. We instead propose post-training an LLM to generate…

Computation and Language · Computer Science 2026-02-17 Tim Franzmeyer , Archie Sravankumar , Lijuan Liu , Yuning Mao , Rui Hou , Sinong Wang , Jakob N. Foerster , Luke Zettlemoyer , Madian Khabsa

Hallucinations present a significant challenge for large language models (LLMs). The utilization of parametric knowledge in generating factual content is constrained by the limited knowledge of LLMs, potentially resulting in internal…

Computation and Language · Computer Science 2025-10-07 Hanxing Ding , Liang Pang , Zihao Wei , Huawei Shen , Xueqi Cheng

Despite the impressive capabilities of multimodal large language models (MLLMs) in vision-language tasks, they are prone to hallucinations in real-world scenarios. This paper investigates the hallucination phenomenon in MLLMs from the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Zongmeng Zhang , Wengang Zhou , Jie Zhao , Houqiang Li

Large language models (LLMs) have generated significant attention since their inception, finding applications across various academic and industrial domains. However, these models often suffer from the "hallucination problem", where…

Computation and Language · Computer Science 2025-05-13 Zikai Xie

Large Language Models (LLMs) have revolutionized Natural Language Processing (NLP) based applications including automated text generation, question answering, chatbots, and others. However, they face a significant challenge: hallucinations,…

Computation and Language · Computer Science 2024-11-22 Ernests Lavrinovics , Russa Biswas , Johannes Bjerva , Katja Hose

Large language models (LLMs) often generate hallucinations -- unsupported content that undermines reliability. While most prior works frame hallucination detection as a binary task, many real-world applications require identifying…

Hallucination is a major concern in LLM-driven service systems, necessitating explicit knowledge grounding for compliance-guaranteed responses. In this paper, we introduce Retrieval-Augmented Learning-to-Match (RAL2M), a novel framework…

Computation and Language · Computer Science 2026-01-07 Mengze Hong , Di Jiang , Jiangtao Wen , Zhiyang Su , Yawen Li , Yanjie Sun , Guan Wang , Chen Jason Zhang

Hallucination in Large Language Models (LLMs) refers to the generation of content that is not faithful to the input or the real-world facts. This paper provides a rigorous treatment of hallucination in LLMs, including formal definitions and…

Computation and Language · Computer Science 2025-08-01 Esmail Gumaan

Prior work on large language model (LLM) hallucinations has associated them with model uncertainty or inaccurate knowledge. In this work, we define and investigate a distinct type of hallucination, where a model can consistently answer a…

Computation and Language · Computer Science 2025-08-26 Adi Simhi , Itay Itzhak , Fazl Barez , Gabriel Stanovsky , Yonatan Belinkov

Hallucination, or the generation of incorrect or fabricated information, remains a critical challenge in large language models (LLMs), particularly in high-stake domains such as legal question answering (QA). In order to mitigate the…

Computation and Language · Computer Science 2025-01-14 Yinghao Hu , Leilei Gan , Wenyi Xiao , Kun Kuang , Fei Wu

While Large language models (LLMs) have the capability to iteratively reflect on their own outputs, recent studies have observed their struggles with knowledge-rich problems without access to external resources. In addition to the…

Computation and Language · Computer Science 2024-06-25 Hanqi Yan , Qinglin Zhu , Xinyu Wang , Lin Gui , Yulan He

The propensity of Large Language Models (LLMs) to generate hallucinations and non-factual content undermines their reliability in high-stakes domains, where rigorous control over Type I errors (the conditional probability of incorrectly…

Computation and Language · Computer Science 2024-11-08 Fan Nie , Xiaotian Hou , Shuhang Lin , James Zou , Huaxiu Yao , Linjun Zhang

Large Language Models (LLMs) are pretrained on extensive multilingual corpora to acquire both language-specific cultural knowledge and general knowledge. Ideally, while LLMs should provide consistent responses to culture-independent…

Computation and Language · Computer Science 2025-02-11 Yumeng Wang , Zhiyuan Fan , Qingyun Wang , May Fung , Heng Ji

Large Language Models (LLMs) have been transformative. They are pre-trained foundational models that are self-supervised and can be adapted with fine tuning to a wide range of natural language tasks, each of which previously would have…

Computation and Language · Computer Science 2023-02-22 Terrence Sejnowski

Reliable Large Language Models (LLMs) should abstain when confidence is insufficient. However, prior studies often treat refusal as a generic "I don't know'', failing to distinguish input-level ambiguity (data uncertainty) from capability…

Computation and Language · Computer Science 2026-04-21 Jingyi Ren , Ante Wang , Yunghwei Lai , Xiaolong Wang , Linlu Gong , Weitao Li , Weizhi Ma , Yang Liu