中文
相关论文

相关论文: Task Abstention for Large Language Models in Code …

200 篇论文

Large Language Models (LLMs) are powerful linguistic engines but remain susceptible to hallucinations: plausible-sounding outputs that are factually incorrect or unsupported. In this work, we present a mathematically grounded framework to…

计算与语言 · 计算机科学 2025-11-20 Moses Kiprono

Large Language Models (LLMs) have made significant progress in code generation, offering developers groundbreaking automated programming support. However, LLMs often generate code that is syntactically correct and even semantically…

计算与语言 · 计算机科学 2025-01-22 Yuchen Tian , Weixiang Yan , Qian Yang , Xuandong Zhao , Qian Chen , Wen Wang , Ziyang Luo , Lei Ma , Dawn Song

Modern code-generation LLMs can already solve a large fraction of programming problems, yet they still hallucinate subtle bugs that make their outputs unsafe for autonomous deployment. We present functional clustering, a black-box wrapper…

软件工程 · 计算机科学 2025-06-16 Chaitanya Ravuri , Saman Amarasinghe

Recently developed large language models have achieved remarkable success in generating fluent and coherent text. However, these models often tend to 'hallucinate' which critically hampers their reliability. In this work, we address this…

计算与语言 · 计算机科学 2023-08-15 Neeraj Varshney , Wenlin Yao , Hongming Zhang , Jianshu Chen , Dong Yu

Despite their powerful chat, coding, and reasoning abilities, Large Language Models (LLMs) frequently hallucinate. Conventional wisdom suggests that hallucinations are a consequence of a balance between creativity and factuality, which can…

Hallucination detection in Large Language Models (LLMs) is crucial for ensuring their reliability. This work presents our participation in the CLEF ELOQUENT HalluciGen shared task, where the goal is to develop evaluators for both generating…

As large language models continue to develop in the field of AI, text generation systems are susceptible to a worrisome phenomenon known as hallucination. In this study, we summarize recent compelling insights into hallucinations in LLMs.…

计算与语言 · 计算机科学 2023-09-14 Hongbin Ye , Tong Liu , Aijia Zhang , Wei Hua , Weiqiang Jia

Retrieval-augmented generation (RAG) appears as a promising method to alleviate the "hallucination" problem in large language models (LLMs), since it can incorporate external traceable resources for response generation. The essence of RAG…

计算与语言 · 计算机科学 2024-10-16 Haosheng Qian , Yixing Fan , Ruqing Zhang , Jiafeng Guo

The hallucination problem of Large Language Models (LLMs) significantly limits their reliability and trustworthiness. Humans have a self-awareness process that allows us to recognize what we don't know when faced with queries. Inspired by…

计算与语言 · 计算机科学 2024-10-01 Ziwei Ji , Delong Chen , Etsuko Ishii , Samuel Cahyawijaya , Yejin Bang , Bryan Wilie , Pascale Fung

Large language models (LLMs) can suffer from hallucinations when generating text. These hallucinations impede various applications in society and industry by making LLMs untrustworthy. Current LLMs generate text in an autoregressive fashion…

机器学习 · 计算机科学 2025-11-05 Lukas Aichberger , Kajetan Schweighofer , Mykyta Ielanskyi , Sepp Hochreiter

Large Language Models (LLMs), when used for conditional text generation, often produce hallucinations, i.e., information that is unfaithful or not grounded in the input context. This issue arises in typical conditional text generation…

Large Language Models often generate factually incorrect but plausible outputs, known as hallucinations. We identify a more insidious phenomenon, LLM delusion, defined as high belief hallucinations, incorrect outputs with abnormally high…

计算与语言 · 计算机科学 2025-03-11 Hongshen Xu , Zixv yang , Zichen Zhu , Kunyao Lan , Zihan Wang , Mengyue Wu , Ziwei Ji , Lu Chen , Pascale Fung , Kai Yu

For Large Language Models (LLMs) to be reliably deployed in both everyday and high-stakes domains, knowing when not to answer is equally critical as answering correctly. Real-world user queries, which can be underspecified, ill-posed, or…

人工智能 · 计算机科学 2025-06-11 Polina Kirichenko , Mark Ibrahim , Kamalika Chaudhuri , Samuel J. Bell

The hallucination of code generation models hinders their applicability to systems requiring higher safety standards. One critical bottleneck in addressing code hallucination is the difficulty of identifying the functional correctness of…

软件工程 · 计算机科学 2025-10-27 Jaewoo Jeong , Taesoo Kim , Sangdon Park

Despite their impressive ability to generate high-quality and fluent text, generative large language models (LLMs) also produce hallucinations: statements that are misaligned with established world knowledge or provided input context.…

计算与语言 · 计算机科学 2025-01-15 Abhilasha Ravichander , Shrusti Ghela , David Wadden , Yejin Choi

In text generation, hallucinations refer to the generation of seemingly coherent text that contradicts established knowledge. One compelling hypothesis is that hallucinations occur when a language model is given a generation task outside…

计算与语言 · 计算机科学 2024-08-21 Ameya Godbole , Nicholas Monath , Seungyeon Kim , Ankit Singh Rawat , Andrew McCallum , Manzil Zaheer

Large language models (LLMs) often generate responses that deviate from user input or training data, a phenomenon known as "hallucination." These hallucinations undermine user trust and hinder the adoption of generative AI systems.…

计算与语言 · 计算机科学 2025-04-25 Yejin Bang , Ziwei Ji , Alan Schelten , Anthony Hartshorn , Tara Fowler , Cheng Zhang , Nicola Cancedda , Pascale Fung

Large language models (LLMs) have generated significant attention since their inception, finding applications across various academic and industrial domains. However, these models often suffer from the "hallucination problem", where…

计算与语言 · 计算机科学 2025-05-13 Zikai Xie

Large Language Models (LLMs) have shown impressive capabilities but still suffer from the issue of hallucinations. A significant type of this issue is the false premise hallucination, which we define as the phenomenon when LLMs generate…

计算与语言 · 计算机科学 2024-03-01 Hongbang Yuan , Pengfei Cao , Zhuoran Jin , Yubo Chen , Daojian Zeng , Kang Liu , Jun Zhao

Large Language Models (LLMs) and Large Reasoning Models (LRMs) offer transformative potential for high-stakes domains like finance and law, but their tendency to hallucinate, generating factually incorrect or unsupported content, poses a…

人工智能 · 计算机科学 2026-01-16 Ahmad Pesaranghader , Erin Li