中文
相关论文

相关论文: Hallucination Augmented Recitations for Language M…

200 篇论文

While Large Language Models (LLM) are able to accumulate and restore knowledge, they are still prone to hallucination. Especially when faced with factual questions, LLM cannot only rely on knowledge stored in parameters to guarantee…

计算与语言 · 计算机科学 2024-01-04 Pierre Erbacher , Louis Falissar , Vincent Guigue , Laure Soulier

Reasoning Large Language Models (R-LLMs) have significantly advanced complex reasoning tasks but often struggle with factuality, generating substantially more hallucinations than their non-reasoning counterparts on long-form factuality…

计算与语言 · 计算机科学 2025-08-08 Xilun Chen , Ilia Kulikov , Vincent-Pierre Berges , Barlas Oğuz , Rulin Shao , Gargi Ghosh , Jason Weston , Wen-tau Yih

Large Audio-Language Models (LALMs) can take audio and text as the inputs and answer questions about the audio. While prior LALMs have shown strong performance on standard benchmarks, there has been alarming evidence that LALMs can…

音频与语音处理 · 电气工程与系统科学 2025-09-16 Tzu-wen Hsu , Ke-Han Lu , Cheng-Han Chiang , Hung-yi Lee

Alignment is a standard procedure to fine-tune pre-trained large language models (LLMs) to follow natural language instructions and serve as helpful AI assistants. We have observed, however, that the conventional alignment process fails to…

计算与语言 · 计算机科学 2024-05-03 Sheng-Chieh Lin , Luyu Gao , Barlas Oguz , Wenhan Xiong , Jimmy Lin , Wen-tau Yih , Xilun Chen

In this work, we present a framework that utilizes ontology alignment to improve the learning process of deep learning models. With this approach we show that models fine-tuned using ontologies learn a downstream task at a higher rate with…

人工智能 · 计算机科学 2025-03-04 Shriram M S , Sushmitha S , Gayathri K S , Shahina A

Despite remarkable advancements in mitigating hallucinations in large language models (LLMs) by retrieval augmentation, it remains challenging to measure the reliability of LLMs using static question-answering (QA) data. Specifically, given…

计算与语言 · 计算机科学 2024-06-04 Xiaodong Yu , Hao Cheng , Xiaodong Liu , Dan Roth , Jianfeng Gao

Hallucination is a persistent challenge in large language models (LLMs), where even with rigorous quality control, models often generate distorted facts. This paradox, in which error generation continues despite high-quality training data,…

计算与语言 · 计算机科学 2025-02-25 Yuji Zhang , Sha Li , Cheng Qian , Jiateng Liu , Pengfei Yu , Chi Han , Yi R. Fung , Kathleen McKeown , Chengxiang Zhai , Manling Li , Heng Ji

Large Language Models (LLMs) have demonstrated remarkable fluency across a range of natural language tasks, yet remain vulnerable to hallucinations - factual inaccuracies that undermine trust in real world deployment. We present…

计算与语言 · 计算机科学 2025-07-16 Kaushik Dwivedi , Padmanabh Patanjali Mishra

Large Language Models (LLMs) generalize well across language tasks, but suffer from hallucinations and uninterpretability, making it difficult to assess their accuracy without ground-truth. Retrieval-Augmented Generation (RAG) models have…

计算与语言 · 计算机科学 2023-12-18 Jakub Lála , Odhran O'Donoghue , Aleksandar Shtedritski , Sam Cox , Samuel G. Rodriques , Andrew D. White

Large Language Models (LLMs) have shown propensity to generate hallucinated outputs, i.e., texts that are factually incorrect or unsupported. Existing methods for alleviating hallucinations typically require costly human annotations to…

计算与语言 · 计算机科学 2024-04-03 Yu Xia , Xu Liu , Tong Yu , Sungchul Kim , Ryan A. Rossi , Anup Rao , Tung Mai , Shuai Li

Large Language Models (LLMs) enhanced with retrieval, an approach known as Retrieval-Augmented Generation (RAG), have achieved strong performance in open-domain question answering. However, RAG remains prone to hallucinations: factually…

Large language models (LLMs) have achieved a degree of success in generating coherent and contextually relevant text, yet they remain prone to a significant challenge known as hallucination: producing information that is not substantiated…

计算与语言 · 计算机科学 2024-10-28 Ray Li , Tanishka Bagade , Kevin Martinez , Flora Yasmin , Grant Ayala , Michael Lam , Kevin Zhu

This paper presents a systematic defense of large language model (LLM) hallucinations or 'confabulations' as a potential resource instead of a categorically negative pitfall. The standard view is that confabulations are inherently…

计算与语言 · 计算机科学 2024-06-27 Peiqi Sui , Eamon Duede , Sophie Wu , Richard Jean So

This paper primarily focuses on the hallucinations caused due to AI language models(LLMs).LLMs have shown extraordinary Language understanding and generation capabilities .Still it has major a disadvantage hallucinations which give outputs…

计算与语言 · 计算机科学 2026-04-07 Sailesh kiran kurra , Shiek Ruksana , Vishal Borusu

While reinforcement learning has unlocked unprecedented complex reasoning in large language models, it has also amplified their propensity for hallucination, creating a critical trade-off between capability and reliability. This work…

计算与语言 · 计算机科学 2025-12-11 Yudong Wang , Zhe Yang , Wenhan Ma , Zhifang Sui , Liang Zhao

Large Language Models (LLMs) excel in language comprehension and generation but are prone to hallucinations, producing factually incorrect or unsupported outputs. Retrieval Augmented Generation (RAG) systems address this issue by grounding…

信息检索 · 计算机科学 2025-04-09 Chandana Sree Mala , Gizem Gezici , Fosca Giannotti

Despite their remarkable capabilities, Large Language Models (LLMs) are prone to generate responses that contradict verifiable facts, i.e., unfaithful hallucination content. Existing efforts generally focus on optimizing model parameters or…

计算与语言 · 计算机科学 2025-01-28 Dingkang Yang , Dongling Xiao , Jinjie Wei , Mingcheng Li , Zhaoyu Chen , Ke Li , Lihua Zhang

Large Language Models are prompting us to view more NLP tasks from a generative perspective. At the same time, they offer a new way of accessing information, mainly through the RAG framework. While there have been notable improvements for…

计算与语言 · 计算机科学 2025-03-21 Alex-Razvan Ispas , Charles-Elie Simon , Fabien Caspani , Vincent Guigue

Large Language Models (LLMs) have been found to have difficulty knowing they do not possess certain knowledge and tend to provide specious answers in such cases. Retrieval Augmentation (RA) has been extensively studied to mitigate LLMs'…

计算与语言 · 计算机科学 2024-06-12 Shiyu Ni , Keping Bi , Jiafeng Guo , Xueqi Cheng

Large language models (LLMs) demonstrate strong capabilities in natural language processing but remain prone to hallucinations, generating factually incorrect or fabricated content. This issue undermines their reliability, particularly in…

计算与语言 · 计算机科学 2025-02-19 Cheng Peng Huang , Hao-Yuan Chen