中文
相关论文

相关论文: Perception of Knowledge Boundary for Large Languag…

200 篇论文

Large language models (LLMs) often encounter knowledge conflicts, scenarios where discrepancy arises between the internal parametric knowledge of LLMs and non-parametric information provided in the prompt context. In this work we ask what…

计算与语言 · 计算机科学 2024-10-16 Yike Wang , Shangbin Feng , Heng Wang , Weijia Shi , Vidhisha Balachandran , Tianxing He , Yulia Tsvetkov

Large language models (LLMs) exhibit strong generative capabilities but remain vulnerable to confabulations, fluent yet unreliable outputs that vary arbitrarily even under identical prompts. Leveraging a quantum tensor network based…

计算与语言 · 计算机科学 2026-02-03 Pragatheeswaran Vipulanandan , Kamal Premaratne , Dilip Sarkar

Hallucination in large language models (LLMs) can be detected by assessing the uncertainty of model outputs, typically measured using entropy. Semantic entropy (SE) enhances traditional entropy estimation by quantifying uncertainty at the…

机器学习 · 计算机科学 2025-06-03 Dang Nguyen , Ali Payani , Baharan Mirzasoleiman

Despite the superb performance in many tasks, large language models (LLMs) bear the risk of generating hallucination or even wrong answers when confronted with tasks that demand the accuracy of knowledge. The issue becomes even more…

信息检索 · 计算机科学 2024-12-16 Lihui Liu , Zihao Wang , Ruizhong Qiu , Yikun Ban , Eunice Chan , Yangqiu Song , Jingrui He , Hanghang Tong

Large Language Models (LLMs) have exhibited impressive generation capabilities, but they suffer from hallucinations when solely relying on their internal knowledge, especially when answering questions that require less commonly known…

计算与语言 · 计算机科学 2023-11-01 Wenting Zhao , Ye Liu , Tong Niu , Yao Wan , Philip S. Yu , Shafiq Joty , Yingbo Zhou , Semih Yavuz

Large Language Models (LLMs) have shown the impressive capability of answering questions in a wide range of scenarios. However, when LLMs face different types of questions, it is worth exploring whether LLMs are aware that some questions…

计算与语言 · 计算机科学 2024-10-02 Dongjie Yang , Hai Zhao

Ensuring large language model (LLM) reliability requires distinguishing objective unsolvability (inherent contradictions) from subjective capability limitations (tasks exceeding model competence). Current LLMs often conflate these…

计算与语言 · 计算机科学 2026-02-03 Dengyun Peng , Qiguang Chen , Bofei Liu , Jiannan Guan , Libo Qin , Zheng Yan , Jinhao Liu , Jianshu Zhang , Wanxiang Che

Large language models (LLMs) have learned vast amounts of factual knowledge through self-supervised pre-training on large-scale corpora. Meanwhile, LLMs have also demonstrated excellent multilingual capabilities, which can express the…

计算与语言 · 计算机科学 2024-11-27 Pengfei Cao , Yuheng Chen , Zhuoran Jin , Yubo Chen , Kang Liu , Jun Zhao

Large language models (LLMs) can generate fluent responses, but sometimes hallucinate facts. In this paper, we investigate whether LLMs can detect their own hallucinations. We formulate hallucination detection as a classification task of a…

计算与语言 · 计算机科学 2025-11-17 Sora Kadotani , Kosuke Nishida , Kyosuke Nishida

Hallucinations in large language models (LLMs), defined as fluent yet incorrect or incoherent outputs, pose a significant challenge to the automatic generation of educational multiple-choice questions (MCQs). We identified four key…

计算与语言 · 计算机科学 2026-01-22 Nicholas X. Wang , Aggelos K. Katsaggelos

Large language model (LLM) research has grown rapidly, along with increasing concern about their limitations. In this survey, we conduct a data-driven, semi-automated review of research on limitations of LLMs (LLLMs) from 2022 to early 2025…

计算与语言 · 计算机科学 2026-03-13 Aida Kostikova , Zhipin Wang , Deidamea Bajri , Ole Pütz , Benjamin Paaßen , Steffen Eger

The prevalent use of large language models (LLMs) in various domains has drawn attention to the issue of "hallucination," which refers to instances where LLMs generate factually inaccurate or ungrounded information. Existing techniques for…

计算与语言 · 计算机科学 2023-10-10 Junyu Luo , Cao Xiao , Fenglong Ma

Large Language Models (LLMs) are known for their remarkable ability to generate synthesized 'knowledge', such as text documents, music, images, etc. However, there is a huge gap between LLM's and human capabilities for understanding…

计算与语言 · 计算机科学 2024-08-14 Vladimir Cherkassky , Eng Hock Lee

Hallucination is often viewed as a direct consequence of missing knowledge: a model answers incorrectly when the correct answer is absent from its generation-time distribution, and correctly when it is present. We test this assumption by…

计算与语言 · 计算机科学 2026-05-22 Jewon Yeom , Jaewon Sok , Heejun Kim , Seonghyeon Park , Jeongjae Park , Taesup Kim

As Large Language Models (LLMs) continue to advance in their ability to write human-like text, a key challenge remains around their tendency to hallucinate generating content that appears factual but is ungrounded. This issue of…

计算与语言 · 计算机科学 2024-01-09 S. M Towhidul Islam Tonmoy , S M Mehedi Zaman , Vinija Jain , Anku Rani , Vipula Rawte , Aman Chadha , Amitava Das

Large language models (LLMs), including ChatGPT, Bard, and Llama, have achieved remarkable successes over the last two years in a range of different applications. In spite of these successes, there exist concerns that limit the wide…

计算与语言 · 计算机科学 2024-01-17 Junliang Luo , Tianyu Li , Di Wu , Michael Jenkin , Steve Liu , Gregory Dudek

Despite the remarkable abilities of Large Language Models (LLMs) to answer questions, they often display a considerable level of overconfidence even when the question does not have a definitive answer. To avoid providing hallucinated…

计算与语言 · 计算机科学 2024-10-03 Yang Deng , Yong Zhao , Moxin Li , See-Kiong Ng , Tat-Seng Chua

The task of reading comprehension (RC), often implemented as context-based question answering (QA), provides a primary means to assess language models' natural language understanding (NLU) capabilities. Yet, when applied to large language…

计算与语言 · 计算机科学 2025-07-08 Victoria Basmov , Yoav Goldberg , Reut Tsarfaty

Benchmarking modern large language models (LLMs) on complex and realistic tasks is critical to advancing their development. In this work, we evaluate the factual accuracy and citation performance of state-of-the-art LLMs on the task of…

计算与语言 · 计算机科学 2024-12-25 Maya Patel , Aditi Anand

We analyze knowledge-based visual question answering, for which given a question, the models need to ground it into the visual modality and retrieve the relevant knowledge from a given large knowledge base (KB) to be able to answer. Our…

人工智能 · 计算机科学 2024-04-17 Elham J. Barezi , Parisa Kordjamshidi