中文
相关论文

相关论文: Retrieving Supporting Evidence for LLMs Generated …

200 篇论文

Recent progress in natural language processing (NLP) owes much to remarkable advances in large language models (LLMs). Nevertheless, LLMs frequently "hallucinate," resulting in non-factual outputs. Our carefully-designed human evaluation…

计算与语言 · 计算机科学 2024-03-22 Jian Guan , Jesse Dodge , David Wadden , Minlie Huang , Hao Peng

Detecting hallucinations in large language model (LLM) outputs is pivotal, yet traditional fine-tuning for this classification task is impeded by the expensive and quickly outdated annotation process, especially across numerous vertical…

人工智能 · 计算机科学 2024-07-09 Dongxu Zhang , Varun Gangal , Barrett Martin Lattimer , Yi Yang

The hallucination problem of Large Language Models (LLMs) significantly limits their reliability and trustworthiness. Humans have a self-awareness process that allows us to recognize what we don't know when faced with queries. Inspired by…

计算与语言 · 计算机科学 2024-10-01 Ziwei Ji , Delong Chen , Etsuko Ishii , Samuel Cahyawijaya , Yejin Bang , Bryan Wilie , Pascale Fung

This work studies improving large language model (LLM) generations at inference time by mitigating fact-conflicting hallucinations. Particularly, we propose a self-endorsement framework that leverages the fine-grained fact-level comparisons…

计算与语言 · 计算机科学 2024-02-27 Ante Wang , Linfeng Song , Baolin Peng , Ye Tian , Lifeng Jin , Haitao Mi , Jinsong Su , Dong Yu

Recently, with the chain of thought (CoT) prompting, large language models (LLMs), e.g., GPT-3, have shown strong reasoning ability in several natural language processing tasks such as arithmetic, commonsense, and logical reasoning.…

人工智能 · 计算机科学 2023-10-20 Yixuan Weng , Minjun Zhu , Fei Xia , Bin Li , Shizhu He , Shengping Liu , Bin Sun , Kang Liu , Jun Zhao

We present a novel approach to automated proof generation for the TLA+ Proof System (TLAPS) using Large Language Models (LLMs). Our method combines two key components: a sub-proof obligation generation phase that breaks down complex proof…

计算机科学中的逻辑 · 计算机科学 2025-01-07 Yuhao Zhou

Large language models (LLMs) have transformed natural language processing, achieving remarkable performance across diverse tasks. However, their impressive fluency often comes at the cost of producing false or fabricated information, a…

计算与语言 · 计算机科学 2026-03-20 Aisha Alansari , Hamzah Luqman

As we all know, hallucinations prevail in Large Language Models (LLMs), where the generated content is coherent but factually incorrect, which inflicts a heavy blow on the widespread application of LLMs. Previous studies have shown that…

计算与语言 · 计算机科学 2024-10-15 Xinping Zhao , Jindi Yu , Zhenyu Liu , Jifang Wang , Dongfang Li , Yibin Chen , Baotian Hu , Min Zhang

Retrieval augmented generation (RAG) is frequently used to mitigate hallucinations and provide up-to-date knowledge for large language models (LLMs). However, given that document retrieval is an imprecise task and sometimes results in…

计算与语言 · 计算机科学 2025-02-10 Kevin Wu , Eric Wu , James Zou

We develop a principled procedure for determining when a large language model (LLM) should abstain from responding (e.g., by saying "I don't know") in a general domain, instead of resorting to possibly "hallucinating" a non-sensical or…

Large language models (LLMs) have demonstrated remarkable capabilities across various domains, although their susceptibility to hallucination poses significant challenges for their deployment in critical areas such as healthcare. To address…

计算与语言 · 计算机科学 2024-05-13 Mengjia Niu , Hao Li , Jie Shi , Hamed Haddadi , Fan Mo

Large Language Models (LLMs) show promise as a writing aid for professionals performing legal analyses. However, LLMs can often hallucinate in this setting, in ways difficult to recognize by non-professionals and existing text evaluation…

计算与语言 · 计算机科学 2024-09-25 Abe Bohan Hou , William Jurayj , Nils Holzenberger , Andrew Blair-Stanek , Benjamin Van Durme

Ambiguity in natural language poses significant challenges to Large Language Models (LLMs) used for open-domain question answering. LLMs often struggle with the inherent uncertainties of human communication, leading to misinterpretations,…

计算与语言 · 计算机科学 2024-11-20 Aryan Keluskar , Amrita Bhattacharjee , Huan Liu

The profusion of knowledge encoded in large language models (LLMs) and their ability to apply this knowledge zero-shot in a range of settings makes them promising candidates for use in decision-making. However, they are currently limited by…

计算与语言 · 计算机科学 2026-05-08 Gabriel Freedman , Adam Dejl , Deniz Gorur , Xiang Yin , Antonio Rago , Francesca Toni

Large language models (LLMs) have achieved significant success in interacting with human. However, recent studies have revealed that these models often suffer from hallucinations, leading to overly confident but incorrect judgments. This…

计算与语言 · 计算机科学 2023-09-06 Yusheng Liao , Yutong Meng , Hongcheng Liu , Yanfeng Wang , Yu Wang

Large language models (LLMs) often struggle with knowledge intensive NLP tasks, such as answering "Who won the latest World Cup?" because the knowledge they learn during training may be insufficient or outdated. Conditioning generation on…

计算与语言 · 计算机科学 2025-03-04 Matthew Finlayson , Ilia Kulikov , Daniel M. Bikel , Barlas Oguz , Xilun Chen , Aasish Pappu

Large language models (LLMs) inherently display hallucinations since the precision of generated texts cannot be guaranteed purely by the parametric knowledge they include. Although retrieval-augmented generation (RAG) systems enhance the…

人工智能 · 计算机科学 2025-02-18 Bingyu Wan , Fuxi Zhang , Zhongpeng Qi , Jiayi Ding , Jijun Li , Baoshi Fan , Yijia Zhang , Jun Zhang

Search-based test generators are effective at producing unit tests with high coverage. However, such automatically generated tests have no meaningful test and variable names, making them hard to understand and interpret by developers. On…

软件工程 · 计算机科学 2025-06-12 Matteo Biagiola , Gianluca Ghislotti , Paolo Tonella

The increasing popularity of Large Language Models (LLMs) in recent years has changed the way users interact with and pose questions to AI-based conversational systems. An essential aspect for increasing the trustworthiness of generated LLM…

计算与语言 · 计算机科学 2024-10-23 Juraj Vladika , Luca Mülln , Florian Matthes

The increasing use of large language models (LLMs) in causal discovery as a substitute for human domain experts highlights the need for optimal model selection. This paper presents the first hallucination survey of popular LLMs for causal…

计算与语言 · 计算机科学 2024-11-21 Grace Sng , Yanming Zhang , Klaus Mueller