中文
相关论文

相关论文: ArxEval: Evaluating Retrieval and Generation in La…

200 篇论文

The development of Large Language Models (LLMs) has significantly advanced various AI applications in commercial and scientific research fields, such as scientific literature summarization, writing assistance, and knowledge graph…

计算与语言 · 计算机科学 2024-10-17 Huiwen Wu , Xiaohan Li , Xiaogang Xu , Jiafei Wu , Deyi Zhang , Zhe Liu

Large Language Models (LLMs) drive scientific question-answering on modern search engines, yet their evaluation robustness remains underexplored. We introduce YESciEval, an open-source framework that combines fine-grained rubric-based…

计算与语言 · 计算机科学 2025-05-30 Jennifer D'Souza , Hamed Babaei Giglou , Quentin Münch

Large language model (LLM) hallucinations, meaning fluent but factually incorrect generations, fall into two types: faithfulness violations, where the model misuses provided context, and factuality violations, where answers reflect errors…

计算与语言 · 计算机科学 2026-05-28 Ivo Brink , Alexander Boer , Dennis Ulmer

Hallucination has been a major problem for large language models and remains a critical challenge when it comes to multimodality in which vision-language models (VLMs) have to deal with not just textual but also visual inputs. Despite rapid…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Zhecan Wang , Garrett Bingham , Adams Yu , Quoc Le , Thang Luong , Golnaz Ghiasi

Retrieval-augmented Generation (RAG) has demonstrated potential in enhancing medical question-answering systems through the integration of large language models (LLMs) with external medical literature. LLMs can retrieve relevant medical…

计算与语言 · 计算机科学 2025-10-29 Mengzhou Sun , Sendong Zhao , Jianyu Chen , Haochun Wang , Bin Qin

In the realm of medical report generation (MRG), the integration of natural language processing has emerged as a vital tool to alleviate the workload of radiologists. Despite the impressive capabilities demonstrated by large vision language…

计算与语言 · 计算机科学 2026-01-23 Ruoqing Zhao , Runze Xia , Piji Li

Large Language Models (LLMs) have achieved remarkable success in various natural language processing tasks, yet their ability to generate long-form content remains poorly understood and evaluated. Our analysis reveals that current LLMs…

While hallucinations of large language models could been alleviated through retrieval-augmented generation and citation generation, how the model utilizes internal knowledge is still opaque, and the trustworthiness of its generated answers…

计算与语言 · 计算机科学 2025-04-22 Jiajun Shen , Tong Zhou , Yubo Chen , Delai Qiu , Shengping Liu , Kang Liu , Jun Zhao

Large language models (LLMs) have been increasingly applied to a wide range of tasks, from natural language understanding to code generation. While they have also been used to assist in bibliographic recommendation, the hallucination of…

计算与语言 · 计算机科学 2025-10-30 Junichiro Niimi

Some consider large-scale language models that can generate long and coherent pieces of text as dangerous, since they may be used in misinformation campaigns. Here we formulate large-scale language model output detection as a hypothesis…

计算与语言 · 计算机科学 2020-02-11 Lav R. Varshney , Nitish Shirish Keskar , Richard Socher

Large language models (LLMs) have revolutionized natural language processing, yet their propensity for hallucination, generating plausible but factually incorrect or fabricated content, remains a critical challenge. This report provides a…

计算与语言 · 计算机科学 2025-08-05 Manuel Cossio

Large language models (LLMs) are increasingly used to generate scientific reports, but they can produce references that appear plausible while containing corrupted metadata or pointing to papers that do not exist. We introduce CiteCheck, a…

数字图书馆 · 计算机科学 2026-05-28 Khashayar Khajavi , Shaghayegh Sadeghi , Rise Adhikari , Alexander Tessier

The Retrieval-Augmented Language Model (RALM) has shown remarkable performance on knowledge-intensive tasks by incorporating external knowledge during inference, which mitigates the factual hallucinations inherited in large language models…

计算与语言 · 计算机科学 2024-12-20 Yuan Xia , Jingbo Zhou , Zhenhui Shi , Jun Chen , Haifeng Huang

Large language models (LLMs) have achieved impressive performance across a wide range of natural language processing tasks, yet they often produce hallucinated content that undermines factual reliability. To address this challenge, we…

计算与语言 · 计算机科学 2026-03-23 Yaxin Zhao , Yu Zhang

Pre-trained language models (LMs) store knowledge in their parameters and can generate informative responses when used in conversational systems. However, LMs suffer from the problem of "hallucination:" they may generate plausible-looking…

计算与语言 · 计算机科学 2022-12-21 Weiwei Sun , Zhengliang Shi , Shen Gao , Pengjie Ren , Maarten de Rijke , Zhaochun Ren

This paper presents the contributions of the ATLANTIS team to SemEval-2025 Task 3, focusing on detecting hallucinated text spans in question answering systems. Large Language Models (LLMs) have significantly advanced Natural Language…

计算与语言 · 计算机科学 2025-08-08 Catherine Kobus , François Lancelot , Marion-Cécile Martin , Nawal Ould Amer

Hallucinations in Large Language Models (LLMs), defined as the generation of content inconsistent with facts or context, represent a core obstacle to their reliable deployment in critical domains. Current research primarily focuses on…

计算与语言 · 计算机科学 2026-03-20 Yanyi Liu , Qingwen Yang , Tiezheng Guo , Feiyu Qu , Jun Liu , Yingyou Wen

Retrieval-augmented generation (RAG) has become a main technique for alleviating hallucinations in large language models (LLMs). Despite the integration of RAG, LLMs may still present unsupported or contradictory claims to the retrieved…

计算与语言 · 计算机科学 2024-05-20 Cheng Niu , Yuanhao Wu , Juno Zhu , Siliang Xu , Kashun Shum , Randy Zhong , Juntong Song , Tong Zhang

How much large language models (LLMs) can aid scientific discovery, notably in assisting academic peer review, is in heated debate. Between a literature digest and a human-comparable research assistant lies their practical application…

计算与语言 · 计算机科学 2025-08-19 Tianyi Li , Yu Qin , Olivia R. Liu Sheng

Large language models (LLMs) are increasingly used to make sense of ambiguous, open-textured, value-laden terms. Platforms routinely rely on LLMs for content moderation, asking them to label text based on disputed concepts like "hate…

计算机与社会 · 计算机科学 2026-03-09 Shira Gur-Arieh , Angelina Wang , Sina Fazelpour