中文
相关论文

相关论文: Leveraging LLM Parametric Knowledge for Fact Check…

200 篇论文

Large Language Models (LLMs) have achieved remarkable success across a wide range of natural language tasks, and recent efforts have sought to extend their capabilities to multimodal domains and resource-constrained environments. However,…

机器学习 · 计算机科学 2025-05-26 Yun-Da Tsai

Artificial intelligence (AI) is transforming the practice of science. Machine learning and large language models (LLMs) can generate hypotheses at a scale and speed far exceeding traditional methods, offering the potential to accelerate…

人工智能 · 计算机科学 2025-12-18 Cristina Cornelio , Takuya Ito , Ryan Cory-Wright , Sanjeeb Dash , Lior Horesh

Long-form generations from large language models (LLMs) contain a mix of factual and non-factual claims, making evaluating factuality difficult. Prior works evaluate the factuality of a long paragraph by decomposing it into multiple facts,…

计算与语言 · 计算机科学 2024-06-10 Cheng-Han Chiang , Hung-yi Lee

Large language models (LLMs) augmented with retrieval systems have demonstrated significant potential in handling knowledge-intensive tasks. However, these models often struggle with unfaithfulness issues, generating outputs that either…

计算与语言 · 计算机科学 2025-07-09 Qinggang Zhang , Zhishang Xiang , Yilin Xiao , Le Wang , Junhui Li , Xinrun Wang , Jinsong Su

Offline evaluation of search systems depends on test collections. These benchmarks provide the researchers with a corpus of documents, topics and relevance judgements indicating which documents are relevant for each topic. While test…

信息检索 · 计算机科学 2025-07-23 David Otero , Javier Parapar , Álvaro Barreiro

Large Language Models (LLMs) have gained significant popularity for their impressive performance across diverse fields. However, LLMs are prone to hallucinate untruthful or nonsensical outputs that fail to meet user expectations in many…

计算与语言 · 计算机科学 2023-11-23 Tianhang Zhang , Lin Qiu , Qipeng Guo , Cheng Deng , Yue Zhang , Zheng Zhang , Chenghu Zhou , Xinbing Wang , Luoyi Fu

Large Language Models (LLMs) have demonstrated exceptional natural language understanding abilities and have excelled in a variety of natural language processing (NLP)tasks in recent years. Despite the fact that most LLMs are trained…

计算与语言 · 计算机科学 2023-10-25 Xiang Zhang , Senyu Li , Bradley Hauer , Ning Shi , Grzegorz Kondrak

Large Language Models (LLMs) have shown remarkable capabilities across diverse tasks, yet they face inherent limitations such as constrained parametric knowledge and high retraining costs. Retrieval-Augmented Generation (RAG) augments the…

信息检索 · 计算机科学 2025-08-26 Leqian Li , Dianxi Shi , Jialu Zhou , Xinyu Wei , Mingyue Yang , Songchang Jin , Shaowu Yang

Truly reliable AI requires more than simply scaling up knowledge; it demands the ability to know what it knows and when it does not. Yet recent research shows that even the best LLMs misjudge their own competence in more than one in five…

计算与语言 · 计算机科学 2025-10-14 Sahil Kale , Devendra Singh Dhami

The increased use of large language models (LLMs) across a variety of real-world applications calls for automatic tools to check the factual accuracy of their outputs, as LLMs often hallucinate. This is difficult as it requires assessing…

计算与语言 · 计算机科学 2025-10-30 Hasan Iqbal , Yuxia Wang , Minghan Wang , Georgi Georgiev , Jiahui Geng , Iryna Gurevych , Preslav Nakov

Automatic fact verification systems increasingly rely on large language models (LLMs). We investigate how parametric knowledge biases in these models affect fact-checking outcomes of the HerO system (baseline for FEVER-25). We examine how…

计算与语言 · 计算机科学 2025-06-30 Eivind Morris Bakke , Nora Winger Heggelund

Large language models (LLMs), such as ChatGPT, have rapidly penetrated into people's work and daily lives over the past few years, due to their extraordinary conversational skills and intelligence. ChatGPT has become the fastest-growing…

计算与语言 · 计算机科学 2024-09-04 Wenxuan Wang

This article presents a method for verifying RDF triples using LLMs, with an emphasis on providing traceable arguments. Because the LLMs cannot currently reliably identify the origin of the information used to construct the response to the…

人工智能 · 计算机科学 2025-06-12 Daniel Adam , Tomáš Kliegr

The advent of Large Language Models (LLMs) has significantly transformed the AI landscape, enhancing machine learning and AI capabilities. Factuality issue is a critical concern for LLMs, as they may generate factually incorrect responses.…

计算与语言 · 计算机科学 2024-04-02 Xiaoze Liu , Feijie Wu , Tianyang Xu , Zhuo Chen , Yichi Zhang , Xiaoqian Wang , Jing Gao

This paper investigates the role of dynamic external knowledge integration in improving counter-argument generation using Large Language Models (LLMs). While LLMs have shown promise in argumentative tasks, their tendency to generate…

计算与语言 · 计算机科学 2025-06-23 Anar Yeginbergen , Maite Oronoz , Rodrigo Agerri

As Large Language Models (LLMs) become increasingly sophisticated and ubiquitous in natural language processing (NLP) applications, ensuring their robustness, trustworthiness, and alignment with human values has become a critical challenge.…

计算与语言 · 计算机科学 2024-08-09 Wrick Talukdar , Anjanava Biswas

It is important for Large Language Models (LLMs) to be aware of the boundary of their knowledge, distinguishing queries they can confidently answer from those that lie beyond their capabilities. Such awareness enables models to perform…

计算与语言 · 计算机科学 2026-03-05 Lihu Chen , Gerard de Melo , Fabian M. Suchanek , Gaël Varoquaux

Large language models (LLMs) have demonstrated strong capabilities in text understanding and generation. However, they often lack factuality, producing a mixture of true and false information, especially in long-form generation. In this…

计算与语言 · 计算机科学 2025-09-26 Lifu Tu , Rui Meng , Shafiq Joty , Yingbo Zhou , Semih Yavuz

While Large Language Models (LLM) are able to accumulate and restore knowledge, they are still prone to hallucination. Especially when faced with factual questions, LLM cannot only rely on knowledge stored in parameters to guarantee…

计算与语言 · 计算机科学 2024-01-04 Pierre Erbacher , Louis Falissar , Vincent Guigue , Laure Soulier

While hallucinations of large language models (LLMs) prevail as a major challenge, existing evaluation benchmarks on factuality do not cover the diverse domains of knowledge that the real-world users of LLMs seek information about. To…