中文
相关论文

相关论文: Evaluating the Factuality of Large Language Models…

200 篇论文

Handling graph data is one of the most difficult tasks. Traditional techniques, such as those based on geometry and matrix factorization, rely on assumptions about the data relations that become inadequate when handling large and complex…

机器学习 · 计算机科学 2024-04-15 Zhenyu Qian , Yiming Qian , Yuting Song , Fei Gao , Hai Jin , Chen Yu , Xia Xie

Large language models (LLMs) have made remarkable progress in various natural language processing tasks as a benefit of their capability to comprehend and reason with factual knowledge. However, a significant amount of factual knowledge is…

计算与语言 · 计算机科学 2024-08-23 Sirui Huang , Yanggan Gu , Xuming Hu , Zhonghao Li , Qing Li , Guandong Xu

Large language models (LLMs) have raised hopes for automated end-to-end fact-checking, but prior studies report mixed results. As mainstream chatbots increasingly ship with reasoning capabilities and web search tools -- and millions of…

计算与语言 · 计算机科学 2025-11-25 Matthew R. DeVerna , Kai-Cheng Yang , Harry Yaojun Yan , Filippo Menczer

Knowledge graphs have emerged as a popular method for injecting up-to-date, factual knowledge into large language models (LLMs). This is typically achieved by converting the knowledge graph into text that the LLM can process in context.…

计算与语言 · 计算机科学 2025-04-10 Elan Markowitz , Krupa Galiya , Greg Ver Steeg , Aram Galstyan

In recent years, efforts have been made to use text information for better user profiling and item characterization in recommendations. However, text information can sometimes be of low quality, hindering its effectiveness for real-world…

人工智能 · 计算机科学 2024-02-15 Yingpeng Du , Ziyan Wang , Zhu Sun , Haoyan Chua , Hongzhi Liu , Zhonghai Wu , Yining Ma , Jie Zhang , Youchen Sun

Large Language Models (LLMs) possess a remarkable capacity to generate persuasive and intelligible language. However, coherence does not equate to truthfulness, as the responses often contain subtle hallucinations. Existing benchmarks are…

计算与语言 · 计算机科学 2026-02-24 Alex Robertson , Huizhi Liang , Mahbub Gani , Rohit Kumar , Srijith Rajamohan

With the rapidly improving reasoning abilities of Large Language Models (LLMs), there is also a rising demand to use them in a wide variety of domains. This brings about the need to carefully evaluate the limits of the capabilities of these…

机器学习 · 计算机科学 2026-05-05 Sunil Kumar Maurya , Xin Liu

The growing trend of Large Language Models (LLM) development has attracted significant attention, with models for various applications emerging consistently. However, the combined application of Large Language Models with semantic…

计算与语言 · 计算机科学 2023-05-09 Milena Trajanoska , Riste Stojanov , Dimitar Trajanov

A graph is a fundamental data model to represent various entities and their complex relationships in society and nature, such as social networks, transportation networks, and financial networks. Recently, large language models (LLMs) have…

计算与语言 · 计算机科学 2025-07-08 Wenbo Shang , Xin Huang

Pretrained language models (LMs) are susceptible to generate text with nonfactual information. In this work, we measure and improve the factual accuracy of large-scale LMs for open-ended text generation. We design the FactualityPrompts test…

计算与语言 · 计算机科学 2023-03-03 Nayeon Lee , Wei Ping , Peng Xu , Mostofa Patwary , Pascale Fung , Mohammad Shoeybi , Bryan Catanzaro

Large Language Models (LLMs) often struggle with producing factually consistent answers due to limitations in their parametric memory. Retrieval-Augmented Generation (RAG) paradigms mitigate this issue by incorporating external knowledge at…

计算与语言 · 计算机科学 2026-05-05 Shanglin Wu , Lihui Liu , Jinho D. Choi , Kai Shu

Since the recent prosperity of Large Language Models (LLMs), there have been interleaved discussions regarding how to reduce hallucinations from LLM responses, how to increase the factuality of LLMs, and whether Knowledge Graphs (KGs),…

计算与语言 · 计算机科学 2024-04-04 Kai Sun , Yifan Ethan Xu , Hanwen Zha , Yue Liu , Xin Luna Dong

Grounded claim factuality checking is important for large language model (LLM) applications such as retrieval-augmented generation, as it helps users assess the correctness of generated outputs. Existing metrics using entailment classifiers…

计算与语言 · 计算机科学 2026-05-29 Yuxuan Ye , Raul Santos-Rodriguez , Edwin Simpson

Large Language Models (LLMs) demonstrate an impressive capacity to recall a vast range of factual knowledge. However, understanding their underlying reasoning and internal mechanisms in exploiting this knowledge remains a key research area.…

计算与语言 · 计算机科学 2024-08-07 Marco Bronzini , Carlo Nicolini , Bruno Lepri , Jacopo Staiano , Andrea Passerini

Large Language Models (LLMs) are trained on vast and diverse internet corpora that often include inaccurate or misleading content. Consequently, LLMs can generate misinformation, making robust fact-checking essential. This review…

Automated fact-checking, using machine learning to verify claims, has grown vital as misinformation spreads beyond human fact-checking capacity. Large Language Models (LLMs) like GPT-4 are increasingly trusted to write academic papers,…

计算与语言 · 计算机科学 2024-02-08 Dorian Quelle , Alexandre Bovet

The use of large language models (LLMs) has significantly increased since the introduction of ChatGPT in 2022, demonstrating their value across various applications. However, a major challenge for enterprise and commercial adoption of LLMs…

计算与语言 · 计算机科学 2024-08-28 N. E. Kriman

Large language models (LLMs) have shown impressive prowess in solving a wide range of tasks with world knowledge. However, it remains unclear how well LLMs are able to perceive their factual knowledge boundaries, particularly under…

计算与语言 · 计算机科学 2024-11-20 Ruiyang Ren , Yuhao Wang , Yingqi Qu , Wayne Xin Zhao , Jing Liu , Hao Tian , Hua Wu , Ji-Rong Wen , Haifeng Wang

Large Language Models (LLMs) have achieved impressive results in processing text data, which has sparked interest in applying these models beyond textual data, such as graphs. In the field of graph learning, there is a growing interest in…

人工智能 · 计算机科学 2024-10-10 Sheng Ouyang , Yulan Hu , Ge Chen , Yong Liu

Although Large Language Models (LLMs) are effective in performing various NLP tasks, they still struggle to handle tasks that require extensive, real-world knowledge, especially when dealing with long-tail facts (facts related to long-tail…

计算与语言 · 计算机科学 2024-05-13 Wenyu Huang , Guancheng Zhou , Mirella Lapata , Pavlos Vougiouklis , Sebastien Montella , Jeff Z. Pan