中文
相关论文

相关论文: Diving Deep into Modes of Fact Hallucinations in D…

200 篇论文

Knowledge graphs (KGs) are vital for knowledge-intensive tasks and have shown promise in reducing hallucinations in large language models (LLMs). However, constructing high-quality KGs remains difficult, requiring accurate information…

计算与语言 · 计算机科学 2025-10-14 Ruirui Chen , Weifeng Jiang , Chengwei Qin , Bo Xiong , Fiona Liausvia , Dongkyu Choi , Boon Kiat Quek

Large Language Models (LLMs) may suffer from hallucinations in real-world applications due to the lack of relevant knowledge. In contrast, knowledge graphs encompass extensive, multi-relational structures that store a vast array of symbolic…

计算与语言 · 计算机科学 2024-09-06 Jie Ma , Zhitao Gao , Qi Chai , Wangchun Sun , Pinghui Wang , Hongbin Pei , Jing Tao , Lingyun Song , Jun Liu , Chen Zhang , Lizhen Cui

Hallucination is a persistent challenge in large language models (LLMs), where even with rigorous quality control, models often generate distorted facts. This paradox, in which error generation continues despite high-quality training data,…

计算与语言 · 计算机科学 2025-02-25 Yuji Zhang , Sha Li , Cheng Qian , Jiateng Liu , Pengfei Yu , Chi Han , Yi R. Fung , Kathleen McKeown , Chengxiang Zhai , Manling Li , Heng Ji

Knowledge graph (KG) is known to be helpful for the task of question answering (QA), since it provides well-structured relational information between entities, and allows one to further infer indirect facts. However, it is challenging to…

机器学习 · 计算机科学 2017-11-29 Yuyu Zhang , Hanjun Dai , Zornitsa Kozareva , Alexander J. Smola , Le Song

Recent advancements in Large Language Models (LLMs) have showcased their proficiency in answering natural language queries. However, their effectiveness is hindered by limited domain-specific knowledge, raising concerns about the…

Large language models (LMs) are prone to generate factual errors, which are often called hallucinations. In this paper, we introduce a comprehensive taxonomy of hallucinations and argue that hallucinations manifest in diverse forms, each…

Integrating structured knowledge from Knowledge Graphs (KGs) into Large Language Models (LLMs) remains a key challenge for symbolic reasoning. Existing methods mainly rely on prompt engineering or fine-tuning, which lose structural fidelity…

机器学习 · 计算机科学 2025-05-13 Erica Coppolillo

Large Language Models (LLMs) are often challenged by generating erroneous or hallucinated responses, especially in complex reasoning tasks. Leveraging Knowledge Graphs (KGs) as external knowledge sources has emerged as a viable solution.…

人工智能 · 计算机科学 2025-05-23 Yuan Sui , Yufei He , Nian Liu , Xiaoxin He , Kun Wang , Bryan Hooi

Answering logical queries on knowledge graphs (KG) poses a significant challenge for machine reasoning. The primary obstacle in this task stems from the inherent incompleteness of KGs. Existing research has predominantly focused on…

机器学习 · 计算机科学 2024-03-20 Zezhong Xu , Peng Ye , Lei Liang , Huajun Chen , Wen Zhang

In the context of knowledge-driven seq-to-seq generation tasks, such as document-based question answering and document summarization systems, two fundamental knowledge sources play crucial roles: the inherent knowledge embedded within model…

计算与语言 · 计算机科学 2025-01-16 Han Cao , Zhaoyang Zhang , Xiangtian Li , Chufan Wu , Hansong Zhang , Wenqing Zhang

Answering complex questions about textual narratives requires reasoning over both stated context and the world knowledge that underlies it. However, pretrained language models (LM), the foundation of most modern QA systems, do not robustly…

Knowledge-grounded dialogue systems aim to generate informative, contextually relevant responses by conditioning on external knowledge sources. However, most existing approaches focus exclusively on English, lack explicit citation…

计算与语言 · 计算机科学 2026-03-20 Vedant Pandya

Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language understanding and generation. However, they often struggle with complex reasoning tasks and are prone to hallucination. Recent research has shown…

计算与语言 · 计算机科学 2024-12-17 Xue Wu , Kostas Tsioutsiouliklis

Humans usually have conversations by making use of prior knowledge about a topic and background information of the people whom they are talking to. However, existing conversational agents and datasets do not consider such comprehensive…

计算与语言 · 计算机科学 2022-05-17 Yoonna Jang , Jungwoo Lim , Yuna Hur , Dongsuk Oh , Suhyune Son , Yeonsoo Lee , Donghoon Shin , Seungryong Kim , Heuiseok Lim

Mitigating the hallucinations of Large Language Models is a crucial task. Although some existing methods employ self-enhancement techniques, they fall short of effectively addressing unknown factual hallucinations. Meanwhile, Knowledge…

计算与语言 · 计算机科学 2025-03-04 Jiaxiang Liu , Tong Zhou , Yubo Chen , Kang Liu , Jun Zhao

Machine Learning has been the quintessential solution for many AI problems, but learning is still heavily dependent on the specific training data. Some learning models can be incorporated with a prior knowledge in the Bayesian set up, but…

计算与语言 · 计算机科学 2018-05-22 K M Annervaz , Somnath Basu Roy Chowdhury , Ambedkar Dukkipati

Prior works have shown that fine-tuning on new knowledge can induce factual hallucinations in large language models (LLMs), leading to incorrect outputs when evaluated on previously known information. However, the specific manifestations of…

计算与语言 · 计算机科学 2026-04-20 Renfei Dang , Peng Hu , Zhejian Lai , Changjiang Gao , Min Zhang , Shujian Huang

Knowledge Graphs (KGs) are a powerful representation of linked data, offering flexibility, semantic richness, and support for knowledge enrichment and reasoning. They help data owners organize and exploit heterogeneous data to provide…

密码学与安全 · 计算机科学 2026-05-20 Yasmine Hayder

Knowledge Graphs (KG) act as a great tool for holding distilled information from large natural language text corpora. The problem of natural language querying over knowledge graphs is essential for the human consumption of this information.…

机器学习 · 计算机科学 2021-12-22 Aayushee Gupta , K. M. Annervaz , Ambedkar Dukkipati , Shubhashis Sengupta

Knowledge graph (KG) embeddings have been a mainstream approach for reasoning over incomplete KGs. However, limited by their inherently shallow and static architectures, they can hardly deal with the rising focus on complex logical queries,…

机器学习 · 计算机科学 2022-08-17 Xiao Liu , Shiyu Zhao , Kai Su , Yukuo Cen , Jiezhong Qiu , Mengdi Zhang , Wei Wu , Yuxiao Dong , Jie Tang