English
Related papers

Related papers: Addressing Hallucinations in Language Models with …

200 papers

Large Language Models (LLMs) have achieved impressive performance in text understanding and have become an essential tool for building smart assistants. Originally focusing on text, they have been enhanced with multimodal capabilities in…

Software Engineering · Computer Science 2024-10-24 Aaron Haag , Vlad Argatu , Oliver Lohse

Knowledge Graph Completion (KGC), which aims to infer missing or incomplete facts, is a crucial task for KGs. However, integrating the vital structural information of KGs into Large Language Models (LLMs) and outputting predictions…

Computation and Language · Computer Science 2025-06-02 Kangyang Luo , Yuzhuo Bai , Cheng Gao , Shuzheng Si , Yingli Shen , Zhu Liu , Zhitong Wang , Cunliang Kong , Wenhao Li , Yufei Huang , Ye Tian , Xuantang Xiong , Lei Han , Maosong Sun

Knowledge graph embeddings are dense numerical representations of entities in a knowledge graph (KG). While the majority of approaches concentrate only on relational information, i.e., relations between entities, fewer approaches exist…

Artificial Intelligence · Computer Science 2023-09-07 Patryk Preisner , Heiko Paulheim

Knowledge graphs (KGs) are the cornerstone of the semantic web, offering up-to-date representations of real-world entities and relations. Yet large language models (LLMs) remain largely static after pre-training, causing their internal…

Computation and Language · Computer Science 2026-03-24 Songlin Zhai , Guilin Qi , Yue Wang , Yuan Meng

Large language models (LLMs) have significantly advanced the field of natural language generation. However, they frequently generate unverified outputs, which compromises their reliability in critical applications. In this study, we propose…

Computation and Language · Computer Science 2025-02-18 Alexandru Lecu , Adrian Groza , Lezan Hawizy

Knowledge Graphs (KGs) have been applied to many tasks including Web search, link prediction, recommendation, natural language processing, and entity linking. However, most KGs are far from complete and are growing at a rapid pace. To…

Artificial Intelligence · Computer Science 2017-11-10 Baoxu Shi , Tim Weninger

Large Language Models (LLMs) exhibit strong abilities in natural language understanding and generation, yet they struggle with knowledge-intensive reasoning. Structured Knowledge Graphs (KGs) provide an effective form of external knowledge…

Computation and Language · Computer Science 2026-04-15 Shuai Wang , Yinan Yu

Recent advances in large language models (LLMs) have led to impressive progress in natural language generation, yet their tendency to produce hallucinated or unsubstantiated content remains a critical concern. To improve factual…

Computation and Language · Computer Science 2025-05-20 Xukai Liu , Ye Liu , Shiwen Wu , Yanghai Zhang , Yihao Yuan , Kai Zhang , Qi Liu

Knowledge-Enhanced Pre-trained Language Models (KEPLMs) improve the performance of various downstream NLP tasks by injecting knowledge facts from large-scale Knowledge Graphs (KGs). However, existing methods for pre-training KEPLMs with…

Computation and Language · Computer Science 2023-11-14 Ruyao Xu , Taolin Zhang , Chengyu Wang , Zhongjie Duan , Cen Chen , Minghui Qiu , Dawei Cheng , Xiaofeng He , Weining Qian

Large Language Models (LLMs) have been extensively adopted in Knowledge Graph Completion (KGC), showcasing significant research advancements. However, as black-box models driven by deep neural architectures, current LLM-based KGC methods…

Computation and Language · Computer Science 2025-10-22 Wenbin Guo , Xin Wang , Jiaoyan Chen , Zhao Li , Zirui Chen

Large Language Models (LLMs) often struggle with tasks requiring external knowledge, such as knowledge-intensive Multiple Choice Question Answering (MCQA). Integrating Knowledge Graphs (KGs) can enhance reasoning; however, existing methods…

Computation and Language · Computer Science 2025-04-01 Haochen Liu , Song Wang , Chen Chen , Jundong Li

Large language models have shown remarkable language processing and reasoning ability but are prone to hallucinate when asked about private data. Retrieval-augmented generation (RAG) retrieves relevant data that fit into an LLM's context…

Machine Learning · Computer Science 2025-11-13 Alfred Clemedtson , Borun Shi

While textual information significantly enhances the performance of pre-trained language models (PLMs) in knowledge graph completion (KGC), the static and noisy nature of existing corpora collected from Wikipedia articles or synsets…

Computation and Language · Computer Science 2024-02-27 Dawei Li , Zhen Tan , Tianlong Chen , Huan Liu

Recent advancements in large language models (LLMs) have shown impressive versatility across various tasks. To eliminate their hallucinations, retrieval-augmented generation (RAG) has emerged as a powerful approach, leveraging external…

Computation and Language · Computer Science 2025-05-30 Yuzheng Cai , Zhenyue Guo , Yiwen Pei , Wanrui Bian , Weiguo Zheng

Modeling human language requires the ability to not only generate fluent text but also encode factual knowledge. However, traditional language models are only capable of remembering facts seen at training time, and often have difficulty…

Computation and Language · Computer Science 2019-06-24 Robert L. Logan , Nelson F. Liu , Matthew E. Peters , Matt Gardner , Sameer Singh

To mitigate hallucinations in large language models (LLMs), we propose a framework that focuses on errors induced by prompts. Our method extends a chain-style knowledge distillation approach by incorporating a programmable module that…

Computation and Language · Computer Science 2026-01-08 Jinbo Hao , Kai Yang , Qingzhen Su , Yifan Li , Chao Jiang

Knowledge graphs (KGs) consist of links that describe relationships between entities. Due to the difficulty of manually enumerating all relationships between entities, automatically completing them is essential for KGs. Knowledge Graph…

Computation and Language · Computer Science 2024-06-07 Yusuke Sakai , Hidetaka Kamigaito , Katsuhiko Hayashi , Taro Watanabe

Hallucinations, the generation of apparently convincing yet false statements, remain a major barrier to the safe deployment of LLMs. Building on the strong performance of self-detection methods, we examine the use of structured knowledge…

Computation and Language · Computer Science 2025-12-30 Sahil Kale , Antonio Luca Alfeo

Knowledge Representation Learning (KRL) is crucial for enabling applications of symbolic knowledge from Knowledge Graphs (KGs) to downstream tasks by projecting knowledge facts into vector spaces. Despite their effectiveness in modeling KG…

Computation and Language · Computer Science 2025-04-09 Xin Wang , Zirui Chen , Haofen Wang , Leong Hou U , Zhao Li , Wenbin Guo

Knowledge graph completion (KGC) is a widely used method to tackle incompleteness in knowledge graphs (KGs) by making predictions for missing links. Description-based KGC leverages pre-trained language models to learn entity and relation…

Computation and Language · Computer Science 2024-03-05 Derong Xu , Ziheng Zhang , Zhenxi Lin , Xian Wu , Zhihong Zhu , Tong Xu , Xiangyu Zhao , Yefeng Zheng , Enhong Chen