English
Related papers

Related papers: Empowering Language Models with Knowledge Graph Re…

200 papers

Knowledge-Enhanced Pre-trained Language Models (KEPLMs) improve the performance of various downstream NLP tasks by injecting knowledge facts from large-scale Knowledge Graphs (KGs). However, existing methods for pre-training KEPLMs with…

Computation and Language · Computer Science 2023-11-14 Ruyao Xu , Taolin Zhang , Chengyu Wang , Zhongjie Duan , Cen Chen , Minghui Qiu , Dawei Cheng , Xiaofeng He , Weining Qian

Retrieval-Augmented Generation (RAG) has been shown to enhance the factual accuracy of Large Language Models (LLMs), but existing methods often suffer from limited reasoning capabilities in effectively using the retrieved evidence,…

Computation and Language · Computer Science 2024-10-03 Shayekh Bin Islam , Md Asib Rahman , K S M Tozammel Hossain , Enamul Hoque , Shafiq Joty , Md Rizwan Parvez

Ontology Alignment (OA) is essential for enabling semantic interoperability across heterogeneous knowledge systems. While recent advances have focused on large language models (LLMs) for capturing contextual semantics, this work revisits…

Artificial Intelligence · Computer Science 2025-10-01 Hamed Babaei Giglou , Jennifer D'Souza , Sören Auer , Mahsa Sanaei

Recently, large language models (LLMs) have demonstrated impressive performance in Knowledge Graph Question Answering (KGQA) tasks, which aim to find answers based on knowledge graphs (KGs) for natural language questions. Existing…

Computation and Language · Computer Science 2025-05-20 Xiao Long , Liansheng Zhuang , Chen Shen , Shaotian Yan , Yifei Li , Shafei Wang

Question Answering (QA) is a task that entails reasoning over natural language contexts, and many relevant works augment language models (LMs) with graph neural networks (GNNs) to encode the Knowledge Graph (KG) information. However, most…

Computation and Language · Computer Science 2023-04-26 Jinyoung Park , Hyeong Kyu Choi , Juyeon Ko , Hyeonjin Park , Ji-Hoon Kim , Jisu Jeong , Kyungmin Kim , Hyunwoo J. Kim

Pre-trained Text-to-Text Language Models (LMs), such as T5 or BART yield promising results in the Knowledge Graph Question Answering (KGQA) task. However, the capacity of the models is limited and the quality decreases for questions with…

Computation and Language · Computer Science 2023-10-12 Mikhail Salnikov , Maria Lysyuk , Pavel Braslavski , Anton Razzhigaev , Valentin Malykh , Alexander Panchenko

Large language models (LLMs) have demonstrated remarkable capabilities in various complex tasks, yet they still suffer from hallucinations. By incorporating and exploring external knowledge, such as knowledge graphs(KGs), LLM's ability to…

Artificial Intelligence · Computer Science 2025-05-27 Qi Zhao , Hongyu Yang , Qi Song , Xinwei Yao , Xiangyang Li

Knowledge Graphs (KGs) often have two characteristics: heterogeneous graph structure and text-rich entity/relation information. Text-based KG embeddings can represent entities by encoding descriptions with pre-trained language models, but…

Computation and Language · Computer Science 2023-09-15 Xin Xie , Zhoubo Li , Xiaohan Wang , Zekun Xi , Ningyu Zhang

Mitigating the hallucinations of Large Language Models is a crucial task. Although some existing methods employ self-enhancement techniques, they fall short of effectively addressing unknown factual hallucinations. Meanwhile, Knowledge…

Computation and Language · Computer Science 2025-03-04 Jiaxiang Liu , Tong Zhou , Yubo Chen , Kang Liu , Jun Zhao

This paper presents a scholarly Knowledge Graph Question Answering (KGQA) that answers bibliographic natural language questions by leveraging a large language model (LLM) in a few-shot manner. The model initially identifies the top-n…

Computation and Language · Computer Science 2023-11-17 Tilahun Abedissa Taffa , Ricardo Usbeck

Large Language Models (LLMs) have achieved significant success in open-domain question answering. However, they continue to face challenges such as hallucinations and knowledge cutoffs. These issues can be mitigated through in-context…

Computation and Language · Computer Science 2025-02-19 Zukang Yang , Zixuan Zhu , Xuan Zhu

Conversational question answering (convQA) over knowledge graphs (KGs) involves answering multi-turn natural language questions about information contained in a KG. State-of-the-art methods of ConvQA often struggle with inexplicit…

Computation and Language · Computer Science 2024-04-01 Lihui Liu , Blaine Hill , Boxin Du , Fei Wang , Hanghang Tong

Large Language Models (LLMs) demonstrate impressive natural language capabilities but often struggle with knowledge-intensive reasoning tasks. Knowledge Base Question Answering (KBQA), which leverages structured Knowledge Graphs (KGs)…

Computation and Language · Computer Science 2026-04-15 Shuai Wang , Yinan Yu

Large Language Models (LLMs) have demonstrated remarkable capabilities in many real-world applications. Nonetheless, LLMs are often criticized for their tendency to produce hallucinations, wherein the models fabricate incorrect statements…

Computation and Language · Computer Science 2024-06-05 Qinggang Zhang , Junnan Dong , Hao Chen , Daochen Zha , Zailiang Yu , Xiao Huang

Recently, ChatGPT, a representative large language model (LLM), has gained considerable attention due to its powerful emergent abilities. Some researchers suggest that LLMs could potentially replace structured knowledge bases like knowledge…

Computation and Language · Computer Science 2024-01-31 Linyao Yang , Hongyang Chen , Zhao Li , Xiao Ding , Xindong Wu

Retrieval-Augmented Generation (RAG) systems combine Large Language Models (LLMs) with external knowledge, and their performance depends heavily on how that knowledge is represented. This study investigates how different Knowledge Graph…

Information Retrieval · Computer Science 2025-11-11 Tiago da Cruz , Bernardo Tavares , Francisco Belo

Large language models (LLMs) have demonstrated impressive reasoning abilities yet remain unreliable on knowledge-intensive, multi-hop questions -- they miss long-tail facts, hallucinate when uncertain, and their internal knowledge lags…

Computation and Language · Computer Science 2025-10-13 Jia Ao Sun , Hao Yu , Fabrizio Gotti , Fengran Mo , Yihong Wu , Yuchen Hui , Jian-Yun Nie

Recent large language model (LLM) reasoning, despite its success, suffers from limited domain knowledge, susceptibility to hallucinations, and constrained reasoning depth, particularly in small-scale models deployed in resource-constrained…

Artificial Intelligence · Computer Science 2025-03-04 Wenjie Wu , Yongcheng Jing , Yingjie Wang , Wenbin Hu , Dacheng Tao

Large language models (LLMs) have been used to generate query expansions augmenting original queries for improving information search. Recent studies also explore providing LLMs with initial retrieval results to generate query expansions…

Computation and Language · Computer Science 2025-02-07 Yu Xia , Junda Wu , Sungchul Kim , Tong Yu , Ryan A. Rossi , Haoliang Wang , Julian McAuley

Knowledge graphs play a vital role in numerous artificial intelligence tasks, yet they frequently face the issue of incompleteness. In this study, we explore utilizing Large Language Models (LLM) for knowledge graph completion. We consider…

Computation and Language · Computer Science 2025-02-14 Liang Yao , Jiazhen Peng , Chengsheng Mao , Yuan Luo