English
Related papers

Related papers: Multi-hop Reasoning and Retrieval in Embedding Spa…

200 papers

Large Language Models (LLMs) are often challenged by generating erroneous or hallucinated responses, especially in complex reasoning tasks. Leveraging Knowledge Graphs (KGs) as external knowledge sources has emerged as a viable solution.…

Artificial Intelligence · Computer Science 2025-05-23 Yuan Sui , Yufei He , Nian Liu , Xiaoxin He , Kun Wang , Bryan Hooi

The integration of knowledge graphs (KGs) with large language models (LLMs) offers significant potential to improve the retrieval phase of retrieval-augmented generation (RAG) systems. In this study, we propose KG-CQR, a novel framework for…

Computation and Language · Computer Science 2025-09-09 Chi Minh Bui , Ngoc Mai Thieu , Van Vinh Nguyen , Jason J. Jung , Khac-Hoai Nam Bui

Knowledge graphs (KGs), with their structured representation capabilities, offer promising avenue for enhancing Retrieval Augmented Generation (RAG) systems, leading to the development of KG-RAG systems. Nevertheless, existing methods often…

Information Retrieval · Computer Science 2025-10-17 Yikuan Hu , Jifeng Zhu , Lanrui Tang , Chen Huang

Knowledge Graphs (KGs) have found many applications in industry and academic settings, which in turn, have motivated considerable research efforts towards large-scale information extraction from a variety of sources. Despite such efforts,…

Machine Learning · Computer Science 2021-01-25 Andrea Rossi , Donatella Firmani , Antonio Matinata , Paolo Merialdo , Denilson Barbosa

Many mathematical models have been leveraged to design embeddings for representing Knowledge Graph (KG) entities and relations for link prediction and many downstream tasks. These mathematically-inspired models are not only highly scalable…

Artificial Intelligence · Computer Science 2023-09-25 Xiou Ge , Yun-Cheng Wang , Bin Wang , C. -C. Jay Kuo

The integration of Knowledge Graphs (KGs) into the Retrieval Augmented Generation (RAG) framework has attracted significant interest, with early studies showing promise in mitigating hallucinations and improving model accuracy. However, a…

Artificial Intelligence · Computer Science 2025-05-20 Xujie Yuan , Yongxu Liu , Shimin Di , Shiwen Wu , Libin Zheng , Rui Meng , Lei Chen , Xiaofang Zhou , Jian Yin

Knowledge graph (KG) embeddings have been a mainstream approach for reasoning over incomplete KGs. However, limited by their inherently shallow and static architectures, they can hardly deal with the rising focus on complex logical queries,…

Machine Learning · Computer Science 2022-08-17 Xiao Liu , Shiyu Zhao , Kai Su , Yukuo Cen , Jiezhong Qiu , Mengdi Zhang , Wei Wu , Yuxiao Dong , Jie Tang

Large Language Models (LLMs) have been extensively adopted in Knowledge Graph Completion (KGC), showcasing significant research advancements. However, as black-box models driven by deep neural architectures, current LLM-based KGC methods…

Computation and Language · Computer Science 2025-10-22 Wenbin Guo , Xin Wang , Jiaoyan Chen , Zhao Li , Zirui Chen

Knowledge Graphs (KGs) and their machine learning counterpart, Knowledge Graph Embedding Models (KGEMs), have seen ever-increasing use in a wide variety of academic and applied settings. In particular, KGEMs are typically applied to KGs to…

Machine Learning · Computer Science 2024-12-16 Jeffrey Sardina , John D. Kelleher , Declan O'Sullivan

Recently, large language models (LLMs) have demonstrated remarkable capabilities in natural language processing tasks, yet they remain prone to hallucinations when reasoning with insufficient internal knowledge. While integrating LLMs with…

Computation and Language · Computer Science 2025-05-27 Jiajun Zhu , Ye Liu , Meikai Bao , Kai Zhang , Yanghai Zhang , Qi Liu

The task of multi-hop link prediction within knowledge graphs (KGs) stands as a challenge in the field of knowledge graph analysis, as it requires the model to reason through and understand all intermediate connections before making a…

Computation and Language · Computer Science 2025-06-17 Dong Shu , Tianle Chen , Mingyu Jin , Chong Zhang , Mengnan Du , Yongfeng Zhang

Large language models (LLMs) typically improve performance by either retrieving semantically similar information, or enhancing reasoning abilities through structured prompts like chain-of-thought. While both strategies are considered…

Computation and Language · Computer Science 2024-10-16 Yejin Kim , Eojin Kang , Juae Kim , H. Howie Huang

Knowledge-enhanced language representation learning has shown promising results across various knowledge-intensive NLP tasks. However, prior methods are limited in efficient utilization of multilingual knowledge graph (KG) data for language…

Computation and Language · Computer Science 2022-10-20 Linlin Liu , Xin Li , Ruidan He , Lidong Bing , Shafiq Joty , Luo Si

Retrieval-Augmented Generation (RAG) shows impressive performance by supplementing and substituting parametric knowledge in Large Language Models (LLMs). Retrieved knowledge can be divided into three types: explicit answer evidence,…

Computation and Language · Computer Science 2025-08-05 Zhichao Yan , Jiapu Wang , Jiaoyan Chen , Yanyan Wang , Hongye Tan , Jiye Liang , Xiaoli Li , Ru Li , Jeff Z. Pan

Knowledge Graphs (KGs) store structured factual knowledge by linking entities through relationships, crucial for many applications. These applications depend on the KG's factual accuracy, so verifying facts is essential, yet challenging.…

Databases · Computer Science 2026-02-12 Farzad Shami , Stefano Marchesin , Gianmaria Silvello

Representation Learning of words and Knowledge Graphs (KG) into low dimensional vector spaces along with its applications to many real-world scenarios have recently gained momentum. In order to make use of multiple KG embeddings for…

Computation and Language · Computer Science 2020-04-16 Russa Biswas , Mehwish Alam , Harald Sack

Large Language Models (LLMs) excel in many natural language processing tasks but often exhibit factual inconsistencies in knowledge-intensive settings. Integrating external knowledge resources, particularly knowledge graphs (KGs), provides…

Computation and Language · Computer Science 2026-02-17 Shuai Wang , Yinan Yu

Large language models (LLMs) acquire knowledge across diverse domains such as science, history, and geography encountered during generative pre-training. However, due to their stochasticity, it is difficult to predict what LLMs have…

Computation and Language · Computer Science 2026-01-27 Kartik Sharma , Yiqiao Jin , Rakshit Trivedi , Srijan Kumar

Knowledge Graph Embedding (KGE) techniques are crucial in learning compact representations of entities and relations within a knowledge graph, facilitating efficient reasoning and knowledge discovery. While existing methods typically focus…

Computation and Language · Computer Science 2024-10-29 Pengcheng Jiang , Lang Cao , Cao Xiao , Parminder Bhatia , Jimeng Sun , Jiawei Han

Large language models (LLMs) have significantly advanced performance across a spectrum of natural language processing (NLP) tasks. Yet, their application to knowledge graphs (KGs), which describe facts in the form of triplets and allow…

Computation and Language · Computer Science 2024-10-11 Lingbing Guo , Zhongpu Bo , Zhuo Chen , Yichi Zhang , Jiaoyan Chen , Yarong Lan , Mengshu Sun , Zhiqiang Zhang , Yangyifei Luo , Qian Li , Qiang Zhang , Wen Zhang , Huajun Chen