English
Related papers

Related papers: Leveraging LLM-GNN Integration for Open-World Ques…

200 papers

While Large Language Models (LLMs) demonstrate exceptional performance in a multitude of Natural Language Processing (NLP) tasks, they encounter challenges in practical applications, including issues with hallucinations, inadequate…

Computation and Language · Computer Science 2024-06-13 Yihao Li , Ru Zhang , Jianyi Liu

To address the issues of insufficient knowledge and hallucination in Large Language Models (LLMs), numerous studies have explored integrating LLMs with Knowledge Graphs (KGs). However, these methods are typically evaluated on conventional…

Computation and Language · Computer Science 2024-10-08 Yao Xu , Shizhu He , Jiabei Chen , Zihao Wang , Yangqiu Song , Hanghang Tong , Guang Liu , Kang Liu , Jun Zhao

Large language models (LLMs) excel at reasoning but struggle with knowledge-intensive questions due to limited context and parametric knowledge. However, existing methods that rely on finetuned LLMs or GNN retrievers are limited by…

Artificial Intelligence · Computer Science 2025-11-07 Yuanning Cui , Zequn Sun , Wei Hu , Zhangjie Fu

Knowledge Graph (KG) powered question answering (QA) performs complex reasoning over language semantics as well as knowledge facts. Graph Neural Networks (GNNs) learn to aggregate information from the underlying KG, which is combined with…

Computation and Language · Computer Science 2024-02-07 Costas Mavromatis , Petros Karypis , George Karypis

Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language understanding and generation. However, they often struggle with complex reasoning tasks and are prone to hallucination. Recent research has shown…

Computation and Language · Computer Science 2024-12-17 Xue Wu , Kostas Tsioutsiouliklis

Knowledge graphs have emerged as a popular method for injecting up-to-date, factual knowledge into large language models (LLMs). This is typically achieved by converting the knowledge graph into text that the LLM can process in context.…

Computation and Language · Computer Science 2025-04-10 Elan Markowitz , Krupa Galiya , Greg Ver Steeg , Aram Galstyan

Integrating structured knowledge from Knowledge Graphs (KGs) into Large Language Models (LLMs) enhances factual grounding and reasoning capabilities. This survey paper systematically examines the synergy between KGs and LLMs, categorizing…

Computation and Language · Computer Science 2025-06-12 Blaž Škrlj , Boshko Koloski , Senja Pollak , Nada Lavrač

Large Language Models (LLMs) have excelled in multi-hop question-answering (M-QA) due to their advanced reasoning abilities. However, the impact of the inherent reasoning structures on LLM M-QA performance remains unclear, largely due to…

We present LinkQ, a system that leverages a large language model (LLM) to facilitate knowledge graph (KG) query construction through natural language question-answering. Traditional approaches often require detailed knowledge of a graph…

Computation and Language · Computer Science 2025-02-11 Harry Li , Gabriel Appleby , Ashley Suh

While graph neural networks (GNNs) have shown remarkable performance across diverse graph-related tasks, their high-dimensional hidden representations render them black boxes. In this work, we propose Graph Lingual Network (GLN), a GNN…

Machine Learning · Computer Science 2025-09-16 Sunwoo Kim , Soo Yong Lee , Jaemin Yoo , Kijung Shin

The task of multi-hop link prediction within knowledge graphs (KGs) stands as a challenge in the field of knowledge graph analysis, as it requires the model to reason through and understand all intermediate connections before making a…

Computation and Language · Computer Science 2025-06-17 Dong Shu , Tianle Chen , Mingyu Jin , Chong Zhang , Mengnan Du , Yongfeng Zhang

Knowledge Graphs (KGs) have long served as a fundamental infrastructure for structured knowledge representation and reasoning. With the advent of Large Language Models (LLMs), the construction of KGs has entered a new paradigm-shifting from…

Artificial Intelligence · Computer Science 2025-10-24 Haonan Bian

Answering open-domain questions requires world knowledge about in-context entities. As pre-trained Language Models (LMs) lack the power to store all required knowledge, external knowledge sources, such as knowledge graphs, are often used to…

Computation and Language · Computer Science 2022-11-16 Ziniu Hu , Yichong Xu , Wenhao Yu , Shuohang Wang , Ziyi Yang , Chenguang Zhu , Kai-Wei Chang , Yizhou Sun

Large Language Models (LLMs) excel at generating natural language answers, yet their outputs often remain unverifiable and difficult to trace. Knowledge Graphs (KGs) offer a complementary strength by representing entities and their…

Computation and Language · Computer Science 2025-12-05 Alfonso Amayuelas , Joy Sain , Simerjot Kaur , Charese Smiley

Recent research on integrating Large Language Models (LLMs) with Graph Neural Networks (GNNs) typically follows two approaches: LLM-centered models, which convert graph data into tokens for LLM processing, and GNN-centered models, which use…

Machine Learning · Computer Science 2024-12-11 Haotong Yang , Xiyuan Wang , Qian Tao , Shuxian Hu , Zhouchen Lin , Muhan Zhang

While large language models (LLMs) have made considerable advancements in understanding and generating unstructured text, their application in structured data remains underexplored. Particularly, using LLMs for complex reasoning tasks on…

Computation and Language · Computer Science 2023-10-18 Jiho Kim , Yeonsu Kwon , Yohan Jo , Edward Choi

Advancements in natural language processing have revolutionized the way we can interact with digital information systems, such as databases, making them more accessible. However, challenges persist, especially when accuracy is critical, as…

Computation and Language · Computer Science 2025-11-12 Larissa Pusch , Tim O. F. Conrad

Recent advancements have witnessed the ascension of Large Language Models (LLMs), endowed with prodigious linguistic capabilities, albeit marred by shortcomings including factual inconsistencies and opacity. Conversely, Knowledge Graphs…

Information Retrieval · Computer Science 2024-07-29 DaiFeng Li , Fan Xu

Large Language Models (LLMs) often struggle with tasks requiring external knowledge, such as knowledge-intensive Multiple Choice Question Answering (MCQA). Integrating Knowledge Graphs (KGs) can enhance reasoning; however, existing methods…

Computation and Language · Computer Science 2025-04-01 Haochen Liu , Song Wang , Chen Chen , Jundong Li

This paper presents a scholarly Knowledge Graph Question Answering (KGQA) that answers bibliographic natural language questions by leveraging a large language model (LLM) in a few-shot manner. The model initially identifies the top-n…

Computation and Language · Computer Science 2023-11-17 Tilahun Abedissa Taffa , Ricardo Usbeck