English
Related papers

Related papers: Encoder-Free Knowledge-Graph Reasoning with LLMs v…

200 papers

Knowledge graphs have emerged as a popular method for injecting up-to-date, factual knowledge into large language models (LLMs). This is typically achieved by converting the knowledge graph into text that the LLM can process in context.…

Computation and Language · Computer Science 2025-04-10 Elan Markowitz , Krupa Galiya , Greg Ver Steeg , Aram Galstyan

Large Language Models (LLMs) demonstrate strong reasoning abilities but face limitations such as hallucinations and outdated knowledge. Knowledge Graph (KG)-based Retrieval-Augmented Generation (RAG) addresses these issues by grounding LLM…

Computation and Language · Computer Science 2025-03-04 Mufei Li , Siqi Miao , Pan Li

Multi-hop logical reasoning is an established problem in the field of representation learning on knowledge graphs (KGs). It subsumes both one-hop link prediction as well as other more complex types of logical queries. Existing algorithms…

Artificial Intelligence · Computer Science 2022-09-07 Dimitrios Alivanistos , Max Berrendorf , Michael Cochez , Mikhail Galkin

Logical reasoning over incomplete knowledge graphs to answer complex logical queries is a challenging task. With the emergence of new entities and relations in constantly evolving KGs, inductive logical reasoning over KGs has become a…

Computation and Language · Computer Science 2023-05-24 Siyuan Wang , Zhongyu Wei , Meng Han , Zhihao Fan , Haijun Shan , Qi Zhang , Xuanjing Huang

Large scale knowledge graphs (KGs) such as Freebase are generally incomplete. Reasoning over multi-hop (mh) KG paths is thus an important capability that is needed for question answering or other NLP tasks that require knowledge about the…

Computation and Language · Computer Science 2018-06-13 Wenpeng Yin , Yadollah Yaghoobzadeh , Hinrich Schütze

Complex Logical Query Answering (CLQA) over incomplete knowledge graphs is a challenging task. Recently, Query Embedding (QE) methods are proposed to solve CLQA by performing multi-hop logical reasoning. However, most of them only consider…

Machine Learning · Computer Science 2024-06-24 Chongzhi Zhang , Zhiping Peng , Junhao Zheng , Linghao Wang , Ruifeng Shi , Qianli Ma

Dialogue systems powered by large pre-trained language models (LM) exhibit an innate ability to deliver fluent and natural-looking responses. Despite their impressive generation performance, these models can often generate factually…

Computation and Language · Computer Science 2021-09-15 Nouha Dziri , Andrea Madotto , Osmar Zaiane , Avishek Joey Bose

Graph Chain-of-Thought (Graph-CoT) enables large language models (LLMs) to perform step-by-step reasoning over graph-structured knowledge, but existing pipelines suffer from low accuracy, excessive token usage, high latency, and low…

While large language models (LLMs) have made significant progress in processing and reasoning over knowledge graphs, current methods suffer from a high non-retrieval rate. This limitation reduces the accuracy of answering questions based on…

Machine Learning · Computer Science 2025-03-31 Song Wang , Junhong Lin , Xiaojie Guo , Julian Shun , Jundong Li , Yada Zhu

Unified graph representation learning aims to generate node embeddings, which can be applied to multiple downstream applications of graph analytics. However, existing studies based on graph neural networks and language models either suffer…

Computation and Language · Computer Science 2025-08-05 Wenbo Shang , Xuliang Zhu , Xin Huang

Due to the remarkable reasoning ability, Large language models (LLMs) have demonstrated impressive performance in knowledge graph question answering (KGQA) tasks, which find answers to natural language questions over knowledge graphs (KGs).…

Computation and Language · Computer Science 2025-02-25 Xiao Long , Liansheng Zhuang , Aodi Li , Minghong Yao , Shafei Wang

Integrating structured knowledge from Knowledge Graphs (KGs) into Large Language Models (LLMs) remains a key challenge for symbolic reasoning. Existing methods mainly rely on prompt engineering or fine-tuning, which lose structural fidelity…

Machine Learning · Computer Science 2025-05-13 Erica Coppolillo

Large Language Models (LLMs) and Knowledge Graphs (KGs) offer a promising approach to robust and explainable Question Answering (QA). While LLMs excel at natural language understanding, they suffer from knowledge gaps and hallucinations.…

Machine Learning · Computer Science 2025-04-15 Jasper Linders , Jakub M. Tomczak

Large language models (LLMs) excel at complex reasoning but remain limited by static and incomplete parametric knowledge. Retrieval-augmented generation (RAG) mitigates this by incorporating external knowledge, yet existing RAGs struggle…

Knowledge Graphs (KGs) can serve as reliable knowledge sources for question answering (QA) due to their structured representation of knowledge. Existing research on the utilization of KG for large language models (LLMs) prevalently relies…

Computation and Language · Computer Science 2024-10-25 Kun Li , Tianhua Zhang , Xixin Wu , Hongyin Luo , James Glass , Helen Meng

Reasoning over knowledge graphs (KGs) with first-order logic (FOL) queries is challenging due to the inherent incompleteness of real-world KGs and the compositional complexity of logical query structures. Most existing methods rely on…

Computation and Language · Computer Science 2025-12-23 Ziyan Zhang , Chao Wang , Zhuo Chen , Lei Chen , Chiyi Li , Kai Song

Knowledge Graphs (KGs) represent human-crafted factual knowledge in the form of triplets (head, relation, tail), which collectively form a graph. Question Answering over KGs (KGQA) is the task of answering natural questions grounding the…

Computation and Language · Computer Science 2024-05-31 Costas Mavromatis , George Karypis

Large Language Models (LLMs) have impressive capabilities in text understanding and zero-shot reasoning. However, delays in knowledge updates may cause them to reason incorrectly or produce harmful results. Knowledge Graphs (KGs) provide…

Artificial Intelligence · Computer Science 2025-04-07 Tu Ao , Yanhua Yu , Yuling Wang , Yang Deng , Zirui Guo , Liang Pang , Pinghui Wang , Tat-Seng Chua , Xiao Zhang , Zhen Cai

Recent large language model (LLM) reasoning, despite its success, suffers from limited domain knowledge, susceptibility to hallucinations, and constrained reasoning depth, particularly in small-scale models deployed in resource-constrained…

Artificial Intelligence · Computer Science 2025-03-04 Wenjie Wu , Yongcheng Jing , Yingjie Wang , Wenbin Hu , Dacheng Tao

The reasoning process of Large Language Models (LLMs) is often plagued by hallucinations and missing facts in question-answering tasks. A promising solution is to ground LLMs' answers in verifiable knowledge sources, such as Knowledge…

Computation and Language · Computer Science 2026-02-26 Shiqi Yan , Yubo Chen , Ruiqi Zhou , Zhengxi Yao , Shuai Chen , Tianyi Zhang , Shijie Zhang , Wei Qiang Zhang , Yongfeng Huang , Haixin Duan , Yunqi Zhang