English
Related papers

Related papers: Grounding LLM Reasoning with Knowledge Graphs

200 papers

Understanding complex biomolecular mechanisms requires multi-step reasoning across molecular interactions, signaling cascades, and metabolic pathways. While large language models(LLMs) show promise in such tasks, their application to…

Artificial Intelligence · Computer Science 2025-11-12 Tianwen Lyu , Xiang Zhuang , Keyan Ding , Xinzhe Cao , Lei Liang , Wei Zhao , Qiang Zhang , Huajun Chen

Using Large Language Models (LLMs) to process graph-structured data is an active research area, yet current state-of-the-art approaches typically rely on multi-step pipelines with Graph Neural Network (GNN) encoders that compress rich…

Machine Learning · Computer Science 2026-05-12 Dario Vajda

Knowledge graph (KG) reasoning is a task that aims to predict unknown facts based on known factual samples. Reasoning methods can be divided into two categories: rule-based methods and KG-embedding based methods. The former possesses…

Artificial Intelligence · Computer Science 2024-07-08 Fengsong Sun , Jinyu Wang , Zhiqing Wei , Xianchao Zhang

Knowledge graphs (KGs) have emerged as a powerful paradigm for structuring and leveraging diverse real-world knowledge, which serve as a fundamental technology for enabling cognitive intelligence systems with advanced understanding and…

Artificial Intelligence · Computer Science 2025-06-16 Guanglin Niu , Bo Li , Yangguang Lin

Large Language Models (LLMs) have revolutionized Natural Language Processing (NLP) based applications including automated text generation, question answering, chatbots, and others. However, they face a significant challenge: hallucinations,…

Computation and Language · Computer Science 2024-11-22 Ernests Lavrinovics , Russa Biswas , Johannes Bjerva , Katja Hose

As the field of Large Language Models (LLMs) evolves at an accelerated pace, the critical need to assess and monitor their performance emerges. We introduce a benchmarking framework focused on knowledge graph engineering (KGE) accompanied…

Artificial Intelligence · Computer Science 2023-09-01 Lars-Peter Meyer , Johannes Frey , Kurt Junghanns , Felix Brei , Kirill Bulert , Sabine Gründer-Fahrer , Michael Martin

Despite recent advances in training and prompting strategies for Large Language Models (LLMs), these models continue to face challenges with complex logical reasoning tasks that involve long reasoning chains. In this work, we explore the…

Computation and Language · Computer Science 2024-12-18 Jiaming Zhou , Abbas Ghaddar , Ge Zhang , Liheng Ma , Yaochen Hu , Soumyasundar Pal , Mark Coates , Bin Wang , Yingxue Zhang , Jianye Hao

We introduce fs1, a simple yet effective method that improves the factuality of reasoning traces by collecting them from large reasoning models and grounding them in knowledge graph (KG) paths. We fine-tune eight instruction-tuned Large…

Computation and Language · Computer Science 2026-04-21 Mike Zhang , Johannes Bjerva , Russa Biswas

Large Language Models (LLMs) have achieved impressive capabilities in language understanding and generation, yet they continue to underperform on knowledge-intensive reasoning tasks due to limited access to structured context and multi-hop…

Computation and Language · Computer Science 2025-06-26 Travis Thompson , Seung-Hwan Lim , Paul Liu , Ruoying He , Dongkuan Xu

Large language models (LLMs) have achieved remarkable success across a wide range of applications especially when augmented by external knowledge through retrieval-augmented generation (RAG). Despite their widespread adoption, recent…

Computation and Language · Computer Science 2026-04-14 Tianzhe Zhao , Jiaoyan Chen , Shuxiu Zhang , Haiping Zhu , Qika Lin , Jun Liu

Large language models (LLMs) solve complex problems yet fail on simpler variants, suggesting they achieve correct outputs through mechanisms fundamentally different from human reasoning. To understand this gap, we synthesize cognitive…

Entity alignment, which is a prerequisite for creating a more comprehensive Knowledge Graph (KG), involves pinpointing equivalent entities across disparate KGs. Contemporary methods for entity alignment have predominantly utilized knowledge…

Computation and Language · Computer Science 2024-01-31 Linyao Yang , Hongyang Chen , Xiao Wang , Jing Yang , Fei-Yue Wang , Han Liu

Large language models (LLMs) have shown remarkable generalization capability with exceptional performance in various language modeling tasks. However, they still exhibit inherent limitations in precisely capturing and returning grounded…

Computation and Language · Computer Science 2024-01-01 Yijun Tian , Huan Song , Zichen Wang , Haozhu Wang , Ziqing Hu , Fang Wang , Nitesh V. Chawla , Panpan Xu

Logical rules are essential for uncovering the logical connections between relations, which could improve reasoning performance and provide interpretable results on knowledge graphs (KGs). Although there have been many efforts to mine…

Artificial Intelligence · Computer Science 2024-01-23 Linhao Luo , Jiaxin Ju , Bo Xiong , Yuan-Fang Li , Gholamreza Haffari , Shirui Pan

Large language models (LLMs) have demonstrated remarkable capabilities in various scientific domains, from natural language processing to complex problem-solving tasks. Their ability to understand and generate human-like text has opened up…

Computation and Language · Computer Science 2024-11-05 Guangzhi Xiong , Eric Xie , Amir Hassan Shariatmadari , Sikun Guo , Stefan Bekiranov , Aidong Zhang

While Language Models (LMs) are the workhorses of NLP, their interplay with structured knowledge graphs (KGs) is still actively researched. Current methods for encoding such graphs typically either (i) linearize them for embedding with LMs…

Computation and Language · Computer Science 2024-06-04 Moritz Plenz , Anette Frank

Large language models (LLMs) excel at reasoning but struggle with knowledge-intensive questions due to limited context and parametric knowledge. However, existing methods that rely on finetuned LLMs or GNN retrievers are limited by…

Artificial Intelligence · Computer Science 2025-11-07 Yuanning Cui , Zequn Sun , Wei Hu , Zhangjie Fu

Large Language Models (LLMs) face significant accuracy degradation due to insufficient reasoning ability when dealing with complex and abstract tasks. Thought structures such as Chain of Thought (CoT) and Tree of Thought (ToT) focus on…

Computation and Language · Computer Science 2025-09-29 Fengxiao Tang , Yufeng Li , Zongzong Wu , Ming Zhao

Recent works integrating Knowledge Graphs (KGs) have shown promising improvements in enhancing the reasoning capabilities of Large Language Models (LLMs). However, existing benchmarks primarily focus on closed-ended tasks, leaving a gap in…

Computation and Language · Computer Science 2025-05-23 Yuan Sui , Yufei He , Zifeng Ding , Bryan Hooi

This study explores the use of Large Language Models (LLMs) for automatic evaluation of knowledge graph (KG) completion models. Historically, validating information in KGs has been a challenging task, requiring large-scale human annotation…

Artificial Intelligence · Computer Science 2024-04-25 Jack Boylan , Shashank Mangla , Dominic Thorn , Demian Gholipour Ghalandari , Parsa Ghaffari , Chris Hokamp