English
Related papers

Related papers: Look Globally and Reason: Two-stage Path Reasoning…

200 papers

Retrieval-Augmented Generation (RAG) enhances language models by grounding responses in external information, yet explainability remains a critical challenge, particularly when retrieval relies on unstructured text. Knowledge graphs (KGs)…

Machine Learning · Computer Science 2025-07-14 Georgios Balanos , Evangelos Chasanis , Konstantinos Skianis , Evaggelia Pitoura

Reasoning over structured graphs remains a fundamental challenge for Large Language Models (LLMs), particularly when scaling to large graphs. Existing approaches typically follow the retrieval-augmented generation (RAG) paradigm: first…

Information Retrieval · Computer Science 2026-03-03 Haoyu Han , Kai Guo , Harry Shomer , Yu Wang , Yucheng Chu , Hang Li , Li Ma , Jiliang Tang

Large Language Models (LLMs) have achieved impressive capabilities in language understanding and generation, yet they continue to underperform on knowledge-intensive reasoning tasks due to limited access to structured context and multi-hop…

Computation and Language · Computer Science 2025-06-26 Travis Thompson , Seung-Hwan Lim , Paul Liu , Ruoying He , Dongkuan Xu

While large language models (LLMs) have made significant progress in processing and reasoning over knowledge graphs, current methods suffer from a high non-retrieval rate. This limitation reduces the accuracy of answering questions based on…

Machine Learning · Computer Science 2025-03-31 Song Wang , Junhong Lin , Xiaojie Guo , Julian Shun , Jundong Li , Yada Zhu

Recent advancements in large language models (LLMs) have shown impressive versatility across various tasks. To eliminate their hallucinations, retrieval-augmented generation (RAG) has emerged as a powerful approach, leveraging external…

Computation and Language · Computer Science 2025-05-30 Yuzheng Cai , Zhenyue Guo , Yiwen Pei , Wanrui Bian , Weiguo Zheng

Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language understanding and generation. However, they often struggle with complex reasoning tasks and are prone to hallucination. Recent research has shown…

Computation and Language · Computer Science 2024-12-17 Xue Wu , Kostas Tsioutsiouliklis

Knowledge Graphs (KGs) store human knowledge in the form of entities (nodes) and relations, and are used extensively in various applications. KG embeddings are an effective approach to addressing tasks like knowledge discovery, link…

Artificial Intelligence · Computer Science 2025-02-03 Ioannis Reklos , Jacopo de Berardinis , Elena Simperl , Albert Meroño-Peñuela

Knowledge Graph Embeddings (KGE) aim to map entities and relations to low dimensional spaces and have become the \textit{de-facto} standard for knowledge graph completion. Most existing KGE methods suffer from the sparsity challenge, where…

Artificial Intelligence · Computer Science 2023-02-14 Zhaoxuan Tan , Zilong Chen , Shangbin Feng , Qingyue Zhang , Qinghua Zheng , Jundong Li , Minnan Luo

To mitigate the hallucination and knowledge deficiency in large language models (LLMs), Knowledge Graph (KG)-based Retrieval-Augmented Generation (RAG) has shown promising potential by utilizing KGs as external resource to enhance LLMs…

Computation and Language · Computer Science 2025-01-23 Zengyi Gao , Yukun Cao , Hairu Wang , Ao Ke , Yuan Feng , Xike Xie , S Kevin Zhou

Complex logical query answering (CLQA) is a challenging task that involves finding answer entities for complex logical queries over incomplete knowledge graphs (KGs). Previous research has explored the use of pre-trained knowledge graph…

Artificial Intelligence · Computer Science 2024-10-10 Changyi Xiao , Yixin Cao

Knowledge graph question answering (KGQA) based on information retrieval aims to answer a question by retrieving answer from a large-scale knowledge graph. Most existing methods first roughly retrieve the knowledge subgraphs (KSG) that may…

Computation and Language · Computer Science 2022-10-06 Hanning Gao , Lingfei Wu , Po Hu , Zhihua Wei , Fangli Xu , Bo Long

Graph Retrieval-Augmented Generation (GraphRAG) has become a common approach for multi-hop reasoning by using knowledge graphs (KGs) as structured retrieval indexes. However, most existing GraphRAG methods implicitly assume that…

Information Retrieval · Computer Science 2026-05-20 Yizhuo Ma , Jinchuan Xu , Tao Wen , Qizhi Chen , Jiakai Li , Rongzheng Wang , Muquan Li , Shuang Liang , Ke Qin

Due to the remarkable reasoning ability, Large language models (LLMs) have demonstrated impressive performance in knowledge graph question answering (KGQA) tasks, which find answers to natural language questions over knowledge graphs (KGs).…

Computation and Language · Computer Science 2025-02-25 Xiao Long , Liansheng Zhuang , Aodi Li , Minghong Yao , Shafei Wang

Retrieval-augmented generation (RAG) systems have been widely adopted in contemporary large language models (LLMs) due to their ability to improve generation quality while reducing the required input context length. In this work, we focus…

Computation and Language · Computer Science 2026-04-07 Tianyi Zhang , Andreas Marfurt

Sparse autoencoders can localize where concepts live in language models, but not how they interact during multi-step reasoning. We propose Causal Concept Graphs (CCG): a directed acyclic graph over sparse, interpretable latent features,…

Machine Learning · Computer Science 2026-04-27 Md Muntaqim Meherab , Noor Islam S. Mohammad , Faiza Feroz

To understand a document with multiple events, event-event relation extraction (ERE) emerges as a crucial task, aiming to discern how natural events temporally or structurally associate with each other. To achieve this goal, our work…

Information Theory · Computer Science 2024-12-20 Peixin Huang , Xiang Zhao , Minghao Hu , Zhen Tan , Weidong Xiao

Graph-based retrieval-augmented generation (RAG) methods, typically built on knowledge graphs (KGs) with binary relational facts, have shown promise in multi-hop open-domain QA. However, their rigid retrieval schemes and dense similarity…

Computation and Language · Computer Science 2026-02-17 Wen-Sheng Lien , Yu-Kai Chan , Hao-Lung Hsiao , Bo-Kai Ruan , Meng-Fen Chiang , Chien-An Chen , Yi-Ren Yeh , Hong-Han Shuai

Multimodal reasoning with large language models (LLMs) often suffers from hallucinations and the presence of deficient or outdated knowledge within LLMs. Some approaches have sought to mitigate these issues by employing textual knowledge…

Computation and Language · Computer Science 2024-06-06 Junlin Lee , Yequan Wang , Jing Li , Min Zhang

Knowledge Graphs (KGs) can serve as reliable knowledge sources for question answering (QA) due to their structured representation of knowledge. Existing research on the utilization of KG for large language models (LLMs) prevalently relies…

Computation and Language · Computer Science 2024-10-25 Kun Li , Tianhua Zhang , Xixin Wu , Hongyin Luo , James Glass , Helen Meng

Large language models (LLMs) achieve strong results on knowledge graph question answering (KGQA), but most benchmarks assume complete knowledge graphs (KGs) where direct supporting triples exist. This reduces evaluation to shallow retrieval…

Artificial Intelligence · Computer Science 2025-12-18 Dongzhuoran Zhou , Yuqicheng Zhu , Xiaxia Wang , Hongkuan Zhou , Jiaoyan Chen , Steffen Staab , Yuan He , Evgeny Kharlamov