English
Related papers

Related papers: BYOKG-RAG: Multi-Strategy Graph Retrieval for Know…

200 papers

Large Language Models (LLMs) have showcased impressive reasoning abilities, but often suffer from hallucinations or outdated knowledge. Knowledge Graph (KG)-based Retrieval-Augmented Generation (RAG) remedies these shortcomings by grounding…

Information Retrieval · Computer Science 2025-05-29 Martin Böckling , Heiko Paulheim , Andreea Iana

Large language models (LLMs) still struggle with multi-hop reasoning over knowledge-graphs (KGs), and we identify a previously overlooked structural reason for this difficulty: Transformer attention heads naturally specialize in distinct…

Computation and Language · Computer Science 2026-04-15 Jinliang Liu , Jiale Bai , Shaoning Zeng

Vision-language retrieval-augmented generation (RAG) has become an effective approach for tackling Knowledge-Based Visual Question Answering (KB-VQA), which requires external knowledge beyond the visual content presented in images. The…

Information Retrieval · Computer Science 2025-09-15 Wei Yang , Jingjing Fu , Rui Wang , Jinyu Wang , Lei Song , Jiang Bian

In this paper, we aim to improve the reasoning ability of large language models (LLMs) over knowledge graphs (KGs) to answer complex questions. Inspired by existing methods that design the interaction strategy between LLMs and KG, we…

Computation and Language · Computer Science 2024-02-20 Jinhao Jiang , Kun Zhou , Wayne Xin Zhao , Yang Song , Chen Zhu , Hengshu Zhu , Ji-Rong Wen

Retrieval-augmented generation (RAG) with large language models (LLMs) plays a crucial role in question answering, as LLMs possess limited knowledge and are not updated with continuously growing information. Most recent work on RAG has…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Shichao Kan , Yuhai Deng , Jiale Fu , Lihui Cen , Zhe Qu , Linna Zhang , Yixiong Liang , Yigang Cen

In this paper, we investigate the retrieval-augmented generation (RAG) based on Knowledge Graphs (KGs) to improve the accuracy and reliability of Large Language Models (LLMs). Recent approaches suffer from insufficient and repetitive…

Computation and Language · Computer Science 2024-04-22 Xinke Jiang , Ruizhe Zhang , Yongxin Xu , Rihong Qiu , Yue Fang , Zhiyuan Wang , Jinyi Tang , Hongxin Ding , Xu Chu , Junfeng Zhao , Yasha Wang

Understanding complex biomolecular mechanisms requires multi-step reasoning across molecular interactions, signaling cascades, and metabolic pathways. While large language models(LLMs) show promise in such tasks, their application to…

Artificial Intelligence · Computer Science 2025-11-12 Tianwen Lyu , Xiang Zhuang , Keyan Ding , Xinzhe Cao , Lei Liang , Wei Zhao , Qiang Zhang , Huajun Chen

Large Language Models (LLMs) have shown promise in character imitation, enabling immersive and engaging conversations. However, they often generate content that is irrelevant or inconsistent with a character's background. We attribute these…

Artificial Intelligence · Computer Science 2025-05-27 Yongjie Wang , Jonathan Leung , Zhiqi Shen

Graph-based retrieval-augmented generation (RAG) enables large language models (LLMs) to ground responses with structured external knowledge from up-to-date knowledge graphs (KGs) and reduce hallucinations. However, LLMs often rely on a…

Computation and Language · Computer Science 2025-07-01 Deyu Zou , Yongqiang Chen , Mufei Li , Siqi Miao , Chenxi Liu , Bo Han , James Cheng , Pan Li

This study addresses the challenge of ambiguity in knowledge graph question answering (KGQA). While recent KGQA systems have made significant progress, particularly with the integration of large language models (LLMs), they typically assume…

Computation and Language · Computer Science 2025-04-15 Liqiang Wen , Guanming Xiong , Tong Mo , Bing Li , Weiping Li , Wen Zhao

Large language models excel at many tasks but often incur high inference costs during deployment. To mitigate hallucination, many systems use a knowledge graph to enhance retrieval-augmented generation (KG-RAG). However, the large amount of…

Information Retrieval · Computer Science 2025-10-14 Hairu Wang , Yuan Feng , Yukun Cao , Xike Xie , S Kevin Zhou

The problem of answering questions using knowledge from pre-trained language models (LMs) and knowledge graphs (KGs) presents two challenges: given a QA context (question and answer choice), methods need to (i) identify relevant knowledge…

Computation and Language · Computer Science 2022-12-14 Michihiro Yasunaga , Hongyu Ren , Antoine Bosselut , Percy Liang , Jure Leskovec

Deploying Large Language Models (LLMs) for healthcare question answering requires robust methods to ensure accuracy and reliability. This work introduces Query-Based Retrieval Augmented Generation (QB-RAG), a framework for enhancing…

Machine Learning · Computer Science 2025-07-31 Eric Yang , Jonathan Amar , Jong Ha Lee , Bhawesh Kumar , Yugang Jia

In knowledge-intensive tasks, especially in high-stakes domains like medicine and law, it is critical not only to retrieve relevant information but also to provide causal reasoning and explainability. Large language models (LLMs) have…

Artificial Intelligence · Computer Science 2025-03-18 Hang Luo , Jian Zhang , Chujun Li

Graph retrieval-augmented generation (GraphRAG) has emerged as a powerful paradigm for enhancing large language models (LLMs) with external knowledge. It leverages graphs to model the hierarchical structure between specific concepts,…

Computation and Language · Computer Science 2026-02-24 Zhishang Xiang , Chuanjie Wu , Qinggang Zhang , Shengyuan Chen , Zijin Hong , Xiao Huang , Jinsong Su

Retrieval-Augmented Generation (RAG) systems enable large language models (LLMs) instant access to relevant information for the generative process, demonstrating their superior performance in addressing common LLM challenges such as…

Computation and Language · Computer Science 2025-10-17 Yilun Zheng , Dan Yang , Jie Li , Lin Shang , Lihui Chen , Jiahao Xu , Sitao Luan

Large Language Models (LLMs) have demonstrated remarkable capabilities in text generation and understanding, yet their reliance on implicit, unstructured knowledge often leads to factual inaccuracies and limited interpretability. Knowledge…

Computation and Language · Computer Science 2025-06-17 Qinggang Zhang

Retrieval-Augmented Generation (RAG) has recently demonstrated the performance of Large Language Models (LLMs) in the knowledge-intensive tasks such as Question-Answering (QA). RAG expands the query context by incorporating external…

Machine Learning · Computer Science 2024-06-18 Zijian Hei , Weiling Liu , Wenjie Ou , Juyi Qiao , Junming Jiao , Guowen Song , Ting Tian , Yi Lin

Knowledge Graphs represent real-world entities and the relationships between them. Multilingual Knowledge Graph Construction (mKGC) refers to the task of automatically constructing or predicting missing entities and links for knowledge…

Computation and Language · Computer Science 2025-07-23 Hellina Hailu Nigatu , Min Li , Maartje ter Hoeve , Saloni Potdar , Sarah Chasins

Multi-hop Question Answering over Knowledge Graph~(KGQA) aims to find the answer entities that are multiple hops away from the topic entities mentioned in a natural language question on a large-scale Knowledge Graph (KG). To cope with the…

Computation and Language · Computer Science 2023-03-02 Jinhao Jiang , Kun Zhou , Wayne Xin Zhao , Ji-Rong Wen