English
Related papers

Related papers: Multi-hop Reasoning and Retrieval in Embedding Spa…

200 papers

This paper presents an exhaustive quantitative and qualitative evaluation of Large Language Models (LLMs) for Knowledge Graph (KG) construction and reasoning. We engage in experiments across eight diverse datasets, focusing on four…

Computation and Language · Computer Science 2024-12-30 Yuqi Zhu , Xiaohan Wang , Jing Chen , Shuofei Qiao , Yixin Ou , Yunzhi Yao , Shumin Deng , Huajun Chen , Ningyu Zhang

Knowledge Representation Learning (KRL) is crucial for enabling applications of symbolic knowledge from Knowledge Graphs (KGs) to downstream tasks by projecting knowledge facts into vector spaces. Despite their effectiveness in modeling KG…

Computation and Language · Computer Science 2025-04-09 Xin Wang , Zirui Chen , Haofen Wang , Leong Hou U , Zhao Li , Wenbin Guo

Despite their competitive performance on knowledge-intensive tasks, large language models (LLMs) still have limitations in memorizing all world knowledge especially long tail knowledge. In this paper, we study the KG-augmented language…

Computation and Language · Computer Science 2023-09-22 Yike Wu , Nan Hu , Sheng Bi , Guilin Qi , Jie Ren , Anhuan Xie , Wei Song

To mitigate the hallucination and knowledge deficiency in large language models (LLMs), Knowledge Graph (KG)-based Retrieval-Augmented Generation (RAG) has shown promising potential by utilizing KGs as external resource to enhance LLMs…

Computation and Language · Computer Science 2025-01-23 Zengyi Gao , Yukun Cao , Hairu Wang , Ao Ke , Yuan Feng , Xike Xie , S Kevin Zhou

Efficient knowledge management plays a pivotal role in augmenting both the operational efficiency and the innovative capacity of businesses and organizations. By indexing knowledge through vectorization, a variety of knowledge retrieval…

Computation and Language · Computer Science 2024-04-23 Feihu Jiang , Chuan Qin , Kaichun Yao , Chuyu Fang , Fuzhen Zhuang , Hengshu Zhu , Hui Xiong

LLM post-training has primarily relied on large text corpora and human feedback, without capturing the structure of domain knowledge. This has caused models to struggle dealing with complex reasoning tasks, especially for high-stakes…

Computation and Language · Computer Science 2026-01-21 Dezhao Song , Guglielmo Bonifazi , Frank Schilder , Jonathan Richard Schwarz

Integrating knowledge graphs (KGs) into the reasoning processes of large language models (LLMs) has emerged as a promising approach to mitigate hallucination. However, existing work in this area often relies on proprietary or extremely…

Computation and Language · Computer Science 2025-09-10 Yi-Jie Cheng , Oscar Chew , Yun-Nung Chen

Recently, Knowledge Graphs (KGs) have been successfully coupled with Large Language Models (LLMs) to mitigate their hallucinations and enhance their reasoning capability, such as in KG-based retrieval-augmented frameworks. However, current…

Artificial Intelligence · Computer Science 2024-10-22 Bo Ni , Yu Wang , Lu Cheng , Erik Blasch , Tyler Derr

Embedding knowledge graphs (KGs) for multi-hop logical reasoning is a challenging problem due to massive and complicated structures in many KGs. Recently, many promising works projected entities and queries into a geometric space to…

Machine Learning · Computer Science 2023-04-25 Dong Yang , Peijun Qing , Yang Li , Haonan Lu , Xiaodong Lin

Large language models like GPT-4, Gemini, and Claude have transformed natural language processing (NLP) tasks such as question answering, dialogue generation, summarization, and so forth; yet their susceptibility to hallucination stands as…

Computation and Language · Computer Science 2025-07-21 Nur A Zarin Nishat , Andrea Coletta , Luigi Bellomarini , Kossi Amouzouvi , Jens Lehmann , Sahar Vahdati

Large language models (LLMs) have demonstrated impressive impact in the field of natural language processing, but they still struggle with several issues regarding, such as completeness, timeliness, faithfulness and adaptability. While…

Computation and Language · Computer Science 2023-08-24 Xintao Wang , Qianwen Yang , Yongting Qiu , Jiaqing Liang , Qianyu He , Zhouhong Gu , Yanghua Xiao , Wei Wang

Large Language Models (LLMs) have impressive capabilities in text understanding and zero-shot reasoning. However, delays in knowledge updates may cause them to reason incorrectly or produce harmful results. Knowledge Graphs (KGs) provide…

Artificial Intelligence · Computer Science 2025-04-07 Tu Ao , Yanhua Yu , Yuling Wang , Yang Deng , Zirui Guo , Liang Pang , Pinghui Wang , Tat-Seng Chua , Xiao Zhang , Zhen Cai

Large Language Models (LLMs) have shown remarkable progress in medical question answering (QA), yet their effectiveness remains predominantly limited to English due to imbalanced multilingual training data and scarce medical resources for…

Adversarial attacks on knowledge graph embeddings (KGE) aim to disrupt the model's ability of link prediction by removing or inserting triples. A recent black-box method has attempted to incorporate textual and structural information to…

Computation and Language · Computer Science 2025-10-15 Ting Li , Yang Yang , Yipeng Yu , Liang Yao , Guoqing Chao , Ruifeng Xu

Extensive research has investigated the integration of large language models (LLMs) with knowledge graphs to enhance the reasoning process. However, understanding how models perform reasoning utilizing structured graph knowledge remains…

Computation and Language · Computer Science 2025-02-24 Han Zhang , Langshi Zhou , Hanfang Yang

Technology-enhanced learning environments often help students retrieve relevant learning content for questions arising during self-paced study. Large language models (LLMs) have emerged as novel aids for information retrieval during…

Information Retrieval · Computer Science 2025-09-29 Eason Chen , Chuangji Li , Shizhuo Li , Zimo Xiao , Jionghao Lin , Kenneth R. Koedinger

Modern enterprises manage vast knowledge distributed across heterogeneous systems such as Jira, Git repositories, Confluence, and wikis. Conventional retrieval methods based on keyword search or static embeddings often fail to answer…

Artificial Intelligence · Computer Science 2025-10-14 Nilima Rao , Jagriti Srivastava , Pradeep Kumar Sharma , Hritvik Shrivastava

Large Language Models (LLMs) have recently demonstrated remarkable reasoning abilities, yet hallucinate on knowledge-intensive tasks. Retrieval-augmented generation (RAG) mitigates this issue by grounding answers in external sources, e.g.,…

Computation and Language · Computer Science 2026-01-29 Kaehyun Um , KyuHwan Yeom , Haerim Yang , Minyoung Choi , Hyeongjun Yang , Kyong-Ho Lee

Knowledge Graph (KG) alignment is to discover the mappings (i.e., equivalent entities, relations, and others) between two KGs. The existing methods can be divided into the embedding-based models, and the conventional reasoning and lexical…

Computation and Language · Computer Science 2021-06-14 Zhiyuan Qi , Ziheng Zhang , Jiaoyan Chen , Xi Chen , Yuejia Xiang , Ningyu Zhang , Yefeng Zheng

Large Language Models (LLMs) excel at code generation but struggle with complex problems. Retrieval-Augmented Generation (RAG) mitigates this issue by integrating external knowledge, yet retrieval models often miss relevant context, and…

Software Engineering · Computer Science 2026-01-29 Shahd Seddik , Fahd Seddik , Iman Saberi , Fatemeh Fard , Minh Hieu Huynh , Patanamon Thongtanunam