English
Related papers

Related papers: KG-LLM-Bench: A Scalable Benchmark for Evaluating …

200 papers

As large language models (LLMs) continue to grow in size, their abilities to tackle complex tasks have significantly improved. However, issues such as hallucination and the lack of up-to-date knowledge largely remain unresolved. Knowledge…

Artificial Intelligence · Computer Science 2026-03-17 Lihui Liu

Previous studies have relied on existing question-answering benchmarks to evaluate the knowledge stored in large language models (LLMs). However, this approach has limitations regarding factual knowledge coverage, as it mostly focuses on…

Computation and Language · Computer Science 2023-10-31 Linhao Luo , Thuy-Trang Vu , Dinh Phung , Gholamreza Haffari

Large Language Models (LLMs) have shown unprecedented performance in various real-world applications. However, they are known to generate factually inaccurate outputs, a.k.a. the hallucination problem. In recent years, incorporating…

Computation and Language · Computer Science 2024-06-21 Haochen Liu , Song Wang , Yaochen Zhu , Yushun Dong , Jundong Li

Large Language Models (LLMs) excel at language understanding but remain limited in knowledge-intensive domains due to hallucinations, outdated information, and limited explainability. Text-based retrieval-augmented generation (RAG) helps…

Computation and Language · Computer Science 2026-02-09 Larissa Pusch , Alexandre Courtiol , Tim Conrad

Knowledge Graph (KG) can effectively integrate valuable information from massive data, and thus has been rapidly developed and widely used in many fields. Traditional KG construction methods rely on manual annotation, which often consumes a…

Computation and Language · Computer Science 2026-04-22 Qiubai Zhu , Qingwang Wang , Haibin Yuan , Wei Chen , Tao Shen

The ability of knowledge graphs to represent complex relationships at scale has led to their adoption for various needs including knowledge representation, question-answering, and recommendation systems. Knowledge graphs are often…

Computation and Language · Computer Science 2023-05-18 Jason Youn , Ilias Tagkopoulos

Large language models (LLMs) have demonstrated remarkable performance on question-answering (QA) tasks because of their superior capabilities in natural language understanding and generation. However, LLM-based QA struggles with complex QA…

Computation and Language · Computer Science 2025-09-23 Chuangtao Ma , Yongrui Chen , Tianxing Wu , Arijit Khan , Haofen Wang

Large Language Models (LLMs) may suffer from hallucinations in real-world applications due to the lack of relevant knowledge. In contrast, knowledge graphs encompass extensive, multi-relational structures that store a vast array of symbolic…

Computation and Language · Computer Science 2024-09-06 Jie Ma , Zhitao Gao , Qi Chai , Wangchun Sun , Pinghui Wang , Hongbin Pei , Jing Tao , Lingyun Song , Jun Liu , Chen Zhang , Lizhen Cui

Large Language Models (LLMs) exhibit strong reasoning capabilities in complex tasks. However, they still struggle with hallucinations and factual errors in knowledge-intensive scenarios like knowledge graph question answering (KGQA). We…

Computation and Language · Computer Science 2025-11-12 Songze Li , Zhiqiang Liu , Zhengke Gui , Huajun Chen , Wen Zhang

Answering complex queries over incomplete knowledge graphs (KGs) is a challenging job. Most previous works have focused on learning entity/relation embeddings and simulating first-order logic operators with various neural networks. However,…

Computation and Language · Computer Science 2025-03-04 Tianle Xia , Liang Ding , Guojia Wan , Yibing Zhan , Bo Du , Dacheng Tao

Recently, ChatGPT, a representative large language model (LLM), has gained considerable attention due to its powerful emergent abilities. Some researchers suggest that LLMs could potentially replace structured knowledge bases like knowledge…

Computation and Language · Computer Science 2024-01-31 Linyao Yang , Hongyang Chen , Zhao Li , Xiao Ding , Xindong Wu

Large Language Models (LLMs) have recently emerged as a powerful paradigm for Knowledge Graph Completion (KGC), offering strong reasoning and generalization capabilities beyond traditional embedding-based approaches. However, existing…

Computation and Language · Computer Science 2025-10-14 Wenbin Guo , Xin Wang , Jiaoyan Chen , Lingbing Guo , Zhao Li , Zirui Chen

Large language models (LLMs) often struggle with knowledge-intensive tasks due to a lack of background knowledge and a tendency to hallucinate. To address these limitations, integrating knowledge graphs (KGs) with LLMs has been intensively…

Computation and Language · Computer Science 2025-06-13 Yilin Xiao , Chuang Zhou , Qinggang Zhang , Bo Li , Qing Li , Xiao Huang

This survey investigates the synergistic relationship between Large Language Models (LLMs) and Knowledge Graphs (KGs), which is crucial for advancing AI's capabilities in understanding, reasoning, and language processing. It aims to address…

The design and development of text-based knowledge graph completion (KGC) methods leveraging textual entity descriptions are at the forefront of research. These methods involve advanced optimization techniques such as soft prompts and…

Computation and Language · Computer Science 2024-06-28 Rui Yang , Jiahao Zhu , Jianping Man , Li Fang , Yi Zhou

We present a mixed-methods study to explore how large language models (LLMs) can assist users in the visual exploration and analysis of knowledge graphs (KGs). We surveyed and interviewed 20 professionals from industry, government…

Human-Computer Interaction · Computer Science 2024-04-03 Harry Li , Gabriel Appleby , Ashley Suh

Knowledge graphs (KGs) are powerful data structures, but exploring them effectively remains difficult for even expert users. Large language models (LLMs) are increasingly used to address this gap, yet little is known empirically about how…

Machine Learning · Computer Science 2025-05-29 Harry Li , Gabriel Appleby , Kenneth Alperin , Steven R Gomez , Ashley Suh

Large language models (LLMs) typically improve performance by either retrieving semantically similar information, or enhancing reasoning abilities through structured prompts like chain-of-thought. While both strategies are considered…

Computation and Language · Computer Science 2024-10-16 Yejin Kim , Eojin Kang , Juae Kim , H. Howie Huang

In this paper, we aim to improve the reasoning ability of large language models (LLMs) over knowledge graphs (KGs) to answer complex questions. Inspired by existing methods that design the interaction strategy between LLMs and KG, we…

Computation and Language · Computer Science 2024-02-20 Jinhao Jiang , Kun Zhou , Wayne Xin Zhao , Yang Song , Chen Zhu , Hengshu Zhu , Ji-Rong Wen

Question Answering over Knowledge Graph (KGQA) aims to seek answer entities for the natural language question from a large-scale Knowledge Graph~(KG). To better perform reasoning on KG, recent work typically adopts a pre-trained language…

Computation and Language · Computer Science 2024-01-02 Jinhao Jiang , Kun Zhou , Wayne Xin Zhao , Yaliang Li , Ji-Rong Wen