English
Related papers

Related papers: Characterizing Knowledge Graph Tasks in LLM Benchm…

200 papers

Integrating knowledge graphs (KGs) into the reasoning processes of large language models (LLMs) has emerged as a promising approach to mitigate hallucination. However, existing work in this area often relies on proprietary or extremely…

Computation and Language · Computer Science 2025-09-10 Yi-Jie Cheng , Oscar Chew , Yun-Nung Chen

A graph is a fundamental data model to represent various entities and their complex relationships in society and nature, such as social networks, transportation networks, and financial networks. Recently, large language models (LLMs) have…

Computation and Language · Computer Science 2025-07-08 Wenbo Shang , Xin Huang

We present ControlLLM, a novel framework that enables large language models (LLMs) to utilize multi-modal tools for solving complex real-world tasks. Despite the remarkable performance of LLMs, they still struggle with tool invocation due…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Zhaoyang Liu , Zeqiang Lai , Zhangwei Gao , Erfei Cui , Ziheng Li , Xizhou Zhu , Lewei Lu , Qifeng Chen , Yu Qiao , Jifeng Dai , Wenhai Wang

The core of the Knowledge Graph Completion (KGC) task is to predict and complete the missing relations or nodes in a KG. Common KGC tasks are mostly about inferring unknown elements with one or two elements being known in a triple. In…

Computation and Language · Computer Science 2024-12-25 Yuan Yuan , Yajing Xu , Wen Zhang

Problem-solving has been a fundamental driver of human progress in numerous domains. With advancements in artificial intelligence, Large Language Models (LLMs) have emerged as powerful tools capable of tackling complex problems across…

Machine Learning · Computer Science 2025-05-07 Da Zheng , Lun Du , Junwei Su , Yuchen Tian , Yuqi Zhu , Jintian Zhang , Lanning Wei , Ningyu Zhang , Huajun Chen

Knowledge Graphs (KGs) have shown to be very important for applications such as personal assistants, question-answering systems, and search engines. Therefore, it is crucial to ensure their high quality. However, KGs inevitably contain…

Databases · Computer Science 2022-08-18 Elwin Huaman , Dieter Fensel

By design, large language models (LLMs) are static general-purpose models, expensive to retrain or update frequently. As they are increasingly adopted for knowledge-intensive tasks, it becomes evident that these design choices lead to…

Computation and Language · Computer Science 2024-03-25 Shangbin Feng , Weijia Shi , Yuyang Bai , Vidhisha Balachandran , Tianxing He , Yulia Tsvetkov

Large Language Models (LLMs) are versatile, yet they often falter in tasks requiring deep and reliable reasoning due to issues like hallucinations, limiting their applicability in critical scenarios. This paper introduces a rigorously…

Computation and Language · Computer Science 2023-11-21 Saizhuo Wang , Zhihan Liu , Zhaoran Wang , Jian Guo

Benchmarking the capabilities and limitations of large language models (LLMs) in graph-related tasks is becoming an increasingly popular and crucial area of research. Recent studies have shown that LLMs exhibit a preliminary ability to…

Machine Learning · Computer Science 2025-04-22 Xinnan Dai , Haohao Qu , Yifen Shen , Bohang Zhang , Qihao Wen , Wenqi Fan , Dongsheng Li , Jiliang Tang , Caihua Shan

Knowledge Graph Completion (KGC) is crucial for addressing knowledge graph incompleteness and supporting downstream applications. Many models have been proposed for KGC. They can be categorized into two main classes: triple-based and…

Computation and Language · Computer Science 2024-02-26 Yanbin Wei , Qiushi Huang , James T. Kwok , Yu Zhang

Most Knowledge Graphs (KGs) contain textual descriptions of entities in various natural languages. These descriptions of entities provide valuable information that may not be explicitly represented in the structured part of the KG. Based on…

Computation and Language · Computer Science 2020-04-23 Genet Asefa Gesese , Mehwish Alam , Harald Sack

Inductive Knowledge Graph Reasoning (KGR) aims to discover facts in open-domain KGs containing unknown entities and relations, which poses a challenge for KGR models in comprehending uncertain KG components. Existing studies have proposed…

Computation and Language · Computer Science 2026-04-08 Xingrui Zhuo , Jiapu Wang , Gongqing Wu , Zhongyuan Wang , Jichen Zhang , Shirui Pan , Xindong Wu

Large language models have been extensively studied as neural knowledge bases for their knowledge access, editability, reasoning, and explainability. However, few works focus on the structural patterns of their knowledge. Motivated by this…

Computation and Language · Computer Science 2025-05-28 Utkarsh Sahu , Zhisheng Qi , Yongjia Lei , Ryan A. Rossi , Franck Dernoncourt , Nesreen K. Ahmed , Mahantesh M Halappanavar , Yao Ma , Yu Wang

While large language models (LLMs) have demonstrated impressive capabilities across various natural language processing tasks by acquiring rich factual knowledge from their broad training data, their ability to synthesize and logically…

Computation and Language · Computer Science 2024-07-31 Tianshi Zheng , Jiaxin Bai , Yicheng Wang , Tianqing Fang , Yue Guo , Yauwai Yim , Yangqiu Song

Large language models (LLMs) have recently emerged as powerful tools, finding many medical applications. LLMs' ability to coalesce vast amounts of information from many sources to generate a response-a process similar to that of a human…

Large Language Models (LLMs) have shown promise as robotic planners but often struggle with long-horizon and complex tasks, especially in specialized environments requiring external knowledge. While hierarchical planning and…

Artificial Intelligence · Computer Science 2025-04-08 Cristina Cornelio , Flavio Petruzzellis , Pietro Lio

In contrast to large text corpora, knowledge graphs (KG) provide dense and structured representations of factual information. This makes them attractive for systems that supplement or ground the knowledge found in pre-trained language…

Computation and Language · Computer Science 2023-06-06 Sondre Wold , Lilja Øvrelid , Erik Velldal

Large Language Models (LLMs) have greatly advanced knowledge graph question answering (KGQA), yet existing systems are typically optimized for returning highly relevant but predictable answers. A missing yet desired capacity is to exploit…

Computation and Language · Computer Science 2025-11-18 Mengying Wang , Chenhui Ma , Ao Jiao , Tuo Liang , Pengjun Lu , Shrinidhi Hegde , Yu Yin , Evren Gurkan-Cavusoglu , Yinghui Wu

The evaluation of Large Language Models (LLMs) faces a critical challenge in construct validity, where fragmented benchmarks and ad hoc metrics frequently conflate method variance, such as prompt sensitivity, with true latent capabilities.…

Computation and Language · Computer Science 2026-05-15 Adib Sakhawat , Tahsin Islam , Takia Farhin , Syed Rifat Raiyan , Hasan Mahmud , Md Kamrul Hasan

Attributed Question Answering (AQA) has attracted wide attention, but there are still several limitations in evaluating the attributions, including lacking fine-grained attribution categories, relying on manual annotations, and failing to…

Computation and Language · Computer Science 2025-07-02 Nan Hu , Jiaoyan Chen , Yike Wu , Guilin Qi , Hongru Wang , Sheng Bi , Yongrui Chen , Tongtong Wu , Jeff Z. Pan