English
Related papers

Related papers: KG-LLM-Bench: A Scalable Benchmark for Evaluating …

200 papers

Knowledge graphs (KGs) have emerged as a powerful paradigm for structuring and leveraging diverse real-world knowledge, which serve as a fundamental technology for enabling cognitive intelligence systems with advanced understanding and…

Artificial Intelligence · Computer Science 2025-06-16 Guanglin Niu , Bo Li , Yangguang Lin

Large Language Models (LLMs) have shown strong capabilities in solving problems across domains, including graph-related tasks traditionally addressed by symbolic or algorithmic methods. In this work, we present a framework for structured…

Artificial Intelligence · Computer Science 2025-09-03 Govind Waghmare , Sumedh BG , Sonia Gupta , Srikanta Bedathur

Large language models (LLMs) have significantly advanced performance across a spectrum of natural language processing (NLP) tasks. Yet, their application to knowledge graphs (KGs), which describe facts in the form of triplets and allow…

Computation and Language · Computer Science 2024-10-11 Lingbing Guo , Zhongpu Bo , Zhuo Chen , Yichi Zhang , Jiaoyan Chen , Yarong Lan , Mengshu Sun , Zhiqiang Zhang , Yangyifei Luo , Qian Li , Qiang Zhang , Wen Zhang , Huajun Chen

Knowledge Graphs (KGs) can serve as reliable knowledge sources for question answering (QA) due to their structured representation of knowledge. Existing research on the utilization of KG for large language models (LLMs) prevalently relies…

Computation and Language · Computer Science 2024-10-25 Kun Li , Tianhua Zhang , Xixin Wu , Hongyin Luo , James Glass , Helen Meng

Although Large Language Models (LLMs) are effective in performing various NLP tasks, they still struggle to handle tasks that require extensive, real-world knowledge, especially when dealing with long-tail facts (facts related to long-tail…

Computation and Language · Computer Science 2024-05-13 Wenyu Huang , Guancheng Zhou , Mirella Lapata , Pavlos Vougiouklis , Sebastien Montella , Jeff Z. Pan

Despite the recent popularity of knowledge graph (KG) related tasks and benchmarks such as KG embeddings, link prediction, entity alignment and evaluation of the reasoning abilities of pretrained language models as KGs, the structure and…

Machine Learning · Computer Science 2023-11-14 Nedelina Teneva , Estevam Hruschka

The problem of answering questions using knowledge from pre-trained language models (LMs) and knowledge graphs (KGs) presents two challenges: given a QA context (question and answer choice), methods need to (i) identify relevant knowledge…

Computation and Language · Computer Science 2022-12-14 Michihiro Yasunaga , Hongyu Ren , Antoine Bosselut , Percy Liang , Jure Leskovec

Improving the performance of large language models (LLMs) in complex question-answering (QA) scenarios has always been a research focal point. Recent studies have attempted to enhance LLMs' performance by combining step-wise planning with…

Computation and Language · Computer Science 2024-10-24 Junjie Wang , Mingyang Chen , Binbin Hu , Dan Yang , Ziqi Liu , Yue Shen , Peng Wei , Zhiqiang Zhang , Jinjie Gu , Jun Zhou , Jeff Z. Pan , Wen Zhang , Huajun Chen

Recent advances in large language models (LLMs) have unlocked powerful reasoning and decision-making capabilities. However, their inherent dependence on static parametric memory fundamentally limits their adaptability, factual accuracy, and…

Information Retrieval · Computer Science 2025-08-07 Xinkui Zhao , Haode Li , Yifan Zhang , Guanjie Cheng , Yueshen Xu

Large language models (LLMs) demonstrate great potential for problems with implicit graphical structures, while recent works seek to enhance the graph reasoning capabilities of LLMs through specialized instruction tuning. The resulting…

Computation and Language · Computer Science 2024-10-14 Yizhuo Zhang , Heng Wang , Shangbin Feng , Zhaoxuan Tan , Xiaochuang Han , Tianxing He , Yulia Tsvetkov

Numerical reasoning is an important task in the analysis of financial documents. It helps in understanding and performing numerical predictions with logical conclusions for the given query seeking answers from financial texts. Recently,…

Computation and Language · Computer Science 2026-01-13 Aryan Mishra , Akash Anil

Knowledge graphs (KGs) are increasingly integrated with large language models (LLMs) to provide structured, verifiable reasoning. A core operation in this integration is multi-hop retrieval, yet existing systems struggle to balance…

Computation and Language · Computer Science 2026-04-22 He Cheng , Yifu Wu , Saksham Khatwani , Maya Kruse , Dmitriy Dligach , Timothy A. Miller , Majid Afshar , Yanjun Gao

Large Language Models (LLMs) have achieved great success in various reasoning tasks. In this work, we focus on the graph reasoning ability of LLMs. Although theoretical studies proved that LLMs are capable of handling graph reasoning tasks,…

Computation and Language · Computer Science 2025-01-09 Xinnan Dai , Qihao Wen , Yifei Shen , Hongzhi Wen , Dongsheng Li , Jiliang Tang , Caihua Shan

Large language models (LLMs), while exhibiting exceptional performance, suffer from hallucinations, especially on knowledge-intensive tasks. Existing works propose to augment LLMs with individual text units retrieved from external knowledge…

Computation and Language · Computer Science 2024-10-04 Bowen Jin , Chulin Xie , Jiawei Zhang , Kashob Kumar Roy , Yu Zhang , Zheng Li , Ruirui Li , Xianfeng Tang , Suhang Wang , Yu Meng , Jiawei Han

Semi-inductive link prediction (LP) in knowledge graphs (KG) is the task of predicting facts for new, previously unseen entities based on context information. Although new entities can be integrated by retraining the model from scratch in…

Computation and Language · Computer Science 2023-10-19 Adrian Kochsiek , Rainer Gemulla

The development of large language models (LLMs) has been catalyzed by advancements in pre-training techniques. These models have demonstrated robust reasoning capabilities through manually designed prompts. In this work, we evaluate the…

Computation and Language · Computer Science 2024-11-18 Yuxuan Huang

While large language models (LLMs) have demonstrated impressive capabilities across various natural language processing tasks by acquiring rich factual knowledge from their broad training data, their ability to synthesize and logically…

Computation and Language · Computer Science 2024-07-31 Tianshi Zheng , Jiaxin Bai , Yicheng Wang , Tianqing Fang , Yue Guo , Yauwai Yim , Yangqiu Song

Large language models (LLMs) have demonstrated remarkable performance on various medical benchmarks, but their capabilities across different cognitive levels remain underexplored. Inspired by Bloom's Taxonomy, we propose a…

Computation and Language · Computer Science 2025-06-11 Yuxuan Zhou , Xien Liu , Chenwei Yan , Chen Ning , Xiao Zhang , Boxun Li , Xiangling Fu , Shijin Wang , Guoping Hu , Yu Wang , Ji Wu

Large Language Models (LLMs) have impressive capabilities in text understanding and zero-shot reasoning. However, delays in knowledge updates may cause them to reason incorrectly or produce harmful results. Knowledge Graphs (KGs) provide…

Artificial Intelligence · Computer Science 2025-04-07 Tu Ao , Yanhua Yu , Yuling Wang , Yang Deng , Zirui Guo , Liang Pang , Pinghui Wang , Tat-Seng Chua , Xiao Zhang , Zhen Cai

Knowledge Graphs (KG) provide us with a structured, flexible, transparent, cross-system, and collaborative way of organizing our knowledge and data across various domains in society and industrial as well as scientific disciplines. KGs…