English
Related papers

Related papers: KG-LLM-Bench: A Scalable Benchmark for Evaluating …

200 papers

Logical reasoning over incomplete knowledge graphs to answer complex logical queries is a challenging task. With the emergence of new entities and relations in constantly evolving KGs, inductive logical reasoning over KGs has become a…

Computation and Language · Computer Science 2023-05-24 Siyuan Wang , Zhongyu Wei , Meng Han , Zhihao Fan , Haijun Shan , Qi Zhang , Xuanjing Huang

Benchmarks play a crucial role in tracking the rapid advancement of large language models (LLMs) and identifying their capability boundaries. However, existing benchmarks predominantly curate questions at the question level, suffering from…

Large language models (LLMs) based on generative pre-trained Transformer have achieved remarkable performance on knowledge graph question-answering (KGQA) tasks. However, LLMs often produce ungrounded subgraph planning or reasoning results…

Computation and Language · Computer Science 2025-03-10 Mufan Xu , Kehai Chen , Xuefeng Bai , Muyun Yang , Tiejun Zhao , Min Zhang

Knowledge Graph-based Retrieval-Augmented Generation (KG-RAG) is an increasingly explored approach for combining the reasoning capabilities of large language models with the structured evidence of knowledge graphs. However, current…

Artificial Intelligence · Computer Science 2026-01-13 Dongzhuoran Zhou , Yuqicheng Zhu , Xiaxia Wang , Hongkuan Zhou , Yuan He , Jiaoyan Chen , Steffen Staab , Evgeny Kharlamov

Knowledge graphs (KGs) are the cornerstone of the semantic web, offering up-to-date representations of real-world entities and relations. Yet large language models (LLMs) remain largely static after pre-training, causing their internal…

Computation and Language · Computer Science 2026-03-24 Songlin Zhai , Guilin Qi , Yue Wang , Yuan Meng

The reasoning process of Large Language Models (LLMs) is often plagued by hallucinations and missing facts in question-answering tasks. A promising solution is to ground LLMs' answers in verifiable knowledge sources, such as Knowledge…

Computation and Language · Computer Science 2026-02-26 Shiqi Yan , Yubo Chen , Ruiqi Zhou , Zhengxi Yao , Shuai Chen , Tianyi Zhang , Shijie Zhang , Wei Qiang Zhang , Yongfeng Huang , Haixin Duan , Yunqi Zhang

Large Language Models (LLMs) provide flexible natural language processing capabilities, while knowledge graphs (KGs) offer explicit and structured knowledge. Integrating these two in a complementary manner enables the development of…

Computation and Language · Computer Science 2026-05-12 Shusaku Egami , Aoi Ohta , Tomoki Tsujimura , Masaki Asada , Tatsuya Ishigaki , Ken Fukuda , Masahiro Hamasaki , Hiroya Takamura

Procedural Knowledge is the know-how expressed in the form of sequences of steps needed to perform some tasks. Procedures are usually described by means of natural language texts, such as recipes or maintenance manuals, possibly spread…

Artificial Intelligence · Computer Science 2025-12-08 Valentina Anita Carriero , Antonia Azzini , Ilaria Baroni , Mario Scrocca , Irene Celino

Large Language Models (LLMs) have garnered considerable interest within both academic and industrial. Yet, the application of LLMs to graph data remains under-explored. In this study, we evaluate the capabilities of four LLMs in addressing…

Artificial Intelligence · Computer Science 2023-09-12 Chang Liu , Bo Wu

Teaching large language models (LLMs) to use tools is crucial for improving their problem-solving abilities and expanding their applications. However, effectively using tools is challenging because it requires a deep understanding of tool…

Machine Learning · Computer Science 2025-06-27 Jingwei Wang , Zai Zhang , Hao Qian , Chunjing Gan , Binbin Hu , Ziqi Liu , Zhiqiang Zhang , Jun Zhou , Bin Shi , Bo Dong

In recent years, we have witnessed the proliferation of knowledge graphs (KG) in various domains, aiming to support applications like question answering, recommendations, etc. A frequent task when integrating knowledge from different KGs is…

Databases · Computer Science 2023-06-08 Nikolaos Fanourakis , Vasilis Efthymiou , Dimitris Kotzinos , Vassilis Christophides

Large language models (LLMs) have achieved remarkable performance on knowledge graph question answering (KGQA) tasks by planning and interacting with knowledge graphs. However, existing methods often confuse tool utilization with knowledge…

Computation and Language · Computer Science 2025-03-10 Mufan Xu , Gewen Liang , Kehai Chen , Wei Wang , Xun Zhou , Muyun Yang , Tiejun Zhao , Min Zhang

Developments in Graph-Language Models (GLMs) aim to integrate the structural reasoning capabilities of Graph Neural Networks (GNNs) with the semantic understanding of Large Language Models (LLMs). However, we demonstrate that current…

Computation and Language · Computer Science 2025-08-29 Soham Petkar , Hari Aakash K , Anirudh Vempati , Akshit Sinha , Ponnurangam Kumarauguru , Chirag Agarwal

The remarkable reasoning and generalization capabilities of Large Language Models (LLMs) have paved the way for their expanding applications in embodied AI, robotics, and other real-world tasks. To effectively support these applications,…

Computation and Language · Computer Science 2025-05-30 Dongil Yang , Minjin Kim , Sunghwan Kim , Beong-woo Kwak , Minjun Park , Jinseok Hong , Woontack Woo , Jinyoung Yeo

The role of large language models (LLMs) in enterprise modeling has recently started to shift from academic research to that of industrial applications. Thereby, LLMs represent a further building block for the machine-supported generation…

Multiagent Systems · Computer Science 2025-01-08 Benedikt Reitemeyer , Hans-Georg Fill

Pre-trained language representation models (PLMs) cannot well capture factual knowledge from text. In contrast, knowledge embedding (KE) methods can effectively represent the relational facts in knowledge graphs (KGs) with informative…

Computation and Language · Computer Science 2020-11-24 Xiaozhi Wang , Tianyu Gao , Zhaocheng Zhu , Zhengyan Zhang , Zhiyuan Liu , Juanzi Li , Jian Tang

Knowledge graph-based dialogue generation (KG-DG) is a challenging task requiring models to effectively incorporate external knowledge into conversational responses. While large language models (LLMs) have achieved impressive results across…

Computation and Language · Computer Science 2025-11-18 Hadi Sheikhi , Chenyang Huang , Osmar R. Zaïane

Narrative data spans all disciplines and provides a coherent model of the world to the reader or viewer. Recent advancement in machine learning and Large Language Models (LLMs) have enable great strides in analyzing natural language.…

Knowledge Graph-based recommendations have gained significant attention due to their ability to leverage rich semantic relationships. However, constructing and maintaining Knowledge Graphs (KGs) is resource-intensive, and the accuracy of…

Information Retrieval · Computer Science 2025-02-07 Rui Cai , Chao Wang , Qianyi Cai , Dazhong Shen , Hui Xiong

Large Language Models (LLMs) have shown remarkable capabilities across various tasks but remain prone to hallucinations in knowledge-intensive scenarios. Knowledge Base Question Answering (KBQA) mitigates this by grounding generation in…

Computation and Language · Computer Science 2026-04-15 Shuai Wang , Xixi Wang , Yinan Yu