English
Related papers

Related papers: Thinking with Knowledge Graphs: Enhancing LLM Reas…

200 papers

Knowledge Graphs (KGs) play a crucial role in enhancing e-commerce system performance by providing structured information about entities and their relationships, such as complementary or substitutable relations between products or product…

Information Retrieval · Computer Science 2023-05-18 Jiao Chen , Luyi Ma , Xiaohan Li , Nikhil Thakurdesai , Jianpeng Xu , Jason H. D. Cho , Kaushiki Nag , Evren Korpeoglu , Sushant Kumar , Kannan Achan

Large Language Models (LLMs) have demonstrated impressive performance in natural language processing tasks by leveraging chain of thought (CoT) that enables step-by-step thinking. Extending LLMs with multimodal capabilities is the recent…

Computation and Language · Computer Science 2024-01-24 Debjyoti Mondal , Suraj Modi , Subhadarshi Panda , Rituraj Singh , Godawari Sudhakar Rao

Knowledge Graphs (KGs) represent human-crafted factual knowledge in the form of triplets (head, relation, tail), which collectively form a graph. Question Answering over KGs (KGQA) is the task of answering natural questions grounding the…

Computation and Language · Computer Science 2024-05-31 Costas Mavromatis , George Karypis

The growing trend of Large Language Models (LLM) development has attracted significant attention, with models for various applications emerging consistently. However, the combined application of Large Language Models with semantic…

Computation and Language · Computer Science 2023-05-09 Milena Trajanoska , Riste Stojanov , Dimitar Trajanov

Large language models (LLMs) have shown remarkable generalization capability with exceptional performance in various language modeling tasks. However, they still exhibit inherent limitations in precisely capturing and returning grounded…

Computation and Language · Computer Science 2024-01-01 Yijun Tian , Huan Song , Zichen Wang , Haozhu Wang , Ziqing Hu , Fang Wang , Nitesh V. Chawla , Panpan Xu

This paper examines the capacity of LLMs to reason with knowledge graphs using their internal knowledge graph, i.e., the knowledge graph they learned during pre-training. Two research questions are formulated to investigate the accuracy of…

Computation and Language · Computer Science 2023-12-04 Pei-Chi Lo , Yi-Hang Tsai , Ee-Peng Lim , San-Yih Hwang

Knowledge graphs (KGs) have transformed data management within the manufacturing industry, offering effective means for integrating disparate data sources through shared and structured conceptual schemas. However, harnessing the power of…

Artificial Intelligence · Computer Science 2025-07-31 Sebastian Monka , Irlan Grangel-González , Stefan Schmid , Lavdim Halilaj , Marc Rickart , Oliver Rudolph , Rui Dias

Large Language Models (LLMs) have shown remarkable capabilities in processing various data structures, including graphs. While previous research has focused on developing textual encoding methods for graph representation, the emergence of…

Machine Learning · Computer Science 2024-09-16 Zhiqiang Zhong , Davide Mottin

Large language models (LLMs) have achieved remarkable performance on knowledge graph question answering (KGQA) tasks by planning and interacting with knowledge graphs. However, existing methods often confuse tool utilization with knowledge…

Computation and Language · Computer Science 2025-03-10 Mufan Xu , Gewen Liang , Kehai Chen , Wei Wang , Xun Zhou , Muyun Yang , Tiejun Zhao , Min Zhang

Answering complex questions about textual narratives requires reasoning over both stated context and the world knowledge that underlies it. However, pretrained language models (LM), the foundation of most modern QA systems, do not robustly…

Computation and Language · Computer Science 2022-01-25 Xikun Zhang , Antoine Bosselut , Michihiro Yasunaga , Hongyu Ren , Percy Liang , Christopher D. Manning , Jure Leskovec

Large Language Models (LLMs) demonstrate strong reasoning abilities but face limitations such as hallucinations and outdated knowledge. Knowledge Graph (KG)-based Retrieval-Augmented Generation (RAG) addresses these issues by grounding LLM…

Computation and Language · Computer Science 2025-03-04 Mufei Li , Siqi Miao , Pan Li

Despite their competitive performance on knowledge-intensive tasks, large language models (LLMs) still have limitations in memorizing all world knowledge especially long tail knowledge. In this paper, we study the KG-augmented language…

Computation and Language · Computer Science 2023-09-22 Yike Wu , Nan Hu , Sheng Bi , Guilin Qi , Jie Ren , Anhuan Xie , Wei Song

Large language models (LLMs), while exhibiting exceptional performance, suffer from hallucinations, especially on knowledge-intensive tasks. Existing works propose to augment LLMs with individual text units retrieved from external knowledge…

Computation and Language · Computer Science 2024-10-04 Bowen Jin , Chulin Xie , Jiawei Zhang , Kashob Kumar Roy , Yu Zhang , Zheng Li , Ruirui Li , Xianfeng Tang , Suhang Wang , Yu Meng , Jiawei Han

In the current era of big data, extracting deep insights from massive, heterogeneous, and complexly associated multi-dimensional data has become a significant challenge. Large Language Models (LLMs) perform well in natural language…

Artificial Intelligence · Computer Science 2025-11-21 Xi Wang , Xianyao Ling , Kun Li , Gang Yin , Liang Zhang , Jiang Wu , Jun Xu , Fu Zhang , Wenbo Lei , Annie Wang , Peng Gong

Large Language Models (LLMs) might hallucinate facts, while curated Knowledge Graph (KGs) are typically factually reliable especially with domain-specific knowledge. Measuring the alignment between KGs and LLMs can effectively probe the…

Artificial Intelligence · Computer Science 2024-08-02 Shangshang Zheng , He Bai , Yizhe Zhang , Yi Su , Xiaochuan Niu , Navdeep Jaitly

Graphs play an important role in representing complex relationships in various domains like social networks, knowledge graphs, and molecular discovery. With the advent of deep learning, Graph Neural Networks (GNNs) have emerged as a…

Machine Learning · Computer Science 2024-06-05 Wenqi Fan , Shijie Wang , Jiani Huang , Zhikai Chen , Yu Song , Wenzhuo Tang , Haitao Mao , Hui Liu , Xiaorui Liu , Dawei Yin , Qing Li

Large Language Models (LLMs) present massive inherent knowledge and superior semantic comprehension capability, which have revolutionized various tasks in natural language processing. Despite their success, a critical gap remains in…

Computation and Language · Computer Science 2025-02-11 Ben Liu , Jihai Zhang , Fangquan Lin , Cheng Yang , Min Peng

Previous studies have relied on existing question-answering benchmarks to evaluate the knowledge stored in large language models (LLMs). However, this approach has limitations regarding factual knowledge coverage, as it mostly focuses on…

Computation and Language · Computer Science 2023-10-31 Linhao Luo , Thuy-Trang Vu , Dinh Phung , Gholamreza Haffari

Large language models (LLMs), such as ChatGPT and GPT4, are making new waves in the field of natural language processing and artificial intelligence, due to their emergent ability and generalizability. However, LLMs are black-box models,…

Computation and Language · Computer Science 2024-01-26 Shirui Pan , Linhao Luo , Yufei Wang , Chen Chen , Jiapu Wang , Xindong Wu

Large Language Models (LLMs) possess impressive reasoning abilities but are prone to generating incorrect information, often referred to as hallucinations. While incorporating external Knowledge Graphs (KGs) can partially mitigate this…

Computation and Language · Computer Science 2024-10-18 Lei Sun , Xinchen Wang , Youdi Li