English
Related papers

Related papers: Causal Reasoning in Large Language Models: A Knowl…

200 papers

Knowledge Graphs (KGs) represent human-crafted factual knowledge in the form of triplets (head, relation, tail), which collectively form a graph. Question Answering over KGs (KGQA) is the task of answering natural questions grounding the…

Computation and Language · Computer Science 2024-05-31 Costas Mavromatis , George Karypis

Large Language Models (LLMs) have achieved remarkable success across various domains. However, they still face significant challenges, including high computational costs for training and limitations in solving complex reasoning problems.…

Machine Learning · Computer Science 2025-05-20 Hang Gao , Chenhao Zhang , Tie Wang , Junsuo Zhao , Fengge Wu , Changwen Zheng , Huaping Liu

Large Language Models (LLMs) have impressive capabilities in text understanding and zero-shot reasoning. However, delays in knowledge updates may cause them to reason incorrectly or produce harmful results. Knowledge Graphs (KGs) provide…

Artificial Intelligence · Computer Science 2025-04-07 Tu Ao , Yanhua Yu , Yuling Wang , Yang Deng , Zirui Guo , Liang Pang , Pinghui Wang , Tat-Seng Chua , Xiao Zhang , Zhen Cai

Large language models (LLMs) offer new opportunities for constructing knowledge graphs (KGs) from unstructured clinical narratives. However, existing approaches often rely on structured inputs and lack robust validation of factual accuracy…

Artificial Intelligence · Computer Science 2026-01-06 Udiptaman Das , Krishnasai B. Atmakuri , Duy Ho , Chi Lee , Yugyung Lee

Large Language Models (LLMs) have achieved impressive results in various tasks but struggle with hallucination problems and lack of relevant knowledge, especially in deep complex reasoning and knowledge-intensive tasks. Knowledge Graphs…

Computation and Language · Computer Science 2025-03-14 Xingyu Tan , Xiaoyang Wang , Qing Liu , Xiwei Xu , Xin Yuan , Wenjie Zhang

Large Language Models (LLMs) excel at general-purpose reasoning by leveraging broad commonsense knowledge, but they remain limited in tasks requiring personalized reasoning over multifactorial personal data. This limitation constrains their…

Computation and Language · Computer Science 2025-09-03 Zhongqi Yang , Amir Rahmani

Recent works integrating Knowledge Graphs (KGs) have shown promising improvements in enhancing the reasoning capabilities of Large Language Models (LLMs). However, existing benchmarks primarily focus on closed-ended tasks, leaving a gap in…

Computation and Language · Computer Science 2025-05-23 Yuan Sui , Yufei He , Zifeng Ding , Bryan Hooi

While LLMs have emerged as performant architectures for reasoning tasks, their compositional generalization capabilities have been questioned. In this work, we introduce a Compositional Generalization Challenge for Graph-based Commonsense…

Computation and Language · Computer Science 2024-10-10 Xiyan Fu , Anette Frank

Large Language Models (LLMs) have demonstrated remarkable capabilities in many real-world applications. Nonetheless, LLMs are often criticized for their tendency to produce hallucinations, wherein the models fabricate incorrect statements…

Computation and Language · Computer Science 2024-06-05 Qinggang Zhang , Junnan Dong , Hao Chen , Daochen Zha , Zailiang Yu , Xiao Huang

Large language models (LLMs) excel at reasoning but struggle with knowledge-intensive questions due to limited context and parametric knowledge. However, existing methods that rely on finetuned LLMs or GNN retrievers are limited by…

Artificial Intelligence · Computer Science 2025-11-07 Yuanning Cui , Zequn Sun , Wei Hu , Zhangjie Fu

Large Language Models (LLMs) have demonstrated strong capabilities across diverse NLP applications, such as translation, text generation, and question answering. Nevertheless, they remain limited in complex settings that demand deep…

Computation and Language · Computer Science 2026-05-18 Xin Zhang , Yang Cao , Baoxing Wu , Kai Song , Siying Li

Recent advances in Large Language Models (LLMs) have positioned them as a prominent solution for Natural Language Processing tasks. Notably, they can approach these problems in a zero or few-shot manner, thereby eliminating the need for…

Machine Learning · Computer Science 2025-05-07 Gerard Pons , Besim Bilalli , Anna Queralt

Knowledge graphs (KGs) complement Large Language Models (LLMs) by providing reliable, structured, domain-specific, and up-to-date external knowledge. However, KGs and LLMs are often developed separately and must be integrated after…

Artificial Intelligence · Computer Science 2024-08-01 Elan Markowitz , Anil Ramakrishna , Jwala Dhamala , Ninareh Mehrabi , Charith Peris , Rahul Gupta , Kai-Wei Chang , Aram Galstyan

Augmenting pre-trained language models with knowledge graphs (KGs) has achieved success on various commonsense reasoning tasks. However, for a given task instance, the KG, or certain parts of the KG, may not be useful. Although KG-augmented…

Computation and Language · Computer Science 2022-12-20 Aaron Chan , Jiashu Xu , Boyuan Long , Soumya Sanyal , Tanishq Gupta , Xiang Ren

Answering complex questions about textual narratives requires reasoning over both stated context and the world knowledge that underlies it. However, pretrained language models (LM), the foundation of most modern QA systems, do not robustly…

Computation and Language · Computer Science 2022-01-25 Xikun Zhang , Antoine Bosselut , Michihiro Yasunaga , Hongyu Ren , Percy Liang , Christopher D. Manning , Jure Leskovec

Autoregressive large language models (LLMs) pre-trained by next token prediction are inherently proficient in generative tasks. However, their performance on knowledge-driven tasks such as factual knowledge querying remains unsatisfactory.…

Computation and Language · Computer Science 2026-01-14 Peng Yu , Cheng Deng , Beiya Dai , Xinbing Wang , Ying Wen

Recommender systems are pivotal in enhancing user experiences across various web applications by analyzing the complicated relationships between users and items. Knowledge graphs(KGs) have been widely used to enhance the performance of…

Information Retrieval · Computer Science 2024-07-02 Guangsi Shi , Xiaofeng Deng , Linhao Luo , Lijuan Xia , Lei Bao , Bei Ye , Fei Du , Shirui Pan , Yuxiao Li

Although Large Language Models (LLMs) are effective in performing various NLP tasks, they still struggle to handle tasks that require extensive, real-world knowledge, especially when dealing with long-tail facts (facts related to long-tail…

Computation and Language · Computer Science 2024-05-13 Wenyu Huang , Guancheng Zhou , Mirella Lapata , Pavlos Vougiouklis , Sebastien Montella , Jeff Z. Pan

The generation of questions and answers (QA) from knowledge graphs (KG) plays a crucial role in the development and testing of educational platforms, dissemination tools, and large language models (LLM). However, existing approaches often…

Computation and Language · Computer Science 2025-11-17 Sania Nayab , Marco Simoni , Giulio Rossolini , Andrea Saracino

Large Language Models (LLMs) exhibit strong reasoning capabilities in complex tasks. However, they still struggle with hallucinations and factual errors in knowledge-intensive scenarios like knowledge graph question answering (KGQA). We…

Computation and Language · Computer Science 2025-11-12 Songze Li , Zhiqiang Liu , Zhengke Gui , Huajun Chen , Wen Zhang