English
Related papers

Related papers: Evaluating and Enhancing Large Language Models for…

200 papers

Large Language Models (LLMs) have garnered considerable interest within both academic and industrial. Yet, the application of LLMs to graph data remains under-explored. In this study, we evaluate the capabilities of four LLMs in addressing…

Artificial Intelligence · Computer Science 2023-09-12 Chang Liu , Bo Wu

Knowledge graphs play a vital role in numerous artificial intelligence tasks, yet they frequently face the issue of incompleteness. In this study, we explore utilizing Large Language Models (LLM) for knowledge graph completion. We consider…

Computation and Language · Computer Science 2025-02-14 Liang Yao , Jiazhen Peng , Chengsheng Mao , Yuan Luo

Large language models (LLMs), such as GPT3.5, GPT4 and LLAMA2 perform surprisingly well and outperform human experts on many tasks. However, in many domain-specific evaluations, these LLMs often suffer from hallucination problems due to…

Computation and Language · Computer Science 2024-04-19 Yuqi Wang , Boran Jiang , Yi Luo , Dawei He , Peng Cheng , Liangcai Gao

Large language models (LLMs) have shown strong potential across a variety of tasks, but their application in the telecom field remains challenging due to domain complexity, evolving standards, and specialized terminology. Therefore,…

Artificial Intelligence · Computer Science 2026-02-20 Dun Yuan , Hao Zhou , Xue Liu , Hao Chen , Yan Xin , Jianzhong , Zhang

Empirical methods to examine the capability of Large Language Models (LLMs) to use Automated Theorem Prover (ATP) reasoning strategies are studied. We evaluate the performance of State of the Art models from December 2023 and August 2024 on…

Artificial Intelligence · Computer Science 2025-09-18 Lachlan McGinness , Peter Baumgartner

Large language models (LLMs) achieve strong results on knowledge graph question answering (KGQA), but most benchmarks assume complete knowledge graphs (KGs) where direct supporting triples exist. This reduces evaluation to shallow retrieval…

Artificial Intelligence · Computer Science 2025-12-18 Dongzhuoran Zhou , Yuqicheng Zhu , Xiaxia Wang , Hongkuan Zhou , Jiaoyan Chen , Steffen Staab , Yuan He , Evgeny Kharlamov

Large language models (LLMs) demonstrate exceptional performance across a variety of tasks, yet they are often affected by hallucinations and the timeliness of knowledge. Leveraging knowledge graphs (KGs) as external knowledge sources has…

Computation and Language · Computer Science 2024-12-31 Siyuan Fang , Kaijing Ma , Tianyu Zheng , Xinrun Du , Ningxuan Lu , Ge Zhang , Qingkun Tang

We introduce LogicAsker, a novel approach for evaluating and enhancing the logical reasoning capabilities of large language models (LLMs) such as ChatGPT and GPT-4. Despite LLMs' prowess in tasks like writing assistance, code generation,…

Software Engineering · Computer Science 2024-10-10 Yuxuan Wan , Wenxuan Wang , Yiliu Yang , Youliang Yuan , Jen-tse Huang , Pinjia He , Wenxiang Jiao , Michael R. Lyu

Large Language Models (LLMs) like GPT-4 have revolutionized natural language processing, showing remarkable linguistic proficiency and reasoning capabilities. However, their application in strategic multi-agent decision-making environments…

Computation and Language · Computer Science 2024-05-29 Chuanhao Li , Runhan Yang , Tiankai Li , Milad Bafarassat , Kourosh Sharifi , Dirk Bergemann , Zhuoran Yang

Large Language Models (LLMs) excel at generating natural language answers, yet their outputs often remain unverifiable and difficult to trace. Knowledge Graphs (KGs) offer a complementary strength by representing entities and their…

Computation and Language · Computer Science 2025-12-05 Alfonso Amayuelas , Joy Sain , Simerjot Kaur , Charese Smiley

Knowledge graphs have emerged as a popular method for injecting up-to-date, factual knowledge into large language models (LLMs). This is typically achieved by converting the knowledge graph into text that the LLM can process in context.…

Computation and Language · Computer Science 2025-04-10 Elan Markowitz , Krupa Galiya , Greg Ver Steeg , Aram Galstyan

Large Language Models (LLMs) demonstrate impressive natural language capabilities but often struggle with knowledge-intensive reasoning tasks. Knowledge Base Question Answering (KBQA), which leverages structured Knowledge Graphs (KGs)…

Computation and Language · Computer Science 2026-04-15 Shuai Wang , Yinan Yu

Large language models (LLMs), such as GPT4 and LLaMA, are creating significant advancements in natural language processing, due to their strong text encoding/decoding ability and newly found emergent capability (e.g., reasoning). While LLMs…

Computation and Language · Computer Science 2024-11-22 Bowen Jin , Gang Liu , Chi Han , Meng Jiang , Heng Ji , Jiawei Han

Symbolic knowledge graphs (KGs) play a pivotal role in knowledge-centric applications such as search, question answering and recommendation. As contemporary language models (LMs) trained on extensive textual data have gained prominence,…

Computation and Language · Computer Science 2023-08-29 Vishwas Mruthyunjaya , Pouya Pezeshkpour , Estevam Hruschka , Nikita Bhutani

Knowledge Graphs (KGs) are essential for the functionality of GraphRAGs, a form of Retrieval-Augmented Generative Systems (RAGs) that excel in tasks requiring structured reasoning and semantic understanding. However, creating KGs for…

Computation and Language · Computer Science 2024-12-11 Ahan Bhatt , Nandan Vaghela , Kush Dudhia

Improving the performance of large language models (LLMs) in complex question-answering (QA) scenarios has always been a research focal point. Recent studies have attempted to enhance LLMs' performance by combining step-wise planning with…

Computation and Language · Computer Science 2024-10-24 Junjie Wang , Mingyang Chen , Binbin Hu , Dan Yang , Ziqi Liu , Yue Shen , Peng Wei , Zhiqiang Zhang , Jinjie Gu , Jun Zhou , Jeff Z. Pan , Wen Zhang , Huajun Chen

Question Answering over Knowledge Graph (KGQA) aims to seek answer entities for the natural language question from a large-scale Knowledge Graph~(KG). To better perform reasoning on KG, recent work typically adopts a pre-trained language…

Computation and Language · Computer Science 2024-01-02 Jinhao Jiang , Kun Zhou , Wayne Xin Zhao , Yaliang Li , Ji-Rong Wen

Large Language Models (LLMs) demonstrate strong reasoning capabilities but struggle with hallucinations and limited transparency. Recently, KG-enhanced LLMs that integrate knowledge graphs (KGs) have been shown to improve reasoning…

Artificial Intelligence · Computer Science 2025-12-10 Minbae Park , Hyemin Yang , Jeonghyun Kim , Kunsoo Park , Hyunjoon Kim

Large Language Models (LLMs) have achieved impressive results in various tasks but struggle with hallucination problems and lack of relevant knowledge, especially in deep complex reasoning and knowledge-intensive tasks. Knowledge Graphs…

Computation and Language · Computer Science 2025-03-14 Xingyu Tan , Xiaoyang Wang , Qing Liu , Xiwei Xu , Xin Yuan , Wenjie Zhang

Large Language Models (LLMs) have demonstrated remarkable capabilities in text generation and understanding, yet their reliance on implicit, unstructured knowledge often leads to factual inaccuracies and limited interpretability. Knowledge…

Computation and Language · Computer Science 2025-06-17 Qinggang Zhang