English
Related papers

Related papers: KG-LLM-Bench: A Scalable Benchmark for Evaluating …

200 papers

Large language models (LLMs) are increasingly used in the mental health domain, yet it remains unclear how well they capture related biomedical knowledge and how reliably they apply it to clinically salient structured judgments. Here, we…

Computation and Language · Computer Science 2026-05-18 Weixin Liu , Congning Ni , Shelagh A. Mulvaney , Susannah L. Rose , Murat Kantarcioglu , Bradley A. Malin , Zhijun Yin

In recent years, Natural Language Processing (NLP) has played a significant role in various Artificial Intelligence (AI) applications such as chatbots, text generation, and language translation. The emergence of large language models (LLMs)…

Computation and Language · Computer Science 2024-07-10 Amanda Kau , Xuzeng He , Aishwarya Nambissan , Aland Astudillo , Hui Yin , Amir Aryani

Graphs are a powerful tool for representing and analyzing complex relationships in real-world applications such as social networks, recommender systems, and computational finance. Reasoning on graphs is essential for drawing inferences…

Machine Learning · Computer Science 2023-10-10 Bahare Fatemi , Jonathan Halcrow , Bryan Perozzi

Knowledge graphs (KGs) are vital for knowledge-intensive tasks and have shown promise in reducing hallucinations in large language models (LLMs). However, constructing high-quality KGs remains difficult, requiring accurate information…

Computation and Language · Computer Science 2025-10-14 Ruirui Chen , Weifeng Jiang , Chengwei Qin , Bo Xiong , Fiona Liausvia , Dongkyu Choi , Boon Kiat Quek

Large language models (LLMs) have demonstrated impressive reasoning abilities in complex tasks. However, they lack up-to-date knowledge and experience hallucinations during reasoning, which can lead to incorrect reasoning processes and…

Computation and Language · Computer Science 2024-02-27 Linhao Luo , Yuan-Fang Li , Gholamreza Haffari , Shirui Pan

Despite their competitive performance on knowledge-intensive tasks, large language models (LLMs) still have limitations in memorizing all world knowledge especially long tail knowledge. In this paper, we study the KG-augmented language…

Computation and Language · Computer Science 2023-09-22 Yike Wu , Nan Hu , Sheng Bi , Guilin Qi , Jie Ren , Anhuan Xie , Wei Song

The recent advances in large language models (LLM) and foundation models with emergent capabilities have been shown to improve the performance of many NLP tasks. LLMs and Knowledge Graphs (KG) can complement each other such that LLMs can be…

Computation and Language · Computer Science 2023-08-07 Nandana Mihindukulasooriya , Sanju Tiwari , Carlos F. Enguix , Kusum Lata

Generating Knowledge Graphs (KGs) remains one of the most time-consuming and labor-intensive tasks for knowledge engineers, as they need to identify semantic equivalences between input data sources and ontology terms. While declarative…

Artificial Intelligence · Computer Science 2026-05-20 Carla Castedo , Enrique Iglesias , Manuel Lama , Alberto Bugarin-Diz , Maria-Esther Vidal , David Chaves-Fraga

Autoregressive large language models (LLMs) pre-trained by next token prediction are inherently proficient in generative tasks. However, their performance on knowledge-driven tasks such as factual knowledge querying remains unsatisfactory.…

Computation and Language · Computer Science 2026-01-14 Peng Yu , Cheng Deng , Beiya Dai , Xinbing Wang , Ying Wen

Currently, the main approach for Large Language Models (LLMs) to tackle the hallucination issue is incorporating Knowledge Graphs(KGs).However, LLMs typically treat KGs as plain text, extracting only semantic information and limiting their…

Computation and Language · Computer Science 2025-09-29 Yifang Zhang , Pengfei Duan , Yiwen Yang , Shengwu Xiong

Current Large Language Models (LLMs) can assist developing program code beside many other things, but can they support working with Knowledge Graphs (KGs) as well? Which LLM is offering the best capabilities in the field of Semantic Web and…

Artificial Intelligence · Computer Science 2025-06-03 Lars-Peter Meyer , Johannes Frey , Desiree Heim , Felix Brei , Claus Stadler , Kurt Junghanns , Michael Martin

Incorporating factual knowledge into pre-trained language models (PLM) such as BERT is an emerging trend in recent NLP studies. However, most of the existing methods combine the external knowledge integration module with a modified…

Computation and Language · Computer Science 2022-05-06 Yinquan Lu , Haonan Lu , Guirong Fu , Qun Liu

Large Language Models (LLMs) possess a remarkable capacity to generate persuasive and intelligible language. However, coherence does not equate to truthfulness, as the responses often contain subtle hallucinations. Existing benchmarks are…

Computation and Language · Computer Science 2026-02-24 Alex Robertson , Huizhi Liang , Mahbub Gani , Rohit Kumar , Srijith Rajamohan

Large language models (LLMs) have garnered significant attention for their superior performance in many knowledge-driven applications on the world wide web.These models are designed to train hundreds of millions or more parameters on large…

Computation and Language · Computer Science 2025-04-09 Bingchen Liu , Yuanyuan Fang , Naixing Xu , Shihao Hou , Xin Li , Qian Li

The integration of Large Language Models (LLMs) with Knowledge Graphs (KGs) offers significant synergistic potential for knowledge-driven applications. One possible integration is the interpretation and generation of formal languages, such…

Databases · Computer Science 2025-04-07 Lars-Peter Meyer , Johannes Frey , Felix Brei , Natanael Arndt

Evaluating the open-form textual responses generated by Large Language Models (LLMs) typically requires measuring the semantic similarity of the response to a (human generated) reference. However, there is evidence that current semantic…

Artificial Intelligence · Computer Science 2025-11-26 Qiyao Wei , Edward Morrell , Lea Goetz , Mihaela van der Schaar

Large Language Models (LLMs) have been extensively adopted in Knowledge Graph Completion (KGC), showcasing significant research advancements. However, as black-box models driven by deep neural architectures, current LLM-based KGC methods…

Computation and Language · Computer Science 2025-10-22 Wenbin Guo , Xin Wang , Jiaoyan Chen , Zhao Li , Zirui Chen

To tackle the problem of domain-specific knowledge scarcity within large language models (LLMs), knowledge graph-retrievalaugmented method has been proven to be an effective and efficient technique for knowledge infusion. However, existing…

Computation and Language · Computer Science 2024-06-07 Zhouyu Jiang , Ling Zhong , Mengshu Sun , Jun Xu , Rui Sun , Hui Cai , Shuhan Luo , Zhiqiang Zhang

The ability to summarize and organize knowledge into abstract concepts is key to learning and reasoning. Many industrial applications rely on the consistent and systematic use of concepts, especially when dealing with decision-critical…

Computation and Language · Computer Science 2024-05-31 Rosario Uceda-Sosa , Karthikeyan Natesan Ramamurthy , Maria Chang , Moninder Singh

Large Language Models (LLMs) face challenges in knowledge-intensive reasoning tasks like classic multi-hop question and answering, which involves reasoning across multiple facts. This difficulty arises because the chain of thoughts (CoTs)…

Computation and Language · Computer Science 2025-08-25 Nan Wang , Yongqi Fan , yansha zhu , ZongYu Wang , Xuezhi Cao , Xinyan He , Haiyun Jiang , Tong Ruan , Jingping Liu