English
Related papers

Related papers: BLINKG: A Benchmark for LLM-Integrated Knowledge G…

200 papers

Large language models (LLMs) have demonstrated significant advancements in reasoning and code generation, but efficiently creating new benchmarks to evaluate these capabilities remains a challenge. Traditional benchmark creation relies on…

Computation and Language · Computer Science 2026-05-27 Ishir Garg , Neel Kolhe , Xuandong Zhao , Dawn Song

Knowledge graph construction (KGC) from (semi-)structured data is challenging, and facilitating user involvement is an issue frequently brought up within this community. We cannot deny the progress we have made with respect to (declarative)…

Human-Computer Interaction · Computer Science 2025-05-14 Ademar Crotti Junior , Christophe Debruyne

Recent advancements in large language models (LLMs) have shown impressive versatility across various tasks. To eliminate their hallucinations, retrieval-augmented generation (RAG) has emerged as a powerful approach, leveraging external…

Computation and Language · Computer Science 2025-05-30 Yuzheng Cai , Zhenyue Guo , Yiwen Pei , Wanrui Bian , Weiguo Zheng

Although achieving great success, Large Language Models (LLMs) usually suffer from unreliable hallucinations. Although language attribution can be a potential solution, there are no suitable benchmarks and evaluation metrics to attribute…

Computation and Language · Computer Science 2024-05-24 Xinze Li , Yixin Cao , Liangming Pan , Yubo Ma , Aixin Sun

The rapid advancements in large language models (LLMs) have ignited interest in the temporal knowledge graph (tKG) domain, where conventional embedding-based and rule-based methods dominate. The question remains open of whether pre-trained…

Computation and Language · Computer Science 2024-04-18 Ruotong Liao , Xu Jia , Yangzhe Li , Yunpu Ma , Volker Tresp

Large language models like GPT-4, Gemini, and Claude have transformed natural language processing (NLP) tasks such as question answering, dialogue generation, summarization, and so forth; yet their susceptibility to hallucination stands as…

Computation and Language · Computer Science 2025-07-21 Nur A Zarin Nishat , Andrea Coletta , Luigi Bellomarini , Kossi Amouzouvi , Jens Lehmann , Sahar Vahdati

Semantic Knowledge Graphs (SKG) face challenges with scalability, flexibility, contextual understanding, and handling unstructured or ambiguous information. However, they offer formal and structured knowledge enabling highly interpretable…

Artificial Intelligence · Computer Science 2025-01-22 Aldo Gangemi , Andrea Giovanni Nuzzolese

Large Language Models (LLMs) provide flexible natural language processing capabilities, while knowledge graphs (KGs) offer explicit and structured knowledge. Integrating these two in a complementary manner enables the development of…

Computation and Language · Computer Science 2026-05-12 Shusaku Egami , Aoi Ohta , Tomoki Tsujimura , Masaki Asada , Tatsuya Ishigaki , Ken Fukuda , Masahiro Hamasaki , Hiroya Takamura

Multimodal reasoning in Large Language Models (LLMs) struggles with incomplete knowledge and hallucination artifacts, challenges that textual Knowledge Graphs (KGs) only partially mitigate due to their modality isolation. While Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Junming Liu , Siyuan Meng , Yanting Gao , Song Mao , Pinlong Cai , Guohang Yan , Yirong Chen , Zilin Bian , Ding Wang , Botian Shi

Large Language Models (LLMs) have inherent limitations of faithfulness and factuality, commonly referred to as hallucinations. Several benchmarks have been developed that provide a test bed for factuality evaluation within the context of…

Computation and Language · Computer Science 2025-10-24 Ernests Lavrinovics , Russa Biswas , Katja Hose , Johannes Bjerva

Despite the recent popularity of knowledge graph (KG) related tasks and benchmarks such as KG embeddings, link prediction, entity alignment and evaluation of the reasoning abilities of pretrained language models as KGs, the structure and…

Machine Learning · Computer Science 2023-11-14 Nedelina Teneva , Estevam Hruschka

Large language models (LLMs) have demonstrated their capabilities across various NLP tasks. Their potential in e-commerce is also substantial, evidenced by practical implementations such as platform search, personalized recommendations, and…

Computation and Language · Computer Science 2025-03-21 Langming Liu , Haibin Chen , Yuhao Wang , Yujin Yuan , Shilei Liu , Wenbo Su , Xiangyu Zhao , Bo Zheng

Recent work has shown the capability of Large Language Models (LLMs) to solve tasks related to Knowledge Graphs, such as Knowledge Graph Completion, even in Zero- or Few-Shot paradigms. However, they are known to hallucinate answers, or…

Computation and Language · Computer Science 2024-07-19 Vasile Ionut Remus Iga , Gheorghe Cosmin Silaghi

To address the issues of insufficient knowledge and hallucination in Large Language Models (LLMs), numerous studies have explored integrating LLMs with Knowledge Graphs (KGs). However, these methods are typically evaluated on conventional…

Computation and Language · Computer Science 2024-10-08 Yao Xu , Shizhu He , Jiabei Chen , Zihao Wang , Yangqiu Song , Hanghang Tong , Guang Liu , Kang Liu , Jun Zhao

Ontology, and more broadly, Knowledge Graph Matching is a challenging task in which expressiveness has not been fully addressed. Despite the increasing use of embeddings and language models for this task, approaches for generating…

Computation and Language · Computer Science 2025-02-20 Guilherme Sousa , Rinaldo Lima , Cassia Trojahn

This paper presents a scholarly Knowledge Graph Question Answering (KGQA) that answers bibliographic natural language questions by leveraging a large language model (LLM) in a few-shot manner. The model initially identifies the top-n…

Computation and Language · Computer Science 2023-11-17 Tilahun Abedissa Taffa , Ricardo Usbeck

An effective and efficient review of construction contracts is essential for minimizing construction projects losses, but current methods are time-consuming and error-prone. Studies using methods based on Natural Language Processing (NLP)…

Artificial Intelligence · Computer Science 2025-05-20 Chunmo Zheng , Saika Wong , Xing Su , Yinqiu Tang , Ahsan Nawaz , Mohamad Kassem

Analyzing large, complex output datasets from Discrete Event Simulations (DES) of warehouse operations to identify bottlenecks and inefficiencies is a critical yet challenging task, often demanding significant manual effort or specialized…

Machine Learning · Computer Science 2025-07-24 Rishi Parekh , Saisubramaniam Gopalakrishnan , Zishan Ahmad , Anirudh Deodhar

Knowledge graphs (KGs) play a pivotal role in knowledge-intensive tasks across specialized domains, where the acquisition of precise and dependable knowledge is crucial. However, existing KG construction methods heavily rely on human…

Artificial Intelligence · Computer Science 2024-10-07 Hanzhu Chen , Xu Shen , Qitan Lv , Jie Wang , Xiaoqi Ni , Jieping Ye

Knowledge graphs (KGs) have become the standard technology for the representation of factual information in applications such as recommendation engines, search, and question-answering systems. However, the continual updating of KGs, as well…

Artificial Intelligence · Computer Science 2023-07-24 Walid S. Saba