English
Related papers

Related papers: Enhancing Knowledge Graph Construction: Evaluating…

200 papers

In recent years, countless research papers have addressed the topics of knowledge graph creation, extension, or completion in order to create knowledge graphs that are larger, more correct, or more diverse. This research is typically…

Artificial Intelligence · Computer Science 2023-08-22 Nicolas Heist , Sven Hertling , Heiko Paulheim

Large Language Models (LLMs) have inherent limitations of faithfulness and factuality, commonly referred to as hallucinations. Several benchmarks have been developed that provide a test bed for factuality evaluation within the context of…

Computation and Language · Computer Science 2025-10-24 Ernests Lavrinovics , Russa Biswas , Katja Hose , Johannes Bjerva

Large language models (LLMs) offer new opportunities for constructing knowledge graphs (KGs) from unstructured clinical narratives. However, existing approaches often rely on structured inputs and lack robust validation of factual accuracy…

Artificial Intelligence · Computer Science 2026-01-06 Udiptaman Das , Krishnasai B. Atmakuri , Duy Ho , Chi Lee , Yugyung Lee

Large language models (LLMs) possess extensive world knowledge, including geospatial knowledge, which has been successfully applied to various geospatial tasks such as mobility prediction and social indicator prediction. However, LLMs often…

Computation and Language · Computer Science 2025-07-29 Shengyuan Wang , Jie Feng , Tianhui Liu , Dan Pei , Yong Li

Knowledge-enhanced language models (KELMs) have emerged as promising tools to bridge the gap between large-scale language models and domain-specific knowledge. KELMs can achieve higher factual accuracy and mitigate hallucinations by…

Computation and Language · Computer Science 2024-11-26 Alexander Fichtl , Juraj Vladika , Georg Groh

Abstractive text summarization has garnered increased interest as of late, in part due to the proliferation of large language models (LLMs). One of the most pressing problems related to generation of abstractive summaries is the need to…

Computation and Language · Computer Science 2023-10-17 Grant C. Forbes , Parth Katlana , Zeydy Ortiz

Large Language Models (LLMs) increasingly mediate access to scholarly information, yet their outputs are typically evaluated at the level of individual statements rather than knowledge structure. This paper introduces structural…

Social and Information Networks · Computer Science 2026-03-03 Moses Boudourides

Graph-matching metrics such as Smatch are the de facto standard for evaluating neural semantic parsers, yet they capture surface overlap rather than logical equivalence. We reassess evaluation by pairing graph-matching with automated…

Computation and Language · Computer Science 2025-10-14 Hayate Funakura , Hyunsoo Kim , Koji Mineshima

While Large Language Models (LLMs) demonstrate exceptional performance in a multitude of Natural Language Processing (NLP) tasks, they encounter challenges in practical applications, including issues with hallucinations, inadequate…

Computation and Language · Computer Science 2024-06-13 Yihao Li , Ru Zhang , Jianyi Liu

Multimodal large language models (MLLMs) have achieved strong performance on vision-language tasks but still struggle with fine-grained visual differences, leading to hallucinations or missed semantic shifts. We attribute this to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Tianyi Bai , Yuxuan Fan , Jiantao Qiu , Fupeng Sun , Jiayi Song , Junlin Han , Zichen Liu , Conghui He , Wentao Zhang , Binhang Yuan

Although achieving great success, Large Language Models (LLMs) usually suffer from unreliable hallucinations. Although language attribution can be a potential solution, there are no suitable benchmarks and evaluation metrics to attribute…

Computation and Language · Computer Science 2024-05-24 Xinze Li , Yixin Cao , Liangming Pan , Yubo Ma , Aixin Sun

Large Vision-Language Models (LVLMs) have recently demonstrated remarkable progress, yet hallucination remains a critical barrier, particularly in chart understanding, which requires sophisticated perceptual and cognitive abilities as well…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Xingqi Wang , Yiming Cui , Xin Yao , Shijin Wang , Guoping Hu , Xiaoyu Qin

This research work delves into the manifestation of hallucination within Large Language Models (LLMs) and its consequential impacts on applications within the domain of mental health. The primary objective is to discern effective strategies…

Computation and Language · Computer Science 2024-10-16 Abdul Muqtadir , Hafiz Syed Muhammad Bilal , Ayesha Yousaf , Hafiz Farooq Ahmed , Jamil Hussain

Knowledge graphs play a vital role in numerous artificial intelligence tasks, yet they frequently face the issue of incompleteness. In this study, we explore utilizing Large Language Models (LLM) for knowledge graph completion. We consider…

Computation and Language · Computer Science 2025-02-14 Liang Yao , Jiazhen Peng , Chengsheng Mao , Yuan Luo

Graph-based Retrieval-Augmented Generation (GraphRAG) enhances Large Language Models (LLMs) by incorporating external knowledge from linearized subgraphs retrieved from knowledge graphs. However, LLMs struggle to interpret the relational…

Computation and Language · Computer Science 2025-12-11 Shanghao Li , Jinda Han , Yibo Wang , Yuanjie Zhu , Zihe Song , Langzhou He , Kenan Kamel A Alghythee , Philip S. Yu

The ability of knowledge graphs to represent complex relationships at scale has led to their adoption for various needs including knowledge representation, question-answering, and recommendation systems. Knowledge graphs are often…

Computation and Language · Computer Science 2023-05-18 Jason Youn , Ilias Tagkopoulos

Recent advances in Large Language Models (LLMs) have positioned them as a prominent solution for Natural Language Processing tasks. Notably, they can approach these problems in a zero or few-shot manner, thereby eliminating the need for…

Machine Learning · Computer Science 2025-05-07 Gerard Pons , Besim Bilalli , Anna Queralt

Emergency management urgently requires comprehensive knowledge while having a high possibility to go beyond individuals' cognitive scope. Therefore, artificial intelligence(AI) supported decision-making under that circumstance is of vital…

Computation and Language · Computer Science 2023-11-16 Minze Chen , Zhenxiang Tao , Weitong Tang , Tingxin Qin , Rui Yang , Chunli Zhu

Currently, the main approach for Large Language Models (LLMs) to tackle the hallucination issue is incorporating Knowledge Graphs(KGs).However, LLMs typically treat KGs as plain text, extracting only semantic information and limiting their…

Computation and Language · Computer Science 2025-09-29 Yifang Zhang , Pengfei Duan , Yiwen Yang , Shengwu Xiong

Large language models like GPT-4, Gemini, and Claude have transformed natural language processing (NLP) tasks such as question answering, dialogue generation, summarization, and so forth; yet their susceptibility to hallucination stands as…

Computation and Language · Computer Science 2025-07-21 Nur A Zarin Nishat , Andrea Coletta , Luigi Bellomarini , Kossi Amouzouvi , Jens Lehmann , Sahar Vahdati