English
Related papers

Related papers: Knowledge Homophily in Large Language Models

200 papers

Recent advances in machine learning, particularly Large Language Models (LLMs) such as BERT and GPT, provide rich contextual embeddings that improve text representation. However, current document clustering approaches often ignore the…

Computation and Language · Computer Science 2024-12-20 Imed Keraghel , Mohamed Nadif

The core of the Knowledge Graph Completion (KGC) task is to predict and complete the missing relations or nodes in a KG. Common KGC tasks are mostly about inferring unknown elements with one or two elements being known in a triple. In…

Computation and Language · Computer Science 2024-12-25 Yuan Yuan , Yajing Xu , Wen Zhang

Ontology, and more broadly, Knowledge Graph Matching is a challenging task in which expressiveness has not been fully addressed. Despite the increasing use of embeddings and language models for this task, approaches for generating…

Computation and Language · Computer Science 2025-02-20 Guilherme Sousa , Rinaldo Lima , Cassia Trojahn

Narrative data spans all disciplines and provides a coherent model of the world to the reader or viewer. Recent advancement in machine learning and Large Language Models (LLMs) have enable great strides in analyzing natural language.…

Large Language Models (LLMs) have exhibited impressive generation capabilities, but they suffer from hallucinations when solely relying on their internal knowledge, especially when answering questions that require less commonly known…

Computation and Language · Computer Science 2023-11-01 Wenting Zhao , Ye Liu , Tong Niu , Yao Wan , Philip S. Yu , Shafiq Joty , Yingbo Zhou , Semih Yavuz

Knowledge Graphs (KGs) play a crucial role in enhancing e-commerce system performance by providing structured information about entities and their relationships, such as complementary or substitutable relations between products or product…

Information Retrieval · Computer Science 2023-05-18 Jiao Chen , Luyi Ma , Xiaohan Li , Nikhil Thakurdesai , Jianpeng Xu , Jason H. D. Cho , Kaushiki Nag , Evren Korpeoglu , Sushant Kumar , Kannan Achan

Large language models (LLMs) typically enhance their performance through either the retrieval of semantically similar information or the improvement of their reasoning capabilities. However, a significant challenge remains in effectively…

Artificial Intelligence · Computer Science 2026-01-05 Shuqi Liu , Bowei He , Chen Ma , Linqi Song

Large Language Models (LLMs) are capable of performing zero-shot closed-book question answering tasks, based on their internal knowledge stored in parameters during pre-training. However, such internalized knowledge might be insufficient…

Computation and Language · Computer Science 2023-06-08 Jinheon Baek , Alham Fikri Aji , Amir Saffari

Knowledge graphs capture structured information and relations between a set of entities or items. As such knowledge graphs represent an attractive source of information that could help improve recommender systems. However, existing…

Machine Learning · Computer Science 2019-06-17 Hongwei Wang , Fuzheng Zhang , Mengdi Zhang , Jure Leskovec , Miao Zhao , Wenjie Li , Zhongyuan Wang

Large language models (LLMs) have brought significant changes to many aspects of our lives. However, assessing and ensuring their chronological knowledge remains challenging. Existing approaches fall short in addressing the temporal…

Computation and Language · Computer Science 2025-03-03 Yein Park , Chanwoong Yoon , Jungwoo Park , Donghyeon Lee , Minbyul Jeong , Jaewoo Kang

Large language models are successful in answering factoid questions but are also prone to hallucination. We investigate the phenomenon of LLMs possessing correct answer knowledge yet still hallucinating from the perspective of inference…

Computation and Language · Computer Science 2024-10-29 Che Jiang , Biqing Qi , Xiangyu Hong , Dayuan Fu , Yang Cheng , Fandong Meng , Mo Yu , Bowen Zhou , Jie Zhou

Previous studies have relied on existing question-answering benchmarks to evaluate the knowledge stored in large language models (LLMs). However, this approach has limitations regarding factual knowledge coverage, as it mostly focuses on…

Computation and Language · Computer Science 2023-10-31 Linhao Luo , Thuy-Trang Vu , Dinh Phung , Gholamreza Haffari

Despite their success at many natural language processing (NLP) tasks, large language models still struggle to effectively leverage knowledge for knowledge-intensive tasks, manifesting limitations such as generating incomplete, non-factual,…

Computation and Language · Computer Science 2024-10-03 Yougang Lyu , Lingyong Yan , Shuaiqiang Wang , Haibo Shi , Dawei Yin , Pengjie Ren , Zhumin Chen , Maarten de Rijke , Zhaochun Ren

Graph Neural Networks (GNNs) often struggle with heterophilic data, where connected nodes may have dissimilar labels, as they typically assume homophily and rely on local message passing. To address this, we propose creating alternative…

Machine Learning · Computer Science 2025-06-11 Victor M. Tenorio , Madeline Navarro , Samuel Rey , Santiago Segarra , Antonio G. Marques

Large language models (LLMs) have demonstrated remarkable capabilities across various domains, although their susceptibility to hallucination poses significant challenges for their deployment in critical areas such as healthcare. To address…

Computation and Language · Computer Science 2024-05-13 Mengjia Niu , Hao Li , Jie Shi , Hamed Haddadi , Fan Mo

Large Language Models (LLMs) and Knowledge Graphs (KGs) offer a promising approach to robust and explainable Question Answering (QA). While LLMs excel at natural language understanding, they suffer from knowledge gaps and hallucinations.…

Machine Learning · Computer Science 2025-04-15 Jasper Linders , Jakub M. Tomczak

Large Language Models (LLMs) have shown extraordinary capabilities in understanding and generating text that closely mirrors human communication. However, a primary limitation lies in the significant computational demands during training,…

In today's rapidly evolving landscape of Artificial Intelligence, large language models (LLMs) have emerged as a vibrant research topic. LLMs find applications in various fields and contribute significantly. Despite their powerful language…

Computation and Language · Computer Science 2024-09-10 Tuan Bui , Oanh Tran , Phuong Nguyen , Bao Ho , Long Nguyen , Thang Bui , Tho Quan

Large Language Models (LLMs) have been extensively adopted in Knowledge Graph Completion (KGC), showcasing significant research advancements. However, as black-box models driven by deep neural architectures, current LLM-based KGC methods…

Computation and Language · Computer Science 2025-10-22 Wenbin Guo , Xin Wang , Jiaoyan Chen , Zhao Li , Zirui Chen

Retrieval-Augmented Generation (RAG) has significantly mitigated the hallucinations of Large Language Models (LLMs) by grounding the generation with external knowledge. Recent extensions of RAG to graph-based retrieval offer a promising…

Machine Learning · Computer Science 2025-09-23 Jialin Chen , Houyu Zhang , Seongjun Yun , Alejandro Mottini , Rex Ying , Xiang Song , Vassilis N. Ioannidis , Zheng Li , Qingjun Cui