English
Related papers

Related papers: Tokenization, Fusion and Decoupling: Bridging the …

200 papers

The integration of Large Language Models (LLMs) with Graph Representation Learning (GRL) marks a significant evolution in analyzing complex data structures. This collaboration harnesses the sophisticated linguistic capabilities of LLMs to…

Machine Learning · Computer Science 2024-02-12 Qiheng Mao , Zemin Liu , Chenghao Liu , Zhuo Li , Jianling Sun

The Knowledge Graph-to-Text Generation task aims to convert structured knowledge graphs into coherent and human-readable natural language text. Recent efforts in this field have focused on enhancing pre-trained language models (PLMs) by…

Computation and Language · Computer Science 2024-09-24 Shanshan Wang , Chun Zhang , Ning Zhang

Knowledge Graph Completion (KGC) aims to reason over known facts and infer missing links but achieves weak performances on those sparse Knowledge Graphs (KGs). Recent works introduce text information as auxiliary features or apply graph…

Computation and Language · Computer Science 2022-08-16 Tao He , Ming Liu , Yixin Cao , Tianwen Jiang , Zihao Zheng , Jingrun Zhang , Sendong Zhao , Bing Qin

Recently, ChatGPT, a representative large language model (LLM), has gained considerable attention due to its powerful emergent abilities. Some researchers suggest that LLMs could potentially replace structured knowledge bases like knowledge…

Computation and Language · Computer Science 2024-01-31 Linyao Yang , Hongyang Chen , Zhao Li , Xiao Ding , Xindong Wu

Recent advances in knowledge representation learning (KRL) highlight the urgent necessity to unify symbolic knowledge graphs (KGs) with language models (LMs) for richer semantic understanding. However, existing approaches typically…

Computation and Language · Computer Science 2025-06-05 Zirui Chen , Xin Wang , Zhao Li , Wenbin Guo , Dongxiao He

Multimodal Knowledge Graphs (MKGs) extend traditional knowledge graphs by incorporating visual and textual modalities, enabling richer and more expressive entity representations. However, existing MKGs often suffer from incompleteness,…

Artificial Intelligence · Computer Science 2026-01-07 Wei Huang , Peining Li , Meiyu Liang , Xu Hou , Junping Du , Yingxia Shao , Guanhua Ye , Wu Liu , Kangkang Lu , Yang Yu

Large language models (LLMs) have demonstrated immense potential across various tasks. However, research for exploring and improving the capabilities of LLMs in interpreting graph structures remains limited. To address this gap, we conduct…

Computation and Language · Computer Science 2025-02-17 Jie He , Yijun Yang , Wanqiu Long , Deyi Xiong , Victor Gutierrez-Basulto , Jeff Z. Pan

This survey investigates the synergistic relationship between Large Language Models (LLMs) and Knowledge Graphs (KGs), which is crucial for advancing AI's capabilities in understanding, reasoning, and language processing. It aims to address…

Accurate prediction of treatment outcomes in lung cancer remains challenging due to the sparsity, heterogeneity, and contextual overload of real-world electronic health data. Traditional models often fail to capture semantic information…

Schema matching (SM) and entity matching (EM) tasks are crucial for data integration. While large language models (LLMs) have shown promising results in these tasks, they suffer from hallucinations and confusion about task instructions.…

Computation and Language · Computer Science 2025-02-18 Yongqin Xu , Huan Li , Ke Chen , Lidan Shou

Symbolic knowledge graphs (KGs) play a pivotal role in knowledge-centric applications such as search, question answering and recommendation. As contemporary language models (LMs) trained on extensive textual data have gained prominence,…

Computation and Language · Computer Science 2023-08-29 Vishwas Mruthyunjaya , Pouya Pezeshkpour , Estevam Hruschka , Nikita Bhutani

Pre-trained Language Models (PLMs) have the potential to transform software development tasks. However, despite significant advances, current PLMs struggle to capture the structured and relational attributes of code, such as control flow…

Software Engineering · Computer Science 2026-05-06 Mert Tiftikci , Amir Molzam Sharifloo , Mira Mezini

Despite widespread applications of knowledge graphs (KGs) in various tasks such as question answering and intelligent conversational systems, existing KGs face two major challenges: information granularity and deficiency in timeliness.…

Artificial Intelligence · Computer Science 2024-05-01 Linyi Ding , Sizhe Zhou , Jinfeng Xiao , Jiawei Han

The remarkable success of large language models (LLMs) has motivated researchers to adapt them as universal predictors for various graph tasks. As a widely recognized paradigm, Graph-Tokenizing LLMs (GTokenLLMs) compress complex graph data…

Computation and Language · Computer Science 2026-05-06 Zhongjian Zhang , Yue Yu , Mengmei Zhang , Junping Du , Xiao Wang , Chuan Shi

Knowledge graph (KG) alignment - the task of recognizing entities referring to the same thing in different KGs - is recognized as one of the most important operations in the field of KG construction and completion. However, existing…

Computation and Language · Computer Science 2022-03-16 Vinh Van Tong , Thanh Trung Huynh , Thanh Tam Nguyen , Hongzhi Yin , Quoc Viet Hung Nguyen , Quyet Thang Huynh

Narrative data spans all disciplines and provides a coherent model of the world to the reader or viewer. Recent advancement in machine learning and Large Language Models (LLMs) have enable great strides in analyzing natural language.…

Multimodal knowledge graph completion (MMKGC) aims to predict missing links in multimodal knowledge graphs (MMKGs) by leveraging information from various modalities alongside structural data. Existing MMKGC approaches primarily extend…

Computation and Language · Computer Science 2025-09-16 Haodi Ma , Dzmitry Kasinets , Daisy Zhe Wang

Generative AI (GEN AI) models have revolutionized diverse application domains but present substantial challenges due to reliability concerns, including hallucinations, semantic drift, and inherent biases. These models typically operate as…

Artificial Intelligence · Computer Science 2025-09-05 Kishor Datta Gupta , Mohd Ariful Haque , Hasmot Ali , Marufa Kamal , Syed Bahauddin Alam , Mohammad Ashiqur Rahman

Predicting missing facts in a knowledge graph (KG) is a crucial task in knowledge base construction and reasoning, and it has been the subject of much research in recent works using KG embeddings. While existing KG embedding approaches…

Computation and Language · Computer Science 2020-10-09 Xuelu Chen , Muhao Chen , Changjun Fan , Ankith Uppunda , Yizhou Sun , Carlo Zaniolo

Recent advances in machine learning, particularly Large Language Models (LLMs) such as BERT and GPT, provide rich contextual embeddings that improve text representation. However, current document clustering approaches often ignore the…

Computation and Language · Computer Science 2024-12-20 Imed Keraghel , Mohamed Nadif