English
Related papers

Related papers: Unifying Structure and Language Semantic for Effic…

200 papers

In contrast to large text corpora, knowledge graphs (KG) provide dense and structured representations of factual information. This makes them attractive for systems that supplement or ground the knowledge found in pre-trained language…

Computation and Language · Computer Science 2023-06-06 Sondre Wold , Lilja Øvrelid , Erik Velldal

Neuroscience research publications encompass a vast wealth of knowledge. Accurately retrieving existing information and discovering new insights from this extensive literature is essential for advancing the field. However, when knowledge is…

Computation and Language · Computer Science 2025-10-28 Pralaypati Ta , Sriram Venkatesaperumal , Keerthi Ram , Mohanasankar Sivaprakasam

Link prediction in knowledge graphs requires integrating structural information and semantic context to infer missing entities. While large language models offer strong generative reasoning capabilities, their limited exploitation of…

Computation and Language · Computer Science 2025-09-09 Mengxue Yang , Chun Yang , Jiaqi Zhu , Jiafan Li , Jingqi Zhang , Yuyang Li , Ying Li

While Large Language Models (LLMs) exhibit strong linguistic capabilities, their reliance on static knowledge and opaque reasoning processes limits their performance in knowledge intensive tasks. Knowledge graphs (KGs) offer a promising…

Computation and Language · Computer Science 2025-08-15 Dehao Tao , Guangjie Liu , Weizheng , Yongfeng Huang , Minghu jiang

Recently, structure-text contrastive learning has shown promising performance on text-attributed graphs by leveraging the complementary strengths of graph neural networks and language models. However, existing methods typically rely on…

Machine Learning · Computer Science 2026-01-29 Yating Ren , Yikun Ban , Huobin Tan

Commonsense knowledge graph (CKG) is a special type of knowledge graph (KG), where entities are composed of free-form text. However, most existing CKG completion methods focus on the setting where all the entities are presented at training…

Artificial Intelligence · Computer Science 2021-02-19 Bin Wang , Guangtao Wang , Jing Huang , Jiaxuan You , Jure Leskovec , C. -C. Jay Kuo

Many mathematical models have been leveraged to design embeddings for representing Knowledge Graph (KG) entities and relations for link prediction and many downstream tasks. These mathematically-inspired models are not only highly scalable…

Artificial Intelligence · Computer Science 2023-09-25 Xiou Ge , Yun-Cheng Wang , Bin Wang , C. -C. Jay Kuo

Logical reasoning over incomplete knowledge graphs to answer complex logical queries is a challenging task. With the emergence of new entities and relations in constantly evolving KGs, inductive logical reasoning over KGs has become a…

Computation and Language · Computer Science 2023-05-24 Siyuan Wang , Zhongyu Wei , Meng Han , Zhihao Fan , Haijun Shan , Qi Zhang , Xuanjing Huang

Learning transferable representation of knowledge graphs (KGs) is challenging due to the heterogeneous, multi-relational nature of graph structures. Inspired by Transformer-based pretrained language models' success on learning transferable…

Computation and Language · Computer Science 2023-03-29 Sanxing Chen , Hao Cheng , Xiaodong Liu , Jian Jiao , Yangfeng Ji , Jianfeng Gao

Trapped by the label scarcity in molecular property prediction and drug design, graph contrastive learning (GCL) came forward. Leading contrastive learning works show two kinds of view generators, that is, random or learnable data…

Machine Learning · Computer Science 2025-01-16 Xueyuan Chen , Shangzhe Li , Ruomei Liu , Bowen Shi , Jiaheng Liu , Junran Wu , Ke Xu

Knowledge graphs have emerged as a popular method for injecting up-to-date, factual knowledge into large language models (LLMs). This is typically achieved by converting the knowledge graph into text that the LLM can process in context.…

Computation and Language · Computer Science 2025-04-10 Elan Markowitz , Krupa Galiya , Greg Ver Steeg , Aram Galstyan

Knowledge graph completion (KGC) tasks aim to infer missing facts in a knowledge graph (KG) for many knowledge-intensive applications. However, existing embedding-based KGC approaches primarily rely on factual triples, potentially leading…

Artificial Intelligence · Computer Science 2024-10-08 Guanglin Niu , Bo Li , Siling Feng

Knowledge Graph (KG) can effectively integrate valuable information from massive data, and thus has been rapidly developed and widely used in many fields. Traditional KG construction methods rely on manual annotation, which often consumes a…

Computation and Language · Computer Science 2026-04-22 Qiubai Zhu , Qingwang Wang , Haibin Yuan , Wei Chen , Tao Shen

Knowledge graph (KG) embedding has been used to benefit the diagnosis of animal diseases by analyzing electronic medical records (EMRs), such as notes and veterinary records. However, learning representations to capture entities and…

Artificial Intelligence · Computer Science 2023-09-08 Van Thuy Hoang , Sang Thanh Nguyen , Sangmyeong Lee , Jooho Lee , Luong Vuong Nguyen , O-Joun Lee

While large language models (LLMs) have made considerable advancements in understanding and generating unstructured text, their application in structured data remains underexplored. Particularly, using LLMs for complex reasoning tasks on…

Computation and Language · Computer Science 2023-10-18 Jiho Kim , Yeonsu Kwon , Yohan Jo , Edward Choi

Entity alignment (EA) refers to the task of linking entities in different knowledge graphs (KGs). Existing EA methods rely heavily on structural isomorphism. However, in real-world KGs, aligned entities usually have non-isomorphic…

Computation and Language · Computer Science 2024-11-06 Linyan Yang , Jingwei Cheng , Chuanhao Xu , Xihao Wang , Jiayi Li , Fu Zhang

Learning the embeddings of knowledge graphs (KG) is vital in artificial intelligence, and can benefit various downstream applications, such as recommendation and question answering. In recent years, many research efforts have been proposed…

Artificial Intelligence · Computer Science 2022-10-25 Zhiping Luo , Wentao Xu , Weiqing Liu , Jiang Bian , Jian Yin , Tie-Yan Liu

Large Language Models (LLMs) have shown immense potential in Knowledge Graph Completion (KGC), yet bridging the modality gap between continuous graph embeddings and discrete LLM tokens remains a critical challenge. While recent…

Artificial Intelligence · Computer Science 2026-04-24 Qizhuo Xie , Yunhui Liu , Yu Xing , Qianzi Hou , Xudong Jin , Tao Zheng , Tieke He

With the emerging branch of incorporating factual knowledge into pre-trained language models such as BERT, most existing models consider shallow, static, and separately pre-trained entity embeddings, which limits the performance gains of…

Computation and Language · Computer Science 2020-10-02 Tianxiang Sun , Yunfan Shao , Xipeng Qiu , Qipeng Guo , Yaru Hu , Xuanjing Huang , Zheng Zhang

Question Answering over Knowledge Graph (KGQA) aims to seek answer entities for the natural language question from a large-scale Knowledge Graph~(KG). To better perform reasoning on KG, recent work typically adopts a pre-trained language…

Computation and Language · Computer Science 2024-01-02 Jinhao Jiang , Kun Zhou , Wayne Xin Zhao , Yaliang Li , Ji-Rong Wen