English
Related papers

Related papers: Language Models as Knowledge Embeddings

200 papers

Knowledge graph embeddings are now a widely adopted approach to knowledge representation in which entities and relationships are embedded in vector spaces. In this chapter, we introduce the reader to the concept of knowledge graph…

Artificial Intelligence · Computer Science 2020-05-01 Federico Bianchi , Gaetano Rossiello , Luca Costabello , Matteo Palmonari , Pasquale Minervini

Most Knowledge Graphs (KGs) contain textual descriptions of entities in various natural languages. These descriptions of entities provide valuable information that may not be explicitly represented in the structured part of the KG. Based on…

Computation and Language · Computer Science 2020-04-23 Genet Asefa Gesese , Mehwish Alam , Harald Sack

Knowledge graph (KG) alignment - the task of recognizing entities referring to the same thing in different KGs - is recognized as one of the most important operations in the field of KG construction and completion. However, existing…

Computation and Language · Computer Science 2022-03-16 Vinh Van Tong , Thanh Trung Huynh , Thanh Tam Nguyen , Hongzhi Yin , Quoc Viet Hung Nguyen , Quyet Thang Huynh

Large-scale knowledge bases have currently reached impressive sizes; however, these knowledge bases are still far from complete. In addition, most of the existing methods for knowledge base completion only consider the direct links between…

Computation and Language · Computer Science 2017-02-27 Xixun Lin , Yanchun Liang , Fausto Giunchiglia , Xiaoyue Feng , Renchu Guan

Embedding models for deterministic Knowledge Graphs (KG) have been extensively studied, with the purpose of capturing latent semantic relations between entities and incorporating the structured knowledge into machine learning. However,…

Artificial Intelligence · Computer Science 2019-12-24 Xuelu Chen , Muhao Chen , Weijia Shi , Yizhou Sun , Carlo Zaniolo

Learning embeddings of entities and relations existing in knowledge bases allows the discovery of hidden patterns in data. In this work, we examine the geometrical space's contribution to the task of knowledge base completion. We focus on…

Computation and Language · Computer Science 2019-08-20 Prodromos Kolyvakis , Alexandros Kalousis , Dimitris Kiritsis

Though language model text embeddings have revolutionized NLP research, their ability to capture high-level semantic information, such as relations between entities in text, is limited. In this paper, we propose a novel contrastive learning…

Computation and Language · Computer Science 2023-10-10 Christos Theodoropoulos , James Henderson , Andrei C. Coman , Marie-Francine Moens

Knowledge is captured in the form of entities and their relationships and stored in knowledge graphs. Knowledge graphs enhance the capabilities of applications in many different areas including Web search, recommendation, and natural…

Machine Learning · Computer Science 2021-03-31 Kalpa Gunaratna , Yu Wang , Hongxia Jin

Knowledge graph (KG) reasoning is becoming increasingly popular in both academia and industry. Conventional KG reasoning based on symbolic logic is deterministic, with reasoning results being explainable, while modern embedding-based…

Artificial Intelligence · Computer Science 2022-02-16 Wen Zhang , Jiaoyan Chen , Juan Li , Zezhong Xu , Jeff Z. Pan , Huajun Chen

Large language models (LLMs) have significantly advanced performance across a spectrum of natural language processing (NLP) tasks. Yet, their application to knowledge graphs (KGs), which describe facts in the form of triplets and allow…

Computation and Language · Computer Science 2024-10-11 Lingbing Guo , Zhongpu Bo , Zhuo Chen , Yichi Zhang , Jiaoyan Chen , Yarong Lan , Mengshu Sun , Zhiqiang Zhang , Yangyifei Luo , Qian Li , Qiang Zhang , Wen Zhang , Huajun Chen

Traditional methods of linking large language models (LLMs) to knowledge bases via the semantic similarity search often fall short of capturing complex relational dynamics. To address these limitations, we introduce AutoKG, a lightweight…

Computation and Language · Computer Science 2023-11-28 Bohan Chen , Andrea L. Bertozzi

Knowledge Graph Completion is a task of expanding the knowledge graph/base through estimating possible entities, or proper nouns, that can be connected using a set of predefined relations, or verb/predicates describing interconnections of…

Computation and Language · Computer Science 2021-01-25 Tong Chen , Sirou Zhu , Yiming Wen , Zhaomin Zheng

Knowledge graphs (KGs) consist of links that describe relationships between entities. Due to the difficulty of manually enumerating all relationships between entities, automatically completing them is essential for KGs. Knowledge Graph…

Computation and Language · Computer Science 2024-06-07 Yusuke Sakai , Hidetaka Kamigaito , Katsuhiko Hayashi , Taro Watanabe

Knowledge graphs (KGs), structured as multi-relational data of entities and relations, are vital for tasks like data analysis and recommendation systems. Knowledge graph completion (KGC), or link prediction, addresses incompleteness of KGs…

Machine Learning · Computer Science 2025-06-16 Huiling Zhu , Yingqi Zeng

Knowledge graphs have emerged as a popular method for injecting up-to-date, factual knowledge into large language models (LLMs). This is typically achieved by converting the knowledge graph into text that the LLM can process in context.…

Computation and Language · Computer Science 2025-04-10 Elan Markowitz , Krupa Galiya , Greg Ver Steeg , Aram Galstyan

Knowledge graph embedding, which aims to represent entities and relations as low dimensional vectors (or matrices, tensors, etc.), has been shown to be a powerful technique for predicting missing links in knowledge graphs. Existing…

Machine Learning · Computer Science 2022-04-07 Zhanqiu Zhang , Jianyu Cai , Yongdong Zhang , Jie Wang

The problem of knowledge graph (KG) reasoning has been widely explored by traditional rule-based systems and more recently by knowledge graph embedding methods. While logical rules can capture deterministic behavior in a KG they are brittle…

Artificial Intelligence · Computer Science 2020-09-24 Susheel Suresh , Jennifer Neville

Embeddings have become a pivotal means to represent complex, multi-faceted information about entities, concepts, and relationships in a condensed and useful format. Nevertheless, they often preclude direct interpretation. While downstream…

Knowledge representation learning (KRL) aims to represent entities and relations in knowledge graph in low-dimensional semantic space, which have been widely used in massive knowledge-driven tasks. In this article, we introduce the reader…

Computation and Language · Computer Science 2018-12-31 Yankai Lin , Xu Han , Ruobing Xie , Zhiyuan Liu , Maosong Sun

Knowledge Graph (KG) alignment is to discover the mappings (i.e., equivalent entities, relations, and others) between two KGs. The existing methods can be divided into the embedding-based models, and the conventional reasoning and lexical…

Computation and Language · Computer Science 2021-06-14 Zhiyuan Qi , Ziheng Zhang , Jiaoyan Chen , Xi Chen , Yuejia Xiang , Ningyu Zhang , Yefeng Zheng