English
Related papers

Related papers: KG-BERT: BERT for Knowledge Graph Completion

200 papers

Pre-trained language models (LMs) like BERT have shown to store factual knowledge about the world. This knowledge can be used to augment the information present in Knowledge Bases, which tend to be incomplete. However, prior attempts at…

Computation and Language · Computer Science 2022-01-31 Keshav Kolluru , Mayank Singh Chauhan , Yatin Nandwani , Parag Singla , Mausam

Knowledge graph completion (KGC) aims to reason over known facts and infer the missing links. Text-based methods such as KGBERT (Yao et al., 2019) learn entity representations from natural language descriptions, and have the potential for…

Computation and Language · Computer Science 2022-03-07 Liang Wang , Wei Zhao , Zhuoyu Wei , Jingming Liu

Recent advances in information extraction have motivated the automatic construction of huge Knowledge Graphs (KGs) by mining from large-scale text corpus. However, noisy facts are unavoidably introduced into KGs that could be caused by…

Computation and Language · Computer Science 2020-08-18 Yaqing Wang , Fenglong Ma , Jing Gao

Both graph structures and textual information play a critical role in Knowledge Graph Completion (KGC). With the success of Pre-trained Language Models (PLMs) such as BERT, they have been applied for text encoding for KGC. However, the…

Computation and Language · Computer Science 2025-01-06 Yuxia Geng , Jiaoyan Chen , Yuhang Zeng , Zhuo Chen , Wen Zhang , Jeff Z. Pan , Yuxiang Wang , Xiaoliang Xu

With the rapid growth of research publications, there is a vast amount of scholarly knowledge that needs to be organized in digital libraries. To deal with this challenge, techniques relying on knowledge-graph structures are being…

Digital Libraries · Computer Science 2020-07-14 Ming Jiang , Jennifer D'Souza , Sören Auer , J. Stephen Downie

Knowledge graph-based dialogue systems can narrow down knowledge candidates for generating informative and diverse responses with the use of prior information, e.g., triple attributes or graph paths. However, most current knowledge graph…

Computation and Language · Computer Science 2020-04-21 Hongcai Xu , Junpeng Bao , Junqing Wang

Knowledge Graphs (KGs) play a crucial role in enhancing e-commerce system performance by providing structured information about entities and their relationships, such as complementary or substitutable relations between products or product…

Information Retrieval · Computer Science 2023-05-18 Jiao Chen , Luyi Ma , Xiaohan Li , Nikhil Thakurdesai , Jianpeng Xu , Jason H. D. Cho , Kaushiki Nag , Evren Korpeoglu , Sushant Kumar , Kannan Achan

Knowledge graphs are used to represent relational information in terms of triples. To enable learning about domains, embedding models, such as tensor factorization models, can be used to make predictions of new triples. Often there is…

Machine Learning · Computer Science 2018-12-11 Bahare Fatemi , Siamak Ravanbakhsh , David Poole

Answering complex queries over incomplete knowledge graphs (KGs) is a challenging job. Most previous works have focused on learning entity/relation embeddings and simulating first-order logic operators with various neural networks. However,…

Computation and Language · Computer Science 2025-03-04 Tianle Xia , Liang Ding , Guojia Wan , Yibing Zhan , Bo Du , Dacheng Tao

A fundamental task for knowledge graphs (KGs) is knowledge graph completion (KGC). It aims to predict unseen edges by learning representations for all the entities and relations in a KG. A common concern when learning representations on…

Machine Learning · Computer Science 2023-02-13 Harry Shomer , Wei Jin , Wentao Wang , Jiliang Tang

Knowledge Graphs (KGs) are foundational structures in many AI applications, representing entities and their interrelations through triples. However, triple-based KGs lack the contextual information of relational knowledge, like temporal…

Artificial Intelligence · Computer Science 2024-07-01 Chengjin Xu , Muzhi Li , Cehao Yang , Xuhui Jiang , Lumingyuan Tang , Yiyan Qi , Jian Guo

Knowledge graph (KG) entity typing aims at inferring possible missing entity type instances in KG, which is a very significant but still under-explored subtask of knowledge graph completion. In this paper, we propose a novel approach for KG…

Computation and Language · Computer Science 2020-07-22 Yu Zhao , Anxiang Zhang , Ruobing Xie , Kang Liu , Xiaojie Wang

Knowledge graph (KG) refinement mainly aims at KG completion and correction (i.e., error detection). However, most conventional KG embedding models only focus on KG completion with an unreasonable assumption that all facts in KG hold…

Artificial Intelligence · Computer Science 2019-07-30 Yu Zhao , Ji Liu

Pre-training a transformer-based model for the language modeling task in a large dataset and then fine-tuning it for downstream tasks has been found very useful in recent years. One major advantage of such pre-trained language models is…

Computation and Language · Computer Science 2020-11-17 Md Tahmid Rahman Laskar , Enamul Hoque , Jimmy Xiangji Huang

Knowledge Graphs (KGs) are essential for the functionality of GraphRAGs, a form of Retrieval-Augmented Generative Systems (RAGs) that excel in tasks requiring structured reasoning and semantic understanding. However, creating KGs for…

Computation and Language · Computer Science 2024-12-11 Ahan Bhatt , Nandan Vaghela , Kush Dudhia

Knowledge Graphs (KGs) have been applied to many tasks including Web search, link prediction, recommendation, natural language processing, and entity linking. However, most KGs are far from complete and are growing at a rapid pace. To…

Artificial Intelligence · Computer Science 2017-11-10 Baoxu Shi , Tim Weninger

Neural models of Knowledge Base data have typically employed compositional representations of graph objects: entity and relation embeddings are systematically combined to evaluate the truth of a candidate Knowedge Base entry. Using a model…

Computation and Language · Computer Science 2019-08-14 Matthias Lalisse , Paul Smolensky

Knowledge graph completion aims to address the gaps of knowledge bases by adding new triples that represent facts. The complexity of this task depends on how many parts of a triple are already known. Instance completion involves predicting…

Artificial Intelligence · Computer Science 2025-06-02 Amel Gader , Alsayed Algergawy

In this paper, we focus on the classification of books using short descriptive texts (cover blurbs) and additional metadata. Building upon BERT, a deep neural language model, we demonstrate how to combine text representations with metadata…

Computation and Language · Computer Science 2019-09-19 Malte Ostendorff , Peter Bourgonje , Maria Berger , Julian Moreno-Schneider , Georg Rehm , Bela Gipp

Multilingual knowledge graphs (KGs), such as YAGO and DBpedia, represent entities in different languages. The task of cross-lingual entity alignment is to match entities in a source language with their counterparts in target languages. In…

Computation and Language · Computer Science 2019-10-16 Hsiu-Wei Yang , Yanyan Zou , Peng Shi , Wei Lu , Jimmy Lin , Xu Sun