中文
相关论文

相关论文: KG-BERT: BERT for Knowledge Graph Completion

200 篇论文

The ability of knowledge graphs to represent complex relationships at scale has led to their adoption for various needs including knowledge representation, question-answering, and recommendation systems. Knowledge graphs are often…

计算与语言 · 计算机科学 2023-05-18 Jason Youn , Ilias Tagkopoulos

We study the problem of incorporating prior knowledge into a deep Transformer-based model,i.e.,Bidirectional Encoder Representations from Transformers (BERT), to enhance its performance on semantic textual matching tasks. By probing and…

计算与语言 · 计算机科学 2021-02-23 Tingyu Xia , Yue Wang , Yuan Tian , Yi Chang

Knowledge graphs (KGs) that modelings the world knowledge as structural triples are inevitably incomplete. Such problems still exist for multimodal knowledge graphs (MMKGs). Thus, knowledge graph completion (KGC) is of great importance to…

人工智能 · 计算机科学 2022-09-16 Yichi Zhang , Wen Zhang

Medical text learning has recently emerged as a promising area to improve healthcare due to the wide adoption of electronic health record (EHR) systems. The complexity of the medical text such as diverse length, mixed text types, and full…

计算与语言 · 计算机科学 2022-10-11 Yong He , Cheng Wang , Shun Zhang , Nan Li , Zhaorong Li , Zhenyu Zeng

BERTScore is an effective and robust automatic metric for referencebased machine translation evaluation. In this paper, we incorporate multilingual knowledge graph into BERTScore and propose a metric named KG-BERTScore, which linearly…

计算与语言 · 计算机科学 2023-01-31 Zhanglin Wu , Min Zhang , Ming Zhu , Yinglu Li , Ting Zhu , Hao Yang , Song Peng , Ying Qin

While large language models (LLMs) have made considerable advancements in understanding and generating unstructured text, their application in structured data remains underexplored. Particularly, using LLMs for complex reasoning tasks on…

计算与语言 · 计算机科学 2023-10-18 Jiho Kim , Yeonsu Kwon , Yohan Jo , Edward Choi

Complex node interactions are common in knowledge graphs, and these interactions also contain rich knowledge information. However, traditional methods usually treat a triple as a training unit during the knowledge representation learning…

计算与语言 · 计算机科学 2021-10-01 Bin He , Di Zhou , Jinghui Xiao , Xin jiang , Qun Liu , Nicholas Jing Yuan , Tong Xu

Different from traditional knowledge graphs (KGs) where facts are represented as entity-relation-entity triplets, hyper-relational KGs (HKGs) allow triplets to be associated with additional relation-entity pairs (a.k.a qualifiers) to convey…

机器学习 · 计算机科学 2021-04-19 Donghan Yu , Yiming Yang

Knowledge graph completion (KGC) is a task of inferring missing triples based on existing Knowledge Graphs (KGs). Both structural and semantic information are vital for successful KGC. However, existing methods only use either the…

计算与语言 · 计算机科学 2025-07-01 Qiao Qiao , Yuepei Li , Qing Wang , Kang Zhou , Qi Li

We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers. Unlike recent language representation models, BERT is designed to pre-train deep bidirectional…

计算与语言 · 计算机科学 2019-05-28 Jacob Devlin , Ming-Wei Chang , Kenton Lee , Kristina Toutanova

Recent work on enhancing BERT-based language representation models with knowledge graphs (KGs) and knowledge bases (KBs) has yielded promising results on multiple NLP tasks. State-of-the-art approaches typically integrate the original input…

计算与语言 · 计算机科学 2022-10-21 Wei-Lin Liao , Cheng-En Su , Wei-Yun Ma

Knowledge Graph Completion (KGC) aims at automatically predicting missing links for large-scale knowledge graphs. A vast number of state-of-the-art KGC techniques have got published at top conferences in several research fields, including…

计算与语言 · 计算机科学 2020-07-10 Zhiqing Sun , Shikhar Vashishth , Soumya Sanyal , Partha Talukdar , Yiming Yang

Knowledge Graph Completion (KGC) aims to predict the missing [relation] part of (head entity)--[relation]->(tail entity) triplet. Most existing KGC methods focus on single features (e.g., relation types) or sub-graph aggregation. However,…

计算与语言 · 计算机科学 2024-09-27 Pengjie Liu

Knowledge graph (KG) alignment and completion are usually treated as two independent tasks. While recent work has leveraged entity and relation alignments from multiple KGs, such as alignments between multilingual KGs with common entities…

计算与语言 · 计算机科学 2022-10-19 Vinh Tong , Dat Quoc Nguyen , Trung Thanh Huynh , Tam Thanh Nguyen , Quoc Viet Hung Nguyen , Mathias Niepert

Knowledge Graph Completion is a task of expanding the knowledge graph/base through estimating possible entities, or proper nouns, that can be connected using a set of predefined relations, or verb/predicates describing interconnections of…

计算与语言 · 计算机科学 2021-01-25 Tong Chen , Sirou Zhu , Yiming Wen , Zhaomin Zheng

Knowledge graph completion (KGC) is a widely used method to tackle incompleteness in knowledge graphs (KGs) by making predictions for missing links. Description-based KGC leverages pre-trained language models to learn entity and relation…

计算与语言 · 计算机科学 2024-03-05 Derong Xu , Ziheng Zhang , Zhenxi Lin , Xian Wu , Zhihong Zhu , Tong Xu , Xiangyu Zhao , Yefeng Zheng , Enhong Chen

Generating knowledge grounded responses in both goal and non-goal oriented dialogue systems is an important research challenge. Knowledge Graphs (KG) can be viewed as an abstraction of the real world, which can potentially facilitate a…

计算与语言 · 计算机科学 2021-03-31 Debanjan Chaudhuri , Md Rashad Al Hasan Rony , Jens Lehmann

Embedding based Knowledge Graph (KG) Completion has gained much attention over the past few years. Most of the current algorithms consider a KG as a multidirectional labeled graph and lack the ability to capture the semantics underlying the…

人工智能 · 计算机科学 2024-07-12 Mehwish Alam , Frank van Harmelen , Maribel Acosta

Knowledge Graph Completion (KGC) is crucial for addressing knowledge graph incompleteness and supporting downstream applications. Many models have been proposed for KGC. They can be categorized into two main classes: triple-based and…

计算与语言 · 计算机科学 2024-02-26 Yanbin Wei , Qiushi Huang , James T. Kwok , Yu Zhang

Language model pre-training has proven to be useful in learning universal language representations. As a state-of-the-art language model pre-training model, BERT (Bidirectional Encoder Representations from Transformers) has achieved amazing…

计算与语言 · 计算机科学 2020-02-06 Chi Sun , Xipeng Qiu , Yige Xu , Xuanjing Huang