中文
相关论文

相关论文: Pre-training Transformers for Knowledge Graph Comp…

200 篇论文

For many years, link prediction on knowledge graphs (KGs) has been a purely transductive task, not allowing for reasoning on unseen entities. Recently, increasing efforts are put into exploring semi- and fully inductive scenarios, enabling…

机器学习 · 计算机科学 2021-07-13 Mehdi Ali , Max Berrendorf , Mikhail Galkin , Veronika Thost , Tengfei Ma , Volker Tresp , Jens Lehmann

Transformers have achieved remarkable performance in widespread fields, including natural language processing, computer vision and graph mining. However, vanilla Transformer architectures have not yielded promising improvements in the…

计算与语言 · 计算机科学 2023-11-22 Zhen Bi , Siyuan Cheng , Jing Chen , Xiaozhuan Liang , Feiyu Xiong , Ningyu Zhang

Knowledge graphs (KGs) have gained prominence for their ability to learn representations for uni-relational facts. Recently, research has focused on modeling hyper-relational facts, which move beyond the restriction of uni-relational facts…

机器学习 · 计算机科学 2022-08-31 Harry Shomer , Wei Jin , Juanhui Li , Yao Ma , Jiliang Tang

Learning knowledge graph (KG) embeddings has received increasing attention in recent years. Most embedding models in literature interpret relations as linear or bilinear mapping functions to operate on entity embeddings. However, we find…

人工智能 · 计算机科学 2020-04-29 Zequn Sun , Jiacheng Huang , Wei Hu , Muchao Chen , Lingbing Guo , Yuzhong Qu

Knowledge graph embedding (KGE) models represent each entity and relation of a knowledge graph (KG) with low-dimensional embedding vectors. These methods have recently been applied to KG link prediction and question answering over…

计算与语言 · 计算机科学 2022-03-22 Apoorv Saxena , Adrian Kochsiek , Rainer Gemulla

Knowledge graph completion (KGC) revolves around populating missing triples in a knowledge graph using available information. Text-based methods, which depend on textual descriptions of triples, often encounter difficulties when these…

计算与语言 · 计算机科学 2025-04-08 Haotian Li , Bin Yu , Yuliang Wei , Kai Wang , Richard Yi Da Xu , Bailing Wang

Question Answering (QA) is a task that entails reasoning over natural language contexts, and many relevant works augment language models (LMs) with graph neural networks (GNNs) to encode the Knowledge Graph (KG) information. However, most…

计算与语言 · 计算机科学 2023-04-26 Jinyoung Park , Hyeong Kyu Choi , Juyeon Ko , Hyeonjin Park , Ji-Hoon Kim , Jisu Jeong , Kyungmin Kim , Hyunwoo J. Kim

Transformers have recently emerged as powerful neural networks for graph learning, showcasing state-of-the-art performance on several graph property prediction tasks. However, these results have been limited to small-scale graphs, where the…

机器学习 · 计算机科学 2023-12-19 Vijay Prakash Dwivedi , Yozen Liu , Anh Tuan Luu , Xavier Bresson , Neil Shah , Tong Zhao

Embedding based Knowledge Graph (KG) Completion has gained much attention over the past few years. Most of the current algorithms consider a KG as a multidirectional labeled graph and lack the ability to capture the semantics underlying the…

人工智能 · 计算机科学 2024-07-12 Mehwish Alam , Frank van Harmelen , Maribel Acosta

Knowledge graphs (KGs) are becoming essential resources for many downstream applications. However, their incompleteness may limit their potential. Thus, continuous curation is needed to mitigate this problem. One of the strategies to…

人工智能 · 计算机科学 2023-08-29 Bayu Distiawan Trisedya , Flora D Salim , Jeffrey Chan , Damiano Spina , Falk Scholer , Mark Sanderson

In the realm of computational knowledge representation, Knowledge Graph Reasoning (KG-R) stands at the forefront of facilitating sophisticated inferential capabilities across multifarious domains. The quintessence of this research…

人工智能 · 计算机科学 2024-03-12 Chen Li , Haotian Zheng , Yiping Sun , Cangqing Wang , Liqiang Yu , Che Chang , Xinyu Tian , Bo Liu

Knowledge graph completion (KGC) aims to reason over known facts and infer the missing links. Text-based methods such as KGBERT (Yao et al., 2019) learn entity representations from natural language descriptions, and have the potential for…

计算与语言 · 计算机科学 2022-03-07 Liang Wang , Wei Zhao , Zhuoyu Wei , Jingming Liu

Complex node interactions are common in knowledge graphs, and these interactions also contain rich knowledge information. However, traditional methods usually treat a triple as a training unit during the knowledge representation learning…

计算与语言 · 计算机科学 2021-10-01 Bin He , Di Zhou , Jinghui Xiao , Xin jiang , Qun Liu , Nicholas Jing Yuan , Tong Xu

Knowledge Graphs (KGs) are widely employed in artificial intelligence applications, such as question-answering and recommendation systems. However, KGs are frequently found to be incomplete. While much of the existing literature focuses on…

人工智能 · 计算机科学 2024-06-28 Sakher Khalil Alqaaidi , Krzysztof Kochut

The main objective of Knowledge Graph (KG) embeddings is to learn low-dimensional representations of entities and relations, enabling the prediction of missing facts. A significant challenge in achieving better KG embeddings lies in…

计算与语言 · 计算机科学 2024-02-06 Yihua Zhu , Hidetoshi Shimodaira

Pre-trained language representation models, such as BERT, capture a general language representation from large-scale corpora, but lack domain-specific knowledge. When reading a domain text, experts make inferences with relevant knowledge.…

计算与语言 · 计算机科学 2019-09-18 Weijie Liu , Peng Zhou , Zhe Zhao , Zhiruo Wang , Qi Ju , Haotang Deng , Ping Wang

Knowledge graph embedding (KGE) aims to learn continuous vectors of relations and entities in knowledge graph. Recently, transition-based KGE methods have achieved promising performance, where the single relation vector learns to translate…

计算与语言 · 计算机科学 2022-05-02 Xuanyu Zhang , Qing Yang , Dongliang Xu

Representation learning models for Knowledge Graphs (KG) have proven to be effective in encoding structural information and performing reasoning over KGs. In this paper, we propose a novel pre-training-then-fine-tuning framework for…

人工智能 · 计算机科学 2021-12-09 Ganqiang Ye , Wen Zhang , Zhen Bi , Chi Man Wong , Chen Hui , Huajun Chen

The incompleteness of Knowledge Graphs (KGs) is a crucial issue affecting the quality of AI-based services. In the scholarly domain, KGs describing research publications typically lack important information, hindering our ability to analyse…

Multilingual knowledge graph (KG) embeddings provide latent semantic representations of entities and structured knowledge with cross-lingual inferences, which benefit various knowledge-driven cross-lingual NLP tasks. However, precisely…

人工智能 · 计算机科学 2018-06-19 Muhao Chen , Yingtao Tian , Kai-Wei Chang , Steven Skiena , Carlo Zaniolo