English
Related papers

Related papers: KG-BERT: BERT for Knowledge Graph Completion

200 papers

Large Language Models (LLMs) have shown impressive performance in various tasks, including knowledge graph completion (KGC). However, current studies mostly apply LLMs to classification tasks, like identifying missing triplets, rather than…

Artificial Intelligence · Computer Science 2025-01-07 Zaiyi Zheng , Yushun Dong , Song Wang , Haochen Liu , Qi Wang , Jundong Li

Knowledge-enhanced language representation learning has shown promising results across various knowledge-intensive NLP tasks. However, prior methods are limited in efficient utilization of multilingual knowledge graph (KG) data for language…

Computation and Language · Computer Science 2022-10-20 Linlin Liu , Xin Li , Ruidan He , Lidong Bing , Shafiq Joty , Luo Si

Knowledge graph completion (KGC), the task of predicting missing information based on the existing relational data inside a knowledge graph (KG), has drawn significant attention in recent years. However, the predictive power of KGC methods…

Computation and Language · Computer Science 2023-05-26 Weihang Zhang , Ovidiu Serban , Jiahao Sun , Yi-ke Guo

Knowledge graphs (KGs) of real-world facts about entities and their relationships are useful resources for a variety of natural language processing tasks. However, because knowledge graphs are typically incomplete, it is useful to perform…

Computation and Language · Computer Science 2020-10-28 Dat Quoc Nguyen

Multilingual knowledge graphs (KGs) provide high-quality relational and textual information for various NLP applications, but they are often incomplete, especially in non-English languages. Previous research has shown that combining…

Computation and Language · Computer Science 2025-01-08 Zelin Zhou , Simone Conia , Daniel Lee , Min Li , Shenglei Huang , Umar Farooq Minhas , Saloni Potdar , Henry Xiao , Yunyao Li

Background : Knowledge is evolving over time, often as a result of new discoveries or changes in the adopted methods of reasoning. Also, new facts or evidence may become available, leading to new understandings of complex phenomena. This is…

Computation and Language · Computer Science 2023-04-24 Ayoub Harnoune , Maryem Rhanoui , Mounia Mikram , Siham Yousfi , Zineb Elkaimbillah , Bouchra El Asri

Translation models tend to ignore the rich semantic information in triads in the process of knowledge graph complementation. To remedy this shortcoming, this paper constructs a knowledge graph complementation method that incorporates…

Computation and Language · Computer Science 2023-02-07 Weidong Ji , Zengxiang Yin , Guohui Zhou , Yuqi Yue , Xinru Zhang , Chenghong Sun

Knowledge Graphs (KGs) often have two characteristics: heterogeneous graph structure and text-rich entity/relation information. Text-based KG embeddings can represent entities by encoding descriptions with pre-trained language models, but…

Computation and Language · Computer Science 2023-09-15 Xin Xie , Zhoubo Li , Xiaohan Wang , Zekun Xi , Ningyu Zhang

We address the problem of learning vector representations for entities and relations in Knowledge Graphs (KGs) for Knowledge Base Completion (KBC). This problem has received significant attention in the past few years and multiple methods…

Artificial Intelligence · Computer Science 2018-01-09 Srinivas Ravishankar , Chandrahas , Partha Pratim Talukdar

Contextualized entity representations learned by state-of-the-art transformer-based language models (TLMs) like BERT, GPT, T5, etc., leverage the attention mechanism to learn the data context from training data corpus. However, these models…

Computation and Language · Computer Science 2021-09-06 Keyur Faldu , Amit Sheth , Prashant Kikani , Hemang Akbari

Knowledge graph (KG) embeddings have been a mainstream approach for reasoning over incomplete KGs. However, limited by their inherently shallow and static architectures, they can hardly deal with the rising focus on complex logical queries,…

Machine Learning · Computer Science 2022-08-17 Xiao Liu , Shiyu Zhao , Kai Su , Yukuo Cen , Jiezhong Qiu , Mengdi Zhang , Wei Wu , Yuxiao Dong , Jie Tang

Existing pre-trained models for knowledge-graph-to-text (KG-to-text) generation simply fine-tune text-to-text pre-trained models such as BART or T5 on KG-to-text datasets, which largely ignore the graph structure during encoding and lack…

Computation and Language · Computer Science 2021-06-22 Pei Ke , Haozhe Ji , Yu Ran , Xin Cui , Liwei Wang , Linfeng Song , Xiaoyan Zhu , Minlie Huang

Lexical relations describe how concepts are semantically related, in the form of relation triples. The accurate prediction of lexical relations between concepts is challenging, due to the sparsity of patterns indicating the existence of…

Computation and Language · Computer Science 2020-12-04 Chengyu Wang , Minghui Qiu , Jun Huang , Xiaofeng He

Knowledge Graphs (KGs) store information in the form of (head, predicate, tail)-triples. To augment KGs with new knowledge, researchers proposed models for KG Completion (KGC) tasks such as link prediction; i.e., answering (h; p; ?) or (?;…

Artificial Intelligence · Computer Science 2022-08-24 Haris Widjaja , Kiril Gashteovski , Wiem Ben Rim , Pengfei Liu , Christopher Malon , Daniel Ruffinelli , Carolin Lawrence , Graham Neubig

Knowledge graphs (KGs) have gained prominence for their ability to learn representations for uni-relational facts. Recently, research has focused on modeling hyper-relational facts, which move beyond the restriction of uni-relational facts…

Machine Learning · Computer Science 2022-08-31 Harry Shomer , Wei Jin , Juanhui Li , Yao Ma , Jiliang Tang

Knowledge graph completion (KGC) focuses on identifying missing triples in a knowledge graph (KG) , which is crucial for many downstream applications. Given the rapid development of large language models (LLMs), some LLM-based methods are…

Computation and Language · Computer Science 2025-01-06 Rui Yang , Jiahao Zhu , Jianping Man , Hongze Liu , Li Fang , Yi Zhou

Machine Learning has been the quintessential solution for many AI problems, but learning is still heavily dependent on the specific training data. Some learning models can be incorporated with a prior knowledge in the Bayesian set up, but…

Computation and Language · Computer Science 2018-05-22 K M Annervaz , Somnath Basu Roy Chowdhury , Ambedkar Dukkipati

The task of completing knowledge triplets has broad downstream applications. Both structural and semantic information plays an important role in knowledge graph completion. Unlike previous approaches that rely on either the structures or…

Computation and Language · Computer Science 2022-09-20 Jianhao Shen , Chenguang Wang , Linyuan Gong , Dawn Song

Knowledge graphs (KGs) consisting of triples are always incomplete, so it's important to do Knowledge Graph Completion (KGC) by predicting missing triples. Multi-Source KG is a common situation in real KG applications which can be viewed as…

Computation and Language · Computer Science 2020-10-27 Mingyang Chen , Wen Zhang , Zonggang Yuan , Yantao Jia , Huajun Chen

Text-based knowledge graph completion methods take advantage of pre-trained language models (PLM) to enhance intrinsic semantic connections of raw triplets with detailed text descriptions. Typical methods in this branch map an input query…

Information Retrieval · Computer Science 2025-05-01 Duanyang Yuan , Sihang Zhou , Xiaoshu Chen , Dong Wang , Ke Liang , Xinwang Liu , Jian Huang