English
Related papers

Related papers: Pre-training Transformers for Knowledge Graph Comp…

200 papers

Knowledge-enhanced language representation learning has shown promising results across various knowledge-intensive NLP tasks. However, prior methods are limited in efficient utilization of multilingual knowledge graph (KG) data for language…

Computation and Language · Computer Science 2022-10-20 Linlin Liu , Xin Li , Ruidan He , Lidong Bing , Shafiq Joty , Luo Si

Knowledge Graph (KG) completion has been excessively studied with a massive number of models proposed for the Link Prediction (LP) task. The main limitation of such models is their insensitivity to time. Indeed, the temporal aspect of…

Computation and Language · Computer Science 2021-06-09 Sebastien Montella , Lina Rojas-Barahona , Johannes Heinecke

A few models have tried to tackle the link prediction problem, also known as knowledge graph completion, by embedding knowledge graphs in comparably lower dimensions. However, the state-of-the-art results are attained at the cost of…

Machine Learning · Computer Science 2022-11-29 Peyman Baghershahi , Reshad Hosseini , Hadi Moradi

Knowledge graph (KG) foundation models aim to generalize across graphs with unseen entities and relations by learning transferable relational structure. However, most existing methods primarily emphasize relation-level universality, while…

Artificial Intelligence · Computer Science 2026-05-15 Yisen Gao , Jiaxin Bai , Haoyu Huang , Zhongwei Xie , Yufei Li , Hong Ting Tsang , Sirui Han , Yangqiu Song

Pretraining has been widely explored to augment the adaptability of graph learning models to transfer knowledge from large datasets to a downstream task, such as link prediction or classification. However, the gap between training…

Information Retrieval · Computer Science 2024-03-29 Mingdai Yang , Zhiwei Liu , Liangwei Yang , Xiaolong Liu , Chen Wang , Hao Peng , Philip S. Yu

Link prediction for knowledge graphs aims to predict missing connections between entities. Prevailing methods are limited to a transductive setting and hard to process unseen entities. The recent proposed subgraph-based models provided…

Machine Learning · Computer Science 2021-08-03 Shuangjia Zheng , Sijie Mai , Ya Sun , Haifeng Hu , Yuedong Yang

Knowledge graphs (KGs) store enormous facts as relationships between entities. Due to the long-tailed distribution of relations and the incompleteness of KGs, there is growing interest in few-shot knowledge graph completion (FKGC). Existing…

Information Retrieval · Computer Science 2024-08-06 Zicheng Zhao , Linhao Luo , Shirui Pan , Chengqi Zhang , Chen Gong

Knowledge graph completion (KGC) is the task of inferencing missing facts from any given knowledge graphs (KG). Previous KGC methods typically represent knowledge graph entities and relations as trainable continuous embeddings and fuse the…

Computation and Language · Computer Science 2023-07-13 Chen Chen , Yufei Wang , Yang Zhang , Quan Z. Sheng , Kwok-Yan Lam

Recent approaches of computer vision utilize deep learning methods as they perform quite well if training and testing domains follow the same underlying data distribution. However, it has been shown that minor variations in the images that…

Computer Vision and Pattern Recognition · Computer Science 2022-01-31 Sebastian Monka , Lavdim Halilaj , Achim Rettinger

Knowledge graph (KG) based Collaborative Filtering is an effective approach to personalizing recommendation systems for relatively static domains such as movies and books, by leveraging structured information from KG to enrich both item and…

Information Retrieval · Computer Science 2022-04-05 Weizhe Lin , Linjun Shou , Ming Gong , Pei Jian , Zhilin Wang , Bill Byrne , Daxin Jiang

Knowledge tracing (KT) which aims at predicting learner's knowledge mastery plays an important role in the computer-aided educational system. In recent years, many deep learning models have been applied to tackle the KT task, which have…

Computers and Society · Computer Science 2022-08-30 Hanshuang Tong , Zhen Wang , Yun Zhou , Shiwei Tong , Wenyuan Han , Qi Liu

Quantum machine learning is a promising direction for building more efficient and expressive models, particularly in domains where understanding complex, structured data is critical. We present the Quantum Graph Transformer (QGT), a hybrid…

Computation and Language · Computer Science 2025-06-10 Shamminuj Aktar , Andreas Bärtschi , Abdel-Hameed A. Badawy , Stephan Eidenbenz

Knowledge graphs (KGs) have become the preferred technology for representing, sharing and adding knowledge to modern AI applications. While KGs have become a mainstream technology, the RDF/SPARQL-centric toolset for operating with them at…

Knowledge representation is a major topic in AI, and many studies attempt to represent entities and relations of knowledge base in a continuous vector space. Among these attempts, translation-based methods build entity and relation vectors…

Computation and Language · Computer Science 2015-09-29 Han Xiao , Minlie Huang , Yu Hao , Xiaoyan Zhu

The representation learning on textual graph is to generate low-dimensional embeddings for the nodes based on the individual textual features and the neighbourhood information. Recent breakthroughs on pretrained language models and graph…

Computation and Language · Computer Science 2023-10-10 Junhan Yang , Zheng Liu , Shitao Xiao , Chaozhuo Li , Defu Lian , Sanjay Agrawal , Amit Singh , Guangzhong Sun , Xing Xie

Many Knowledege Graphs (KGs) are frequently updated, forcing their Knowledge Graph Embeddings (KGEs) to adapt to these changes. To address this problem, continual learning techniques for KGEs incorporate embeddings for new entities while…

Machine Learning · Computer Science 2026-05-29 Gerard Pons , Besim Bilalli , Anna Queralt

Multilingual Knowledge Graph Completion (mKGC) aim at solving queries like (h, r, ?) in different languages by reasoning a tail entity t thus improving multilingual knowledge graphs. Previous studies leverage multilingual pretrained…

Computation and Language · Computer Science 2024-06-27 Ran Song , Shizhu He , Shengxiang Gao , Li Cai , Kang Liu , Zhengtao Yu , Jun Zhao

Knowledge graph (KG) completion aims to identify additional facts that can be inferred from the existing facts in the KG. Recent developments in this field have explored this task in the inductive setting, where at test time one sees…

Machine Learning · Computer Science 2025-04-10 Sharmishtha Dutta , Alex Gittens , Mohammed J. Zaki , Charu C. Aggarwal

Neural language representation models such as BERT pre-trained on large-scale corpora can well capture rich semantic patterns from plain text, and be fine-tuned to consistently improve the performance of various NLP tasks. However, the…

Computation and Language · Computer Science 2019-06-05 Zhengyan Zhang , Xu Han , Zhiyuan Liu , Xin Jiang , Maosong Sun , Qun Liu

Knowledge tracing (KT) aims to leverage students' learning histories to estimate their mastery levels on a set of pre-defined skills, based on which the corresponding future performance can be accurately predicted. As an important way of…

Artificial Intelligence · Computer Science 2023-06-07 Fucai Ke , Weiqing Wang , Weicong Tan , Lan Du , Yuan Jin , Yujin Huang , Hongzhi Yin